About the role
Employment Type: Full-Time
Working Hours: Aligned with APAC business hours
Joining Preference: Immediate Joiners
Role Overview:
We are looking for an experienced Senior Data Engineer to lead the design, development and optimization of enterprise data solutions. The ideal candidate will bring strong expertise in SQL, Python, data architecture, ETL/ELT development and cloud data platforms.
The role requires the ability to independently drive technical workstreams, design scalable data pipelines, solve complex engineering challenges and translate business requirements into robust technical solutions. The candidate will work closely with client stakeholders and distributed engineering teams across APAC.
Key Responsibilities:
- Design and implement scalable data architectures, ETL/ELT pipelines and data integration frameworks.
- Build and optimize end-to-end data ingestion and transformation workflows across multiple enterprise systems.
- Develop robust data models, warehouse structures and analytical datasets.
- Drive data platform modernization, migration and integration initiatives.
- Develop complex SQL queries, stored procedures and data transformations, with a strong focus on query optimization and performance tuning.
- Build data processing and automation solutions using Python and relevant engineering frameworks.
- Optimize data storage, processing, partitioning and execution strategies for large-scale datasets.
- Implement efficient and reusable engineering components.
- Design and implement cloud-based data solutions across Azure, AWS or GCP.
- Work with modern data platforms and technologies such as Azure Data Factory, Databricks, Synapse, Snowflake and BigQuery.
- Drive the development of reliable data workflows, ensuring scalability, performance and cost efficiency.
- Own end-to-end technical deliverables, from requirement analysis and solution design to implementation and production deployment.
- Collaborate with client stakeholders, architects, business teams and engineering teams to translate requirements into technical solutions.
- Lead technical discussions, architecture reviews and provide recommendations on engineering best practices.
- Mentor junior engineers and contribute to technical standards, documentation and delivery quality.
- Establish data quality, validation, reconciliation and monitoring mechanisms.
- Oversee production pipeline performance, troubleshoot complex failures and drive root-cause resolution.
- Implement appropriate error handling, logging and recovery mechanisms to ensure operational reliability.
Required Skills & Qualifications:
- 5-10 years of professional experience in Data Engineering or Data Platform Development.
- Advanced proficiency in SQL, including complex queries, CTEs, window functions, stored procedures and query optimization.
- Strong hands-on experience designing and developing production-grade ETL/ELT pipelines.
- Proficiency in Python for data processing, transformation and automation.
- Strong understanding of data warehousing, data modelling, data architecture and database design.
- Hands-on experience with at least one major cloud platform: Microsoft Azure, AWS or GCP.
- Experience working with relational databases such as PostgreSQL, SQL Server, MySQL or equivalent.
- Good understanding of distributed data processing, data integration and pipeline orchestration.
- Strong problem-solving skills and experience handling complex data engineering challenges.
- Ability to independently manage technical deliverables and communicate effectively with client stakeholders.
Preferred Skills:
- Azure: Azure Data Factory, Azure Databricks, Synapse Analytics, Data Lake and Blob Storage.
- AWS: S3, Glue, Redshift and Lambda.
- GCP: BigQuery, Cloud Storage and Dataflow.
- Data Processing: Apache Spark, PySpark and distributed computing.
- Data Architecture: Data Lake, Lakehouse and Medallion Architecture.
- Data Integration: REST APIs, JSON and third-party system integrations.
- Analytics: Power BI, Tableau or similar BI platforms.
- Experience working in Agile and enterprise consulting environments.
Additional Requirements:
- Comfortable working with international clients and distributed teams across APAC.
- Willingness to align working hours with APAC business requirements.
- Willingness to work from the client's office in Pune.
- Strong ownership, accountability and ability to operate independently in a client-facing environment.
- Immediate joiners or candidates with a short notice period preferred.