About the role
Senior ETL Developer (L6)
Role: Senior ETL Developer
Location: Offshore, Bangalore, India
Level: L6
Summary
We are looking for a skilled Senior ETL Developer responsible for designing, developing, and maintaining scalable data integration and processing solutions using PySpark, Python, Hangfire, Java, and database technologies. The role focuses on delivering reliable, high-performance ETL pipelines that support operational, reporting, and analytics requirements across enterprise platforms.
Key Responsibilities
Design, develop, test, and maintain ETL pipelines and large-scale data processing workflows using PySpark and Python.
Build and optimize data ingestion, transformation, and loading solutions for structured and semi-structured datasets.
Develop batch processing and job orchestration solutions using Hangfire and enterprise scheduling frameworks.
Create and maintain complex SQL queries, stored procedures, and database objects for efficient data processing.
Implement database schema changes and release deployments using Liquibase.
Perform data quality validation, reconciliation, error handling, and performance tuning activities.
Analyze source systems and create data mappings, transformation rules, and technical specifications.
Troubleshoot ETL failures, production incidents, and performance bottlenecks.
Support data migration, modernization, and application integration initiatives.
Collaborate with architects, business analysts, developers, and DBAs to deliver scalable data solutions.
Participate in code reviews, testing, deployment, and release activities.
Ensure adherence to enterprise data governance, security, and development standards.
Skills Required
Primary Skills
PySpark
Python
ETL/Data Integration
SQL & Database Development
Hangfire
Liquibase
Secondary Skills
Java
Data Modeling
CI/CD
Git
Agile Methodologies
Data Quality & Reconciliation
Technical Expertise
Strong hands-on experience with PySpark for large-scale data transformation.
Experience building enterprise ETL solutions using Python.
Strong SQL tuning and query optimization skills.
Experience with relational databases such as Oracle, SQL Server, PostgreSQL, or MySQL.
Experience with Hangfire job scheduling, monitoring, and background processing.
Experience using Liquibase for database version control and release automation.
Understanding of distributed data processing concepts and performance optimization techniques.
Experience
5-8 years of overall experience in ETL Development, Data Engineering, or Data Integration.
Minimum 3 years of hands-on PySpark development experience.
Strong Python development experience for ETL and automation.
Experience with Hangfire-based scheduling and job management.
Minimum 2 years of Liquibase experience.
Experience in production support of enterprise ETL/data processing systems.
Exposure to Agile delivery methodologies.