About the role
Job Title: Senior Data Engineer
Experience: 7–12 Years
Location: PAN India / Hybrid (Based on Project Requirement)
Job Description:We are looking for an experienced Senior Data Engineer to design, build, and optimize scalable data pipelines for enterprise data platforms. The ideal candidate should have strong expertise in Python, SQL, ETL development, API integrations, and big data technologies.
Key Skills Required:- Strong experience in Python programming.
- Hands-on experience in API Ingestion and integrating REST APIs.
- Expertise in designing and developing Data Pipelines.
- Strong knowledge of SQL with experience in MySQL and/or Oracle databases.
- Experience in ETL development and data transformation.
- Hands-on experience with PySpark for large-scale data processing.
- Good knowledge of Apache Airflow for workflow orchestration.
- Experience with Apache Kafka for real-time data streaming.
- Strong understanding of data warehousing concepts and data engineering best practices.
- Excellent problem-solving and analytical skills.
- Develop and maintain scalable ETL and data ingestion pipelines.
- Build robust API-based data integration solutions.
- Process and transform large datasets using PySpark.
- Design, schedule, and monitor workflows using Airflow.
- Implement real-time data streaming solutions using Kafka.
- Optimize SQL queries and improve database performance.
- Collaborate with cross-functional teams to deliver reliable and high-quality data solutions.