About the role
Requirements:
- 6+ years of hands-on data engineering experience in cloud-native environments (AWS required).
- 5+ years of strong proficiency in Python and PySpark for data processing, transformation, and pipeline development.
- 6+ years of experience in advanced SQL skills, complex queries, window functions, performance tuning, and query optimization across Redshift and Spark SQL; 5+ years of hands-on experience with AWS Glue, EMR, Databricks, or similar Spark-based compute services.
- 5+ years of experience with Terraform for infrastructure provisioning and management.
- 5+ years of experience with different ingestion and ETL tools like Glue, DMS, Golden Gate, HVR, Informatica, Talend, etc.
- Experience supporting multi-tenant platforms, understanding tenant isolation, shared frameworks, and config-driven patterns.
- Strong troubleshooting and debugging skills; ability to diagnose and resolve production pipeline failures quickly.
- Excellent communication skills; ability to engage with multiple tenant teams, provide technical consulting, and explain complex solutions clearly.