About the role
We are looking for an experienced AWS Data Engineer to design, develop, and maintain scalable data pipelines and data solutions on AWS. The candidate should have strong hands-on experience with AWS data services, Python, SQL, ETL, and data engineering.
Key Responsibilities- Design, develop, and maintain ETL/ELT data pipelines on AWS.
- Build scalable and reliable data ingestion and transformation workflows.
- Work with structured and unstructured data from multiple sources.
- Develop data pipelines using AWS Glue, Lambda, Step Functions, and S3.
- Design and optimize data storage solutions using Amazon Redshift.
- Work with RDS, DynamoDB, Kinesis, EMR, and other AWS data services.
- Develop complex SQL queries and perform data transformation and optimization.
- Implement data quality, validation, monitoring, and error-handling processes.
- Collaborate with Data Analysts, Data Scientists, Architects, and business teams.
- Troubleshoot pipeline failures and performance issues.
- Implement security, access control, and best practices for AWS data platforms.
- Participate in code reviews, testing, deployment, and production support.
- Automate data engineering processes using Python and CI/CD tools.