About the role
Must-Haves:
- 3+ years of experience in Data Engineering
- Strong expertise in ETL pipelines to manage and process data effectively
- Hands-on experience with AWS resources (EC2, Athena, Lambda, Step Functions) – this is
CRITICAL for the role
- Proficiency in MySQL to manage and query databases
- Experience with Docker for containerization
Good-to-Haves:
- Experience with Airflow for orchestration of workflows
- Familiarity with PySpark for big data processing
- Strong Python skills, including libraries like:
- SQLAlchemy, DuckDB, PyArrow, Pandas, and Numpy
- Experience with DLT (Data Load Tool) is optional but nice to have