About the role
AuxoAIisseekinga skilled and experienced Data Engineer to join our dynamic team. The ideal candidate will have 6-8 years of prior experience in data engineering, with a strong background in AWS (Amazon Web Services) technologies. This role offers an exciting opportunity to work on diverse projects, collaborating with cross functional teams to design, build, andoptimizedata pipelines and infrastructure.
Responsibilities:
- Design, develop, andmaintainscalable data pipelines and ETL processesleveragingAWS services such as S3,
- Glue, EMR, Lambda, and Redshift.
- Collaborate with data scientists and analysts to understand data requirements and implement solutions thatsupport analytics and machine learning initiatives.
- Optimizedata storage and retrieval mechanisms to ensure performance, reliability, and cost-effectiveness.
- Implement data governance and security best practices to ensure compliance and data integrity.
- Troubleshoot and debug data pipeline issues, providingtimelyresolution and proactive monitoring.
- Stay abreast of emerging technologies and industry trends, recommending innovative solutions to enhance data engineering capabilities.
Requirements
- Bachelor's orMaster's degree in Computer Science, Engineering, or a related field.
- 6-8 years of prior experience in data engineering, with a focus on designing and building data pipelines.
- Proficiencyin AWS services, particularly S3, Glue, EMR, Lambda, and Redshift.
- Strong programming skills in languages such as Python, Java, or Scala.
- Experience with SQL and NoSQL databases, data warehousing concepts, and big data technologies.
- Familiarity with containerization technologies (e.g., Docker, Kubernetes) and orchestration tools (e.g., Apache Airflow) is a plus.