About the role
Responsibilities:
- Design, develop, and maintain scalable data pipelines and data processing solutions.
- Write clean, efficient, and production-ready Python code.
- Apply strong Data Structures & Algorithms (DSA) and problem-solving skills to solve complex technical challenges.
- Work extensively with GCP services to build and manage cloud-based data solutions.
- Collaborate with data scientists, software engineers, and other stakeholders.
- Optimize data pipelines for performance, reliability, and scalability.
- Troubleshoot technical issues and contribute to continuous improvement of data engineering processes.
Requirements:
- 2-8 years of experience in Data Engineering or a related role.
- Strong proficiency in Python.
- Strong understanding of DSA and problem-solving.
- Mandatory: Hands-on experience with GCP.
- Good understanding of data engineering concepts, ETL/ELT pipelines, and data processing.
- Strong analytical and communication skills.
- Experience with GCP data services such as BigQuery, Dataflow, Pub/Sub, Cloud Storage, or Composer.
- Experience with SQL and databases.
- Familiarity with distributed data processing frameworks and cloud-based architectures.