About the role
Experience Required: 5+ Years
Location: Hyderabad, India
Job Type: Full-time / Permanent
Work Mode: [Onsite / Hybrid / Remote – customize as per your policy]
Job Summary:We are seeking an experienced Data Engineer with strong programming skills in Python, proficiency in developing APIs using FastAPI, and hands-on experience with AWS Cloud services. The ideal candidate will be responsible for designing and building scalable data pipelines, APIs, and cloud-based solutions to support advanced analytics and real-time data processing needs.
Key Responsibilities:- Design and implement data ingestion, transformation, and integration pipelines using Python and AWS services.
- Develop robust and scalable REST APIs using FastAPI to enable data access and orchestration.
- Build and manage data workflows using AWS services like S3, Lambda, Glue, RDS, Redshift, Step Functions, and CloudWatch.
- Work with both structured and unstructured data to build high-performance, reliable pipelines.
- Ensure data quality, integrity, and security across all processes.
- Collaborate with data scientists, analysts, and product teams to meet project goals.
- Monitor and troubleshoot data pipelines and API performance issues.
- Python – strong experience in data engineering and API development
- FastAPI – hands-on experience building and deploying RESTful APIs
- AWS Cloud – working knowledge of S3, Lambda, Glue, IAM, RDS/Redshift, CloudWatch
- Strong understanding of SQL and relational databases
- Experience with CI/CD pipelines, version control (Git), and automated deployments
- Familiarity with containerization (Docker) and orchestration tools (ECS, EKS – preferred)
- Basic knowledge of data modeling, ETL design, and real-time data processing
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field
- Minimum 5 years of experience in data engineering roles
- Strong analytical and problem-solving skills
- Good communication and team collaboration abilities
- Experience with Apache Airflow or similar workflow management tools
- Knowledge of data security best practices in the cloud
- Exposure to Big Data frameworks (Spark, Hadoop – a plus)
- Experience with Terraform or CloudFormation for infrastructure as code