About the role
Responsibilities:
- Build and Manage Data Pipelines: Develop secure and scalable data ingestion and transformation pipelines using AWS services (Glue, Lambda, Athena, Timestream, S3) and edge technologies (MQTT, AWS IoT Greengrass).
- Infrastructure as Code (IaC): Define, develop, and deploy cloud infrastructure using Terraform.
- SQL and Data Transformation: Write, optimize, and maintain complex SQL queries for data transformation and validation across AWS data services.
- Observability and Security: Implement and maintain observability tools (CloudWatch, Grafana) and ensure robust data security using best practices for IAM, encryption, and access control.
- Cross-Functional Collaboration: Partner with software, DevOps, and product teams to deliver comprehensive data solutions.
Requirements:
- Education and Experience: Bachelor's degree in Computer Science, Engineering, or a related technical field, coupled with 2+ years of hands-on software or data engineering experience in a multidisciplinary team.
- Development Lifecycle: Proven experience in prototyping, testing, and code review across full development cycles.
Technical Skills:
- Strong proficiency in SQL.
- Skilled in scripting languages like Python or JavaScript.
- Experience with Linux environments, Docker, and Git.
- Solid understanding of cloud infrastructure and Terraform.
Key Attributes:
- Self-motivated, responsible, adept at managing multiple priorities independently, with excellent communication, collaboration, and analytical skills.
- A proactive, quick learner with a strong sense of initiative and ownership.
Preferred Qualifications:
- Experience with low-latency edge-to-cloud data pipelines.
- Familiarity with React/Node.js for internal tools or dashboards.
- Hands-on experience with a broader range of AWS services and IaC tools (e. g., Terragrunt, Atlantis).
- Exposure to additional monitoring tools (e. g., Prometheus) or end-to-end testing frameworks.