About the role
Job Summary
We are seeking a skilled Data Engineer with experience in both Data Engineering Development and Production Support. The candidate will be responsible for designing, developing, enhancing, monitoring, and supporting enterprise data pipelines, ETL/ELT processes, cloud-based data platforms, and integration frameworks. The role requires expertise in Databricks, AWS, Oracle technologies, data ingestion frameworks, and support operations to ensure reliable and scalable data solutions across the organization.
Key Responsibilities
Data Engineering Development
- Design, develop, and maintain scalable ETL/ELT data pipelines.
- Build and optimize data ingestion frameworks for batch and near-real-time processing.
- Develop and enhance solutions using Snowflake, Databricks, AWS Glue, and Oracle technologies.
- Design data models, schemas, and database objects to support business requirements.
- Develop complex SQL queries, stored procedures, and PL/SQL packages.
- Implement file-based, API-based, and database integration solutions.
- Optimize data processing jobs for performance, scalability, and cost efficiency.
- Participate in code reviews, testing, and quality assurance activities.
- Support CI/CD implementation and automated deployment processes.
- Collaborate with business and technical stakeholders to deliver data solutions.
Production Support & Operations
- Monitor and support critical data pipelines and production workloads.
- Investigate, troubleshoot, and resolve production incidents within SLA timelines.
- Perform root cause analysis (RCA) and implement preventive measures.
- Support release deployments, production validations, and environment migrations.
- Manage incident, problem, and change requests using ServiceNow.
- Ensure successful execution of scheduled jobs and data workflows.
- Respond to monitoring alerts and perform proactive issue resolution.
- Support data reconciliation, validation, and quality assurance activities.
- Create and maintain operational runbooks, SOPs, and support documentation.
- Engineering & Support Practices
- Incident, problem, and change management
- ServiceNow ticket handling and queue management
- SLA-driven support delivery
- Production monitoring and alert management
- Release and deployment coordination
- Environment migration support
- Code review and testing best practices
- DevOps and CI/CD pipeline integration
- Documentation and knowledge management
- Required Qualifications
- Bachelor's degree in Computer Science, Information Technology, Engineering, or related field.
- 2+ years of experience in Data Engineering, ETL Development, or Data Platform Support.
- Strong SQL and database concepts.
- Hands-on experience in Databricks, AWS Services, Oracle, and ODI.
- Experience in production support, incident management, and troubleshooting.
- Strong analytical and problem-solving skills.
- Excellent communication and stakeholder management abilities.