About the role
- Independently design, develop, and execute end-to-end data migration workflows.
- Build scalable and reusable ETL pipelines using Python and SQL.
- Handle data extraction and migration across databases, CSV, Excel, JSON, and REST APIs.
- Develop complex data mapping, cleansing, transformation, and loading logic.
- Implement incremental migrations, delta updates, and bulk data processing.
- Optimize migration scripts for performance and reliability.
- Identify and resolve complex data migration issues.
- Develop robust, modular, and maintainable Python applications.
- Build reusable components for data extraction, transformation, validation, and loading.
- Work extensively with Pandas and other Python data-processing libraries.
- Implement exception handling, logging, retry mechanisms, and error recovery.
- Optimize scripts for handling large datasets.
- Perform code reviews and guide junior engineers on development best practices.
- Design and implement REST API-based migration and integration workflows.
- Handle API authentication, pagination, rate limiting, and bulk operations.
- Troubleshoot API failures, data inconsistencies, and integration challenges.
- Develop complex SQL queries for transformation, reconciliation, and validation.
- Work with relational databases such as PostgreSQL, MySQL, or MS SQL Server.
- Contribute to the architecture, development, and enhancement of an AI-powered Data Migration Platform.
- Explore and implement AI-assisted data mapping, field matching, and transformation recommendations.
- Develop automation components to reduce manual migration efforts.
- Evaluate LLM-based approaches for intelligent data processing and validation.
- Integrate AI capabilities into existing Python-based migration workflows.
- Work with the team to improve platform scalability, reusability, and maintainability.
- Continuously learn and adopt emerging AI technologies and development practices.
- Design and implement automated data validation and reconciliation frameworks.
- Ensure accuracy, completeness, consistency, and integrity of migrated data.
- Develop reusable validation scripts and exception reports.
- Investigate and resolve source-to-target data mismatches.
- Establish quality checkpoints for migration execution.
- Take technical ownership of assigned customer migration projects.
- Analyze source and target systems and identify migration dependencies and risks.
- Participate in technical discussions, solution design, and estimation.
- Collaborate with Technical Leads, Project Managers, and implementation teams.
- Identify technical blockers early and communicate risks proactively.
- Prepare technical documentation, mapping specifications, and migration execution reports.
- Mentor junior engineers and support their technical development.
- Python: Strong programming skills, modular development, scripting, automation, and exception handling.
- SQL: Advanced SQL queries, joins, subqueries, aggregations, data transformations, and performance optimization.
- ETL & Data Migration: Hands-on experience designing and executing end-to-end migration workflows.
- Pandas: Strong experience in data manipulation, transformation, and processing.
- REST APIs: API integrations, authentication, pagination, rate limiting, and error handling.
- Databases: PostgreSQL, MySQL, MS SQL Server, or equivalent relational databases.
- Data Processing: CSV, Excel, JSON, XML, and structured/semi-structured datasets.
- Data Validation: Reconciliation, data-quality checks, exception reporting, and troubleshooting.
- Git: Version control and collaborative development.
- Debugging & Optimization: Strong troubleshooting and performance-improvement capabilities.
- Experience in SaaS-to-SaaS or enterprise application data migration.
- Experience developing reusable ETL or migration frameworks.
- Knowledge of Docker, cloud platforms, and deployment practices.
- Familiarity with AI, LLMs, prompt engineering, and AI-assisted automation.
- Exposure to AI frameworks such as LangChain or LlamaIndex.
- Experience with fuzzy matching, intelligent data mapping, or schema matching.
- Understanding of data pipelines, scheduling, and workflow orchestration.
- Experience working with high-volume datasets and complex data structures.
- Strong technical ownership and independent problem-solving capabilities.
- Ability to understand migration requirements and translate them into technical solutions.
- Experience independently handling complex migration tasks.
- Strong debugging, analytical, and troubleshooting skills.
- Ability to review code and mentor junior developers.
- Good communication and collaboration skills.
- Willingness to learn, experiment with, and contribute to AI-driven migration technologies.
- Ability to proactively identify project risks and technical dependencies.
- Commitment to code quality, documentation, and timely delivery.
- Willingness to work from the Chennai office during the 2:00 PM – 11:00 PM IST shift.