Databricks Data Engineer | Senior Data Engineer | Migration / Technical Architect

DATABRICKS DATA ENGINEERING | MIGRATION & MODERNIZATION | AI-ENABLED ENGINEERING

“Engineer the future of data and AI with Databricks, work with the best!”

About the opportunity

Hoonartek has spent more than 15 years engineering enterprise data platforms. Today, our teams work on cloud migrations, lakehouse modernization, streaming, governance and AI-ready data foundations across industries such as financial services, manufacturing, telecom and digital commerce.

As a Databricks silver partner, we work alongside Databricks teams on demanding migration and modernization programs. You will learn from experienced architects and engineers, solve real production challenges and get room to grow, whether your next step is deeper engineering, AI, leading a squad or owning architecture decisions. You will get opportunities to further your career through Databricks learning and certification pathways.

Our focus is practical: understanding the legacy estate, simplifying where possible, automating migration work, proving that the data reconciles, and leaving the new platform faster, governed and easier to run, ready for analytics and AI.

· Opportunities: Databricks Data Engineer • Senior Data Engineer • Migration / Technical Architect

· Experience: Open to different career stages with relevant experience of 2-8 years in the Databricks data ecosystem; responsibilities depend on demonstrated skills and ownership

· Location: Pune, Mumbai, Bengaluru, Delhi NCR with Flexible/Hybrid Working as applicable

· Assess legacy databases, ETL jobs, data warehouses and reporting dependencies. Help decide what to migrate, redesign or retire.

· Build Databricks pipelines and data models using Delta Lake, Unity Catalog, Lakeflow, Auto Loader, Databricks SQL and other capabilities suited to the workload.

· Improve performance & cost during migration through better Spark & SQL design, partitioning or liquid clustering, Photon, efficient compute choices & simpler processing patterns.

· Create reusable, metadata-driven components. Automate ingestion, conversion, validation, reconciliation and deployment. Use Databricks migration utilities, Lakebridge where applicable, Hoonartek accelerators and AI-assisted engineering where they make delivery faster and safer.

· Plan and execute testing: schema checks, record counts, business rules, aggregates, regression testing, parallel runs and cutover readiness.

· Design for production with logging, monitoring, restartability, security & data quality built in.

· For senior roles, guide migration squads, review designs, resolve technical blockers and work directly with customers and Databricks architects.

· Business and domain appreciation; able to describe the purpose of project & use of data, technology used, how the data was consumed by business, SDLC is a must.

· Strong SQL, PySpark and practical Databricks data engineering are central. Delta Lake, Unity Catalog, Auto Loader, Lakeflow and Databricks Workflows experience are particularly relevant. Python, data modelling, incremental loads, CDC, SCD patterns and production support are valuable.

· Migration experience in large data environments from platforms such as Oracle, SQL Server, SSIS, SSRS, PL*SQL, Informatica, Snowflake,  DataStage, SAS, Teradata, Snowflake, BigQuery or legacy Hadoop/Spark platforms is useful.

· Hands-on experience and knowledge of Unity Catalog, Lakeflow Connect, Declarative Pipelines, Databricks Workflows, Databricks SQL Warehouses, CI/CD & Workspace setups is a must.

· Structured Streaming, serverless compute, Databricks Asset Bundles,  Kafka, system tables, AI/BI Dashboards, Genie, MLflow or Mosaic AI is an advantage. Not every candidate needs every capability.

· Optimize migrated workloads for performance and cost by tuning Spark and SQL, data models, file layout, clustering, orchestration, compute sizing & resource usage after go-live.

· Practical skills and knowledge of parallel runs, data and pipeline testing, migration, CI/CD, data governance, observability, FinOps and DevOps will be preferred.

· AI is becoming part of migration delivery. Familiarity with Databricks AI/BI, Genie, Mosaic AI or other LLM-based engineering tools for code understanding and conversion, mapping, documentation, test generation, validation and migration automation is valuable. We expect these tools to be used with engineering judgment and verification.

· Relevant industry and Databricks certifications, backed by validated project experience, is greatly preferred.

· You can deepen your engineering skills, take ownership of a migration workstream, lead a squad or grow into technical architecture. The path depends on the problems you can solve and the ownership you are ready to take, not just years of experience.

· Curiosity to understand before building. Judgment to modernize rather than copy old designs. A habit of automating repeatable work. Careful testing and ownership of production outcomes. Clear communication, willingness to learn and the confidence to ask good questions. As you grow, we expect you to help others grow too.

Benefits

· Medical Insurance, Learning & Certification Support, Referral Bonus, Flexible/Hybrid Working where applicable, Employee Recognition Programs, PF, Gratuity, Paid Leaves, and Career Growth Opportunities.

Check our databricks pageat