NextHire Try for free

EXL

Posted 15 Nov 2026

Lead Assistant Manager

Apply with NextHire Auto Apply fills in the application for you.
Employment
Full time
Team
Software Engineering
Posted
15 Nov 2026

About the role

We are hiring a Data Engineer to build and run scalable batch data pipelines on our big data platform. You will write production-grade Python, PySpark and SQL, orchestrate workflows in Airflow, and work with data stored in Hadoop and Hive. You will partner with analysts, data scientists and product teams to deliver reliable, well-modelled data that the business can trust.


ResponsibilitiesKey Responsibilities:

  • Design, build and maintain scalable ETL/ELT pipelines using Python, PySpark and SQL.
  • Develop and schedule workflows in Apache Airflow (DAG design, dependencies, retries, SLAs, alerting).
  • Ingest, transform and store large datasets on Hadoop (HDFS) and expose them through Hive tables.
  • Design Hive schemas with sound partitioning, bucketing and file-format choices (Parquet/ORC).
  • Tune PySpark jobs and SQL queries for performance and cost (partitioning, joins, caching, skew handling).
  • Build data quality checks, validation, monitoring and reconciliation into every pipeline.
  • Troubleshoot production failures, perform root-cause analysis and support on-call or incident rotations.
  • Write clean, tested, version-controlled code and take part in code reviews.
  • Document data flows, data models and runbooks.
  • Collaborate with analysts, data scientists and business stakeholders to translate requirements into data solutions.
  • Attention To Consistency
  • Data Privacy Management
  • Data Quality
  • Data Quality Metrics
  • Database Management and Administration
  • Governance Tools
  • Internal Communications
  • Interpersonal Relationship Building
  • Leadership Capabilities
  • Working Under Pressure

Similar jobs

See every job

85% of jobs are filled through networking

The AI Outreach Agent writes to recruiters and hiring managers at the companies you pick, from your own Gmail.

Try AI Outreach