About the role
Responsibilities:
- Innovate and ideate products and features that improve the platform and promote efficiency across all data pipelines in the data organization.
- Skilled at producing architectural artifacts, including system diagrams, technical documentation, and design decision records
- Engage with and understand our customers, forming relationships that allow us to understand and prioritize both innovative new offerings and incremental platform improvements.
- Manage, coach, and grow engineers to perform their best work to deliver products at the need of the hour with the highest quality.
- Collaborate with product managers, architects, and other engineers to drive the success of the data platform.
- Ensure high operational efficiency and quality of the data platform projects.
- Be an active participant and advocate of agile/scrum ceremonies to collaborate and improve processes for our team.
Requirements:
- BS/BA in Computer Engineering, Computer Science, Information Technology, or a closely related field
- 10+ years of software engineering experience leading teams and delivering projects end-to-end.
- 4+ years of management/team lead experience
- Strong algorithmic problem-solving expertise
- Proficient in data engineering technologies like Airflow, Spark, Databricks, Snowflake, and OpenSearch
- Strong people manager with key skills like conflict resolution, ruthless prioritization, effective execution, and communication
- Strong programming fundamentals in at least one primary language (e. g., Python, TypeScript, or Java) and a working understanding of distributed systems trade-offs around consistency, latency, and cost at scale.
- Track record of leading cross-team technical efforts and mentoring senior engineers.
- Bachelor's or master's degree in computer science or a related discipline or its equivalent.
Preferred Qualifications:
- Passion to explore new technology and participate in proof of concepts.
- Enjoy new and meaningful technology or business challenges that require you to think and respond quickly.
- Passionate about automation, data, technology, and creative innovation.
- Hands-on experience with several of: Airflow, Spark, Databricks, Snowflake - including tuning and operating these in production.
- Familiarity with search/graph systems (OpenSearch, Neptune) and API frameworks (GraphQL).
- Experience with data catalog platforms (Acryl DataHub, Alation), data governance, and PII handling.
- Background in knowledge graph systems and graph algorithms.