About the role
Requirements:
- 9+ years of Engineering experience, primarily in Data Engineering in an agile production environment.
- High proficiency in using Python or Scala, Spark, Hadoop platforms and tools (Hive, Impala, Oozie, Airflow, NiFi, Scoop), and SQL to build Big Data products and platforms.
- Extensive experience with Databricks, Spark, PySpark or Java + Spark processing engine.
- Proficiency in at least one modern programming language such as Python, Java or Scala.
- Strong Computer Science fundamentals in object-oriented design, data structures, algorithm design, problem solving, and complexity analysis.
- Ability to easily move between business, data management, and technical teams; ability to quickly intuit the business use case and identify technical solutions to enable it.
- Working knowledge of software development engineering Paradigms along with Data Engineering.
- Relational Databases as well as NoSQL experience,
- Cloud technologies like Databricks/AWS/Azure ( Good to have).
- Basic Shell scripting and knowledge of Linux/Unix systems.
- Experience in designing & developing software at scale.
- Strong written and verbal English communication skills.
- Motivation, creativity, self-direction, and desire to thrive on small project teams.
- Superior academic record with a degree in Computer Science or related technical field.