About the role
Location: Remote
We are hiring a Senior Data Engineer for one of our leading software development clients. The Senior Data Engineer will play a key role in building and extending data pipeline architecture, optimizing data flow, and supporting cross-functional teams. The ideal candidate has extensive experience in handling big data and enjoys creating data systems from the ground up.
Key Responsibilities:
- Design and develop key components of our data pipeline for extracting, transforming, and loading data from various sources using modern Big Data technologies.
- Implement internal process improvements by automating manual tasks, optimizing data delivery, and enhancing scalability.
- Collaborate with executives, product teams, and design teams to address data-related technical issues and ensure their infrastructure needs are met.
- Work closely with machine learning, data, and analytics teams to innovate and improve functionality in our data systems.
Qualifications:
- Bachelor’s degree in Engineering, Computer Science, or related field.
- 11+ years of experience as a Data Engineer.
- 5+ years of hands-on experience with Apache Spark and a deep understanding of Big Data fundamentals.
- Strong coding skills in Scala, Python, Java, or other languages, with the ability to switch between them as needed.
- Proficiency in SQL and experience with relational databases like Postgres or MySQL.
- Experience with cloud technologies, specifically DataBricks.
- Familiarity with various data formats including Delta Tables, Parquet, CSV, and JSON.
- Comfortable working in a Linux shell environment and writing scripts when needed.
- Experience working in Agile development environments.
- Knowledge of Machine Learning is a plus.
- Ability to work independently and deliver stable, reliable, and efficient software.
- Strong written and verbal communication skills in English.
- Proven ability to collaborate with cross-functional teams in a dynamic work environment.
If you are excited about the opportunity to help redesign data architecture and build scalable data solutions, apply today!