About the role
Job Description:
We are seeking an experienced Java Scala Developer to join our team as a Big Data Platform Engineer. The ideal candidate will be responsible for the technical delivery of our Data Platform's core functionality and strategic solutions, including the development of reusable tooling, APIs, applications, and data stores. You will work on big data analytics, relational data warehousing, and cloud-based solutions to support our evolving business requirements.Key Responsibilities:
- Develop and maintain Big Data applications using Scala, Java, Python, and Spark.
- Design and implement reusable APIs, tools, and data management solutions.
- Collaborate with stakeholders including the Hadoop Data Engineering Team, Application Team, and Unix Ops Team to ensure the stability of our Big Data platform.
- Develop Cloud-based Big Data solutions on AWS or Azure.
- Maintain Cloudera Hadoop infrastructure, including HDFS, YARN, Spark, Impala, and edge nodes.
- Work with large-scale database platforms and develop strong SQL solutions.
- Lead multiple small development teams working on the Big Data platform.
- Follow Agile methodologies and participate in the complete SDLC process.
Required Skills & Experience:
- Strong experience in Scala, Java, Python, and Spark for Big Data application development.
- Hands-on experience with Hadoop infrastructure, including HDFS, YARN, Spark, and Impala.
- Experience developing Cloud-based Big Data solutions on AWS or Azure.
- Proficiency in SQL with experience in large database platforms.
- Experience in Agile development methodologies and SDLC processes.
- Strong problem-solving, communication, and collaboration skills.
Good to Have:
- Experience with Cloud Data Platforms like Snowflake or Databricks.
- Familiarity with modern data management solutions.
- Exposure to Unix/Linux-based environments.
If you are an experienced Java Scala Developer with a passion for Big Data and Cloud Technologies, we encourage you to apply!