About the role
Responsibilities:
- Enhance System Availability and Scalability: Spearhead efforts to optimise Hadoop-related projects, ensuring the system is highly available and scalable to meet growing data demands. Your work will be pivotal in maintaining uninterrupted service and accommodating future growth, supporting strategic objectives.
- Drive High-Impact Projects: Lead initiatives that directly contribute to the ability to efficiently process and analyse vast amounts of data. Your enhancements will bolster system performance and reliability, which is vital for sustaining a competitive edge.
- Develop Innovative Solutions: Create and refine customer-facing tools that improve user experience and operational efficiency. Your contributions will streamline data access and management, making it easier for stakeholders to leverage insights.
- Enhance Integration: Ensure seamless integration of Hadoop systems with other platforms, fostering a cohesive data ecosystem. Your work will enable cross-functional teams to reduce the manual work and utilise data insights effectively, driving informed decision-making across the organisation.
Requirements:
- Validated successful track record of 5+ years of software engineering design and development experience with a solid background in open-source technology.
- Strong programming skills in languages commonly used with Hadoop, such as Java and Scala.
- Knowledge of common algorithms and data structures to write efficient and optimised code.
- Familiarity with Linux/Unix systems, including shell scripting and system commands.
- Understanding of networking principles, as Hadoop often operates in distributed environments.
- Overall, the candidate is expected to have analytical skills to tackle complex distributed system challenges and optimise solutions.
- Experience with big data technologies and frameworks such as Hadoop, Spark, Iceberg, YuniKorn, etc.contribution to related open-source projects is a plus.
- Excellent problem-solving and analytical skills in both defect and performance issue resolution.
- Proven result-oriented individual with a delivery focus in a high-velocity, high-quality environment.