About the role
Job Summary:
We're seeking an experienced Big Data Developer with expertise in PySpark, Python, Spark, and Hive to join our team. As a Big Data Developer, you'll design, develop, and implement big data solutions using Spark, PySpark, and Hive.
Key Responsibilities:
- Design, develop, and implement big data solutions using Spark, PySpark, and Hive
- Write efficient and scalable Spark jobs using PySpark
- Develop data pipelines and workflows using Spark, Hive, and Python
- Collaborate with cross-functional teams to identify and prioritize project requirements
- Troubleshoot and optimize big data solutions
Requirements:
- Strong experience in PySpark, Python, Spark, and Hive
- Expertise in Spark ecosystem (Spark Core, Spark SQL, Spark Streaming)
- Experience with data processing, data warehousing, and data governance
- Strong programming skills in Python and PySpark
- Experience with big data tools and technologies (e.g., Hadoop, HDFS, MapReduce)
Any Gaduation
Nice to Have:
- Experience with cloud-based big data solutions (e.g., AWS EMR, Google Cloud Dataproc)
- Knowledge of data architecture and data engineering principles
- Familiarity with DevOps tools (e.g., Jenkins, Git)