About the role
Job description
Technical/Functional Skills •PySpark: In-depth knowledge of PySpark, Apache Spark, and Python. •Data Processing: Strong understanding of data processing concepts, including data ingestion, data transformation, and data storage. •Cloud Experience: Experience with cloud-based data platforms, including AWS, Azure, or Google Cloud. •Expertise in DataFrames & Spark SQL, Spark Streaming with Apache Kafka real-time data ingestion pipelines •Very good conceptual understanding of Multithreading, distributed computing concepts of Pyspark •Programming: Proficiency in programming languages, including Python, Java, or Scala. •Communication: Excellent communication and collaboration skills. Preferred Skills: •Apache Spark Certifications: Relevant certifications, such as Apache Spark Certification or Cloudera Certified Spark Developer. •Big Data: Experience with big data technologies, including Hadoop, HBase, or Cassandra. •Machine Learning: Experience with machine learning frameworks, including TensorFlow, PyTorch, or Scikit-learn. •Data Science: Experience with data science tools, including Jupyter Notebook, Pandas, or NumPy Qualifications: BACHELOR OF TECHNOLOGY