SQL With Python

Primary Skills / Must have:

1. Should possess strong SQL skills
2. Experience in creating large scale data processing pipelines using a Python and Spark based framework.
3. Work with different aspects of the Spark ecosystem, including Spark SQL, DataFrames, Datasets, and Streaming
4. Should have strong programming skills in Python.

1. Solid Understanding of data engineering concepts and best practices.
2. Excellent problem solving and analytical skills.
3. Excellent verbal and written communication skills.
4. Experience in optimizing large data loads.

Secondary Skills / Desired skills

1. Exposure to an Agile Development environment would be a plus.
2. Strong understanding of Data warehousing domain.
3. ETL skill is optional
4. Good understanding of dimensional modelling.