About the role
Must have skills: Python and Pyspark, Experience on Pyspark and we are looking for resources with extensive Pyspark experience
3-5 years of experience with the technical analysis and design, development and implementation of data warehousing / Data Lake solutions;
Well versed and Hand-on in Azure pipelines, Snowflake, Azure Databricks, Hive, Pyspark and Unix
Additional Skills
Good understanding/experience in Hive/Impala/Spark;
Strong SQL programming and stored procedure development skills
Strong UNIX Shell scripting experience to support data warehousing solutions;
Process oriented, focused on standardization, streamlining, and implementation of best practices delivery approach;
Excellent problem solving and analytical skills;
Excellent verbal and written communication skills;
Experience in optimizing large data loads;