About the role
Primary Skills: Databricks, Databricks AI/BI Genie, SQL, Python, PySpark
Key Responsibilities:
- Develop and maintain data pipelines using Databricks, SQL, and PySpark.
- Configure and manage Databricks AI/BI Genie Spaces.
- Enable natural language-based querying and analytics using Genie.
- Prepare and optimize datasets for Genie integration.
- Validate Genie-generated SQL queries and results.
- Troubleshoot data pipeline and Genie-related issues.
- Work with business teams to understand requirements and deliver solutions.
Required Skills:
- Hands-on experience with Databricks and PySpark.
- Working knowledge of Databricks AI/BI Genie.
- Strong SQL and Python skills.
- Understanding of Delta Lake and Medallion Architecture.
- Knowledge of Unity Catalog.
- Good analytical, debugging, and problem-solving skills.
Preferred: Azure Data Factory, Azure DevOps, and basic Generative AI knowledge.