Azure Data Engineer

Azure Data Engineer

Job Description:

We're seeking a skilled and passionate Azure Data Engineer with expertise in building and maintaining large-scale data pipelines, securing data assets, and crafting insights through Power BI visualizations. You'll join a dynamic team dedicated to unlocking the power of data for transformative business decision-making.

Key Responsibilities:

• Design and implement robust Azure Data Lake Storage (ADLS) Gen2 architectures, optimizing data ingestion, processing, and storage.
• Develop and manage efficient data pipelines using Azure Data Factory, including orchestrating transformations, data movement, and error handling.
• Leverage your SQL proficiency to write optimized queries for data extraction, cleansing, and transformation within the data lake environment.
• Implement robust Azure Security and Data Governance measures to ensure data accuracy, integrity, and access control.
• Design and develop compelling Power BI reports and dashboards, translating data into actionable insights for stakeholders.
• Collaborate with data engineers, analysts, and business users to understand data requirements and deliver tailor-made solutions.
• Stay updated on the latest Azure data technologies and best practices, actively contributing to knowledge sharing within the team.

Required Skills and Experience:

• Strong experience with Azure Data Lake Storage (ADLS) Gen2 and Azure Data Factory.
• Proficiency in Python or another scripting language for data manipulation and pipeline development.
• Expertise in SQL (T-SQL or similar dialects) for data querying, manipulation, optimization, and stored procedure development.
• Solid understanding of data governance and security principles in cloud environments.
• Experience with Power BI development, creating interactive reports and dashboards.
• Excellent problem-solving, analytical, and communication skills.
• Passion for learning and adapting to new technologies.
• Effective communication and collaboration abilities.

Desired Qualifications:

• Bachelor’s degree in computer science, Information Technology, or a related field.
• Experience with cloud-based data warehousing solutions (Azure Synapse Analytics, Azure SQL Database, Azure Data Lake Analytics, Azure Analysis Services etc.).
• Familiarity with DevOps practices for data lake deployments and management.
• Knowledge of data visualization tools (Power BI, Tableau, etc.).
• Certifications in Azure data services are a plus.