About the role
Key Responsibilities:
- Extract and process data from multiple databases, APIs, and cloud platforms by establishing strong source connections.
- Design, develop, and maintain ETL pipelines for efficient data transformation and ingestion.
- Write and optimize complex SQL queries for data extraction, validation, and reporting.
- Utilize PySpark and Big Data technologies (Hadoop, Spark, Databricks, etc.) to process and analyze large datasets.
- Perform data analysis using Python (Pandas, NumPy, etc.) to uncover trends, patterns, and insights.
- Develop and maintain interactive dashboards and reports in Power BI (good to have).
- Work with cross-functional teams to understand business requirements and translate them into data-driven solutions.
- Experience in data warehouse schema creation and optimization.
- Ensure data accuracy, security, and compliance with company policies.
- Present analytical findings and recommendations to stakeholders in a clear and actionable manner.
- Must have senior-level experience.
- Proven team-handling/leadership experience.
- Strong portfolio of diverse certifications and projects.
- Mandatory: Hands-on experience or certification in Microsoft Fabric or Databricks.
Required Skills & Qualifications:
- 4-6 years of experience in data analytics, data engineering, or business intelligence.
- Strong expertise in SQL (writing, optimizing, and managing complex queries).
- Hands-on experience in ETL processes and building/maintaining data pipelines.
- Experience working with Big Data technologies (Hadoop, Spark, PySpark, Databricks, etc.).
- Proficiency in Python for data analysis (Pandas, NumPy, etc.).
- Experience of working on Fabric.
- Experience of working on Databricks.
- Experience in connecting to and processing data from multiple data sources (databases, APIs, cloud platforms).
- Strong analytical and problem-solving skills.