About the role
· Design, develop, and optimize complex Spark SQL / SQL queries, stored procedures, views, and triggers for high-performance systems.
· Lead the design and implementation of scalable database architectures to meet business needs.
· Perform advanced query optimization and troubleshooting to ensure database performance, efficiency, and reliability.
· Mentor junior developers and provide guidance on best practices for SQL development, performance tuning, and database design.
· Collaborate with cross-functional teams, including software engineers, product managers, and system architects, to understand requirements and deliver robust database solutions.
· Conduct code reviews to ensure code quality, performance standards, and compliance with database design principles.
· Develop and implement strategies for data security, backup, disaster recovery, and high availability.
· Monitor and maintain database performance, ensuring minimal downtime and optimal resource utilization.
· Contribute to long-term technical strategies for database management and integration with other systems.
· Write and maintain comprehensive documentation on database systems, queries, and architecture.
· Experience: 7+ years of hands-on experience in SQL Developer / data engineering or a related field.
· Expert-level proficiency in Spark SQL and extensive experience with Bigdata (Hive), MPP (Teradata), relational databases such as SQL Server, MySQL, or Oracle.
· Strong experience in database design, optimization, and troubleshooting.
· Deep knowledge of query optimization, indexing, and performance tuning techniques.
· Strong understanding of database architecture, scalability, and high-availability strategies.
· Experience with large-scale, high-transaction databases and data warehousing.
· Strong problem-solving skills with the ability to analyze complex data issues and provide effective solutions.
· Data testing and data reconciliation
· Ability to mentor and guide junior developers and promote best practices in SQL development.
· Proficiency in database migration, version control, and integration with applications.
· Excellent communication and collaboration skills, with the ability to interact with both technical and non-technical stakeholders.
· Experience with NoSQL databases (e.g., MongoDB, Cassandra) and cloud-based databases (e.g., AWS RDS, Azure SQL Database).
· Familiarity with data analytics, ETL processes, and data pipelines.
· Experience in automation tools, CI/CD pipelines, and agile methodologies.
· Familiarity with programming languages such as Python, Java, or C#.