About the role
RR created as per Aswathi Manoj s mail Proactive Pool Pipeline Planning for the Next 6 Months TTH
Primary Skills Data Engineers with Python SQL AWS Hands on technical resources
Work Description DSE ETL Advanced SQL Python AWS Services UNIXLINUX and Data Cloud
Work with business stakeholders Business Systems Analysts and Developers to ensure quality delivery of software
Interact with key business functions to confirm data quality policies and governed attributes
Assemble large complex sets of data that meet nonfunctional and functional business requirements
Identify design and implement internal process improvements including redesigning infrastructure for greater scalability optimizing data delivery and automating manual processes
Build required infrastructure for optimal extraction transformation and loading of data from various data sources using AWS and SQL technologies
Design development of Reports and dashboards
Analyzing and evaluating data sources data volume and business rules
Build analytical tools to utilize the data pipeline providing actionable insight into key business performance metrics including operational efficiency and customer acquisition
Interpret and analyses data from various source systems to support data integration and data reporting needs
Experience in testing Database Application to validate source to destination data movement and transformation
Work with team leads to prioritize business and information needs
Develop and summarize Data Quality analysis and dashboards
Knowledge of Data modeling and Data warehousing concepts with emphasis on Cloud On Prem ETL
Execute testing of data analytic and data integration on time and within budget
Troubleshoot determine best resolution for data issues and anomalies
Has deep understanding of data architecture data modeling best practices and guidelines for different data and analytic platforms
Job Requirements
Must Haves Skills
Preferred Experience in Spark SQL Python Cloud Formation
Extensive experience with Python scripting and Cloud Technologies
Extensive experience with AWS components like S3 Athena EMR Glue Redshift Kinesis and Sagemaker
Experience in Automating ETL process with Python and Automation around AWS Data Infrastructure
Extensive Experience with SQL Unix Linux scripting is a must
Extensive experience on Developing testing Cloud On Prem ETL Ab Initio AWS Glue Informatica Alteryx
Extensive Experience in Data migration is a must Teradata to Redshift preferred
Experienced in largescale application development testing Cloud On Prem Data warehouse Data Lake Data Science
Experience in building Data flow CICD pipelines in GitLab
Extensive experience in DevOps Data Ops space
Experience in Data Science platforms like Sage Maker Machine Learning Studio H2O
Strong experience of Kafka
Knowledge of Data Analytics Architecture Patterns and Toolset required to create highperformance Analytics ecosystem Big Data MPP
Nice to Have Skills
Experience using Jenkins and Gitlab
Experience using both Waterfall and Agile methodologies
Experience in testing storage tools like S3 HDFS
Experience with one or more industry standard defect or Test Case management Tools
Soft Skills
Great communication skills regularly interacts with cross functional team members
Who takes Ownership to complete the tasks on time with less supervision
Guiding developers and automation teams in case of an issue
Monitoring reviewing and managing technical operations
Effective problem solving expertise trouble shooting code debugging and root cause analysis skills
Note We are actively looking for Data Engineering Python profiles and good to have Testing experience We need more Data Engineer skills