About the role
Job Description
we are hiring a driven Data Engineer with a passion for technology to help revolutionize the world of Healthcare IT. Data engineers are at the core of a data-driven business; they build and maintain the infrastructure that empowers analysts and data scientists to drive insights. We've built a team of passionate, creative, and innovative engineers and data scientists that are changing the world and having fun doing it!Your Role
. Develop and maintain data pipelines while achieving high reliability and efficiency
. Help guide data infrastructure design and develop proof of concepts for recommended solutions
. Liaison with engineering and product to help the Research team develop new data-products
. Maintain documentation for the Data Warehouse and other data products
. Design, develop, QA and maintain code related to data engineering
. Provide thought-leadership and dependable execution on diverse projects
Skills & Requirements
. Masters in Computer Science or equivalent work experience.
. Strong knowledge of SQL and relational databases
. Deep understanding and prior experience with Spark
. Deep understanding and prior experience with Spark/pySpark
. Understanding of data warehouse table design, star schemas, etc.
. Previous experience architecting and building data pipelines from 1st party and 3rd party data sources
. Strong problem-solving skills, adaptable, proactive, and willing to take ownership
. Strong commitment to quality, architecture, and documentation
. Experience using AWS cloud services (S3, Athena, EMR, Kinesis)
. Experience with data pipeline technologies a plus (Airflow, Luigi)
. Experience with Talend ETL or similar a plus
. Experience with business intelligence tools a plus (Tableau, Qlik)
. Experience with Databricks