Senior Data Engineer – Healthcare

Job Description

<p>Hello,</p><p> </p><p>Please take a look at the JD below and let me know if you're interested in an updated resume.</p><p> </p><p><b>Senior Data Engineer – Healthcare (Backfill Role) </b></p><p><b>Halifax, Canada(Remote 100%)</b></p><p><b>12+ Months Contract/ C2H</b></p><p> </p><p><b>Client looking: Healthcare background in recent projects with AWS Glue and Pyspark, and SQL.</b></p><p> </p><p><b>Position Summary:</b></p><p>The Data Engineer is responsible for building and maintaining data pipelines, ensuring the smooth operation of data systems, and optimizing workflows to meet business requirements. This role will support data integration and processing for various applications.</p><p> </p><p><b>Minimum Qualifications:</b></p><ul><li>9+ Years of overall IT experience with a minimum of 4 years of work experience in the below tech skills</li></ul><p><b>Tech Skills: </b></p><ul><li>Proficient in Python scripting and Spark for data processing tasks.</li><li>Strong SQL capabilities, with hands-on experience managing big data using ETL tools like Informatica.</li><li>Experience with the AWS cloud platform and its data services, including S3, Redshift, Lambda, EMR, Airflow, Postgres, SNS, and Event Bridge.</li><li>Skilled in BASH/Shell scripting.</li><li>Understanding of data Lakehouse architecture, particularly with Iceberg format, is a plus.</li><li>Understanding of healthcare data systems is a plus.</li><li>Experience in Agile methodologies.</li><li>Strong analytical and problem-solving skills.</li><li>Effective communication and teamwork abilities.</li></ul><p> </p><p><b>Responsibilities:</b></p><ul><li>Develop and maintain data pipelines and ETL processes to manage large-scale datasets.</li><li>Collaborate to design & test data architectures to align with business needs.</li><li>Implement and optimise data models for efficient querying and reporting.</li><li>Assist in the development and maintenance of data quality checks and monitoring processes.</li><li>Support the creation of data solutions that enable analytical capabilities.</li><li>Contribute to aligning data architecture with overall organisational solutions.</li></ul><p></p>