Data Engineer

About Manulife

Manulife is embarking on replacing and building new data capabilities to help fuel our bold ambition to become a digital customer leader!

Job Summary

We are seeking a skilled and motivated data engineer to join our diverse team and play a key role in implementing, optimizing, and maintaining assets that deliver these capabilities!

Key Responsibilities

• Data Pipeline Development: Design, develop, and manage data pipelines that facilitate the detailed extraction, transformation, and loading of data from diverse sources.
• Data Mapping & Integration: Collaborate closely with multi-functional teams to understand and design schemas for data from various source systems and other transactional or application databases, ensuring accuracy and reliability.
• ETL Optimization: Continuously improve and optimize ETL processes to enhance data flow efficiency, minimize latency, and support real-time and batch processing requirements.
• Data Transformation: Implement data cleansing, enrichment, and transformation processes to ensure high-quality data is available for analysis and reporting.
• Data Quality Assurance: Design testing plans, develop and implement data quality checks, validation rules, and supervising mechanisms to maintain data accuracy and integrity.
• Platform Improvement: Collaborate with various technical resources from across the organization to identify and implement improvements to the infrastructure, integrations, and functionalities.
• Data Architecture: Work closely with business leads and data architects to design, implement, and manage end-to-end architecture based on business requirements.
• User Documentation: Develop and maintain detailed documentation for data pipelines, processes, and configurations to support seamless onboarding.
• Teamwork: Partner with other data engineers, data analysts, business collaborators, and data scientists to understand data requirements and translate them into effective data engineering solutions.
• Performance Monitoring: Monitor data pipeline performance and solve issues to ensure efficient data flow and proactively find opportunities for improvement.
• Data Governance and Compliance: Ensure consistency with data privacy and compliance standards throughout the data lifecycle.

Required Qualifications

• Bachelor’s Degree in Computer Science, Information Technology, or a related field. Master’s degree is a plus.
• 5+ years of experience as a Data Engineer, with a track record of efficiently implementing and maintaining data pipelines, scheduling, monitoring, notification, and ETL processes using Azure Data Factory, Databricks, Python/Pyspark, Java, Scala.
• Understanding of Azure infrastructure; subscriptions, resource groups, resources, access control with RBAC (role-based access control), integrations with Azure AD and Azure security principles.