Senior Data Engineer

Mass General Brigham (Enterprise Services)
United States, Massachusetts, Somerville
399 Revolution Drive (Show on map)
Apr 07, 2025
The Opportunity The Payer Data Integration team performs data and content management for the Payer source mart within the Enterprise Data Warehouse (EDW). The primary content in the Payer source mart is information about Mass General Brigham (MGB) patients that have primary care relationship with an MGB Provider. Health plans deliver monthly updates containing changes in patient demographics, enrollment status in the health plan's products, and associated medical and pharmacy claims. The Payer Data Integration team executes a suite of ETL/ELT jobs to perform data ingestion and staging data in the EDW. The team then executes extensive QC activities to evaluate and certify incoming data before promoting updates to Production. The Population Health Service Organization (PHSO) is the primary stakeholder for the Payer source mart and provides direction and prioritization for new and revised functionality. The Payer source mart is a critical data source for other EDW databases, enterprise reporting, program development, and general analytics performed by PHSO and other business organizations across MGB. The Payer Data Integration team employs high standards and best practices to deliver timely, quality content updates to support the needs of these consumers. The Payer Data Integration team leverages an Agile development methodology and is composed of two scrum teams. PHSO Team 1 supports the development and implementation of major PHSO business initiatives. The team develops and revises new EDW data assets and works with PHSO Team 2 for product installation and support. PHSO Team 2 is responsible for the monthly operation and general maintenance of the Payer source mart and other PHSO data assets and products. The Senior Data Engineer is responsible for designing, developing, and maintaining the data architecture and infrastructure within an organization. This position plays a crucial role in managing large-scale data systems and ensuring the efficient flow, storage, and accessibility of data for various stakeholders, such as data analysts, data scientists, and business users. Essential Functions Design, develop, and implement data pipelines and ETL/ELT code to support business requirements. Work on cross-functional teams delivering enterprise solutions for internal and external clients. Assume ownership for delivering code revisions and enhancements from design through development and production installation. Maintain and optimize various components of the data pipeline architecture. < Become subject matter expert for internal and external data products Ensure design solutions can scale and meet technical standards and performance benchmarks. Identify inefficient processes and develop recommendations and design solutions. Lead code review sessions to validate technical solutions and facilitate knowledge sharing. Bachelor's Degree Related Field of Study required We can consider and review experience in lieu of a degree Experience in data engineering, with a focus on building and maintaining data infrastructure and pipelines 5-7 years required and Data warehousing development in large reporting environments 3-5 years required and Experience working with developing data pipelines using on Snowflake features ( Snowpipe, SnowSQL, Snow Sight, Data Streams ) required and Hands-on development experience with ETL/ELT tools, such as dbt, Fivetran, or Informatic required and Experience working in Agile software development environment required Knowledge, Skills and Abilities - Working knowledge of cloud computing platforms such as AWS, GCP, or Azure. - Experience with enterprise database solutions in cloud or on-premise environments Adherence to sound engineering principles and practices when designing technical solutions. M-F Eastern Business hours required Hybrid Onsite Flexible working model required for weekly onsite work at Assembly Row/ Local MGB sites* Business needs and team needs determine in office work Remote working days require stable, secure, quiet, compliant work area Mass General Brigham Incorporated is an Equal Opportunity Employer. By embracing diverse skills, perspectives and ideas, we choose to lead. All qualified applicants will receive consideration for employment without regard to race, color, religious creed, national origin, sex, age, gender identity, disability, sexual orientation, military service, genetic information, and/or other status protected under law. We will ensure that all individuals with a disability are provided a reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment.