Principal Data Engineer

Job summary

Provides expertise on the design and participates in building of data infrastructure to optimize data processing from a variety of data sources. Independently designs and implements data governance policies and procedures for data handling to manage data consistency, integrity, accuracy, and reliability.

Qualifications

• Leverages advanced knowledge of Extract, Transform, and Load (ETL) processes to design, develop, and optimize automated, scalable, and efficient data pipeline architectures to build reusable data products.
• Collection, and Infrastructure:
• Mentors less experienced team members to identify data
• and business objectives of a project or initiative.
• Provides expertise on the design and participates in building of data infrastructure to optimize data processing from a variety of data sources.
• Independently analyzes, designs, and troubleshoots data flows based on business needs.
• Participates and designs architecture, performance, and security reviews of the technical solution.
• Adjusts data collection processes that involve indexing and query optimizations for optimal performance.
• Builds Extract, Transform, and Load (ETL) pipelines to support efficient and scalable data collection and extraction.
• Engages with and holds the upstream and downstream teams accountable for the predefined service level agreements (SLAs).
• Manages relationships with the data providers.
• Data Processing & Pipelining – Data Governance:

Responsibilities

• Data Processing & Pipelining – Data
• Planning & Execution:
• Manages and coordinates moderately complex tasks, monitoring timelines and deliverables to ensure timely completion and adherence to

Work schedule

Industry

Company size