Senior Data Engineer

Job summary

Designs and builds proper data pipelines required for optimal data collection and processing from a variety of data sources. Implements data governance policies and procedures for data handling to manage data consistency, integrity, accuracy, security, and reliability. Implements rigorous data validation and integrity checks to support data pipeline and model performance.

Qualifications

• Designs and builds proper data pipelines required for optimal data collection and processing from a variety of data sources.
• Collection, and Infrastructure:
• Identifies data
• and business objectives of a project or initiative in collaboration with cross-functional teams.
• Designs and builds proper data pipelines required for optimal data processing from a variety of data sources.
• Independently analyzes, designs, and troubleshoots data flows based on business needs.
• Analyzes business
• and translates that into a technical specification.
• Adjusts data collection processes that involve indexing and query optimizations, for optimal performance.
• Builds Extract, Transform, and Load (ETL) pipelines to support efficient data collection and extraction, independently.
• Analyzes data sources for profiling the data to ensure pipeline build success.
• Defines success and failure thresholds for data collection pipelines.

Responsibilities

• Data Processing & Pipelining – Data
• Planning & Execution:
• Independently manages work, monitoring timelines and deliverables to ensure projects or initiatives stay on track and meet

Degrees

Work schedule

Industry

Company size