Senior AI Data Engineer

Job summary

Overview: Summary We are seeking a highly skilled and motivated Sr. AI Data Engineer with a proven track record in building scalable data platforms and incorporating Generative AI into data engineering workflows. The ideal candidate will have deep expertise in Databricks capabilities—including Delta Lake and Unity Catalog—to power AI and machine learning initiatives.

Qualifications

• and Education:
• Required
• BA or BS degree in Computer Science, Computer Engineering, Data Science, or a related field (Master's degree is a plus).
• Open-Source Proficiency: 5+ years of strong proficiency in open-source languages and frameworks, specifically Python and PySpark, for distributed data processing.
• Strong knowledge of open-source data orchestration

Responsibilities

• You will play a pivotal role in setting up and operationalizing MLOps directly within Databricks, while seamlessly integrating a variety of open-source
• What You'll Be Doing:
• Databricks AI Solutions: Design, build, and maintain scalable data pipelines and workflows using Databricks to directly support AI/ML and analytics workloads.
• Leverage core capabilities like Delta Lake, Delta Live Tables, and Databricks Workflows to create high-performance data platforms.
• Open-Source Integration: Utilize and integrate open-source
• a candidate’s work experience, location, education/training, and key

Degrees

Industry

Company size