Databricks Data Engineer

Job summary

Job Description: EXL*** is seeking an accomplished Senior Databricks Data Engineer with 10–12 years of experience designing, developing, and optimizing enterprise data platforms and large-scale ETL solutions. The ideal candidate brings deep expertise in Databricks, Spark, Delta Lake, Azure Data Platform, and modern data engineering practices.

Benefits

Qualifications

• Job Description: EXL*** is seeking an accomplished Senior Databricks Data Engineer with 10–12 years of experience designing, developing, and optimizing enterprise data platforms and large-scale ETL solutions.
• the lower end applies to those with less experience or fewer preferred
• For positions based in higher-cost zones (e.g., California, New York, New Jersey), actual compensation may exceed the posted range; your recruiter will share specifics during the process.
• For more information on
• Required

Responsibilities

• of the position.
• The top of the range is reserved for candidates who notably exceed the
• Data Engineering & Platform Development
• Design, develop, and optimize enterprise-scale data pipelines using Databricks, Spark, Delta Lake, and Azure Data Lake Storage.
• Build batch and incremental ETL/ELT pipelines, real-time streaming architectures, and reusable data integration frameworks.
• Develop scalable ingestion frameworks supporting structured, semi-structured, and API-based data sources.
• Build reusable data engineering frameworks for ingestion, transformation, validation, reconciliation, and publishing.
• Develop Delta Lake solutions using partitioning, optimization, Z-Ordering, Liquid Clustering, and performance tuning techniques.
• Implement CDC, incremental processing, merge strategies, and data synchronization across enterprise platforms.
• Develop Databricks Workflows, notebooks, SQL Jobs, and automation for production workloads.
• Integrate external REST APIs and process JSON/XML data into analytics-ready datasets.
• Implement robust data quality checks, audit frameworks, monitoring, and error handling.

Certifications

Industry

Company size

Contract length