Jobs / JPM***
Lead Software Engineer - Databricks
JPM*** · Wilmington, DE, United States
Visa sponsorship details are locked. Unlock company name and apply link with .
Wilmington, DE, United StatesOnsite
Remuneration
Not specified
Location
Wilmington, DE, United States
Visa sponsorship
Sponsors visa
Job summary
JOB DESCRIPTION Be an integral part of an agile team that's constantly pushing the envelope to enhance, build, and deliver top-notch technology products.
Benefits
And programs to meet employee needs, based on eligibility.Additional details about total compensation andWill be provided during the hiring process.We recognize that our people are our strength and the diverse talents they bringWe are an equal opportunity employer and place a high value on diversity and incVisit our FAQs for more information about requesting an accommodation.JPMorgan Chase & Co.Is an Equal Opportunity Employer, including Disability/VeteransABOUT THE TEAMOur professionals in our Corporate Functions cover a diverse range of areas from
Qualifications
- capabilities, and
Responsibilities
- As a core technical contributor, you are responsible for conducting critical technology solutions across multiple technical areas within various business functions in support of the firm's business objectives.
- Lead the architecture and delivery of high-throughput, low-latency data pipelines on Databricks using Apache Spark (Core, SQL, Structured Streaming), driving performance, reliability, and scalability.
- Establish and evolve Lakehouse patterns with Delta Lake (ACID transactions, schema evolution, time travel, Z-ordering, compaction) to ensure performant, maintainable data platforms at scale.
- Own Databricks cluster strategy and configuration, including runtime selection, autoscaling, driver/executor sizing, Spark configurations, init scripts, cluster policies, pools, and instance profiles.
- Orchestrate and automate pipelines and jobs using Databricks Workflows, integrating with AWS eventing and orchestration services as needed.
- Design secure ingestion and transformation frameworks leveraging Databricks services, including Delta or unmanaged table design, ingestion task creation, and Airflow DAGs to produce trusted and refined datasets.
- Enforce data quality, lineage, and governance using Unity Catalog and/or AWS Glue Catalog, embedding expectations and validation directly into pipelines.
- Build and maintain reusable libraries, frameworks, and APIs in Python and/or Java, ensuring strong unit, integration, and data validation test coverage.
- Applies knowledge of
Skills
AuditingCommunicationElectronic Health RecordsLeadership
Degrees
Associate
Travel
Travel
Industry
AutomotiveBankingHealthcareLogisticsMediaPublic-sector
Company size
EnterpriseSmb
Contract length
00 years
Security clearance
Secret