Jobs / LTI***
Specialist - Data Engineering
LTI*** · Irving, TX, United States
Visa sponsorship details are locked. Unlock company name and apply link with .
Irving, TX, United States83,912-128,080 USD/yearlyOnsite
Remuneration
83,912-128,080 USD/yearly
Location
Irving, TX, United States
Visa sponsorship
Sponsors visa
Job summary
Role description Job Title: Pyspark Developer Work Location : Irving, Texas Job Summary - We are seeking a highly skilled and motivated Data Engineer to play a pivotal role in designing building and optimizing our next generation scalable data pipelines This position requires expertise in processing massive datasets using cutting-edge technologies like Apache Spark PySpark and Hive within a dynami
Benefits
Listed below may vary depending on the nature of your employment with LTIMindtreComprehensive Medical Plan Covering Medical, Dental, VisionShort Term and Long-Term Disability Coverage401(k) Plan with Company matchLife InsuranceVacation Time, Sick Leave, Paid HolidaysPaid Paternity and Maternity LeaveThe range displayed on each job posting reflects the minimum and maximum salaryWithin the range, individual pay is determined by work location and job level anInformation provided herein is accurate as of the date of this posting.LTIMindtree is an equal opportunity employer that is committed to diversity in tCompensation range: $83,912.00 to $128,080.00 per year
Qualifications
- into technically sound and efficient data solutions
- Required Core Technical
- CICD DevOps Automation Experience with Continuous IntegrationContinuous Deployment CICD practices and automation
- permitted by law.
Responsibilities
- Data Pipeline Development Maintenance Design build and maintain highly scalable and efficient ETLELT data pipelines utilizing PySpark and Spark SQL for complex data transformations
- Data Warehousing Storage Optimization Strategically manage data layout partitioning and indexing within Apache Hive and various cloud data lake solutions to optimize performance and accessibility
- Performance Tuning Optimization Proactively identify and resolve performance bottlenecks in Spark jobs leveraging Spark UI for indepth analysis effectively managing data skewness and optimizing memory utilization
- Diverse Data Integration Develop robust solutions for ingesting highvolume and diverse datasets from both structured relational databases and unstructured flat files into our data ecosystem
- Automated Workflow Orchestration Implement and manage automated data workflows using industrystandard scheduling
Skills
Electronic Health Records
Certifications
AWS CertifiedMicrosoft Certified
Degrees
Associate
Industry
AutomotiveDefenseEducationEnergyInsurancePublic-sector
Company size
EnterpriseSmb