Data Engineer II

Job summary

Where Ambition Meets Innovation Build a career that matches all your initiative with an impressive dose of innovation. From cutting-edge resources and a collaborative environment to the freedom to make an impact and more, you’ll find the ingredients you need at LPL*** to shape your success while helping clients pursue their financial goals.

Benefits

Qualifications

• Minimum of 3 years of Proficiency in Python and related frameworks (e.g., Flask, FastAPI, Django).
• Minimum of 2 Strong experience with AWS services: Lambda, API Gateway, Glue, EKS, DynamoDB, S3.
• Experience with PySpark for data processing.
• Solid understanding of relational and NoSQL databases (PostgreSQL, DynamoDB).
• Hands-on experience with GitHub and CI/CD workflows.
• Core Competencies:
• Excellent knowledge of OOP concepts, data modeling design patterns/frameworks using Search, Index, and Distribute Caching

Responsibilities

• Design, develop, and maintain Python-based applications and services.
• Build and optimize data pipelines using AWS Glue and PySpark.
• Develop and deploy containerized applications on AWS EKS.
• Implement API and Microservices patterns using API Gateway and AWS Lambda.
• Integrate with AWS DynamoDB, PostgreSQL, and other data stores.
• Implement messaging and streaming solutions using Kafka.
• Write clean, maintainable, and testable code following Test Driven Development (TDD) principles.
• Collaborate in an Agile Scrum environment, participating in sprint planning, daily stand-ups, and retrospectives.
• Document technical designs and processes in Confluence and manage tasks in JIRA.
• Work with GitHub for version control and CI/CD pipelines.
• Apply basic Terraform

Skills

Certifications

Degrees

Work schedule

Industry

Company size

Contract length