Kubernetes Big Data Engineer
Rockville, MD
Category: Data
Industry: Financial Services
Reference ID: JN -042026-106358
Date Posted: 04/13/2026
Shortcut: http://careers.eliassen.com/kYQyex
Description:
Hybrid 3 days onsite / 2 days remote in Rockville, MD
Our client seeks a Big Data Engineer to design and optimize large-scale data processing on AWS with Spark and Kubernetes. The role will implement containerized workloads on EMR on EKS, build scalable data pipelines, and improve performance, reliability, and observability. The engineer will collaborate with cross-functional teams, apply Spark tuning expertise, and manage Kubernetes-based infrastructure to support data-driven outcomes. Financial industry experience is beneficial.
We can facilitate w2 and corp-to-corp consultants. For our w2 consultants, we offer a great benefits package that includes Medical, Dental, and Vision benefits, 401k with company matching, and life insurance.
Rate: $54.00 to $64.00/hr. w2
JN -042026-106358
#LI-JS1
Responsibilities:
- Design, develop, and maintain large-scale data processing pipelines using Hadoop, Spark, Python, and Scala.
- Architect and deploy containerized big data workloads on Amazon EMR on EKS.
- Design and implement Kubernetes-based infrastructure for running Spark applications at scale.
- Implement scalable ingestion, storage, transformation, and analysis solutions.
- Stay current with industry trends and emerging big data technologies to improve architecture.
- Collaborate with cross-functional teams to translate business requirements into technical solutions.
- Optimize and enhance existing data pipelines for performance, scalability, and reliability.
- Develop automated testing frameworks and implement continuous testing for data quality.
- Conduct unit, integration, and system testing for data pipeline robustness and accuracy.
- Support data scientists and analysts with reliable datasets and tooling.
- Write and maintain automated unit, integration, and end-to-end tests.
- Monitor and troubleshoot production data pipelines and resolve issues.
- Manage Kubernetes clusters, pods, services, and deployments for big data workloads.
Experience Requirements:
- Hands-on experience with AI development tools such as GitHub Copilot, Q Developer, ChatGPT, or Claude.
- Proficiency with Hadoop, Spark, Hive, and Trino.
- Experience addressing data skew, petabyte-scale processing, and remediation of resource, data quality, and scalability issues.
- Strong Kubernetes experience including pods, services, deployments, namespaces, ConfigMaps, and Secrets.
- Hands-on EMR on EKS experience for Spark workloads.
- Kubernetes resource management, scheduling, and auto-scaling expertise.
- Knowledge of Helm charts, Kubernetes networking, PVs/PVCs, security best practices, kubectl, and YAML manifests.
- Ability to troubleshoot cluster issues, pod failures, resource constraints, and Spark-on-Kubernetes integration with dynamic allocation.
- Prompt engineering, AI workflow design, AI-driven analysis, and change management for AI adoption.
- Deep understanding of Spark internals including executors, tasks, stages, and DAGs.
- Spark performance tuning including partitioning, caching, and broadcast joins with proven optimization of large datasets.
- Experience troubleshooting slow or stuck Spark jobs and resource issues.
- Strong AWS experience including S3, EMR, EMR on EKS, Glue, Lambda, and Athena.
- Hands-on S3 usage with Spark including file formats and consistency behaviors.
- Amazon EKS architecture and best practices, IAM roles for service accounts (IRSA), and VPC networking for EKS.
- AWS monitoring and logging for Kubernetes using CloudWatch and CloudTrail; familiarity with serverless services such as Lambda and Fargate.
- Proficiency in Python or Scala with clean, modular, performant code and functional programming concepts.
- Strong understanding of collections, concurrency, and memory management.
- Advanced SQL skills including window functions, multi-table joins, aggregations, and edge case handling.
- Production ETL/pipeline management experience (preferred).
- CI/CD experience with tools such as Jenkins, GitLab CI, GitHub Actions, or ArgoCD (preferred).
- Infrastructure as Code for EKS and EMR on EKS using Terraform or CloudFormation (preferred).
- Comprehensive test case development and test automation experience (preferred).
- Docker and container image optimization experience (preferred).
- Knowledge of service mesh such as Istio or Linkerd (preferred).
- Monitoring and observability with Prometheus, Grafana, or ELK (preferred).
- AWS or Kubernetes certifications such as AI Practitioner, Solutions Architect, Big Data Specialty, CKA, or CKAD (preferred).
- Experience with GitOps practices for Kubernetes deployments (preferred).
Education Requirements:
- Bachelor's degree in Computer Science, Information Systems, or related discipline, or equivalent training and work experience.
- Master's degree preferred.
- AWS certifications such as AI Practitioner, Solutions Architect, or Big Data Specialty (preferred).
- Kubernetes certifications such as CKA or CKAD (preferred).
Skills, experience, and other compensable factors will be considered when determining pay rate. The pay range provided in this posting reflects a W2 hourly rate; other employment options may be available that may result in pay outside of the provided range.
W2 employees of Eliassen Group who are regularly scheduled to work 30 or more hours per week are eligible for the following benefits: medical (choice of 3 plans), dental, vision, pre-tax accounts, other voluntary benefits including life and disability insurance, 401(k) with match, and sick time if required by law in the worked-in state/locality.
If anyone reaches out to you about an open position connected with Eliassen Group, please ensure that you are working directly with us by confirming the following:
· When you work with Eliassen Group, all email communication will come from an Eliassen.com address, never Gmail, Yahoo, etc.
· Eliassen Group will never ask you for personal information (home address, bank account, or check routing number) until you have worked with someone clearly associated with Eliassen Group.
If you have any indication of fraudulent activity, please contact fraud@eliassen.com.
-
Software Engineer – Data Engineer with Java
Smithfield, RI
Description: Hybrid 2 weeks per month onsite in Smithfield, RI Our client seeks a senior data-focused software engineer to build and enhance performance measurement and analysis platforms within a wealth management domain. The role centers on SQL, Spar...
Date Posted: 04/05/2026 Recommended
-
Senior Data Engineer
Durham, NC
Description: Hybrid Every other week onsite/5 days in Durham, NC Our client seeks a senior Data Engineer to design, build, and maintain operational and analytical capabilities across modern data platforms. The role focuses on Snowflake, AWS, and Python...
Date Posted: 04/22/2026 Recommended
-
Platform Engineer IV
Anywhere
Description: Remote Our client seeks a Platform Engineer IV to build and maintain scalable Java and Angular services with Spring Boot for a high-availability platform. The role focuses on platform uptime, performance, stability, and public API developm...
Date Posted: 04/22/2026 Recommended
-
Senior Data Engineer
Cincinnati, OH
Description: Onsite in Cincinnati, OH The Senior Data Engineer will design and deliver scalable data solutions that enable secure data management, analytics, and business intelligence for the organization. The role requires proficiency with SQL, a mode...
Date Posted: 04/23/2026 Recommended
-
Java Full Stack Engineer
Westlake, TX
Description: Hybrid Every other week onsite/5 days in Westlake, TX Our client seeks a Java Full Stack Engineer to build distributed, event-driven applications and microservices that power core notification and messaging services. The role will contribu...
Date Posted: 04/19/2026 Recommended
-
Development Tester
Englewood, CO
Description: Hybrid 4 days onsite, 1 remote. in Englewood, CO Our client seeks a Development Tester to expand automated test coverage for backend microservices supporting advanced in-home Wi-Fi routers. The role focuses on REST API testing, Java-based ...
Date Posted: 04/20/2026 Recommended
-
Full Stack Engineer
Merrimack, NH
Description: Hybrid 50% onsite a month in either Merrimack, NH or NC We seek a Full Stack Engineer to build scalable UI and APIs that support data-centric workflows for investment decisioning. The role will develop with Angular on the front end and Jav...
Date Posted: 03/30/2026 Recommended
-
Senior Software Engineer, Java
Englewood, CO
Description: Hybrid 4 days onsite, 1 remote. in Englewood, CO Our client seeks a senior Software Engineer to design, build, and maintain Java and Spring-based microservices supporting cloud platforms for CPE devices. The role focuses on RESTful APIs, e...
Date Posted: 04/13/2026 Recommended
-
Principal Full Stack Engineering Consultant
Merrimac, NH
Description: Hybrid 50% in either Merrimack, NH or Smithfield, RI, or Dallas TX Our client seeks a Principal Full Stack Engineering Consultant to design and develop complex systems, lead technical initiatives, and enable innovation across teams. The ro...
Date Posted: 04/10/2026 Recommended
-
Full Stack Data Engineer
Westlake, TX
Description: Hybrid Onsite Every Other Week in Westlake, TX This role focuses on designing, developing, and maintaining backend data services and RESTful APIs that power enterprise-scale platforms. The engineer will build secure, scalable services, ena...
Date Posted: 04/02/2026 Recommended
-
DevOps Engineer
Westborough, MA
Description: Hybrid Tues, Wed, Thurs onsite in Westborough, MA The organization seeks a DevOps Engineer to design and operate CI/CD pipelines, cloud infrastructure, and reliable deployment strategies across AWS, Azure, and Kubernetes. The role will sta...
Date Posted: 04/17/2026 Recommended
-
AI Engineer
Boston, MA
Description: Hybrid Onsite 5 days/week, alternating weeks in either Boston, MA, Providence, RI, or Manchester, NH Our client seeks an experienced AI engineer to prototype and deploy solutions that demonstrate tangible business value. You will build Pyt...
Date Posted: 03/30/2026 Recommended
-
Data Insights Engineer
Greenwood Village, CO
Description: Hybrid 4 onsite / 1 work from home in Greenwood Village, CO Our client seeks a Data Insights Engineer to own stakeholder-facing dashboards, translate complex data into actionable narratives, and support ETL and data quality efforts within ...
Date Posted: 04/06/2026 Recommended
-
Principal Software Engineer
Westlake, TX, NC
Description: Hybrid 50% on site in Westlake, TX We are seeking an experienced Full Stack Engineer to join a Risk-focused product team responsible for building and modernizing applications that support critical business functions across a large financia...
Date Posted: 04/08/2026 Recommended
-
Senior Technical Lead – Emerging Technologies
St. Louis, MO
Description: Hybrid 3 days in office/week in St. Louis, MO Our client seeks a Senior Technical Lead to guide emerging retail technologies including in-store automation, digital shelf capabilities, and item integration. The role will lead solution desig...
Date Posted: 04/16/2026 Recommended
-
AI Software Engineer
Anywhere
Description: Remote Our client seeks an AI Software Engineer to design and deliver AI-enabled solutions that enhance engineering productivity and operational effectiveness. The role will build agentic workflows, integrate LLMs, and implement orchestrat...
Date Posted: 04/09/2026 Recommended
-
Junior Data Management and Quantitative Analyst
Pittsburgh, PA
Description: Hybrid 4 days onsite in Pittsburgh, PA Our client seeks a detail-focused data management analyst to support a legacy middle-office environment for a single client. The role centers on BAU processing, security master setups and maintenance,...
Date Posted: 04/05/2026 Recommended
-
Senior Data Scientist
Charlotte, NC
Description: Hybrid 3 on in Charlotte, NC Our client seeks a Data Science/AI Specialist to build and productionize machine learning solutions, data pipelines, and model deployment workflows. The role will emphasize Python development, SQL, feature engi...
Date Posted: 03/29/2026 Recommended
-
Senior Cloud ETL Platform Engineering Consultant
West Lake
Description: Hybrid role (50% on site in Westlake TX) We are seeking a Senior Cloud ETL Platform Engineer to join a large‑scale enterprise data integration organization within the financial services industry. This team is responsible for administering ...
Date Posted: 04/21/2026 Recommended
-
AI Governance Analyst
Charlotte, NC
Description: Hybrid 3 on in Charlotte, NC Our client seeks an AI Governance Analyst to enable responsible, secure, and compliant adoption of AI technologies. The role will vet in-house and third-party AI solutions, improve acquisition workflows, and su...
Date Posted: 04/16/2026 Recommended
-
Software Engineer – Data Engineering
Irvine, CA
Description: Hybrid 3 Days in Irvine, CA Our client seeks a hands-on Software Engineer to build and operate high-throughput, highly available distributed backend systems for semiconductor manufacturing data platforms. The role demands strong backend en...
Date Posted: 04/02/2026 Recommended
-
Back-End Engineer
Jersey City, NJ
Description: Hybrid 4 days on-site in Jersey City in Jersey City, NJ Our client seeks a senior back-end engineer to build scalable data services in Java and modernize critical custody systems. The role requires expertise in Spring-based microservices, ...
Date Posted: 04/09/2026 Recommended
-
Program Manager
Rockville, MD
Description: Hybrid 3 days onsite in Rockville, MD Our client seeks a Program Manager to drive strategy, governance, and execution across a technology portfolio in the financial domain. The role will coordinate program-level engagement, create clear na...
Date Posted: 03/30/2026 Recommended
-
Sr. KDB+ Developer
Jersey City, NJ
Description: Hybrid Onsite 5 days/week, alternating weeks in either Jersey City, NJ, TX, BOS, MMK or SMT The organization seeks a Sr. KDB+ Developer to build and maintain regulatory reporting applications across multiple asset classes. The role will de...
Date Posted: 04/07/2026 Recommended
-
Data Platform Operations Engineer
Bloomington, MN
Description: Hybrid 2-3 days onsite in Bloomington, MN Our client seeks a Data Platform Operations Engineer to deploy, maintain, and monitor Azure Data Landing Zone resources and the enterprise analytics platform. The role will automate infrastructure ...
Date Posted: 04/19/2026 Recommended
-
Data Engineer
Anywhere
Description: Remote Our client seeks a Data Engineer to support clinical trial data operations over a 12+ month contract. The role will program SAS edit checks and macros, build and optimize ETL/ELT pipelines, and ensure data quality across structured ...
Date Posted: 04/12/2026 Recommended
-
Sr. Senior Platform Engineer III
Washington dc, DC
Description: Onsite in Washington dc, DC Our client seeks a Sr. Senior Platform Engineer III to design and operate Kubernetes platforms for mission-critical federal workloads. The role spans CI/CD, infrastructure automation, and platform reliability, p...
Date Posted: 04/12/2026 Recommended
-
Quality Control Data & LIMS Specialist
Indianaolis, IN
Description: Onsite in Indianaolis, IN Our client seeks a QC Data and LIMS Specialist to support a new advanced therapies manufacturing site as it moves into operations. The role will manage QC data workflows, configure and maintain LIMS and ELN master...
Date Posted: 03/31/2026 Recommended
-
Mid Java, Angular, Vue.js SW Eng
Rockville, MD
Description: Hybrid 3 days onsite / 2 days remote in Rockville, MD Our client seeks a full stack developer to build and maintain applications across UI, services, and data layers in a regulated financial context. The role requires proficiency with Java...
Date Posted: 04/22/2026 Recommended
-
DevOps / MLOps Engineer
Westlake, TX
Description: Hybrid 50% ON SITE, requires candidates local to the area within Westlake, TX / DFW greater metro We are seeking a hands-on DevOps Engineer to support and modernize cloud infrastructure for a large, mission‑critical platform in the financi...
Date Posted: 04/14/2026 Recommended
Eliassen Group is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status. Eliassen Group’s Affirmative Action Plan (AAP) is available for inspection by any employee or applicant for employment upon request, during normal business hours of Monday through Friday, 8:30am to 5:30pm EST. Interested persons should contact Phaedra Wells at pwells@eliassen.com for assistance. It is unlawful in Massachusetts and Maryland to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.
Applicants with disabilities that believe they require an accommodation or assistance with a position, please email our HR team at hradmin@eliassen.com. This email inbox is designed exclusively to assist job seekers whose disability prevents them from being able to apply online. Emails sent for other purposes will not receive a response.
Please be advised that a number of fraudulent job postings have been released under the Eliassen Group brand.
Unfortunately, fraudulent job postings can happen. If anyone reaches out to you about an open position connected with Eliassen Group, never provide personal or financial information to anyone who is not clearly associated with Eliassen Group
If anyone seemingly from Eliassen Group has ever requested this personal information in the past or does so in the future, please contactInfoSec@eliassen.com.
Please ensure that you are working directly with us by confirming the following:
- When you work with Eliassen Group, all email communication will come from an Eliassen.com address, never Gmail, Yahoo, etc.
- Eliassen Group will never ask you for personal information (home address, bank account, or check routing number) until you have worked with someone clearly associated with Eliassen Group, as indicated above