Kubernetes Big Data Engineer
Rockville, MD
Category: Data
Industry: Financial Services
Reference ID: JN -042026-106358
Date Posted: 04/13/2026
Shortcut: http://careers.eliassen.com/kYQyex
Description:
Hybrid 3 days onsite / 2 days remote in Rockville, MD
Our client seeks a Big Data Engineer to design and optimize large-scale data processing on AWS with Spark and Kubernetes. The role will implement containerized workloads on EMR on EKS, build scalable data pipelines, and improve performance, reliability, and observability. The engineer will collaborate with cross-functional teams, apply Spark tuning expertise, and manage Kubernetes-based infrastructure to support data-driven outcomes. Financial industry experience is beneficial.
We can facilitate w2 and corp-to-corp consultants. For our w2 consultants, we offer a great benefits package that includes Medical, Dental, and Vision benefits, 401k with company matching, and life insurance.
Rate: $54.00 to $64.00/hr. w2
JN -042026-106358
#LI-JS1
Responsibilities:
- Design, develop, and maintain large-scale data processing pipelines using Hadoop, Spark, Python, and Scala.
- Architect and deploy containerized big data workloads on Amazon EMR on EKS.
- Design and implement Kubernetes-based infrastructure for running Spark applications at scale.
- Implement scalable ingestion, storage, transformation, and analysis solutions.
- Stay current with industry trends and emerging big data technologies to improve architecture.
- Collaborate with cross-functional teams to translate business requirements into technical solutions.
- Optimize and enhance existing data pipelines for performance, scalability, and reliability.
- Develop automated testing frameworks and implement continuous testing for data quality.
- Conduct unit, integration, and system testing for data pipeline robustness and accuracy.
- Support data scientists and analysts with reliable datasets and tooling.
- Write and maintain automated unit, integration, and end-to-end tests.
- Monitor and troubleshoot production data pipelines and resolve issues.
- Manage Kubernetes clusters, pods, services, and deployments for big data workloads.
Experience Requirements:
- Hands-on experience with AI development tools such as GitHub Copilot, Q Developer, ChatGPT, or Claude.
- Proficiency with Hadoop, Spark, Hive, and Trino.
- Experience addressing data skew, petabyte-scale processing, and remediation of resource, data quality, and scalability issues.
- Strong Kubernetes experience including pods, services, deployments, namespaces, ConfigMaps, and Secrets.
- Hands-on EMR on EKS experience for Spark workloads.
- Kubernetes resource management, scheduling, and auto-scaling expertise.
- Knowledge of Helm charts, Kubernetes networking, PVs/PVCs, security best practices, kubectl, and YAML manifests.
- Ability to troubleshoot cluster issues, pod failures, resource constraints, and Spark-on-Kubernetes integration with dynamic allocation.
- Prompt engineering, AI workflow design, AI-driven analysis, and change management for AI adoption.
- Deep understanding of Spark internals including executors, tasks, stages, and DAGs.
- Spark performance tuning including partitioning, caching, and broadcast joins with proven optimization of large datasets.
- Experience troubleshooting slow or stuck Spark jobs and resource issues.
- Strong AWS experience including S3, EMR, EMR on EKS, Glue, Lambda, and Athena.
- Hands-on S3 usage with Spark including file formats and consistency behaviors.
- Amazon EKS architecture and best practices, IAM roles for service accounts (IRSA), and VPC networking for EKS.
- AWS monitoring and logging for Kubernetes using CloudWatch and CloudTrail; familiarity with serverless services such as Lambda and Fargate.
- Proficiency in Python or Scala with clean, modular, performant code and functional programming concepts.
- Strong understanding of collections, concurrency, and memory management.
- Advanced SQL skills including window functions, multi-table joins, aggregations, and edge case handling.
- Production ETL/pipeline management experience (preferred).
- CI/CD experience with tools such as Jenkins, GitLab CI, GitHub Actions, or ArgoCD (preferred).
- Infrastructure as Code for EKS and EMR on EKS using Terraform or CloudFormation (preferred).
- Comprehensive test case development and test automation experience (preferred).
- Docker and container image optimization experience (preferred).
- Knowledge of service mesh such as Istio or Linkerd (preferred).
- Monitoring and observability with Prometheus, Grafana, or ELK (preferred).
- AWS or Kubernetes certifications such as AI Practitioner, Solutions Architect, Big Data Specialty, CKA, or CKAD (preferred).
- Experience with GitOps practices for Kubernetes deployments (preferred).
Education Requirements:
- Bachelor's degree in Computer Science, Information Systems, or related discipline, or equivalent training and work experience.
- Master's degree preferred.
- AWS certifications such as AI Practitioner, Solutions Architect, or Big Data Specialty (preferred).
- Kubernetes certifications such as CKA or CKAD (preferred).
Skills, experience, and other compensable factors will be considered when determining pay rate. The pay range provided in this posting reflects a W2 hourly rate; other employment options may be available that may result in pay outside of the provided range.
W2 employees of Eliassen Group who are regularly scheduled to work 30 or more hours per week are eligible for the following benefits: medical (choice of 3 plans), dental, vision, pre-tax accounts, other voluntary benefits including life and disability insurance, 401(k) with match, and sick time if required by law in the worked-in state/locality.
If anyone reaches out to you about an open position connected with Eliassen Group, please ensure that you are working directly with us by confirming the following:
· When you work with Eliassen Group, all email communication will come from an Eliassen.com address, never Gmail, Yahoo, etc.
· Eliassen Group will never ask you for personal information (home address, bank account, or check routing number) until you have worked with someone clearly associated with Eliassen Group.
If you have any indication of fraudulent activity, please contact fraud@eliassen.com.
-
Software Engineer – Data Engineer with Java
Smithfield, RI
Description: Hybrid 2 weeks per month onsite in Smithfield, RI Our client seeks a senior data-focused software engineer to build and enhance performance measurement and analysis platforms within a wealth management domain. The role centers on SQL, Spar...
Date Posted: 04/05/2026 Recommended
-
Full Stack Software Engineer
Rockville, MD
Description: Hybrid 3 days onsite / 2 days remote in either Rockville, MD or Tysons Corner, VA The organization seeks a Senior Full Stack Engineer to lead by example and deliver scalable solutions across distributed microservices, big data, and full-st...
Date Posted: 04/04/2026 Recommended
-
Senior Data Engineer
Cincinnati, OH
Description: Onsite in Cincinnati, OH The Senior Data Engineer will design and deliver scalable data solutions that enable secure data management, analytics, and business intelligence for the organization. The role requires proficiency with SQL, a mode...
Date Posted: 03/24/2026 Recommended
-
Full Stack Data Engineer
Westlake, TX
Description: Hybrid Onsite Every Other Week in Westlake, TX This role focuses on designing, developing, and maintaining backend data services and RESTful APIs that power enterprise-scale platforms. The engineer will build secure, scalable services, ena...
Date Posted: 04/02/2026 Recommended
-
AI Engineer
Boston, MA
Description: Hybrid Onsite 5 days/week, alternating weeks in either Boston, MA, Providence, RI, or Manchester, NH Our client seeks an experienced AI engineer to prototype and deploy solutions that demonstrate tangible business value. You will build Pyt...
Date Posted: 03/30/2026 Recommended
-
Full Stack Engineer
Merrimack, NH
Description: Hybrid 50% onsite a month in either Merrimack, NH or NC We seek a Full Stack Engineer to build scalable UI and APIs that support data-centric workflows for investment decisioning. The role will develop with Angular on the front end and Jav...
Date Posted: 03/30/2026 Recommended
-
Data Insights Engineer
Greenwood Village, CO
Description: Hybrid 4 onsite / 1 work from home in Greenwood Village, CO Our client seeks a Data Insights Engineer to own stakeholder-facing dashboards, translate complex data into actionable narratives, and support ETL and data quality efforts within ...
Date Posted: 04/06/2026 Recommended
-
AI Software Engineer
Anywhere
Description: Remote Our client seeks an AI Software Engineer to design and deliver AI-enabled solutions that enhance engineering productivity and operational effectiveness. The role will build agentic workflows, integrate LLMs, and implement orchestrat...
Date Posted: 04/09/2026 Recommended
-
Principal Software Engineer
Westlake, TX, NC
Description: Hybrid 50% on site in Westlake, TX We are seeking an experienced Full Stack Engineer to join a Risk-focused product team responsible for building and modernizing applications that support critical business functions across a large financia...
Date Posted: 04/08/2026 Recommended
-
Machine Learning Engineer
Westlake, TX
Description: Hybrid two weeks onsite a month in Westlake, TX Our client is seeking a Machine Learning Engineer to build and optimize GenAI solutions on AWS, including RAG, prompt engineering, fine tuning, and LLM evaluation. The role will design and de...
Date Posted: 04/11/2026 Recommended
-
Back-End Engineer
Jersey City, NJ
Description: Hybrid 4 days on-site in Jersey City in Jersey City, NJ Our client seeks a senior back-end engineer to build scalable data services in Java and modernize critical custody systems. The role requires expertise in Spring-based microservices, ...
Date Posted: 04/09/2026 Recommended
-
Sr. KDB+ Developer
Jersey City, NJ
Description: Hybrid Onsite 5 days/week, alternating weeks in either Jersey City, NJ, TX, BOS, MMK or SMT The organization seeks a Sr. KDB+ Developer to build and maintain regulatory reporting applications across multiple asset classes. The role will de...
Date Posted: 04/07/2026 Recommended
-
DevOps Engineer
Westborough, MA
Description: Hybrid Tues, Wed, Thurs onsite in Westborough, MA The organization seeks a DevOps Engineer to design and operate CI/CD pipelines, cloud infrastructure, and reliable deployment strategies across AWS, Azure, and Kubernetes. The role will sta...
Date Posted: 03/18/2026 Recommended
-
Program Manager
Rockville, MD
Description: Hybrid 3 days onsite in Rockville, MD Our client seeks a Program Manager to drive strategy, governance, and execution across a technology portfolio in the financial domain. The role will coordinate program-level engagement, create clear na...
Date Posted: 03/30/2026 Recommended
-
DevOps / MLOps Engineer
Westlake, TX
Description: Hybrid 50% ON SITE, requires candidates local to the area within Westlake, TX / DFW greater metro We are seeking a hands-on DevOps Engineer to support and modernize cloud infrastructure for a large, mission‑critical platform in the financi...
Date Posted: 04/14/2026 Recommended
-
DevOps Engineer
Westlake, TX
Description: Hybrid (50% onsite, 50% remote) in the DFW metro We seek a DevOps Engineer to implement and manage CI/CD pipelines, infrastructure automation, and cloud environments that support externally facing applications. The role will coordinate and...
Date Posted: 03/25/2026 Recommended
-
Data Engineer
Durham, NC
Description: Hybrid Every other week onsite/5 days in Durham, NC Our client seeks a Data Engineer to build and scale data solutions on AWS with Snowflake. The role focuses on data analysis, data modeling, and ETL development using Python and SQL to sup...
Date Posted: 04/14/2026 Recommended
-
Sr. Senior Platform Engineer III
Washington dc, DC
Description: Onsite in Washington dc, DC Our client seeks a Sr. Senior Platform Engineer III to design and operate Kubernetes platforms for mission-critical federal workloads. The role spans CI/CD, infrastructure automation, and platform reliability, p...
Date Posted: 04/12/2026 Recommended
-
Fullstack Engineer
Englewood, CO
Description: Hybrid 4 days onsite, 1 remote. in Englewood, CO We are seeking a Fullstack Engineer to build and maintain mission-critical applications for our client and its end users. The role involves Golang, TypeScript, Angular, Spring Boot, and even...
Date Posted: 03/16/2026 Recommended
-
Physical Security Systems Engineer
Austin, TX
Description: Hybrid Monday - Thursday in either Austin, TX or Salt Lake City, UT or Dublin, IE The organization seeks a Physical Security Systems Engineer to support and optimize enterprise physical security technologies. The role will administer acces...
Date Posted: 03/26/2026 Recommended
-
Quality Control Data & LIMS Specialist
Indianaolis, IN
Description: Onsite in Indianaolis, IN Our client seeks a QC Data and LIMS Specialist to support a new advanced therapies manufacturing site as it moves into operations. The role will manage QC data workflows, configure and maintain LIMS and ELN master...
Date Posted: 03/31/2026 Recommended
-
GenAI Scientist
Atlanta, GA
Description: Open to remote candidates - but must work EST hours. Our client, a nationally-recognized transportation and logistics company seeks a GenAI Scientist to build and enhance enterprise-grade conversational AI and document intelligence capabil...
Date Posted: 04/14/2026 Recommended
-
Data Engineer
Merrimack, NH
Description: Hybrid two weeks onsite a month in either Merrimack, NH or Durham, NC We are seeking a Senior Data Engineer to build scalable data solutions within a highly collaborative technology team. The role focuses on Oracle PL/SQL, SQL scripting, E...
Date Posted: 03/30/2026 Recommended
-
Full Stack Developer
Salt Lake City, UT
Description: Hybrid Onsite Every Other Week in either Salt Lake City, UT or Westlake, TX Our client seeks a Full Stack Developer to design, build, and deliver enterprise-scale, customer-facing services for modernized life events and beneficiary process...
Date Posted: 04/07/2026 Recommended
-
Enterprise Data Architect (Data Transformation)
Atlanta, GA
Description: Our client, a leader in their industry, has an excellent opportunity for an Enterprise Data Architect to work on a 6-12 contract-to-hire position in Atlanta, GA (Dunwoody). This is a hybrid role onsite 2–3 days a week. This is not a tradit...
Date Posted: 04/08/2026 Recommended
-
Junior Data Management and Quantitative Analyst
Pittsburgh, PA
Description: Hybrid 4 days onsite in Pittsburgh, PA Our client seeks a detail-focused data management analyst to support a legacy middle-office environment for a single client. The role centers on BAU processing, security master setups and maintenance,...
Date Posted: 04/05/2026 Recommended
-
Senior Data Engineer
Westlake, TX
Description: Hybrid 50% ON SITE, requires candidates to be local in DFW area of TX We are seeking a Data Engineer to lead design and implementation of data solutions within a large, enterprise financial services organization. In this role, you will des...
Date Posted: 04/02/2026 Recommended
-
Senior Data Engineer Java Spring Boot AWS (Hybrid role)
Smithfield, RI
Description: Hybrid 2 weeks per month onsite in Smithfield, RI Our client’s Data Solutions team requires a Senior Data Engineer focused on Java Spring Batch ETL, AWS, and Snowflake to support critical compensation data initiatives. The role contributes...
Date Posted: 04/13/2026 Recommended
-
Senior Business Systems Analyst / Technical Business Analyst
Greenwood Village, CO
Description: Hybrid 4 days onsite, 1 remote. in Greenwood Village, CO Our client seeks a Senior Business Systems Analyst to drive end-to-end shipping, logistics, and procurement coordination within a PMO. The role requires disciplined organization, cro...
Date Posted: 04/01/2026 Recommended
-
BI Reporting Engineer
Westlake, TX
Description: Hybrid 3 days a week onsite in Westlake, TX Our client seeks a BI Reporting Engineer to build analytical reports and advanced visualizations while supporting core BI platforms. The role focuses on SAP BusinessObjects with strong SQL and Sn...
Date Posted: 03/22/2026 Recommended
Eliassen Group is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status. Eliassen Group’s Affirmative Action Plan (AAP) is available for inspection by any employee or applicant for employment upon request, during normal business hours of Monday through Friday, 8:30am to 5:30pm EST. Interested persons should contact Phaedra Wells at pwells@eliassen.com for assistance. It is unlawful in Massachusetts and Maryland to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.
Applicants with disabilities that believe they require an accommodation or assistance with a position, please email our HR team at hradmin@eliassen.com. This email inbox is designed exclusively to assist job seekers whose disability prevents them from being able to apply online. Emails sent for other purposes will not receive a response.
Please be advised that a number of fraudulent job postings have been released under the Eliassen Group brand.
Unfortunately, fraudulent job postings can happen. If anyone reaches out to you about an open position connected with Eliassen Group, never provide personal or financial information to anyone who is not clearly associated with Eliassen Group
If anyone seemingly from Eliassen Group has ever requested this personal information in the past or does so in the future, please contactInfoSec@eliassen.com.
Please ensure that you are working directly with us by confirming the following:
- When you work with Eliassen Group, all email communication will come from an Eliassen.com address, never Gmail, Yahoo, etc.
- Eliassen Group will never ask you for personal information (home address, bank account, or check routing number) until you have worked with someone clearly associated with Eliassen Group, as indicated above