Staff AI & Data Engineer – Databricks
Anywhere
Category: Data
Industry: Technology
Workplace Type: Remote
Standard Hours: Open
Reference ID: JN -112026-109353
Date Posted: 11/03/2026
Shortcut: http://careers.eliassen.com/SeR7jt
Description:
Remote
Our client is seeking a highly experienced Staff AI & Data Engineer to design and build enterprise-grade data and AI solutions on Databricks. This hands-on role focuses on strengthening the Databricks platform, onboarding new data sources, building reusable ingestion and transformation frameworks, creating trusted Gold-layer data products, enabling cross-domain analytics, and developing semantic and agent-ready capabilities. The ideal candidate brings strong data engineering expertise with modern AI and GenAI engineering skills and works across pipelines, modeling, data quality, governance, semantic layers, natural-language analytics, and AI agents.
Due to client requirements, applicants must be willing and able to work on a w2 basis. For our w2 consultants, we offer a great benefits package that includes Medical, Dental, and Vision benefits, 401k with company matching, and life insurance.
Rate: $80.00 to $90.00/hr. w2
JN -112026-109353
Responsibilities:
- Design and build production-grade data pipelines on Databricks.
- Ingest data from enterprise applications, databases, APIs, SaaS platforms, files, and other source systems.
- Build and maintain Bronze, Silver, and Gold medallion architectures.
- Implement incremental processing and change data capture patterns where appropriate.
- Standardize types, codes, units, keys, and business definitions across source systems.
- Implement deduplication, historical tracking, schema evolution, and data lineage.
- Optimize pipelines for reliability, performance, scalability, and cost.
- Build a configuration-driven source onboarding framework and Lakeflow pipeline templates.
- Automate source registration, deployment, monitoring, lineage, and operational controls.
- Implement data quality expectations, anomaly detection, monitoring, and quarantine processes.
- Implement job and pipeline monitoring, alerting, audit logging, and operational dashboards.
- Support automated deployment and promotion using Databricks Asset Bundles and CI/CD.
- Develop conformed dimensions and shared-key strategies across domains.
- Build integrated Gold-layer products and reusable data contracts.
- Build AI-ready Gold data products with ownership, lineage, definitions, and quality information.
- Develop semantic context, business glossary, ontology, and certified KPIs in Unity Catalog.
- Build governed Unity Catalog functions and agent-ready tools and endpoints.
- Implement tracing, evaluation, testing, monitoring, and governance for AI and agent workflows.
- Support development of AI agents that use trusted enterprise data.
Experience Requirements:
- Advanced hands-on experience with Databricks, Apache Spark, Delta Lake, and SQL.
- Hands-on experience with AWS services related to data analytics and AI, including EMR and Bedrock.
- Strong Python and SQL development skills.
- Experience building scalable batch and/or streaming data pipelines.
- Deep understanding of Bronze/Silver/Gold medallion architectures.
- Experience with Databricks Lakeflow or comparable orchestration technologies.
- Experience implementing enterprise data quality, lineage, observability, and monitoring.
- Experience with Unity Catalog and governed enterprise data environments.
- Strong understanding of dimensional modeling, data products, semantic models, and cross-domain integration.
- Experience with Git-based development, CI/CD, automated testing, and production deployment.
- Ability to troubleshoot complex distributed data and pipeline issues.
- Experience building AI and GenAI solutions against enterprise data.
- Understanding of semantic layers and natural-language-to-data architectures.
- Experience with Databricks Genie or comparable natural-language analytics technology.
- Experience building tools, functions, APIs, or services consumed by AI agents.
- Understanding of MCP, agent tool calling, tracing, evaluation, and AI governance.
- Experience developing production AI solutions with security, observability, and governance controls.
- Preferred: Databricks Data Engineer Professional or equivalent experience.
- Preferred: Experience with Databricks AI/BI, Genie, MLflow, and MCP-based integrations.
- Preferred: Experience in Real Estate, Finance, People/Workplace, Operations, or similar domains.
- Preferred: Experience building metadata-driven or configuration-driven ingestion frameworks.
Skills, experience, and other compensable factors will be considered when determining pay rate. The pay range provided in this posting reflects a W2 hourly rate; other employment options may be available that may result in pay outside of the provided range.
W2 employees of Eliassen Group who are regularly scheduled to work 30 or more hours per week are eligible for the following benefits: medical (choice of 3 plans), dental, vision, pre-tax accounts, other voluntary benefits including life and disability insurance, 401(k) with match, and sick time if required by law in the worked-in state/locality.
If anyone reaches out to you about an open position connected with Eliassen Group, please ensure that you are working directly with us by confirming the following:
· When you work with Eliassen Group, all email communication will come from an Eliassen.com address, never Gmail, Yahoo, etc.
· Eliassen Group will never ask you for personal information (home address, bank account, or check routing number) until you have worked with someone clearly associated with Eliassen Group.
If you have any indication of fraudulent activity, please contact fraud@eliassen.com.
-
Senior Solution Architect – Databricks, Data & AI
Anywhere
Description: Remote Our client is seeking a Senior Solution Architect to provide technical leadership for a large-scale Data & AI modernization initiative. This individual will own the overall architecture and technical direction across Databricks plat...
Date Posted: 11/03/2026 Recommended
-
Senior Data Engineer
Anywhere
Description: Remote Our client seeks a Senior Data Engineer to own the governed transformation layer end-to-end. The role will design and build Snowflake transformation layers, migrate legacy SQL views and user-maintained dimensions into versioned, tes...
Date Posted: 10/20/2026 Recommended
-
Data Platform Architect
washington, DC
Description: On-site in Falls Church, VA Our client seeks an experienced Data Platform Architect to provide architectural guidance, technical standards, and operational support for secure, scalable data, analytics, and AI/ML solutions. The role will pa...
Date Posted: 11/03/2026 Recommended
-
Senior Machine Learning Operations (MLOps) Engineer
Cincinnati, OH
Description: On-site in Cincinnati, OH Our client seeks a Senior Machine Learning Operations (MLOps) Engineer to design, build, and optimize scalable platforms and production ML systems across the end-to-end lifecycle. You will enable feature engineeri...
Date Posted: 10/20/2026 Recommended
-
Knowledge Graph Architect
Anywhere
Description: Remote Our client is seeking a Knowledge Graph Architect to lead the architecture and technical strategy for a construction-focused ontology, knowledge graph, and AI knowledge platform. You will connect historical project and operational d...
Date Posted: 10/28/2026 Recommended
-
Senior Data Engineer
Farmington Hills, MI
Description: On-site in Farmington Hills, MI Our client seeks a Senior Data Engineer to design, build, and support scalable and secure data solutions for enterprise Wealth & Asset Management applications. The role focuses on data ingestion, transformat...
Date Posted: 11/03/2026 Recommended
-
Data Engineer
Anywhere
Description: Remote Our client seeks a data engineer to collaborate with cross-functional teams and own systems, processes, and the tech stack across the SDLC. The role focuses on building and optimizing scalable data pipelines across Azure and GCP, im...
Date Posted: 10/08/2026 Recommended
-
Data Analyst
Anywhere
Description: Remote in or Richmond, VA Our client seeks a Data Analyst to partner with business stakeholders to translate needs into data solutions. The role will design metrics and dashboards, deliver business intelligence insights, and drive adherenc...
Date Posted: 10/29/2026 Recommended
-
Senior Agentic Software Engineer
Charlotte, NC
Description: Hybrid 3 days on-site in Charlotte, NC Our client seeks a Senior Agentic Software Engineer who will design and deliver intelligent systems that combine AI agents, cloud-native architectures, automation frameworks, and modern engineering pr...
Date Posted: 10/14/2026 Recommended
-
Sr Associate - Asset Projection, Data Controls, & Governance
Anywhere
Description: We are seeking a Senior Associate – Data Controls & Governance to support the evaluation and enhancement of controls surrounding financial and asset projection data. This individual will assess how data is sourced, transformed, stored, gov...
Date Posted: 10/15/2026 Recommended
-
Data Analyst
McLean, VA
Description: Hybrid 3 days onsite in McLean, VA or Richmond, VA Our client seeks a Data Analyst to support a data product team building raw data assets and data controls for AML use cases. The role will focus on data mapping, data profiling, querying, ...
Date Posted: 10/06/2026 Recommended
-
Senior Specialist, Application Development
New York, NY
Description: Hybrid 3 days on site in New York, NY Our client seeks a Senior Specialist, Application Development to consult with internal business groups and deliver application software development services aligned with business objectives. The role i...
Date Posted: 11/03/2026 Recommended
-
Data Architect
McLean, VA
Description: Hybrid 3 daysi in mclean in McLean, VA Our client seeks a Data Architect to design and operationalize data solutions that support analytics, reporting, and stakeholder decision-making. The role will develop data pipelines and integrations ...
Date Posted: 10/13/2026 Recommended
-
Senior Data Analyst
McLean, VA
Description: Hybrid 3 days onsite in McLean, VA Our client is seeking a senior data analyst to improve the data ecosystem and stand up new datasets. The analyst will model data, enhance data quality, streamline scripts and pipelines, and collaborate us...
Date Posted: 10/29/2026 Recommended
-
Senior Dataiku Platform Engineer
Cincinnati, OH
Description: On-site in Cincinnati, OH Our client seeks a Senior Dataiku Platform Engineer to lead engineering, automation, governance, and enterprise integration of the Dataiku DSS platform across a modern data ecosystem that includes Snowflake, AWS, ...
Date Posted: 10/20/2026 Recommended
-
Senior Java Developer
Lake Mary, FL
Description: Hybrid 4 days on site 8-5 in Lake Mary, FL Our client seeks a Senior Java Lead Developer to design, develop, and support scalable, low-latency, real-time enterprise applications. The role contributes to architecture and engineering of dist...
Date Posted: 11/03/2026 Recommended
-
Principal Data Scientist
Cincinnati, OH
Description: Hybrid 3 days onsite in Cincinnati, OH or Atlanta, GA Our client seeks a Principal Data Scientist to scale Data Science and AI capabilities for end-to-end payment optimization. The role will collaborate with ML engineers and product partne...
Date Posted: 10/28/2026 Recommended
-
Senior Data Analyst
McLean, VA
Description: Hybrid hybrid in Mclean or Richmond in McLean, VA Our client seeks a Senior Data Analyst to support the one of the world's largest credit card organizations. The contractor will design and improve data management controls, develop reportin...
Date Posted: 10/18/2026 Recommended
-
Senior Full Stack Developer
Farmington Hills, MI
Description: On-site in Farmington Hills, MI Our client seeks a Senior Full Stack Developer to design, develop, and support secure, scalable web applications and APIs for enterprise Wealth & Asset Management solutions. The role focuses on frontend deve...
Date Posted: 11/03/2026 Recommended
-
Senior AI Enablement Engineer
New York, NY
Description: Hybrid 3 days onsite in New York, NY Our client is seeking a Senior AI Enablement Engineer to design, build, integrate, and operationalize AI-powered tools and workflows across the business. This hands-on individual contributor role focuse...
Date Posted: 10/26/2026 Recommended
-
Azure Cloud Security and Databricks Consultant
Anywhere
Description: Remote but King of Prussia, PA or Milwaukee, WI preferred Our client seeks a security-focused Azure and Databricks specialist to support cloud migration and hardening activities associated with a transition services agreement. The consulta...
Date Posted: 10/15/2026 Recommended
-
Sr. Software Engineer – Identity & Access Management Engineering
Burbank, CA
Description: Hybrid 4 Days a week on-site in Burbank, CA Our client’s Identity & Access Management Engineering team seeks a Senior Software Engineer to build and secure enterprise identity platforms and services that power critical business operations ...
Date Posted: 10/13/2026 Recommended
-
ServiceNow / Moveworks Architect (hybrid, W2 only)
Orlando, FL
Description: Hybrid 4 days on site in Orlando FL, Burbank CA, Seattle WA, New York, Bristol CT, or Los Angeles CA. W2 only (NO C2C) Our client seeks a Senior SME to architect and evolve enterprise-grade integrations across ServiceNow, Moveworks, agenti...
Date Posted: 10/21/2026 Recommended
-
Analytics Integration Product Specialist
McLean, VA
Description: Hybrid hybrid in Mclean in McLean, VA Our client seeks an Analytics Integration Product Specialist to lead a multi-site web analytics migration and decommission effort supporting DFS Integration. The role will establish and drive a migrati...
Date Posted: 10/30/2026 Recommended
-
Senior Data Engineer
McLean, VA
Description: Hybrid 3 days onsite in McLean, VA Our client seeks a Senior Data Engineer to design, build, and optimize scalable data pipelines and platforms on AWS. The role will focus on batch and streaming data processing, integration across enterpri...
Date Posted: 11/02/2026 Recommended
-
Software Engineer
Anywhere
Description: Remote in either Remote or Remote Our client seeks a Software Engineer to design, build, test, and support full-stack solutions across Agile teams. You will leverage Python, APIs, SQL, Spark, and AWS services with a focus on serverless and...
Date Posted: 10/19/2026 Recommended
-
Senior Salesforce FSC Data Migration Analyst
Anywhere
Description: Remote Our client seeks a hands-on Senior Salesforce FSC Data Migration Analyst to support migration of legacy banking data into a new Salesforce Financial Services Cloud and Snowflake environment. The role centers on data profiling, clean...
Date Posted: 10/25/2026 Recommended
-
Project Manager, AI & Machine Learning Initiatives
Irvine, CA
Description: Hybrid 3 days onsite in Irvine, CA Our client seeks an experienced Project Manager to lead and coordinate Artificial Intelligence and Machine Learning initiatives across the organization. The role drives AI and ML projects from use-case de...
Date Posted: 10/26/2026 Recommended
-
Lead Product Manager
McLean, VA
Description: Hybrid 3 days onsite in McLean, VA Our client seeks a Lead Product Manager to support Discover integration within a Risk Management Product team. The role focuses on building data products for Anti Money Laundering, Compliance, Enterprise ...
Date Posted: 10/06/2026 Recommended
-
Full Stack Developer
Durham, NC
Description: Hybrid Onsite Every Other Week in Durham, NC We are seeking a talented Full Stack Developer to join a high-impact team building a next-generation Data Analytics Platform within the financial services industry. This role offers the opportun...
Date Posted: 11/02/2026 Recommended
Eliassen Group is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status. Eliassen Group’s Affirmative Action Plan (AAP) is available for inspection by any employee or applicant for employment upon request, during normal business hours of Monday through Friday, 8:30am to 5:30pm EST. Interested persons should contact Phaedra Wells at pwells@eliassen.com for assistance. It is unlawful in Massachusetts and Maryland to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.
Applicants with disabilities that believe they require an accommodation or assistance with a position, please email our HR team at hradmin@eliassen.com. This email inbox is designed exclusively to assist job seekers whose disability prevents them from being able to apply online. Emails sent for other purposes will not receive a response.
Please be advised that a number of fraudulent job postings have been released under the Eliassen Group brand.
Unfortunately, fraudulent job postings can happen. If anyone reaches out to you about an open position connected with Eliassen Group, never provide personal or financial information to anyone who is not clearly associated with Eliassen Group
If anyone seemingly from Eliassen Group has ever requested this personal information in the past or does so in the future, please contact fraud@eliassen.com.
Please ensure that you are working directly with us by confirming the following:
- When you work with Eliassen Group, all email communication will come from an Eliassen.com address, never Gmail, Yahoo, etc.
- Eliassen Group will never ask you for personal information (home address, bank account, or check routing number) until you have worked with someone clearly associated with Eliassen Group, as indicated above