This site uses cookies. To find out more, see our Cookies Policy

Senior Data Engineer (Spark/Azure) in Dunwoody, GA at Eliassen Group

Date Posted: 6/13/2019

Job Snapshot

  • Employee Type:
    Full-Time/Part-Time
  • Location:
    Dunwoody, GA
  • Job Type:
  • Experience:
    Not Specified
  • Date Posted:
    6/13/2019

Job Description

Senior Data Engineer (Spark/Azure)

Terms: Full-Time Permanent 
Location: Dunwoody, GA
Salary: $135,000 - $140,000/year + bonus
Job ID: #319955 
Benefits: Excellent Benefits including Health, Dental, Vision, 401(k) with matching, Disability, Life, PTO, and much more
Work Authorization: Must be authorized to work in the US without sponsorship


Job Description:
Our client, a leader in their industry, has an excellent opportunity for a Senior Data Engineer to work on a full-time permanent basis on an Enterprise Data Organization on a new Data Transformation Team.  This Data Engineer will build and manage real-time and batch data pipelines performing Data ingesting, data transformation, data distribution, quality rules, data storage for an Azure cloud-based data platform.  The Senior Data Engineer will work with Spark and Azure Cloud, Talend ETL development, and Data warehouse builds.   This Data Engineer will also perform Data Modeling, Data Transformation, Data Warehouse, Data Governance.  The role will be 30-40% hands-on development, deployment, and integration, and 60% driving delivery, business integration, mentoring/leading.  This Data Engineer will possess strong technical, analytical, programming, and critical thinking skills. The ideal candidate will have familiarity with data transformation, data modeling, Master data management, and Metadata management as well.

Key Responsibilities:
•    Design, develop, and maintain reliable automated data solutions based on the identification, collection, and evaluation of business requirements. Including but not limited to, data models, database objects, stored procedures, and views.  
•    Developing new and enhancing existing data processing (Data Ingest, Data Transformation, Data Store, Data Management, Data Quality) components
•    Engage with IT teams such as DBAs, Security, Storage, and Networking when their involvement is required to meet the project needs.
•    Support and troubleshoot the data environment (including periodically on call)
•    Document technical artifacts for developed solutions
•    Maintains professional and technical knowledge by attending educational workshops; reviewing professional publications; establishing personal networks; benchmarking state-of-the-art practices; participating in professional societies.

Key Requirements:
•    10+ Years of professional IT experience focusing on Data related disciplines with recent and in-depth experience as a Data Engineer 
•    Seeking strong skills with Spark and Azure Cloud is preferred
•    Be able to build Data Pipelines from scratch directly from Architecture 
•    Data Modeling for ETL / Data Warehouse with Informatica, Ab Initio, Talend or equivalent
•    Heavy data warehousing, RDMS, working with batch and real-time data. 
•    BS in either Information Systems, Finance/Mathematics, or Computer Science or similar field

Preferred Skills:
•    Azure Cloud
•    Talend is a huge plus
•    Experience with a DevOps model utilizing a CI/CD tool
 
Technical Environment:
Agile, Spark, PySpark, Python, SQL, Java, Hadoop, NoSQL databases (Cassandra, HBase, MongoDB), RDMS, Azure Cloud Data Warehouse, Talend, ETL, Databricks, Snowflake

Please send your word resume with contact number to this posting to apply.  Feel free to give me (Ben Crosby) a call to discuss at 770-399-4508 for immediate consideration.