Home
/
Comprehensive
/
Sr. Data Engineer
Sr. Data Engineer-July 2024
Atlanta
Jul 27, 2026
ABOUT INSIGHT GLOBAL
Insight Global provides top talent and staffing solutions that help job seekers find careers in healthcare, finance, IT and government.
1,001 - 5,000 employees
Consulting, Technology
VIEW COMPANY PROFILE >>
About Sr. Data Engineer

  Job Description

  This telecom mogul is looking for skilled data engineers to add on to their data ingestion team for the build out of their new Integrated Data Warehouse. In this role, you will be responsible for reviewing and analyzing user stories, High level Solution Designs, source systems, Source to Target Mappings, and then developing code to ingest the data into various database platforms and services. Once Ingested, you will be responsible for ensuring the accuracy of the data per the requirements, then developing scripts to load the data from the DB/Data Lakes into the staging area. After that is complete, you will develop scripts to extract, transform, and load, the data into the core tables as per the logic in the source to target mapping documents. Then develop scripts to import the data from the core table. From there, you will then develop QA test scenarios and perform QA testing, including but not limited to functional, End to End, and data validation testing. You will oversee the production deployments and support the AppOps team during the deployment, data loads, troubleshooting, as well as regular production break fixes activates, as needed. As part of this DevOps role, you will participate in daily standups, will share regular project status with the DevOps Track lead and Scrum Master, as well as management and stakeholders.

  Skills and Requirements

  Experience with ETL

  Azure Databricks + ADF

  Spark, Scala, or Python

  SQL

  Enterprise Level Experience

  Requirement Analysis Review and Analyze user stories.

  Experience with Python for Automation

  Experience with Shell Scripting

  Review HLSD with solution architects.

  Analyzing source systems, Data modelling and source to target mappings (S2TM) and creating relevant artifacts as needed.

  Data Ingestion and Processing -- Analyze various sources and develop the code to ingest the data into Hadoop Data Lake.

  Data Cleansing - Ensure accuracy and completeness of the data and if required cleanup the data as per the need.

  Dispatch / Export- Develop scripts to load the data from Hadoop data lake into the destination staging area.

  Core Loads -- Develop the scripts to extract, transform and load (ETL) data into the Core tables as per the logic laid out in the source to target mapping (S2TM) document.

  Import -- Develop scripts to import the data from core tables into Hadoop Data Lake.

  Develop QA Test scenarios/cases as needed, and perform QA testing including but not limited to functional, End to End and data validation testing.

  Production deployment.

  Support AppOps team during deployment, data loads and troubleshooting, as well as during regular Production Break Fix Activities, as needed.

  Participate in daily standups, and share regular project status to DevOps Track Lead and/or DevOps Scrum Master, T-Mobile Project Manager, T-Mobile Manager and/or other stakeholders as needed.

  CICD Support as needed.

  Any other relevant analysis, design, development, and application support activities assigned to the team members from time to time. - Experience or strong understanding with Snowflake (DB) null

  We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to [email protected].

Comments
Welcome to zdrecruit comments! Please keep conversations courteous and on-topic. To fosterproductive and respectful conversations, you may see comments from our Community Managers.
Sign up to post
Sort by
Show More Comments
SIMILAR JOBS
Senior Procurement Analyst
Job Description At Boeing, we innovate and collaborate to make the world a better place. From the seabed to outer space, you can contribute to work that matters with a company where diversity, equity
Coating Engineer
Actalent is hiring an experienced Coating Engineer to join an Engineering team in Boulder! Description: A large grant is coming down the pipeline that will allow for current engineering team to expan
Health Technician (Ophthalmology)
Summary The Health Technician (Ophthalmology) in the Veterans Health Administration (VHA) supports the Ophthalmologist in diagnosis, treatment, prevention, follow-up care and patient counseling. This
Sales Associate - Paoli Shopping Ctr Paoli - Part Time Work
Sales Associate - Paoli Shopping Ctr Paoli - Part Time Work Print (https://www.governmentjobs.com/careers/pabureau/jobs/newprint/4354251) Apply  Sales Associate - Paoli Shopping Ctr Paoli - Part Tim
Program Analyst
Summary This position is located at Department of Housing and Urban Development, Assistant Secretary for Public and Indian Housing. This opportunity is also open to Status eligibles under announcemen
Manager, Sales Development
Job Description The Business Developer is a consolidated visionary leader with business acumen and an expert Marketer / Strategic Thinker & Planner / business plans developer - communicator - exe
Sweeper Driver
COME JOIN OUR TEAM AS THE NEXT DRIVER!! Parking lot sweeping, hand blowing, handpicking, emptying trash receptacles, general cleaning & maintenance. High school diploma or GED, valid driver's lic
Health Technician (Telehealth Clinical)
Summary The Veterans Health Administration (VHA) supports the provision of patient care using telehealth technologies which increase a Veteran's access to care and support a Veteran's self-management
Nurse Supervisor (RN) ** Sign on Bonus**
Description Saint Therese offers a sign on bonus of $5,000 for part-time positions! Be a part of the Saint Therese difference! Saint Therese is a nonprofit, Catholic senior living and care organizati
Senior Software Developers, .Net (Job# R2)
This job was posted by https://illinoisjoblink.illinois.gov : For moreinformation, please see:https://illinoisjoblink.illinois.gov/jobs/11604100 Job is located atRolling Meadows, IL. May also require
Copyright 2023-2026 - www.zdrecruit.com All Rights Reserved