Home
/
Comprehensive
/
Sr. Data Engineer
Sr. Data Engineer-November 2024
Atlanta
Nov 25, 2025
ABOUT INSIGHT GLOBAL
Insight Global provides top talent and staffing solutions that help job seekers find careers in healthcare, finance, IT and government.
1,001 - 5,000 employees
Consulting, Technology
VIEW COMPANY PROFILE >>
About Sr. Data Engineer

  Job Description

  This telecom mogul is looking for skilled data engineers to add on to their data ingestion team for the build out of their new Integrated Data Warehouse. In this role, you will be responsible for reviewing and analyzing user stories, High level Solution Designs, source systems, Source to Target Mappings, and then developing code to ingest the data into various database platforms and services. Once Ingested, you will be responsible for ensuring the accuracy of the data per the requirements, then developing scripts to load the data from the DB/Data Lakes into the staging area. After that is complete, you will develop scripts to extract, transform, and load, the data into the core tables as per the logic in the source to target mapping documents. Then develop scripts to import the data from the core table. From there, you will then develop QA test scenarios and perform QA testing, including but not limited to functional, End to End, and data validation testing. You will oversee the production deployments and support the AppOps team during the deployment, data loads, troubleshooting, as well as regular production break fixes activates, as needed. As part of this DevOps role, you will participate in daily standups, will share regular project status with the DevOps Track lead and Scrum Master, as well as management and stakeholders.

  Skills and Requirements

  Experience with ETL

  Azure Databricks + ADF

  Spark, Scala, or Python

  SQL

  Enterprise Level Experience

  Requirement Analysis Review and Analyze user stories.

  Experience with Python for Automation

  Experience with Shell Scripting

  Review HLSD with solution architects.

  Analyzing source systems, Data modelling and source to target mappings (S2TM) and creating relevant artifacts as needed.

  Data Ingestion and Processing -- Analyze various sources and develop the code to ingest the data into Hadoop Data Lake.

  Data Cleansing - Ensure accuracy and completeness of the data and if required cleanup the data as per the need.

  Dispatch / Export- Develop scripts to load the data from Hadoop data lake into the destination staging area.

  Core Loads -- Develop the scripts to extract, transform and load (ETL) data into the Core tables as per the logic laid out in the source to target mapping (S2TM) document.

  Import -- Develop scripts to import the data from core tables into Hadoop Data Lake.

  Develop QA Test scenarios/cases as needed, and perform QA testing including but not limited to functional, End to End and data validation testing.

  Production deployment.

  Support AppOps team during deployment, data loads and troubleshooting, as well as during regular Production Break Fix Activities, as needed.

  Participate in daily standups, and share regular project status to DevOps Track Lead and/or DevOps Scrum Master, T-Mobile Project Manager, T-Mobile Manager and/or other stakeholders as needed.

  CICD Support as needed.

  Any other relevant analysis, design, development, and application support activities assigned to the team members from time to time. - Experience or strong understanding with Snowflake (DB) null

  We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to [email protected].

Comments
Welcome to zdrecruit comments! Please keep conversations courteous and on-topic. To fosterproductive and respectful conversations, you may see comments from our Community Managers.
Sign up to post
Sort by
Show More Comments
SIMILAR JOBS
Customer Support Representative
18.75-20.75 per hour | 1680 Irving Rd, Eugene, OR, USA | Hourly | Sales - Operations | Full Time Who We Are: GloryBee started with a dream of providing natural, healthy ingredients for the people of
CDL Driver - $7,500 Hiring Bonus!!
Position SummaryThe CDL Truck Driver will be responsible for the safe and efficient operation of rear load, front load, side load, and roll off trucks, while providing prompt, courteous and complete
Production Packaging Associate (12 hr - B shift)
...
Pizza Maker
Whether you have prior restaurant experience or none at all, Topper’s is always on the looking for motivated Team Members.  As a Toppers Insider, you have the opportunity to work in a FUN atmosphere
Excavator Operator /Underground Utilities
This job was posted by https://www.azjobconnection.gov : For moreinformation, please see: https://www.azjobconnection.gov/jobs/6306723FNF Construction, Inc. is a general contractor providing heavy ci
Part Time Child Care Program Manager (South Euclid OH
Love your job and shape the future! The kids we serve are the beating heart of Right At School. We strive to provide safe, engaging, and meaningful in-school and extracurricular programs to enrich th
Licensed Optician
America's Best is part of National Vision, one of the largest and fastest-growing optical retailers in the United States. The America’s Best brand continues to grow, with 800 stores and counting. Eac
Construction Superintendent
EquipmentShare is Hiring a Construction Superintendent EquipmentShare is looking for a hands-on Construction Superintendent that has a builder’s mentality. About you: In the past 5 years, you have gr
Summer Intern, Streaming Partnerships
Who We Are: SiriusXM and its brands (Pandora, SXM Media, AdsWizz, Simplecast, and SiriusXM Connected Vehicle Services) are leading a new era of audio entertainment and services by delivering the most
Assistant Professor
Position Information Position/Rank Assistant/Associate Professor in the Tenure Track Department 00246 - Human Genetics City Salt Lake City, UT Track Tenure Track New Position to Begin 7/01/2024 Detai
Copyright 2023-2025 - www.zdrecruit.com All Rights Reserved