Home
/
Comprehensive
/
Big Data Engineers (Airflow, Python, Spark)
Big Data Engineers (Airflow, Python, Spark)-December 2024
Bangalore
Dec 15, 2025
ABOUT NIELSEN
We’re in tune with what the world is watching, buying, and everything in between. If you can think of it, we’re measuring it.
10,000+ employees
Client Services
VIEW COMPANY PROFILE >>
About Big Data Engineers (Airflow, Python, Spark)

  At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big, so we can all continuously improve. We enable your best to power our future.

  About the Role

  You’ll be working within an international group of teams which span from the US till India. This group is responsible for building our Audience Builder application and components which is part of Nielsen’s Advanced Audiences in the Nielsen ONE product suite. Your specific team will be responsible to build data pipelines, services and UIs to support our complex entitlement needs for our current and future web applications.

  As a Software Data Engineer you will be responsible for data pipelines to work on both scheduled and real time use cases. Schedule pipelines run typically in Airflow and real time processing could be airflow or integrated querying in backend services.

  Responsibilities

  Work closely with team leads and backend developers to design and develop functional, robust pipelines to support internal and customer needs.

  Write both unit and integration tests, and develop automation tools for daily tasks.

  Develop high quality, well documented, and efficient code.

  Manage and optimize scalable pipelines in the cloud.

  Optimize internal and external applications for performance and scalability.

  Develop automated tests to ensure business needs are met, and write unit, integration, or data quality tests.

  Communicate regularly with stakeholders, project managers, quality assurance teams, and other developers regarding progress on long-term technology roadmap.

  Recommend systems solutions by comparing advantages and disadvantages of custom development and purchased alternatives.

  Key Skills (Domain Expertise)

  2+ years of experience as a software/data engineer.

  Bachelor’s degree in Computer Science, MIS, or Engineering.

  Technical SKills

  Experience with database systems, with knowledge of SQL and NoSQL stores (e.g. MySQL, Oracle, MongoDB, Couchbase, etc.)

  Experience developing sophisticated data driven software platforms.

  Experience with relational databases and/or analytical data stores (e.g., Spark, Presto, Pandas).

  Experience delivering, supporting enterprise software.

  Experience with cloud service technologies, ex: AWS.

  Experience with container technologies, ex: Docker.

  Experience with source control systems, ex: GIT.

  Information visualization.

  "Big data" systems and analysis.

  Experience with data warehouses or data lakes.

  Mindset and Attributes

  Strong communication skills with ability to communicate complex technical concepts and align organization on decisions.

  Sound problem-solving skills with the ability to quickly process complex information and present it clearly and simply.

  Utilizes team collaboration to create innovative solutions efficiently.

Comments
Welcome to zdrecruit comments! Please keep conversations courteous and on-topic. To fosterproductive and respectful conversations, you may see comments from our Community Managers.
Sign up to post
Sort by
Show More Comments
SIMILAR JOBS
Dams Engineering Manager
Dams Engineering Manager Date: Feb 3, 2024 Location: Denver, CO, US Company: Black & Veatch Family of Companies Together, we own our company, our future, and our shared success. As an employee-ow
Team Member
Pay: Up to $13/HR Position: Team Member Compensation: Hourly, Non Exempt All Team Members are hired as variable hour employees. Hours are scheduled based on business needs, employee availability and
Fitness Manager I
FULL-TIME Full-time LOCATION 10616 Research Blvd Austin TX 78759 Fitness Manager Who we are At 24 Hour Fitness, we are dedicated to our mission of creating a healthier, happier world. We are passiona
Rehabilitation Counselor (Developmental Services)
Horizon House is an Equal Opportunity Employer (M/F/Veteran/Disability/Sexual Orientation/Gender Identity). Returning Applicant? Rehabilitation Counselor (Developmental Services) Req Code:2021:3362-0
Site Engineer
Background and Purpose of the Job: The purpose of this job is to manage the end to end delivery of the capital projects for process or packaging areas. Responsible for all aspects of the day to day m
barista - Store# 05936, I-80 & PITT SCHOOL - DIXON
Join us and inspire with every cup! At Starbucks, it’s all about connection. People are at the heart of who we are, especially the people that are a part of our store team. We connect with each other
Physician, Im
Internist Park Nicollet Clinic - Eagan Minneapolis, MN Park Nicollet Clinic is looking for internist to join our primary care team at Park Nicollet Clinic - Eagan. Being a part of our team means you
Sr. Customer Assistance Representative
Overview Enterprise Mobility operates the Enterprise Rent-A-Car, National Car Rental, and Alamo car rental brands and has frequently been named one of the top places to work. Enterprise Mobility is t
Senior Field Marketing Manager
We're looking for a Senior Field Marketing Manager Cornerstone is looking for a Senior Field Marketing Manager to join our Demand Generation team. We are looking for a creative, driven integrated cam
FOOD SERVICE WORKER/CASHIER (FULL TIME)
Chartwells K12 We are hiring immediately for a full time FOOD SERVICE WORKER/CASHIER position. Location: Windsor School District - 6208 Highway 61-67, Imperial, MO 63052 Note: online applications acc
Copyright 2023-2025 - www.zdrecruit.com All Rights Reserved