Home
/
Comprehensive
/
Big Data Engineer (Airflow/Python/Spark)
Big Data Engineer (Airflow/Python/Spark)-January 2024
Bangalore
Jan 18, 2026
ABOUT NIELSEN
We’re in tune with what the world is watching, buying, and everything in between. If you can think of it, we’re measuring it.
10,000+ employees
Client Services
VIEW COMPANY PROFILE >>
About Big Data Engineer (Airflow/Python/Spark)

  At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big, so we can all continuously improve. We enable your best to power our future.

  About the role

  You’ll be working within an international group of teams which span from the US till India. This group is responsible for building our Audience Builder application and components which is part of Nielsen’s Advanced Audiences in the Nielsen ONE product suite. Your specific team will be responsible to build data pipelines, services and UIs to support our complex entitlement needs for our current and future web applications.

  As an Associate Data Engineer you will be responsible for data pipelines to work on both scheduled and real time use cases. Schedule pipelines run typically in Airflow and real time processing could be airflow or integrated querying in backend services.

  Responsibilities

  Work closely with team leads and backend developers to design and develop functional, robust pipelines to support internal and customer needs

  Write both unit and integration tests, and develop automation tools for daily tasks

  Develop high quality, well documented, and efficient code

  Manage and optimize scalable pipelines in the cloud

  Optimize internal and external applications for performance and scalability

  Develop automated tests to ensure business needs are met, and write unit, integration, or data quality tests

  Communicate regularly with stakeholders, project managers, quality assurance teams, and other developers regarding progress on long-term technology roadmap

  Recommend systems solutions by comparing advantages and disadvantages of custom development and purchased alternatives

  Key Skills (Domain Expertise)

  0-2 years of experience as a software/data engineer

  Bachelor’s degree in Computer Science, MIS, or Engineering

  Technical Skills Preferred

  Experience with database systems, with knowledge of SQL and NoSQL stores (e.g. MySQL, Oracle, MongoDB, Couchbase, etc.)

  Experience on a team developing sophisticated data driven software platforms

  Experience with relational databases and/or analytical data stores (e.g., Spark, Presto, Pandas)

  Contributing to delivery and support of enterprise software

  Experience with cloud service technologies, ex: AWS

  Experience with container technologies, ex: Docker

  Experience with source control systems, ex: GIT

  Information visualization

  "Big data" systems and analysis

  Experience with data warehouses or data lakes

  Mindset and Attributes

  Strong communication skills with ability to communicate complex technical concepts and align organization on decisions

  Sound problem-solving skills with the ability to quickly process complex information and present it clearly and simply

  Utilizes team collaboration to create innovative solutions efficiently

  #LI-DD1

Comments
Welcome to zdrecruit comments! Please keep conversations courteous and on-topic. To fosterproductive and respectful conversations, you may see comments from our Community Managers.
Sign up to post
Sort by
Show More Comments
SIMILAR JOBS
Truck Care Tire Technician
Req ID: 429151 Address: 222 Elizabeth Lee Parkway Loudon, TN, 37774 Benefits: * Paid Time Off * Flexible Scheduling * 401(k) – 100% match up to 5% * Medical/Dental/Vision Insurance after 30 days * Co
Travel LTC RN in Make
...
Lead Mechanical Engineer
This is the LEAD Mechanical Engineer role - will do primarily the same duties as regular/support ME's but will manage more of the tooling packages and oversight of the design integrity updates to leg
Category Buyer II
Career Area: Procurement Job Description: Your Work Shapes the World at Caterpillar Inc. When you join Caterpillar, you're joining a global team who cares not just about the work we do – but also abo
Senior Director, Global Leader of Support Engineering Management
With over 18,000 employees worldwide, the Microsoft Customer Experience & Success (CE&S) organization is responsible for the strategy, design, and implementation of Microsoft’s end-to-end cus
Warehouse I
...
Workforce Management Business Analyst
Job Description · Create testing and performance summary reports clearly communicating to management all testing results. · Collaborate to prioritize defects to be fixed using an understanding of the
Senior Analyst, Search Engine Optimization
Company Description Digitas is the Networked Experience Agency, built on the vision that we create magnetic experiences that earn the right for brands to exist in human networks. Today, and tomorrow.
Manager, Revenue Cycle
...
Carpenter / Handyman
Carpenter Arrow Exterminators is looking to hire a full-time Carpenter to provide uncompromised service to our customers through proper execution of general carpentry work including gutters, siding,
Copyright 2023-2026 - www.zdrecruit.com All Rights Reserved