Home
/
Comprehensive
/
Big Data Lead Engineer
Big Data Lead Engineer-March 2024
Pune
Mar 28, 2026
About Big Data Lead Engineer

  56319BR

  Title:

  Big Data Lead Engineer

  Job Description:

  Quest Global is an organization at the forefront of innovation and one of the world’s fastest growing engineering services firms with deep domain knowledge and recognized expertise in the top OEMs across seven industries. We are a twenty-five-year-old company on a journey to becoming a centenary one, driven by aspiration, hunger and humility.

  We are looking for humble geniuses, who believe that engineering has the potential to make the impossible, possible; innovators, who are not only inspired by technology and innovation, but also perpetually driven to design, develop, and test as a trusted partner for Fortune 500 customers.

  As a team of remarkably diverse engineers, we recognize that what we are really engineering is a brighter future for us all. If you want to contribute to meaningful work and be part of an organization that truly believes when you win, we all win, and when you fail, we all learn, then we’re eager to hear from you.

  The achievers and courageous challenge-crushers we seek, have the following characteristics and skills:

  Roles & Responsibilities:

  Develop high quality, secure and scalable data pipelines using spark, Scala/ python/ Java on Hadoop or object storage.

  Design and architect data flow schemes in Hadoop environment which can be scalable, repeatable and eliminate time consuming steps.

  Drive automation and efficiency in Data ingestion, data movement and data access workflows by innovation and collaboration.

  Understand, implement, and enforce Software development standards and engineering principles in the Big Data space.

  Work closely with business stakeholders and embedded engineering teams within business teams in a collaborative manner to help them build scalable products in quick time.

  Leverage new technologies and approaches to innovating with increasingly large data sets.

  Work with project team to meet scheduled due dates, while identifying emerging issues and recommending solutions for problems.

  Perform assigned tasks and production incident independently.

  Contribute ideas to help ensure that required standards and processes are in place and actively look for opportunities to enhance standards and improve process efficiency.

  Required Skills (Technical Competency):

  10-16 years of experience in Data Warehouse related projects in product or service-based organization

  Expertise in Data Engineering and implementing multiple end-to-end DW projects in Big Data Hadoop environment

  Experience of building data pipelines through Spark with Scala/Python/Java on Hadoop or Object storage

  Experience of working with Databases like Oracle, Hadoop and have strong SQL knowledge

  Experience of working on real time data flow system, NiFi and Kafka will be an added advantage

  Experience of working on automation in data flow process in a Big Data environment.

  Experience of working in Agile teams

  Strong analytical skills required for debugging production issues, providing root cause, and implementing mitigation plan

  Strong communication skills - both verbal and written – and strong relationship, collaboration skills and organizational skills

  Ability to multi-task across multiple projects, interface with external / internal resources and provide technical leadership to junior team members

  Ability to be high-energy, detail-oriented, proactive, and able to function under pressure in an independent environment along with a high degree of initiative and self-motivation to drive results

  Ability to quickly learn and implement new technologies, and perform POC to explore best solution for the problem statement

  Flexibility to work as a member of a matrix based diverse and geographically distributed project teams

  Auto req ID:

  56319BR

  Job Type:

  Full Time-Regular

  Assignment Country:

  India

  Total Years of Exp:

  10 - 15 Yrs

  Assignment State:

  Maharashtra

  Assignment Location:

  Pune

  Experience Level:

  Mid Level

Comments
Welcome to zdrecruit comments! Please keep conversations courteous and on-topic. To fosterproductive and respectful conversations, you may see comments from our Community Managers.
Sign up to post
Sort by
Show More Comments
SIMILAR JOBS
Employee Benefits Compliance Specialist
ABOUT HUB INTERNATIONAL: HUB International Limited (“HUB”) is the 5th largest global insurance and employee benefits broker, providing a broad array of property, casualty, risk management, life and h
Store Scanning Specialist
The pricing intelligence pioneer, RetailData is hiring immediately in your area! Are you retired, want extra income, have extra time on your hands and want to stay active? Retirees are welcome and en
quality inspection day shift
quality inspection day shift. scottsville , kentucky posted 5 days ago job details summary $12.99 - $13 per hour temp to perm no requirements category production occupations referenceAB_4450634 job d
forklift operator
...
Lead Community Resource Center
Lead Community Resource Center Job Category: Customer Service Department: Community Resource Center-Panorama Location: Panorama City, CA, US, 91402 Position Type: Full Time Requisition ID: 10673 Sala
Senior Electrical Engineer
Company Overview Wherever you work and whatever role you fill, when you represent the Bridgestone name you know that you are a valued teammate who is part of our larger mission to “Serve Society with
Automotive Technician
Company Overview Bridgestone Retail Operations (BSRO) is part of Bridgestone Americas and employs over 22,000 teammates in North America. BSRO operates more than 2,200 company-owned stores, including
Laboratory Technician or Clinical Laboratory Scientist - 743999950163173-7597
This job was posted by https://www.kansasworks.com : For moreinformation, please see: https://www.kansasworks.com/jobs/12814776 Company Description With over 30 years of specialized expertise in infe
Training Co-Op
Home (https://careers.loreal.com/en_US/content/Home) / Job Search (https://careers.loreal.com/en_US/jobs/SearchJobs) / 172116 Training Co-Op North Little Rock, AR, Arkansas Apply now (https://careers
L&D Specialist, Associate Training Automation (ATA)
Description The Associate Training Automation (ATA) team supports over 1 million level 1 operations associates with process path training. ATA owns programs that provide learning experiences across t
Copyright 2023-2026 - www.zdrecruit.com All Rights Reserved