Home
/
Comprehensive
/
Senior HPC Performance Engineer
Senior HPC Performance Engineer-November 2024
Santa Clara
Nov 17, 2026
ABOUT NVIDIA
NVIDIA is a computing platform company, innovating at the intersection of graphics, HPC, and AI.
10,000+ employees
Technology
VIEW COMPANY PROFILE >>
About Senior HPC Performance Engineer

  NVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High Performance Computing and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services. Our work opens up new universes to explore, enables amazing creativity and discovery, and powers what were once science fiction inventions from artificial intelligence to autonomous cars.

  We are the GPU Communications Libraries and Networking team at NVIDIA. We deliver libraries like NCCL, NVSHMEM, UCX for Deep Learning and HPC. We are looking for a motivated Performance engineer to influence the roadmap of our communication libraries. The DL and HPC applications of today have a huge compute demand and run on scales which go up to tens of thousands of GPUs. The GPUs are connected with high-speed interconnects (eg. NVLink, PCIe) within a node and with high-speed networking (eg. Infiniband, Ethernet) across the nodes. Communication performance between the GPUs has a direct impact on the end-to-end application performance; and the stakes are even higher at huge scales! This is an outstanding opportunity for someone with HPC and performance background to advance the state of the art in this space. Are you ready for to contribute to the development of innovative technologies and help realize NVIDIA's vision?

  What you will be doing:

  Conduct in-depth performance characterization and analysis on large multi-GPU and multi-node clusters.

  Study the interaction of our libraries with all HW (GPU, CPU, Networking) and SW components in the stack

  Evaluate proof-of-concepts, conduct trade-off analysis when multiple solutions are available

  Triage and root-cause performance issues reported by our customers

  Collect a lot of performance data; build tools and infrastructure to visualize and analyze the information

  Collaborate with a very dynamic team across multiple time zones

  What we need to see:

  M.S. (or equivalent experience) or PHD in Computer Science, or related field with relevant performance engineering and HPC experience

  3+ yrs of experience with parallel programming and at least one communication runtime (MPI, NCCL, UCX, NVSHMEM)

  Experience conducting performance benchmarking and triage on large scale HPC clusters

  Good understanding of computer system architecture, HW-SW interactions and operating systems principles (aka systems software fundamentals)

  Implement micro-benchmarks in C/C++, read and modify the code base when required

  Ability to debug performance issues across the entire HW/SW stack. Proficient in a scripting language, preferably Python

  Familiar with containers, cloud provisioning and scheduling tools (Kubernetes, SLURM, Ansible, Docker)

  Adaptability and passion to learn new areas and tools. Flexibility to work and communicate effectively across different teams and timezones

  Ways to stand out from the crowd:

  Practical experience with Infiniband/Ethernet networks in areas like RDMA, topologies, congestion control

  Experience debugging network issues in large scale deployments

  Familiarity with CUDA programming and/or GPUs

  Experience with Deep Learning Frameworks such PyTorch, TensorFlow

  The base salary range is 144,000 USD - 270,250 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

  You will also be eligible for equity and benefits (https://www.nvidia.com/en-us/benefits/) . NVIDIA accepts applications on an ongoing basis.

  NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

  NVIDIA is a Learning Machine

  NVIDIA pioneered accelerated computing to tackle challenges no one else can solve. Our work in AI and the metaverse is transforming the world's largest industries and profoundly impacting society.

  Learn more about NVIDIA .

Comments
Welcome to zdrecruit comments! Please keep conversations courteous and on-topic. To fosterproductive and respectful conversations, you may see comments from our Community Managers.
Sign up to post
Sort by
Show More Comments
SIMILAR JOBS
Postdoctoral Scientist - Ainsworth Lab - Division of Rheumatology/Kao Autoimmunity Institute
Job Description Are you looking to contribute to groundbreaking research? We look forward to having you join our team! Cedars-Sinai is an international leader in biomedical research, we translate dis
ENGINEERING TECHNICIAN 4
ENGINEERING TECHNICIAN 4 Location: Newport News, Virginia, United States Date: Jan 17, 2024 Req ID: 35597 Team: O04 QUAL ASSUR ENG Entity: Newport News Shipbuilding US Citizenship Required for this P
Baker
Baker: NOTE: This Dunkin' Donuts restaurant is independently owned and operated under a franchise granted by DD Franchising LLC. You are applying for work with a franchisee of Dunkin' Donuts, not Dun
Business Finance Analyst
REM Community Services , a part of the Sevita family , provides community-based services for individuals with intellectual and developmental disabilities. Here we believe every person has the right t
Senior Analyst, Security Risk Management (Client Assurance)
Bring your heart to CVS Health. Every one of us at CVS Health shares a single, clear purpose: Bringing our heart to every moment of your health. This purpose guides our commitment to deliver enhanced
APRN PA I Medical Care at Home and Transitional Care - (Full Time, South-Side/Akron)
Cleveland Clinic Primary Care Institute is looking to add a Physician Assistant or Nurse Practitioner to our Medical Care at Home APP team. This position works with the Medical Care at Home and the H
Werkstudent*in (w/m/d) im Bereich strategischer Einkauf
Job Family: Internal Services Req ID: 403743 Art der Anstellung: Befristet; 15 – 20 Stunden/Woche In Richtung Zukunft? Bitte einsteigen. Wie werden wir in Zukunft miteinander kommunizieren, Energien
Dreamlifter Operations - Supplier Integrator
Job Description At Boeing, we innovate and collaborate to make the world a better place. From the seabed to outer space, you can contribute to work that matters with a company where diversity, equity
Full-Time Assistant Store Manager
When you join our team as an Assistant Store Manager, you’ll take on key store management responsibilities including assisting with supervising day-to-day store activities, ensuring overall store per
Associate Director, U.S. Oncology Marketing Scientific Strategy Women's Cancers (Alliances)
Job Description Our Company's Oncology Marketing team is passionate about bringing our medicines and vaccines to our customers around the world. Our Company and the alliance company entered into a st
Copyright 2023-2026 - www.zdrecruit.com All Rights Reserved