Home
/
Comprehensive
/
Software Engineer, Torch-TensorRT Inference
Software Engineer, Torch-TensorRT Inference-May 2024
Santa Clara
May 14, 2026
ABOUT NVIDIA
NVIDIA is a computing platform company, innovating at the intersection of graphics, HPC, and AI.
10,000+ employees
Technology
VIEW COMPANY PROFILE >>
About Software Engineer, Torch-TensorRT Inference

  We are looking for outstanding Software Engineers for Torch-TensorRT Inference framework! As a member of our Torch-TensorRT Engineering team, you will use groundbreaking NVIDIA deep learning model inference software libraries for deployment on NVIDIA's hardware architecture. You will develop a deep learning compiler and optimize DNN graphs in lower precision using NVIDIA TensorRT!

  We work on innovative vision and language models to ensure they are accelerated by Torch-TensorRT. In addition, we contribute to our open-source library and have opportunities to present our work at conferences.

  What you will be doing:

  Develop components of Torch-TensorRT, NVIDIA's SDK for high-performance deep learning inference along with PyTorch

  Use C++, Python and CUDA to build graph parsers, converters, compiler, and tools for effective deployment of trained deep learning models.

  Work with cross-collaborative teams of deep learning software engineers and GPU architects to innovate across applications like autonomous driving, NLP, and computer vision.

  What we need to see:

  A BS, MS or PhD in Computer Architecture, Computer Science, Electrical Engineering or related field or equivalent experience

  5+ years of work related experience in software development or Machine learning or high-performance computing

  2+ years of experience in developing or using deep learning frameworks (e.g., PyTorch, TensorFlow, ONNX, etc.)

  Strong C++ programming skills including debugging, performance analysis, test design, and optimizations.

  Strong understanding of build/release systems, CI/CD, and experience with solutions like Gitlab, Github, etc.

  Ways to stand out from the crowd:

  Familiarity with sophisticated C++11/C++14 language features and CUDA kernel programming.

  Experience working in an open-source and software development on Windows.

  Strong time-management and organization skills for coordinating multiple initiatives, priorities and implementations of new technology and products into very complex projects.

  The base salary range is 116,000 USD - 270,250 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

  You will also be eligible for equity and benefits (https://www.nvidia.com/en-us/benefits/) . NVIDIA accepts applications on an ongoing basis.

  NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

  NVIDIA is a Learning Machine

  NVIDIA pioneered accelerated computing to tackle challenges no one else can solve. Our work in AI and the metaverse is transforming the world's largest industries and profoundly impacting society.

  Learn more about NVIDIA .

Comments
Welcome to zdrecruit comments! Please keep conversations courteous and on-topic. To fosterproductive and respectful conversations, you may see comments from our Community Managers.
Sign up to post
Sort by
Show More Comments
SIMILAR JOBS
Client Service Representative (Overnight)
Client Service Representative VCA Emergency Animal Hospital & Referral Center located at 2317 Hotel Cir S, San Diego, CA 92108 is growing! We are a fast-paced, 24-hour emergency/specialty referra
Security Officer - Full Time
Allied Universal®, North America’s leading security and facility services company, provides rewarding careers that give you a sense of purpose. While working in a dynamic, diverse and inclusive workp
Purina Feed Sales Representative-R-29483
Purina Feed Sales RepresentativeWe're hiring aLifestyle Production Specialist to focus on horse, beef cattle, small ruminant, poultry feed sales with our partner dealer in the Central Georgiamarkets.
Flex Merchandiser
Flex Merchandiser Date Posted: 01/02/2024 Apply Employee Type:Part Time Location:Red Creek, NY Pay Rate:16.5 Date Posted: 01/02/2024 Job ID: 120962 Job Description Retail Merchandisers Needed! Earn $
Strategic Sourcing Manager - 5042595004_9-6854
This job was posted by https://idahoworks.gov : For more information,please see: https://idahoworks.gov/jobs/2155794 Cribl does differently. What does that mean? It means we are a serious company tha
Teller Full Time Marin County
Why Wells Fargo: Are you ready for the next step in your career? This is where it begins - at a company known for our Well Life approach to supporting employees' career aspirations, work-life balance
Information Security Specialist (Remote Option)
36712BR Requisition ID: 36712BR Business Unit: COR Job Description: CDM Smith is seek an Information Security Specialist to join our corporate Business Technology team. Under general supervision, per
Senior Technical Support Engineer - Focused Services
Our Mission At Palo Alto Networks® everything starts and ends with our mission: Being the cybersecurity partner of choice, protecting our digital way of life. Our vision is a world where each day is
Programmer 1, App Programming (Temporary)
Every great story has a new beginning, and yours starts here. Welcome to Warner Bros. Discovery… the stuff dreams are made of. Who We Are… When we say, “the stuff dreams are made of,” we’re not just
Engineering Equipment Operator (Fire)
Summary The position is in Gautier, MS for the Mississippi Sandhill Crane NWR will be filled under the Office of Personnel Management's Direct Hire Authority and is open to all United States citizens
Copyright 2023-2026 - www.zdrecruit.com All Rights Reserved