Senior Performance Engineer - Deep Learning Job at NVIDIA, Santa Clara, CA

eWxtZDlkcmJDcnJEN3VQT1M5TFhaODVYYkE9PQ==
  • NVIDIA
  • Santa Clara, CA

Job Description

NVIDIA is hiring senior software engineers to build and optimize the tools Deep Learning engineers use across the world to design, develop, and deploy AI applications. We are an ambitious, forward-thinking and diverse team that influences all areas of NVIDIA's AI platform and directly contributes to premiere Deep Learning frameworks - PyTorch, JAX and TensorFlow. We work with multiple teams both inside and outside of NVIDIA across fields, as well as collaborate with the open-source community to optimize the best AI platform in the world!

What you will be doing:

  • Develop and optimize open-source libraries, like Transformer Engine, which enables the fastest training of Large Language Models using low precision data formats, and TensorFlow Distributed Embeddings, providing ability to easily scale training of huge recommender systems on multiple GPUs.

  • Study and tune Deep Learning training workloads at large scale, including important enterprise models.

  • Build and support NVIDIA submissions to community benchmarks like MLPerf.

  • Optimize the performance of influential, modern Deep Learning models coming out of academic and industry research, for NVIDIA GPUs and systems.

  • Explore new technologies and advise design of new hardware generations and core platform software components.

What we need to see:

  • BS in Computer Science, Electrical Engineering or a related field (or equivalent experience).

  • Demonstrated ability with 6+ years of C++ and Python programming.

  • Strong background with parallel programming, preferably on GPUs.

  • Knowledge of Computer Architecture and/or Operating Systems.

  • Proven experience developing large software projects.

  • Excellent verbal and written communication skills.

Ways to stand out from the crowd:

  • Experience with Deep Learning Frameworks, like PyTorch, JAX, Tensorflow or MXNet.

  • Experience training language models.

  • Background with performance analysis and profiling of workloads.

  • Participation in the open-source community.

  • Proven experience working with multidisciplinary teams.

The base salary range is 180,000 USD - 339,250 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits . NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

#deeplearning

Job Tags

Full time,

Similar Jobs

Four Ports Logistics, LLC

Trucking Dispatcher Job at Four Ports Logistics, LLC

 ...Job Description Job Description Dispatcher - Trucking Looking for a dispatcher for small trucking company. We are looking for someone with container, flat bed and reefer experience. Please send in resume to be considered. Are you a highly motivated, energetic... 

VIRGO & ARIES LLC

Remote Customer Service Representative Job at VIRGO & ARIES LLC

 ...Join Our Remote Dream Team - Deliver Outstanding Customer Service from our select locations! Are you a customer-focused superstar with...  ...of Virgo and Aries LLC! PC Laptop (No Chromebooks or Mac/Apple Computers) Hard-Wired Internet Connection (Must have a reliable... 

WellQuest Living Palo Alto

Summer Audit Data Analyst Intern Job at WellQuest Living Palo Alto

We are seeking an Audit Data Analyst Intern who is passionate about combining auditing with data analytics. This role involves applying...  ...AND EXPERIENCE: Currently pursuing a degree in Data Science, Accounting, Finance, Information Systems, or a related field... 

Gold Standard Staffing

Warehouse Assoicate Distribution Center Specialist Livonia Michigan $16.50/hr 1st Shift Job at Gold Standard Staffing

 ...moving position. Cleaning Other duties as required Dirty Job-oily-apron is supplied if desired Minimum Skills/Mandatory Skills/Experience Needed for Hire: Able bodied. Read, write, and speak English. No Educational requirement. No experience needed. Will train.... 

Austin Bridge

QCQA Tech I - Austin Bridge & Road Job at Austin Bridge

 ...Austin Bridge & Road has an outstanding opportunity for QC / QA Techs for our projects in the DFW Area. The Quality Control Technician provides first-class quality control field observation / daily reporting services and assists the Project Leadership team with day-to-...