Senior Solutions Architect, Generative AI Deployment and AIOps
AI summary of the role
Senior Solutions Architect focused on deploying Generative AI inference and LLMs for enterprise customers, combining deep technical advisory with hands-on performance optimization of AI workloads on Kubernetes.
What you’ll do
- Partner with solution architects, engineering, product and business teams to define high-value solutions
- Engage with developers, researchers, and data scientists across a range of technical areas
- Strategically partner with lighthouse customers and industry-specific solution partners
- Help customers adopt and build creative solutions using NVIDIA technology and MLOps
What you’ll bring
- BS/MS/PhD in CS, EE, Physics, Math, or related field (or equivalent experience)
- 8+ years hands-on experience with Deep Learning frameworks (PyTorch, TensorFlow)
- Strong programming and software design skills in Python
- Proficiency in GPU orchestration and MIG management within Kubernetes
Technologies
PyTorch · TensorFlow · Kubernetes · MIG · NVIDIA NIM · Dynamo · TensorRT · TensorRT-LLM · CUDA · MLOps
About NVIDIA
Designs and manufactures GPUs and system-on-chips powering data centers, AI workloads, gaming, autonomous vehicles, and HPC. The foundational hardware for modern deep learning.
Public
Source and classification
Technical pre-sales · Evidence for this classification:
NVIDIA is seeking outstanding AI Solutions Architects to assist and support customers that are building solutions with our newest AI technology. At NVIDIA, our solutions architects work across different teams and enjoy helping customers with the latest Accelerated Computing and Deep Learning software and hardware platforms. We're looking to grow our company, and build our teams with the smartest people in the world. Would you like to join us at the forefront of technological advancement? You will become a trusted technical advisor with our customers and work on exciting projects and proof-of-concepts focused on inference for Generative AI and Large Language Models (LLMs). You will also collaborate with a diverse set of internal teams on performance analysis and modeling of inference software. You should be comfortable working in a dynamic environment, and have experience with Generative
More from the job description
NVIDIA is seeking outstanding AI Solutions Architects to assist and support customers that are building solutions with our newest AI technology. At NVIDIA, our solutions architects work across different teams and enjoy helping customers with the latest Accelerated Computing and Deep Learning software and hardware platforms. We're looking to grow our company, and build our teams with the smartest people in the world. Would you like to join us at the forefront of technological advancement? You will become a trusted technical advisor with our customers and work on exciting projects and proof-of-concepts focused on inference for Generative AI and Large Language Models (LLMs). You will also collaborate with a diverse set of internal teams on performance analysis and modeling of inference software. You should be comfortable working in a dynamic environment, and have experience with Generative AI, LLMs and GPU technologies. This role is an excellent opportunity to work in an interdisciplinary team at NVIDIA! What You Will Be Doing: Partnering with other solution architects, engineering, product and business teams. Understanding their strategies and technical needs and helping define high-value solutions Dynamically engaging with developers, scientific researchers, and data scientists, gaining experience across a range of technical areas Strategically partnering with lighthouse cus [... source excerpt omitted ...] creative solutions using NVIDIA technology and MLOps solutions Analyzing performance and power efficiency of AI inference workloads on Kubernetes Some travel to conferences and customers may be required (20%) What We Need To See: BS, MS, or PhD in Computer Science, Electrical/Computer Engineering, Physics, Mathematics, other Engineering or related fields (or equivalent experience) 8+ years of hands-on experience with Deep Learning frameworks such as PyTorch and TensorFlow Strong fundamentals in programming, optimizations, and software design, especially in Python Proficiency in problem-solving and debugging skills in GPU orchestration and Multi-Instance GPU (MIG) manageme [... source excerpt omitted ...] ellent presentation, communication and collaboration skills Ways To Stand Out From The Crowd: Prior experience with DL training at scale, deploying or optimizing DL inference in production Experience with NVIDIA GPUs and software libraries such as NVIDIA NIM, Dynamo, TensorRT, TensorRT-LLM Excellent C/C++ programming skills, including debugging, profiling, code optimization, performance analysis, and test design Familiarity with parallel programming and distributed computing platforms Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD. You will also be eligi
Employer postings · Data from · Sources