Minimum qualifications:
Bachelor's degree or equivalent practical experience.
12 years of experience with Google Cloud, SaaS, enterprise, internal tools, or supply chain networks.
5 years of experience building and shipping technical products.
Experience creating product roadmap(s) from conception to launch, driving the product vision, defining the go-to-market strategy, and leading design discussions.
Preferred qualifications: Master's degree or PhD in Computer Science, Electrical Engineering, Mathematics, Statistics, or a related technical field.
Experience with AI/ML training and inference, Large Language Models (LLMs), Gen AI, Open Source Software (OSS) libraries and model gardens, Machine Learning frameworks, and Cloud infrastructure.
Experience with inference frameworks (e.g., vLLM, TensorRT-LLM, DeepSpeed, Hugging Face TGI, etc.).
Understanding of AI/ML infrastructure and the cloud computing business.
Ability to determine market segments, target use cases, and differentiation opportunities by working with Cloud customers and internal research teams.
About the job
At Google, we put our users first. The world is always changing, so we need Product Managers who are continuously adapting and excited to work on products that affect millions of people every day.
In this role, you will work cross-functionally to guide products from conception to launch by connecting the technical and business worlds. You can break down complex problems into steps that drive product development.
One of the many reasons Google consistently brings innovative, world-changing products to market is because of the collaborative work we do in Product Management. Our team works closely with creative engineers, designers, marketers, etc. to help design and develop technologies that improve access to the world's information. We're responsible for guiding products throughout the execution cycle, focusing specifically on analyzing, positioning, packaging, promoting, and tailoring our solutions to our users.
As a Group Product Manager, you will lead the development, launch, and landing of the next-generation AI/ML inference software stack for Cloud TPUs and GPUs. This role has significant scope and potential for impact, spanning all key AI/ML use cases, accelerators, frameworks, and partners.
In this role, you will work with leading AI/ML engineers, researchers, and customers and help them do their work on Google Cloud Platform (GCP). You will be responsible for building the next-generation AI accelerator inference stack and bringing it to market, with the goal of transforming the industry and the Google Cloud business.
Google Cloud accelerates organizations' ability to digitally transform their business with the best infrastructure, platform, industry solutions and expertise. We deliver enterprise-grade solutions that leverage Google's cutting-edge technology - all on the cleanest cloud in the industry. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems.
The US base salary range for this full-time position is $208,000-$306,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.
Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about benefits at Google .
Responsibilities
Define, build, launch, and land the next-generation AI/ML inference software stack for Google Cloud TPUs and GPUs. Own the product strategy, roadmap, and product experience and performance.
Articulate the customer journey and their workflows for AI/ML inference, their pain points and how AI/ML infra can address their constraints.
Understand the technical problems and dependencies, partner with cross-functional teams across GCP and Google to ensure effective product launches and deliver a product experience.
Partner closely with outbound Product Managementteam to bring the AI/ML inference product to market, land it with customers, define and measure success, and bring back learnings to the feature teams to set the product strategy and priorities.