Senior Software Engineer, XR World Context

Google's software engineers develop next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products handle information at massive scale and extend well beyond web search. As a software engineer, you will work on a specific project critical to Google’s needs, with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. The XR team is at the forefront of the convergence of AI and XR, building a future where lightweight XR devices like smart glasses and headsets pair with helpful AI to augment human intelligence, offering personalized, conversational, and contextually aware experiences.

• Design, implement, and deploy lightweight scene representations to capture world-facing context signals and enable contextual triggers and panel placement for XR glasses.
• Create suitable ego-centric datasets, as well as the fusion and evaluation of different foundation models for building robust object- and scene-centric representations in real-time.
• Interface these representations with Gemini/Gemma variants to unlock context-aware AI capabilities, such as voice-based spatial placement and on-device scene understanding for Spatial Gemini.
• Create and curate suitable ego-centric datasets, as well as the fusion and evaluation of different foundation models for building robust object- and scene-centric representations in real-time.