ReleaseBytes
gemini Gemini Blog ·

Gemini Live adds visual input for real-time assistance

aiengineer
feature announcement

The Gemini app now features Gemini Live, allowing users to provide visual context through their camera for real-time help. This feature aims to eliminate the need for lengthy descriptions by enabling users to point their camera at objects, error codes, or screens. It supports a variety of use cases, from troubleshooting technical issues to seeking creative advice, and is available for immediate use.

  • →Gemini Live allows real-time visual assistance via camera
  • →Support for screen sharing for app navigation assistance
  • →Versatile use cases including troubleshooting and creative brainstorming
  • →Leverages the real world as a starting point for interaction
Features (3) ›
  • Gemini Live allows real-time visual assistance via camera

    Users can now use the Gemini app's Live icon and camera to provide visual input for immediate assistance. This feature lets users point their camera at objects, error codes, or screens to get help without lengthy descriptions.

  • Support for screen sharing for app navigation assistance

    Gemini Live also supports screen sharing, enabling users to receive help navigating complex applications or interfaces.

  • Versatile use cases including troubleshooting and creative brainstorming

    The feature supports a wide range of applications, from step-by-step repair instructions and organizing advice to brainstorming decor ideas and personalized shopping recommendations.

Notes (1) ›
  • Leverages the real world as a starting point for interaction

    Gemini Live aims to provide real-time help by using the user's immediate physical environment and screen content as the basis for interaction.

Read the original announcement →

https://blog.google/products-and-platforms/products/gemini/gemini-live-camera-how-to/

Related releases