Intelligent Cameras, Multi-Stream & Cloud IntelliFrame for Microsoft Teams Rooms

by HubSite 365 about Microsoft

Software Development Redmond, Washington

Pro UserTeamsLearning Selection

Explore Microsofts enhanced Teams Meeting experience with IntelliFrame technology, AI-powered cameras, and cloud capabilities for seamless hybrid meetings.

Microsoft Teams now offers an enhanced meeting experience with the use of intelligent cameras and Microsoft Cloud IntelliFrame. Most cameras in Teams Rooms offer a default view of the entire room, or an auto-framing group shot. However, this can often make it hard for remote participants to follow the meeting effectively. Intelligent camera features aim to address this, with innovations to transform hybrid meetings.

IntelliFrame is an AI-powered video gallery that provides participants in a Teams Room a virtual presence in hybrid meetings. It breaks down into two different approaches: Multi-stream IntelliFrame and Cloud IntelliFrame. The former is produced by AI from Microsoft and Original Equipment Manufacturers (OEMs) running on intelligent cameras on the edge, while the latter is produced by Microsoft AI in the cloud using camera hardware without AI-powered edge capabilities.

Multi-stream IntelliFrame on Intelligent Cameras: This technology provides high-resolution IntelliFrame video tiles, people recognition, active speaker tracking, and a room view. It sends individual video feeds of attendees in a Teams Room to the Teams meeting stage. Recognizing the individual facilitates their own video streams with name labels. Remote users also see a standard or panoramic view of the room for context. This is achieved through advancements in AI capabilities on edge devices.
Intelligent Camera APIs and technologies are available to OEM partners. Front-of-room Jabra Panacast 50 camera and the center-of-room Yealink SmartVision 60 camera are examples of devices utilizing this technology. These cameras identify in-room participants in meeting transcripts and captions, enhancing accuracy.
Cloud IntelliFrame: For those without intelligent cameras, Cloud IntelliFrame offers a more personalized meeting feel. It breaks the wide group shot into a composite view made up of individual video tiles. While this experience doesn't offer people recognition or active speaker tracking, it enhances the view of remote participants. This technology depends on Microsoft-built AI models running in the Microsoft Cloud.

Integrating Microsoft AI to Improve Hybrid Meeting Experiences

Microsoft's development of active speaker tracking system and room view formats have made meetings more inclusive and easy to follow. The company has collaborated with various OEMs to manufacture intelligent cameras designed with Microsoft AI, offering premier hybrid experiences in meetings. Examples of these devices include Yealink's SmartVision 60 and Jabra's PanaCast 50. Microsoft's IntelliFrame is available to Teams Rooms Pro license holders and they plan to further enrich IntelliFrame capabilities to deliver superior Teams meeting experiences.

Read the full article A deep dive into intelligent cameras Multi-Stream and Cloud IntelliFrame for Teams Rooms

Learn about A deep dive into intelligent cameras Multi-Stream and Cloud IntelliFrame for Teams Rooms

The main topic of the text revolves around the "IntelliFrame” function for Microsoft Teams Rooms, which aims to improve the videoconference experience for users in shared physical spaces. The majority of cameras used within Microsoft Teams currently encompass a wide group shot of all meeting attendees, making it difficult for some remote participants to see individual faces, follow who is speaking at any given moment, or obtain a comprehensive view of the physical space.

Microsoft's solution is to improve this experience using intelligent cameras and the Cloud IntelliFrame feature. This AI-driven amenity is designed to enhance the gallery view experience during a remote meeting. This can be experienced in a variety of methods, namely: the Multi-stream IntelliFrame (produced by Microsoft’s AI and intelligent camera capabilities) and the Cloud IntelliFrame (produced by Microsoft AI within the cloud using camera hardware deprived of AI-powered edge capabilities).

Keywords

Microsoft expert advice, Microsoft Teams Rooms guide, Intelligent camera features, Microsoft Cloud IntelliFrame, AI in Microsoft Teams Rooms