Intelligent Cameras, Multi-Stream & Cloud IntelliFrame for Microsoft Teams Rooms

Microsoft Teams now offers an enhanced meeting experience with the use of intelligent cameras and Microsoft Cloud IntelliFrame. Most cameras in Teams Rooms offer a default view of the entire room, or an auto-framing group shot. However, this can often make it hard for remote participants to follow the meeting effectively. Intelligent camera features aim to address this, with innovations to transform hybrid meetings.

IntelliFrame is an AI-powered video gallery that provides participants in a Teams Room a virtual presence in hybrid meetings. It breaks down into two different approaches: Multi-stream IntelliFrame and Cloud IntelliFrame. The former is produced by AI from Microsoft and Original Equipment Manufacturers (OEMs) running on intelligent cameras on the edge, while the latter is produced by Microsoft AI in the cloud using camera hardware without AI-powered edge capabilities.

• Multi-stream IntelliFrame on Intelligent Cameras: This technology provides high-resolution IntelliFrame video tiles, people recognition, active speaker tracking, and a room view. It sends individual video feeds of attendees in a Teams Room to the Teams meeting stage. Recognizing the individual facilitates their own video streams with name labels. Remote users also see a standard or panoramic view of the room for context. This is achieved through advancements in AI capabilities on edge devices.
• Intelligent Camera APIs and technologies are available to OEM partners. Front-of-room Jabra Panacast 50 camera and the center-of-room Yealink SmartVision 60 camera are examples of devices utilizing this technology. These cameras identify in-room participants in meeting transcripts and captions, enhancing accuracy.
• Cloud IntelliFrame: For those without intelligent cameras, Cloud IntelliFrame offers a more personalized meeting feel. It breaks the wide group shot into a composite view made up of individual video tiles. While this experience doesn't offer people recognition or active speaker tracking, it enhances the view of remote participants. This technology depends on Microsoft-built AI models running in the Microsoft Cloud.

Integrating Microsoft AI to Improve Hybrid Meeting Experiences

Microsoft's development of active speaker tracking system and room view formats have made meetings more inclusive and easy to follow. The company has collaborated with various OEMs to manufacture intelligent cameras designed with Microsoft AI, offering premier hybrid experiences in meetings. Examples of these devices include Yealink's SmartVision 60 and Jabra's PanaCast 50. Microsoft's IntelliFrame is available to Teams Rooms Pro license holders and they plan to further enrich IntelliFrame capabilities to deliver superior Teams meeting experiences.

Read the full article A deep dive into intelligent cameras Multi-Stream and Cloud IntelliFrame for Teams Rooms

Learn about A deep dive into intelligent cameras Multi-Stream and Cloud IntelliFrame for Teams Rooms

The main topic of the text revolves around the "IntelliFrame” function for Microsoft Teams Rooms, which aims to improve the videoconference experience for users in shared physical spaces. The majority of cameras used within Microsoft Teams currently encompass a wide group shot of all meeting attendees, making it difficult for some remote participants to see individual faces, follow who is speaking at any given moment, or obtain a comprehensive view of the physical space.

Microsoft's solution is to improve this experience using intelligent cameras and the Cloud IntelliFrame feature. This AI-driven amenity is designed to enhance the gallery view experience during a remote meeting. This can be experienced in a variety of methods, namely: the Multi-stream IntelliFrame (produced by Microsoft’s AI and intelligent camera capabilities) and the Cloud IntelliFrame (produced by Microsoft AI within the cloud using camera hardware deprived of AI-powered edge capabilities).

More links on about A deep dive into intelligent cameras Multi-Stream and Cloud IntelliFrame for Teams Rooms

A deep dive into intelligent cameras Multi-Stream and ...

6 hours ago — A multi-stream IntelliFrame camera sends individual video feeds of attendees in a Teams Room to the Teams meeting stage, identifying the person ...

Hagen Deike's Post

2 days ago — You can experience IntelliFrame in your Teams Rooms in a variety of ways, ... A deep dive into intelligent cameras Multi-Stream and Cloud ...

Ignite 2022's biggest Microsoft 365 announcements ...

Oct 13, 2022 — In this week's show, Paul Robichaux and I take a short break from Ignite 2022 to discuss the biggest announcements, and take a deep dive ...

9 Game-Changing Ways Microsoft Business Central Beats ...

Aug 18, 2023 — A deep dive into intelligent cameras Multi-Stream and Cloud IntelliFrame for Teams Rooms ... When you join a meeting in Microsoft Teams, what do ...

Multi-Stream IntelliFrame for Teams Rooms on Windows ...

Jul 20, 2023 — IntelliFrame is a combination of AI features that distinguishes participants in the room, performs intelligent zooming, framing, and centering ...

Microsoft Teams Rooms gets Cloud IntelliFrame, AI ...

Jun 14, 2023 — For customers with intelligent cameras, the multiple video stream capability and AI-powered active speaker tracking feature is coming soon. With ...

Keywords

Microsoft expert advice, Microsoft Teams Rooms guide, Intelligent camera features, Microsoft Cloud IntelliFrame, AI in Microsoft Teams Rooms