Speaker 1: ChatGPT is about to revolutionize the way we interact with AI with its new features. This update could change the way we think about AI assistance, making it more intuitive, more personalized, and more powerful than ever before. So join us as we uncover these new features of ChatGPT. OpenAI has rolled out video and screen-sharing features within its advanced voice mode, representing a major advancement in user interaction with the ChatGPT platform. These eagerly anticipated additions enhance the multimodal experience, expanding the ways users can engage with the chatbot and leverage its functionalities. These new features are now accessible to ChatGPT Teams, Plus, and Pro users on both iOS and Android mobile applications. This update allows subscribers across these tiers to interact with ChatGPT in a more engaging and dynamic way. OpenAI has also revealed plans to introduce these capabilities to ChatGPT Enterprise and Education, Edu, users starting in January. This gradual rollout aims to provide a wider audience with access to the advanced voice mode along with its video and screen-sharing options. However, users in the European Union, Switzerland, Iceland, Norway, and Liechtenstein will not be able to access advanced voice mode due to regulatory or technical limitations. The path to this enhancement began earlier in 2024, when OpenAI first hinted at its intentions. In May, the company introduced the concept of multimodal interactions with GPT 4.0, showcasing its vision for ChatGPT to watch a game and narrate the events unfolding. This initiative highlighted OpenAI's dedication to making artificial intelligence more flexible and responsive to user demands. By September, the rollout of advanced voice mode marked the beginning of a new era in interactive AI communication. So, what are these newly introduced features and how do they make ChatGPT better? Users can now enjoy video capabilities through newly added buttons on the advanced voice mode screen, simplifying the process of starting a video. This enhancement enriches the ChatGPT experience by facilitating real-time video interactions. OpenAI's video mode mimics the feel of a video call similar to FaceTime, as ChatGPT can interact instantly to what users present on screen. This feature enables ChatGPT to observe the user's surroundings, recognize objects, and even remember individuals who introduced themselves during the conversation. For instance, during OpenAI's 12 Days of Shipmas event, ChatGPT showcased its video functionality by helping with coffee brewing. It recognized the coffee-making tools, offered detailed instructions for placing a filter, and even provided feedback on the final product.

Speaker 2: Next, you'll add your ground coffee to the filter, usually about 2 tablespoons for every 6 ounces of water. Then, you'll gently pour a small amount of hot water onto the grounds to let them bloom for about 30 seconds.

Speaker 1: Great, thanks. What's bloom?

Speaker 2: Blooming allows the coffee to release gas and enhances the flavor. After blooming, slowly pour the rest of the hot water in a circular motion.

Speaker 1: This example demonstrated how video mode can turn everyday tasks into engaging and guided experiences. The capabilities of OpenAI's video mode are reminiscent of Google's newly launched Project Astra. In this project, users can initiate a video call, and the AI, Gemini 2.0, responds to inquiries based on its visual observations. For example, it can identify a sculpture found on a London street and share in-depth information about it. This similarity underscores a rising trend in AI innovation, where real-time visual recognition and responsive features are becoming essential to enhancing user interactions. In numerous ways, the video-based features represent a significant advancement of ideas first introduced by early AI devices, such as the HumanePin and the Rabbit R1. These early gadgets were promoted as AI voice assistants that could answer questions based on their video feed observations. However, OpenAI's video mode and Google's Project Astra elevate this concept by incorporating advanced real-time interaction and contextual comprehension, greatly improving the functionality of these systems. These innovations highlight the potential for AI technologies to provide seamless support in everyday situations. The real-time features of OpenAI's video mode make it an invaluable resource for a wide range of applications, from simple object recognition to intricate tasks like offering cooking instructions or product assembly guidance. ChatGPT's ability to remember individuals who introduce themselves during video calls adds a personal element, effectively narrowing the divide between human-like engagement and AI capabilities. This progression in AI communication signifies a move toward making technology more intuitive and responsive to human requirements. By allowing ChatGPT to perceive and interpret the world through video, OpenAI has developed a feature that not only broadens the chatbot's functionality, but also aligns with the growing trend of embedding AI into daily life. With this groundbreaking advancement, OpenAI continues to redefine the possibilities of AI, providing users with an engaging and practical tool for real-time support and interaction. Now, let's take a look at the next mind-blowing feature introduced to ChatGPT by OpenAI. In a bid to spread holiday joy, OpenAI has rolled out a whimsical feature known as Santa Mode, within its advanced voice settings. This special voice setting captures the cheerful tone and personality of Santa Claus, embodying the warm and merry spirit that fans of the jolly figure have come to love. With this festive addition, OpenAI seeks to enhance the ChatGPT experience, perfectly aligning it with the joyous atmosphere of the season. What sets Santa Mode apart from some of the other recent features is its wide accessibility. It's available to all users who can access the advanced voice mode, whether they're on the mobile app, the web version, or the desktop applications for Windows and macOS. This ensures that a diverse array of users can engage with ChatGPT in this festive manner. However, it's important to note that Santa Mode is a temporary feature, available only until early January, making it a special treat for the holiday season. A key highlight of Santa Mode is its approach to chat data. Conversations held in this festive mode are not recorded in the chat history and do not affect ChatGPT's memory. This means users can enjoy their interactions with Santa without any concerns about those chats impacting future conversations or being saved for later. By implementing this feature, OpenAI has successfully created an experience that emphasizes fun and spontaneity while safeguarding user privacy. The introduction of Santa Mode highlights OpenAI's commitment to integrating seasonal themes into its offerings, creating features that are not only functional but also fun. This mode invites users to enjoy a unique experience, infusing their interactions with ChatGPT with a playful and festive spirit. Whether users are seeking gift suggestions from Santa, sharing holiday tales, or simply delighting in the charm of the chatbot's jolly voice, Santa Mode delivers an engaging and memorable experience. This sensational feature also showcases OpenAI's adaptability in reflecting cultural moments, making ChatGPT more relatable and enjoyable for its audience. By incorporating Santa Mode, the company illustrates that advanced AI can transcend its primary functions to foster joy and connection even in a digital environment. With the launch of Santa Mode, OpenAI not only embraces the holiday spirit but also demonstrates the flexibility of its voice technology. The friendly and cheerful essence of this feature serves as a reminder that technology can enhance human experiences in imaginative and delightful ways. This initiative embodies the company's aim to sprinkle a bit of holiday cheer into users' lives, merging innovation with tradition in a refreshing and enjoyable manner. Santa Mode encapsulates the joy of the season, providing users with a charming and unforgettable way to interact with ChatGPT during the holidays. Through this festive addition, OpenAI infuses a sense of magic, proving that even the most advanced technology can partake in the joy of Christmas. The newly introduced screen-sharing feature significantly expands ChatGPT's functionality, allowing it to operate beyond its dedicated app and engage directly with browser activities. This enhancement makes the chatbot more adaptable and suitable for a wider array of tasks. Users can activate screen share through a convenient three-dot menu in the ChatGPT app, enabling them to transition smoothly from the app to other applications on their devices. This feature allows users to open various apps on their smartphones and pose questions to ChatGPT about what it sees on the screen. For example, during a demonstration by OpenAI, researchers illustrated this capability by accessing the Messages app and seeking ChatGPT's help in crafting a response to a photo received via text. This real-world application underscores how the feature can streamline user interactions and deliver immediate, context-sensitive assistance. The Advanced Voice Mode screen-sharing function shares similarities with recent innovations from Microsoft and Google. Microsoft, for instance, has rolled out a preview of Co-Pilot Vision, which enables pro subscribers to start a co-pilot chat while browsing. This feature can analyze images on a webpage, aid in shopping choices or enhance gameplay in map-based games like GeoGuessr. Likewise, Google's Project Astra provides similar capabilities, allowing AI to interpret browser content and offer insights or answers based on its observations. Both OpenAI and Google have launched these screen-sharing functionalities on mobile devices, catering to users who rely on AI tools while on the move. By allowing users to incorporate ChatGPT or Gemini into their daily mobile activities, these companies are addressing the increasing demand for accessible and practical AI support. These tools are especially beneficial for those needing quick, immediate assistance in tasks like replying to messages, analyzing images, or navigating intricate applications. The visible benefits of screen-sharing features for consumers are clear, but this advancement also signals a larger trend that could impact enterprise applications. By enabling AI agents to observe user interactions on screens, businesses might harness this capability for advanced collaboration. For example, companies could implement screen-sharing to optimize workflows, allowing AI agents to offer real-time feedback or recommendations based on what's displayed. This could lead to a more integrated use of AI tools within professional settings. Now, these developments suggest exciting future possibilities, including models that can actively interact with a computer's interface. A case in point is Anthropic's Computer Use feature, which proposes that AI models could move beyond mere observation to perform tasks like opening tabs and launching applications for users. Such advancements could fundamentally change how individuals engage with technology, shifting AI from a passive helper to an active partner in digital endeavors. The rollout of screen-sharing in ChatGPT marks a notable achievement in AI functionality, merging ease-of-use with state-of-the-art technology. Whether aiding users with mobile tasks or setting the stage for collaborative efforts in the workplace, this feature illustrates the changing landscape of AI in everyday life and its potential to redefine human-technology interactions. If you've made it this far, let us know what you think in the comment section below. For more interesting topics, make sure you watch the recommended video that you see on the screen right now. Thanks for watching.