Join our every day and weekly newsletters for the newest updates and unique content material on industry-leading AI protection. Learn More
OpenAI has expanded the variety of purposes its desktop apps can work with, together with permitting Advanced Voice Mode to work with different apps, and is shifting nearer to ChatGPT utilizing computer systems.
The desktop app launched integrations in November with an preliminary 4 purposes. During Day 11 of its “12 Days of OpenAI” occasion, OpenAI introduced a number of new built-in improvement environments (IDEs), terminals and textual content apps it can assist.
ChatGPT now helps BBEdit, MatLab, Nova, Script Editor, TextMate as IDEs, VS Code for VSCode Insiders, VSCodium, Cursor, WindSurf, the JetBrains household of IDEs of Android Studio, AppCode, CLion, DataGrip, GoLand, IntelliJ IDEA, PHPStorm, PyCharm, RubyMine, RustRover and WebStorm. It additionally added the Warp and Prompt terminal apps as integration. These purposes be part of VS Code, Xcode, Terminal, iTerm 2 and TextEdit as built-in apps.
But coding purposes gained’t be the one purposes that ChatGPT desktop apps can entry. OpenAI additionally added Apple Notes, Notion and Quip to its integrations. Advanced Voice Mode can work with these purposes, contemplating the context of initiatives within the integrations.
OpenAI emphasised that customers should give ChatGPT permission to entry these purposes.
Letting ChatGPT use your laptop for you
App integrations with AI chatbots are, in fact, nothing new. In October, GitHub Copilot added coding platform integrations. Connecting purposes to ChatGPT or Copilot brings context from these platforms into the chat expertise. Developers can immediate ChatGPT for some coding assist for a undertaking they’ve on VS Code, and the chatbot understands what they’ve been engaged on.
Kevin Weil, chief product officer at OpenAI, stated throughout a stay stream that enhancing the desktop app will assist the corporate get nearer to a extra agentic consumer expertise for ChatGPT.
“We’ve been putting a lot of effort into our desktop apps,” stated Weil. “As our models get increasingly powerful, ChatGPT will more and more become agentic. That means we’ll go beyond just questions and answers; ChatGPT will begin doing things for you.”
He added that the desktop apps “are a big part” of that transformation.
“Being a desktop app you can do much more than you can than just a browser tab,” he stated. “That includes things like, with your permission, being able to see what’s on your screen and being able to automate a lot of the work you’re doing on your desktop. We’ll have a lot more to say on that as we go into 2025.”
If OpenAI lets ChatGPT see extra of your laptop, ChatGPT will get nearer to Anthropic’s Claude Computer Use characteristic, which permits Claude to click on round an individual’s laptop, navigate screens and even sort textual content.
OpenAI already introduced a reasonably comparable characteristic for the cellular model of ChatGPT, though the chatbot can not but entry computer systems or telephones the identical manner. Users can share their screens with the chatbot so it may “see” what they’re studying or . Microsoft and Google additionally developed comparable options with Copilot Vision and Project Astra.
How to entry
On MacOS, customers who need to open ChatGPT whereas utilizing different purposes can use “option + space” to drag up ChatGPT and select the applying they want via a button on the chat display. Another shortcut, “option + shift + 1,” brings up the topmost software used.
From that window, customers may also entry Advanced Voice Mode in the identical manner. Voice mode mechanically detects context from the applying.
Integrations can be found to ChatGPT Plus, Pro, Team, Enterprise and Edu customers. However, Enterprise and Edu subscribers should ask their IT directors to activate the characteristic.
