Back to news
I tried Copilot Vision, and it could change how you use Windows forever
@Source: techradar.com
Skip to main content
TechRadar the technology experts
Search TechRadar
View Profile
België (Nederlands)
Deutschland
North America
US (English)
Australasia
New Zealand
Tech Radar Pro
Tech Radar Gaming
Nintendo Switch 2 Direct LIVE
Nintendo Switch 2
NYT Wordle today
Best laptop
Artificial Intelligence
I tried Copilot Vision, and it could change how you use Windows forever
Lance Ulanoff
4 April 2025
A view into your desktop
When you purchase through links on our site, we may earn an affiliate commission. Here’s how it works.
(Image credit: Future / Lance Ulanoff)
Adding eyes to artificial intelligence is always a tricky thing. Do you want it to see everything you're doing all the time? Certainly not, but I think most of us agree that an AI visual assist when you need it could come in quite handy. Microsoft's new Copilot Vision may be one of the most promising applications of AI-based visual capabilities I've seen yet.
Microsoft unveiled the Copilot Vision update for its Windows App and mobile apps (you can point your camera at things, and Vision can identify them for you) during a splashy, combined Copilot and Microsoft 50th Anniversary event.
Copilot all but got a brain transplant, using both homegrown (Microsoft AI or MAI) and OpenAI GPT generative models to deliver updates across memory, search, personalization, and vision capabilities.
Now that I've seen Copilot Vision in action, I can tell you it's one of the most exciting and important updates of the bunch – even if it is coming in two stages.
(Image credit: Future / Lance Ulanoff)
In the version you can access for your supporting Windows Desktop app right now, Copilot Vision can see the apps you're running on the desktop. When you open Copilot – by selecting the icon or pressing your Copilot key on your keyboard – you can now select the new eyeglasses icon.
This lets you see a list of open apps; in our case, we had two running: Blender 3D and Clipchamp. This means that while Copilot is aware of the available apps running on Windows, it is not automatically watching.
(Image credit: Future / Lance Ulanoff)
We selected Blender 3D, and from that moment forward, something in my Windows existence shifted. I realized that Copilot can truly see which app you're running, and instead of guessing at your intent, it answers based on the app and even the project you're working on.
Get daily insight, inspiration and deals in your inbox
Sign up for breaking news, reviews, opinion, top tech deals, and more.
Contact me with news and offers from other Future brandsReceive email from us on behalf of our trusted partners or sponsorsBy submitting your information you agree to the Terms & Conditions and Privacy Policy and are aged 16 or over.
A 3D coffee table project was open, and using our voice, we asked about how to make the table design more traditional. Our prompt contained almost no details about the app or the project, but Copilot's answer, in a lovely baritone, was fully contextual.
We then switched and asked about how to make annotations in the app. Copilot started to answer but we interrupted and asked where to find the icon to add the annotations. Copilot quickly adjusted and promptly told us how to find it.
This could prove enormously useful because you're no longer breaking your flow to jump out to search or even to over-explain which app you're using or the project. Copilot Vision sees and knows.
Let me tell you, though, about what's to come.
(Image credit: Future / Lance Ulanoff)
We followed the same steps to open Copilot and access the Vision component, but this time, we pointed Copilot at our open Clipchamp project.
We asked Copilot how to make our video transitions more seamless. Instead of a text prompt explaining what to do, Copilot Vision showed us exactly where to find the necessary tool in the app.
A giant arrow (inside an animated circle) appeared on the screen, pointing at the transitions tool it recommended we use as it explained the necessary steps. We ran through this demo a couple of times, and owing to its still under-development nature, it didn't always work.
When it did, though, it pointed to a potentially exciting change in how we'll work with apps in Windows.
(Image credit: Future / Lance Ulanoff)
We've also seen a demo video that shows Copilot Vision digging even deeper into the Photoshop app to find the right tools. This, my friends, is Clippy on steroids.
Imagine the future where you use text prompts or your voice to figure out how to perform tasks in an open app, and Copilot Vision digitally takes your hand and guides you through. There's no sign that it will take app-level actions on your behalf, but this could be an incredible visual assistant.
The good news is that the Copilot Vision that at least knows what app and project you're working on is available now. The bad news is that the Copilot Vision I really want has no definite timeline. But I have to assume it won't be long. We did see it live, after all.
You might also like
Microsoft 50th Anniversary Copilot Event live – we're on the ...
Windows is about to get its biggest intelligent upgrade ...
Microsoft Copilot is getting a huge update that'll make it ...
See more Computing News
Lance Ulanoff
Social Links Navigation
Editor At Large
A 38-year industry veteran and award-winning journalist, Lance has covered technology since PCs were the size of suitcases and “on line” meant “waiting.” He’s a former Lifewire Editor-in-Chief, Mashable Editor-in-Chief, and, before that, Editor in Chief of PCMag.com and Senior Vice President of Content for Ziff Davis, Inc. He also wrote a popular, weekly tech column for Medium called The Upgrade.
Lance Ulanoff makes frequent appearances on national, international, and local news programs including Live with Kelly and Mark, the Today Show, Good Morning America, CNBC, CNN, and the BBC.
You must confirm your public display name before commenting
Please logout and then login again, you will then be prompted to enter your display name.
Latest in Artificial Intelligence
I tried Copilot Vision, and it could change how you use Windows forever
ChatGPT-5 is on hold as OpenAI changes plans and releases new o3 and o4-mini models
OpenAI is giving away ChatGPT Plus subscriptions to students to help you study for finals – here’s how to apply
I didn’t care about Copilot, but this massive upgrade could make Microsoft’s AI the personal assistant I’ve always wanted
Windows is about to get its biggest intelligent upgrade thanks to Copilot
Microsoft Copilot is getting a huge update that'll make it more of a proactive AI companion
Latest in News
I tried Copilot Vision, and it could change how you use Windows forever
Don't worry, TikTok isn't going anywhere - at least not for the next 75 days
Android and Fire TVs are getting a new, cheap ATSC 3.0 adapter – but I wish it worked on LG OLED TVs
ChatGPT-5 is on hold as OpenAI changes plans and releases new o3 and o4-mini models
‘Possible, but not probable': analysts react to rumors of a $2,300 iPhone after Trump tariffs
Nintendo Switch 2 pre-orders delayed in US amid tariff uncertainty
More about artificial intelligence
ChatGPT-5 is on hold as OpenAI changes plans and releases new o3 and o4-mini models
OpenAI is giving away ChatGPT Plus subscriptions to students to help you study for finals – here’s how to apply
I took the rear-windowless Polestar 4 on a three-day road trip – here’s why ditching the back glass was a good (and bad) idea
See more latest
Most Popular
This mini PC has a 7-inch display that can apparently run Windows and an AMD Ryzen 9 CPU, but there's even better options to be had
Chinese brand’s $2,000 Ryzen AI Max+ mini PC set to go on sale, with the first unit personally signed by the CEO of AMD
Android and Fire TVs are getting a new, cheap ATSC 3.0 adapter – but I wish it worked on LG OLED TVs
Don't worry, TikTok isn't going anywhere - at least not for the next 75 days
‘Possible, but not probable': analysts react to rumors of a $2,300 iPhone after Trump tariffs
ChatGPT-5 is on hold as OpenAI changes plans and releases new o3 and o4-mini models
Intel could be key to Nvidia's future plans for megawatt-class rack servers as it pushes ahead with Superfluid cooling
OpenAI is giving away ChatGPT Plus subscriptions to students to help you study for finals – here’s how to apply
Nintendo Switch 2 exclusive The Duskbloods was originally meant to be Switch game but then FromSoftware was 'approached by Nintendo with talk of Switch 2'
Microsoft Copilot is getting a huge update that'll make it more of a proactive AI companion
LATEST ARTICLES
I took the rear-windowless Polestar 4 on a three-day road trip – here’s why ditching the back glass was a good (and bad) idea
This mini PC has a 7-inch display that can apparently run Windows and an AMD Ryzen 9 CPU, but there's even better options to be had
Chinese brand’s $2,000 Ryzen AI Max+ mini PC set to go on sale, with the first unit personally signed by the CEO of AMD
Android and Fire TVs are getting a new, cheap ATSC 3.0 adapter – but I wish it worked on LG OLED TVs
Don't worry, TikTok isn't going anywhere - at least not for the next 75 days
TechRadar is part of Future US Inc, an international media group and leading digital publisher. Visit our corporate site.
Contact Future's experts
Terms and conditions
Privacy policy
Cookies policy
Advertise with us
Web notifications
Accessibility Statement
Future US, Inc. Full 7th Floor, 130 West 42nd Street,
Please login or signup to comment
Please wait...
Related News
18 Mar, 2025
‘Corrupt, illegal and abusive’ – Tennis . . .
11 Mar, 2025
Fergus Finlay: Good luck in the Oval Off . . .
13 Mar, 2025
2023 Jeep Wagoneer L Series II
17 Mar, 2025
Azerbaijan weighs mine defusion volume i . . .
15 Apr, 2025
Lowest Totals Defended in IPL: A Look at . . .
25 Mar, 2025
Tony Hawk apparently intervened to get B . . .
05 Mar, 2025
Lifting weights, resistance training cou . . .
30 Mar, 2025
Riyan Parag's Aggressive Celebration Aft . . .