Elevating Copilot's Capabilities with Image Recognition for UI Understanding

[Qusea]

Select Topic Area

Product Feedback

Body

I propose enhancing Copilot's functionality by integrating image recognition models, which would allow it to understand the current UI state through images or previews. This innovation would allow users to communicate their UI preferences when seeking code modifications or suggestions from Copilot, enabling more seamless and intuitive collaboration.

Your thoughts and support on this idea are crucial. Your feedback will help advance Copilot and make it an even more valuable tool for software development.

[Slax38]

👍

[aymalkhalid]

I wish if it could Recognize the User Interface for Image recognition it would help build UI build much faster and better.

[mgilank]

need this feature

[sdr0x07b6]

I wonder why this feature doesn't exist.
It's a feature that should be there in front-end development.
It's essential for sharing layout wireframes and UI designs.
The problem I always run into when using Github Copilot is that I can't convey information with images.

[Trass3r]

There's a bit of development: https://github.com/microsoft/vscode-copilot-vision

[sdr0x07b6]

Thanks for letting us know! Good news.
I hope it will be a good future for us.