Microsoft’s GitHub is testing a new voice-based interaction system for its Copilot software, “Hey GitHub!” that will allow programmers to write code using only their voice and no keyboard.
This experimental feature will be tested in Copilot, a $10-a-month artificial intelligence tool that GitHub launched earlier this year to help developers write code. copilot recommends lines of code to developers within their code editors, and when developers enter code in integrated development environments (IDEs) like Visual Studio Code, Neovim, and JetBrains IDEs, Copilot can make recommendations for the next line of code. Neovim, and JetBrains IDEs, Copilot can make recommendations for the next line of code.
In a blog post today, GitHub explains, “With the power of your voice, we’re excited to potentially bring the benefits of GitHub Copilot to more developers, including those who have trouble typing by hand.’ Hey GitHub!’ currently just reduces the need for a keyboard when coding within VS Code, but we hope to expand its functionality with further research and testing.”
This feature will be particularly helpful in accessibility scenarios, with the ability for programmers to command Copilot to move to a different line of code, or to navigate to a method or block using only sound. It is even possible to control Visual Studio Code, using commands such as “Run Program” or “Toggle Zen Mode”. You can even ask for a code summary if you want to understand what a block of code is doing.
The new voice system is being developed by GitHub Next, a team of researchers and engineers “working on the future of software development,” but there’s no guarantee that the feature will eventually be released as a full product.
