Microsoft Windows NUIA Extension

Make your daily work at the computer more natural

About

Get the most out of Windows with the Windows NUIA Extension. NUIA is a powerful software middle layer designed to bridge the gap between sensors and applications, allowing natural user interaction.

Use NUIA to perform the standard Windows commands like "Shut down", "Open Start menu", "Show Desktop", "Switch App" or "Mute" via speech, gesture or your eyes. With NUIA you can easily start a Windows, YouTube or a Google search without even opening these applications. You also can open supported applications or switch between them. To minimize, maximize, move or close a window just use your voice.

AND NUIA also gives you the answer to life the universe and everything;)

What's new

Version 2016-2-73 (2015-12-18)

Initial version

Features

NUIA System Menu

Windows System-Wide (Standard Menu)
What is this?
  • Open Start Menu: Opens the start menu.
  • Search: Opens the NUIA Search Menu.
  • Mute: Mutes the system sound.
  • Unmute: Unmutes the system sound.
  • Shut Down: Opens the confirm 'Shut down my computer' menu.
  • Switch App: Opens the Windows task switcher.
  • Open NUIA Store: Opens the NUIA store in default browser.
  • Cancel: Cancels the NUIA Menu without any action.
Windows System-Wide (Search Menu)
What is this?
  • Clear: Clears the dictated words/phrases.
  • Search Google: Opens the default browser and searches for the dictated words/phrases in Google.
  • Search YouTube: Opens the default browser and searches for the dictated words/phrases in YouTube.
  • Search Windows: Opens Cortana and searches for the dictated words/phrases in Windows.
  • Cancel: Cancels the NUIA Menu without any action.
Windows System-Wide (Windows Search View)
What is this?
  • Open Search Result: Opens the search results.
  • Cancel: Cancels the NUIA Menu without any action.

System Voice Commands

Windows System-Wide
What is this?
  • Show NUIA Menu: Activates the NUIA menu for the current application.
  • Go Down In Z Order, Go Down, Show Next Menu, Go To Next Menu: Goes to the next NUIA menu in z order.
  • Go Up In Z Order, Go Up, Show Previous Menu, Go To Previous Menu: Goes to the previous NUIA menu in z order.
  • Search Windows, Search Youtube , Search Google, Start Searching, Show Search, Open Search: Opens the NUIA Search Menu.
  • Show Help Page, Show Help, Open Help Page, Open Help, Help Me: Opens the help page for the current application.
  • Show Speech Commands, Show Voice Commands: Opens the help page for the current application and displays the available speech commands.
  • Close Help Page, Close Help, Hide Help Page, Hide Help: Closes the help page.
  • Open Start Menu, Open Start, Show Start Menu, Show Start: Opens the Windows start menu.
  • Close Start Menu, Close Start: Closes the Windows start menu.
  • Show Desktop: Minimizes all windows and shows the Windows desktop.
  • Switch To Adobe Reader, Open Adobe Reader, Go To Adobe Reader: Opens or switches to the Adobe Reader.
  • Switch To iTunes, Open iTunes, Go To iTunes: Opens or switches to iTunes.
  • Switch To Picasa, Open Picasa, Go To Picasa: Opens or switches to Picasa.
  • Switch To PowerPoint, Open PowerPoint, Go To PowerPoint: Opens or switches to PowerPoint.
  • Open Mozilla Firefox, Open Firefox: Opens Firefox.
  • Open Video Lan Client, Open VLC: Opens VLC Media Player.
  • Open Explorer: Launches the Windows File Explorer.
  • Open Facebook: Opens Facebook in default browser.
  • Open Outlook: Opens Outlook.
  • Open YouTube: Opens YouTube in default browser.
  • Close Window: Closes the current window.
  • Maximize Window: Maximizes the current window.
  • Minimize Window: Minimizes the current window.
  • Maximize Window Right, Move Window Right: Moves the current window to the right screen edge.
  • Maximize Window Left, Move Window Left: Moves the current window to the left screen edge.
  • Move Window To The Previous Screen, Move Window To Previous Screen: Moves the current window to the previous screen (multi screen layout necessary).
  • Move Window To The Next Screen, Move Window To Next Screen: Moves the current window to the next screen (multi screen layout necessary).
  • Scroll Down: Scrolls down the current window or application.
  • Scroll Up: Scrolls up the current window or application.
  • NUIA Shut Down Computer: Opens the confirm 'Shut down my computer' menu.
  • NUIA Go To Sleep: Opens the confirm 'Go to sleep' menu.
  • Lock My Computer: Signs out the current user.
  • Mute Sound: Mutes the system sound.
  • Unmute Sound: Unmutes the system sound.
  • Take Screenshot: Takes a screenshot and saves it in the Home/Pictures folder.
  • What Is The Answer To Life The Universe And Everything?: Gives you "THE ANSWER".

System Requirements

  • You need to have an installed version of NUIA to use this extension
  • Platforms: Windows 8.1, Windows 10
  • Applications: Windows 10
  • Sensors/SDKs: Intel RealSense 3D Camera (Buy), Tobii EyeX / 4C Eye Tracker (Buy)

Additional Information

  • Supported Modalities: Voice, Gestures, Gaze
  • Supported Languages: US English
  • FAQ