Heads-up Text Editing Tool using Voice and Manual Input (via ring mouse)
@inproceedings{ghosh_eyeditor_2020,
author = {Ghosh, Debjyoti and Foong, Pin Sym and Zhao, Shengdong and Liu, Can and Janaka, Nuwan and Erusu, Vinitha},
title = {EYEditor: Towards On-the-Go Heads-Up Text Editing Using Voice and Manual Input},
year = {2020},
isbn = {9781450367080},
publisher = {Association for Computing Machinery},
address = {New York, NY, USA},
url = {https://doi.org/10.1145/3313831.3376173},
doi = {10.1145/3313831.3376173},
booktitle = {Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems},
pages = {1–13},
numpages = {13},
keywords = {heads-up interaction, voice interaction, smart glass, re-speaking, wearable interaction, text editing, eyeditor, mobile interaction, manual-input},
location = {Honolulu, HI, USA},
series = {CHI '20}
}
- See the interactions at YouTube
- See Deb's code introduction
- Project
- Install packages and dependecies:
npm install
(if some packages are missing install them alsonpm install <package_name>
) - Run:
npm start
- Open (Google Chrome) browser at http://localhost:3000/
- Need active internet connection for live transcription
- Create a directory for user data,
public/javascripts/Data/UserData/
- Install the Vuzix Blade with HeadsUpGlass -> eyeditor_1 branch OR NIPGlass -> eyeditor_1 branch. And set up the Blade's IP address at
public/javascripts/Drivers/ConnectBlade.js
(or use the SmartGlassesSimulator) - Configure the ring mouse as bellow and connect it to computer (to change mapping edit
public/javascripts/Drivers/RingControllerDriver.js
)