Skip to content

Heads-up Text Editing Tool using Voice and Manual Input (via ring mouse)

Notifications You must be signed in to change notification settings

Synteraction-Lab/Eyeditor

Repository files navigation

EYEditor

Heads-up Text Editing Tool using Voice and Manual Input (via ring mouse)

Publications

@inproceedings{ghosh_eyeditor_2020,
	author = {Ghosh, Debjyoti and Foong, Pin Sym and Zhao, Shengdong and Liu, Can and Janaka, Nuwan and Erusu, Vinitha},
	title = {EYEditor: Towards On-the-Go Heads-Up Text Editing Using Voice and Manual Input},
	year = {2020},
	isbn = {9781450367080},
	publisher = {Association for Computing Machinery},
	address = {New York, NY, USA},
	url = {https://doi.org/10.1145/3313831.3376173},
	doi = {10.1145/3313831.3376173},
	booktitle = {Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems},
	pages = {1–13},
	numpages = {13},
	keywords = {heads-up interaction, voice interaction, smart glass, re-speaking, wearable interaction, text editing, eyeditor, mobile interaction, manual-input},
	location = {Honolulu, HI, USA},
	series = {CHI '20}
}

Contact person

Project links

Installation

  • Install packages and dependecies: npm install (if some packages are missing install them also npm install <package_name>)
  • Run: npm start
  • Open (Google Chrome) browser at http://localhost:3000/

Requirements

  • Need active internet connection for live transcription
  • Create a directory for user data, public/javascripts/Data/UserData/
  • Install the Vuzix Blade with HeadsUpGlass -> eyeditor_1 branch OR NIPGlass -> eyeditor_1 branch. And set up the Blade's IP address at public/javascripts/Drivers/ConnectBlade.js (or use the SmartGlassesSimulator)
  • Configure the ring mouse as bellow and connect it to computer (to change mapping edit public/javascripts/Drivers/RingControllerDriver.js) attached image

About

Heads-up Text Editing Tool using Voice and Manual Input (via ring mouse)

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published