ACAT New Release v3.11

ACAT Project Website

Click here to download ACAT v3.11

Release Notes

Includes additional protection for reading/saving ACAT configuration files.

ACAT Release v3.10

ACAT Project Website

Click here to download ACAT v3.10

For end-users

• Disabled creation of log files for troubleshooting. This was enabled by default in the previous release. You can enable this by running ACATConfig.exe ->General->EnableLogs
• Updated ACAT BCI User Guide with known issues.

For developers

• Included source code for Brainflow and Accord .NET libraries
• Removed unused PanelConfig files
• Added additional code documentation for BCI

ACAT Release 3.0

ACAT Project Website

Click here to download ACAT v3.0

This release includes support for Brain Computer Interface (BCI) input modality that aims to bridge the communication gap for locked-in users. The sensing is based on a non-invasive, relatively low-cost OpenBCI EEG Kit.
.
Click here for the User Guide for ACAT BCI.

ACAT Release 2.0

ACAT Project Website

Click here to download ACAT 2.0

Release 2.0 includes several significant enhancements.

1. Enhanced language models that are specifically fine-tuned for Augmented and Alternative Communication (AAC) with word and sentence predictions to improve typing efficiency and provide a personalized user experience
2. Multiple typing modes for faster communication
3. Revamped and modernized user interface design
4. Wizard-based user onboarding
5. Modular software architecture for easier extensibility

The core application is developed in C# using Microsoft Visual Studio* 2022 and .NET 4.8.1.
It runs on Windows® 10 (20H2 or higher) and Windows® 11.

ConvAssist

This release includes ConvAssist, a module developed by Intel Labs. It enables users with disabilities to communicate using the latest language modeling technologies, through ACAT. ConvAssist can quickly suggest utterances/sentences that the user can use to have a social conversation or communicate with their caregiver in near real time. ConvAssist is built on the Pressagio library that predicts text based on n-gram models.

ConvAssist is extensible and allows developers to bring in new predictors, new language models for word prediction, sentence completion, semantic search, and more. It currently supports English-only models but can also be extended to other languages by incorporating multilingual language models.

ConvAssist is written in Python (v3.11.5)

System Requirements

1. Windows 10 20H2 or higher / Windows 11
2. At least 5 GB of free diskspace
3. At least 8 GB RAM

Contact the team

Click here to contact the ACAT team

ACAT Release v1.50.0 (deprecated)

Release v1.50.0 is deprecated. Please download v2.00.

Enhancements/Fixes in this release

1. Support for dual monitors. Option to move the application window between the monitors and also to maximize the window in the other monitor. This option can be accessed through the Window menu in the Alphabet scanner. Please refer to the Managing Application Windows section in the ACAT User Guide.

   Note: If you have language packs installed, please uninstall them and install the new ones included in this release.

2. Snapping a window using the Max / Snap option from the contextual menu for Notepad, MS Word and WordPad will dock the window to the alphabet scanner and freeze the window width. This is to prevent movement of text in the window due to word wrapping. This is controlled by a setting called SnapWindowDockAlphabetScanner. If enabled, the windows for these application will dock with the Alphabet scanner. The setting can be accessed through ACAT Config->Applications. Look for the SnapWindowDockAlphabetScanner parameter under MS Word Agent, Notepad Agent, and WordPad Agent.
3. If a MS Word document downloaded from the Internet is opened, Word puts it in the protected mode with a button to Enable Editing. Added a config parameter AutoUnprotectWordDocs to automatically unprotect downloaded Word documents. The default value for this setting is false. The setting can be accessed through ACAT Config->Applications. Look for the AutoUnprotectWordDocs parameter under "MS Word Agent".
4. Fixed a GDI resource leak related to contextual menus
5. Pressing ESC in the exit confirmation dialogs of some of the Functional Agents would cause ACAT to freeze
6. Changed the timer in WindowsOverlapWatchdog class from System.Forms.Timer to System.Timer

Documentation

All ACAT documentation and videos can be found here
Getting Started Guide
ACAT FAQ
User Guide
Developer's Guide

Videos

Prof. Stephen Hawking's Introduction to ACAT
ACAT Features Overview Video
Using Input Switches

Quick Installation Instructions

You must install the base English version ACAT before installing any of the ACAT Language packs. The Language packs are incremental installs over the base version.
Below are quick steps to install ACAT. For detailed install/uninstall instructions, refer to the ACAT User Guide .

The base English version:

1. If you have a previous version of ACAT already installed, first exit the application. If ACAT Dashboard is running, close it. Uninstall ACAT by going to Control Panel -> "Uninstall a Program". Right click on "Assistive Context-Aware Toolkit (ACAT)" and select "Uninstall". When prompted to remove ACAT and all its contents, select "No" if you are upgrading from a previous version and you want to retain your user settings. Otherwise select "Yes", which will delete all the contents under the ACAT installation folder
2. Save ACATSetup.exe (at the bottom of this section) on your computer. This is the default English version
3. Run ACATSetup.exe. Accept all defaults in the installation wizard.
4. When installation is complete, a shortcut to ACAT Dashboard will be created on the Desktop. The Dashboard has shortcuts to all the ACAT applications.

French Language Pack:

1. First download and install the base English version before installing the language pack.
2. If you have a previous version of the ACAT French Language Pack already installed, uninstall it. Go to Control Panel -> "Uninstall a Program". Right click on "Assistive Context-Aware Toolkit (ACAT) - French Language Pack" and select "Uninstall".
3. Save ACATPack-French.exe (at the bottom of this section) on your computer.
4. Run ACATPack-French.exe. Accept all defaults in the installation wizard. This will install the French language extensions. You must install this in same destination folder as the base English version. The default is C:\Intel\ACAT
5. You can switch between languages either by selecting "Language" from the ACAT Config utility, or by selecting the "Language" option from the Main menu in ACAT App

Spanish Language Pack:

1. First download and install the base English version before installing the language pack.
2. If you have a previous version of the ACAT Spanish Language Pack already installed, uninstall it. Go to Control Panel -> "Uninstall a Program". Right click on "Assistive Context-Aware Toolkit (ACAT) - Spanish Language Pack" and select "Uninstall".
3. Save ACATPack-Spanish.exe (at the bottom of this section) on your computer.
4. Run ACATPack-Spanish.exe. Accept all defaults in the installation wizard. This will install the Spanish language extensions. You must install this in same destination folder as the base English version. The default is C:\Intel\ACAT
5. You can switch between languages either by selecting "Language" from the ACAT Config utility, or by selecting the "Language" option from the Main menu in ACAT App

Portuguese Language Pack:

1. First download and install the base English version before installing the language pack.
2. Save ACATPack-Portuguese.exe (at the bottom of this section) on your computer.
3. Run ACATPack-Portuguese.exe. Accept all defaults in the installation wizard. This will install the Spanish language extensions. You must install this in same destination folder as the base English version. The default is C:\Intel\ACAT
4. You can switch between languages either by selecting "Language" from the ACAT Config utility, or by selecting the "Language" option from the Main menu in ACAT App

Extending ACAT to other languages

1. Download ACATResources.en.resx at the bottom of this section
2. Use a resource editor to translate strings. SimpleResx works quite well and it has built in support to translate strings into a number of languages.
3. Generate the resource .RESX file in the target language.
4. Email the translated resource .RESX file to Sai Prasad ([email protected])
5. Identify source material to create the word prediction database. The source should be free of copyright or other violations. Send us a link to the source.
6. We will generate the word prediction database for the target language
7. We will create the ACAT Language pack for the target language and upload it to github

Note:

1. ACAT doesn’t include Prof. Stephen Hawking's voice for text-to-speech. It uses Microsoft’s Speech Synthesizer API and the default TTS voice on the target machine. (Refer to ACAT FAQ or to the ACAT User Guide on how to change the default voice). Developers can easily extend ACAT to support other speech engines.
2. The UI look and feel is different from the one used by Prof. Stephen Hawking. Developers can create new UI's to support the needs of different users.
3. ACAT Vision is not open-source yet. We plan to release it in upcoming releases

ACAT Vision

ACAT Vision which is the vision component of ACAT uses the webcam to track the user's face and to detect facial gestures (cheek twitch and/or eyebrow raise). The detected gestures are then used as triggers to actuate the UI. ACAT Vision supports cheek twitch and eyebrow raise gestures. Only cheek twitch is enabled by default. To use eyebrow raise, or to map gestures to ACAT command shortcuts, refer to either ACAT FAQ or to the "Configure Actuators" section in the ACAT User Guide.

If you have any issues or questions about ACAT Vision, please contact Lama Nachman ([email protected])

Tips

1. Make sure the face is positioned 1 to 2 feet away from the camera.
2. During the calibration phase, try to keep as still as possible. Do not make any head or facial movements.
3. Face detection works well in most lighting conditions but if the room is too dark or (artificial/sun) light is shining directly on the face then face detection will work quite as well. Make sure the face is reasonably illuminated.
4. For gesture detection to work correctly, you must keep your head perfectly still and 1) move only your cheek muscle or your mouth for a cheek twitch gestu...

ACAT Official Release v1.00.0 (Deprecated)

This release is deprecated. Please download the latest release v2.00

New in this release

1. The English version includes an expanded Presage database for word prediction.
2. Bug fixes from the previous release

Refer to the ACAT User Guide for details on the new features.

1. Portuguese Language pack added. ACAT is now available in English, French, Spanish and Portuguese.
2. Support for multi-modal gestures for off-the-shelf switch boxes with multiple switches. For instance, if a switch box has two switches, one can be mapped as the selector and the other to a command such as "undo the last editing change", or to "restart the scanning sequence". Mapping is done through the "Keyboard Actuator" setting in the "Actuators" option in the ACAT Config utility. The default trigger key (F12) can also be changed. All this can be done through the ACAT Config utility.
3. A Phrases editor for adding/deleting/updating phrases that can be converted to speech. In the earlier versions of ACAT, this functionality was embedded in the Abbreviations editor. The Phrases editor can be accessed from the Settings menu. The editor also allows you to re-order phrases for faster access to the more frequently used phrases.
4. ACAT applications are now DPI-aware. The interfaces looks sharper as it is now scaled to the native resolution of the monitor. The previous versions which were not DPI-aware resulted in fuzzy renditions of the UI elements as they depended on the Desktop Windows Manager (DWM) component of Windows to perform default scaling. The difference is more pronounced on high-resolution monitors (4K).
5. Automatically adjusts to changes in screen resolution, for instance, if an external monitor or projector is connected.
6. Contextual support added for the Windows Calculator (Win7, Win8 and Win10). The contextual menu mirrors all the buttons in the Standard calculator
7. Contextual support added for the Windows 10 Photos app.
8. Contextual support added for the Windows Edge Browser on Windows 10
9. A new ACAT FAQ document has been added to the documentation. It has quick answers and tips for some of the most commonly asked questions.

Bugs found in the previous release have been fixed.

This release is deprecated. Please download v2.00

ACAT Release 0.99.1

This is a binary-only release. Source code for this version will be released soon. Please report any issues/problems and also provide feedback before the official release.

New in this release

Refer to the ACAT User Guide for details on the new features.

1. Spanish Language pack added. ACAT is now available in English, French and Spanish.
2. Multi-modal gestures. Commands (ACAT shortcuts) can be mapped to gestures to allow richer interactions. For example, the eyebrow-raise gesture in ACAT Vision can be mapped to "undo the last editing change", or to "restart the scanning sequence". Mapping is done through the "Actuators" option in the ACAT Config utility.
3. A new Phrases application that displays a list of configurable phrases to convert to speech. The app can be launched from the ACAT Dashboard.
4. Select preferred Text-to-speech voice by voice name or by gender. Voice selection can be done through the "Text-to-speech" option in the ACAT Config utility
5. A new color scheme for scanners . Color scheme can be selected from the ACAT Config utility.
6. A new parameter to configure the number of iterations for typing accented letters in non-English languages. Parameter can be controlled through the "Scan" settings in the ACAT settings menu.

Bug Fixes

1. Selecting the @ symbol in the Punctuation scanner would cause ACAT to crash
2. Page-up/Page-down buttons were disabled in the File Browser and Switch Windows scanner even if the window contained more than a pageful of entries
3. On Windows 10, the "Switch Windows" option would display hidden or cloaked windows such as Photos, Calculator, Movies & TV even though they were hidden.
4. "Show Desktop" in Switch Windows" would not work on Windows 10
5. On some Windows 10 machines, ACAT Vision would crash in acat_gestures_dll.dll
6. On Windows 10, right clicking on an icon in the Windows taskbar would cause ACAT to become unresponsive

ACAT Release v0.99

ACAT Release 0.99

This is a binary-only pre-release. Please report any issues/problems and also provide feedback before the official release.

Release notes

Localization

ACAT can now be extended to other languages. English and French versions are included in this release.

1. Text in all the ACAT scanners, menus and dialogs are now localized. Word prediction results are displayed in the selected language as well.
2. Customized Alphabet scanner for the selected language which includes scanners for special characters.
3. Ability to switch between languages from within the ACAT App.
4. Language extensions available as ACAT Language Packs which can be separately downloaded and installed.

ACAT Vision

1. ACAT Vision not a standalone EXE anymore. It is now integrated with ACAT as an extension. TCP/IP is no longer used to communicate with ACAT Vision. This should eliminate problems some users were facing with blocked TCP ports.
2. A more seamless interaction through appropriate visual feedback to the user.
3. Migrated to 32-bit. Will run on both 32-bit and 64-bit Windows OS’s.
4. Ability to select the preferred camera if multiple cameras are present
5. Ability to select the preferred facial gesture that will act as the switch trigger.

UI

1. Additional Alphabet scanner layouts and scanning sequences designed towards making typing more efficient.
2. A new ACAT Dashboard application to launch all the different variations of ACAT App and ACAT Talk app. Shortcuts to the preferred ACAT Apps can be selectively created on the desktop.
3. A new ACAT Config application (non-assistive) for direct control of a host of ACAT settings which are not available through the Settings menu in ACAT App.
4. ACAT Talk App now directly accessible from within the ACAT Application.

Other

1. Support added for MS Word 2013 and Outlook 2013.

ACAT Release v0.98

ACAT Release 0.98.

Changes since the previous release (v0.97.9.1)

• New labels for some of the buttons in the ACAT scanners.

ACAT Release

ACAT Release 0.97.9.1

Release Notes

1. Alphabet scanner with two different layouts - QWERTY and Alphabetic.
2. Color coded scanner buttons for easy identification
3. A new Talk application. Use word prediction and a soft keyboard to type text and convert to speech. Quickly convert user-defined phrases to speech. Two different keyboard layouts - QWERTY and Alphabetic.
4. Support added for Microsoft Outlook 2010. Create and manage emails, appointments, tasks, contacts and notes.
5. Support added for Windows Explorer. Navigate/manage folders and manage files.
6. Support added for Windows Media Player. Control playback - play, pause, fast-forward, rewind, go to next/previous track
7. New mouse grid scanning mode to easily position the mouse cursor anywhere on the display.
8. Keyboard actuation hotkey set to F12.
9. Default user name changed from "Default" to "ACAT". User preferences will be stored under [INSTALLDIR]\Users\ACAT
10. No need to run ACAT Setup as an administrator