This README describes the various scripts available for doing manual segmentation of media files, for annotation or other purposes, for speaker diarization, and converting from-to the file formats of several related tools.
The scripts are either in python2 or perl, but interpreters for these
should be readily available.
Please send any questions/suggestions to [email protected]
A pre-built docker container can be used to run the the scripts.
docker pull blabbertabber/aalto-speech-diarizer
In the following example, we use the container to diarize a
meeting.wav file:
docker run -it blabbertabber/aalto-speech-diarizer bash
cd /speaker-diarization
curl -k -OL https://nono.io/meeting.wav # sample .wav; substitute yours
./spk-diarization2.py meeting.wav # substitute your .wav filename
cat stdout # browse outputMost of these scripts depend on the aku tools that are part of the AaltoASR
package that you can find here. You
should compile that for your platform first, following these instructions.
In this speaker-diarization directory:
- Add a symlink to the folder
AaltoASR/ - Add a symlink to the folder
AaltoASR/build - Add a symlink to
AaltoASR/build/aku/feacat - Make sure the
ffmpegexecutable is on path or add a symlink to it too.
For example, if you have cloned and built AaltoASR into the ../AaltoASR
path (relative to speaker-diarization):
speaker-diarization$ ln -s ../AaltoASR ./
speaker-diarization$ ln -s ../AaltoASR/build ./
speaker-diarization$ ln -s ../AaltoASR/build/aku/feacat ./Would work.
You probably want to use spk-diarization2.py since that one calls the 2
versions of some scrips, while spk-diarization.py uses an old, matlab-based
VAD that is hard to configure and deprecated.
Script to help perform manual segmentation of a media file, it can be any media
file type supported by mplayer. It's only dependency is a Python-mplayer
wrapper that can be installed locally by executing:
$ pip install --user mplayer.py
After that executing it is just:
$ ./mseg.py /path/to/mediafile -o outputfile
The output file is optional. It also supports the invocation:
$ ./mseg.py /path/to/mediafile -o outputfile -i inputfile
To continue a previously saved segmentation session. Once in the program, the controls are:
- Quit: esc or q
- Pause: p
- Mark position: space
- Manually edit mark: e
- Add manual mark: a
- Remove mark: r
- Faster speed: Up
- Slower speed: Down
- Rewind: Left
- Fast Forward: Right
- Scroll down marks: pgDwn
- Scroll up marks: pgUp
The media file starts as paused, so to start reproduction just hit the p key.
Script to convert from mseg output to Elan file format.
Usage:
$ ./mseg2elan.py msoutputfile -o outputfile
If outputfile is not specified, the output will be sent to the stdout.
Once in Elan, segments can be easily fine tuned by changing to the
segmentation mode, in Options->Segmentation Mode.
Script to convert from AKU recipes to Elan file format.
Usage:
$ ./aku2elan.py recipe -o outputfile
If outputfile is not specified, the output will be sent to the stdout.
Once in Elan, segments can be easily fine tuned by changing to the
segmentation mode, in Options->Segmentation Mode.
Script to convert from Elan file format to AKU recipes.
Usage:
$ ./elan2aku.py elanoutputfile -o akurecipe
If akurecipe is not specified, the output will be sent to the stdout.
Script to convert from mseg output to praat file format.
Usage:
$ perl mseg_to_textgrid.pl msfile > outputfile
If outputfile is not specified, the output will be sent to the stdout.
Creates an AKU recipe from the generate_exp.py output (.exp files).
For full help, use:
$ ./voice-detection2.py -h
Rates the performance of a Voice Activity Detection recipe in AKU format, such
as those created with voice-detection.py. To measure the performance, another
recipe with ground truth should be provided.
For full help, use:
$ ./vad-performance.py -h
Performs speaker turn segmentation over audio, using a distance measure such as
GLR, KL2 or BIC, and sliding or growing window. It requires an input recipe file
in AKU format pointing to the audio files, and preferably with turns of
speech/non-speech already processed, and a features file for each wav to
process, in the format outputted by the feacat program of the AKU suite.
For full help, use:
$ ./spk-change-detection.py -h
Rates the performance of a speaker turn segmentation recipe in AKU format, such
as those created with spk-change-detection.py. To measure the performance,
another recipe with ground truth should be provided.
For full help, use:
$ ./spk-change-performance.py -h
Performs speaker turn clustering over audio. It requires a speaker segmentation
recipe in AKU format, such as those created with spk-change-detection.py, and
a features file for each wav file to process, in the format outputted by the
feacat program of the AKU suite.
For full help, use:
$ ./spk-clustering.py -h
Calculates per-speaker speaking time from a speaker-tagged recipe in AKU format.
For full help, use:
$ ./spk-time.py -h
Performs full speaker diarization over media file. If the media is not a wav
file it tries to convert it to wav using ffmpeg. It then calls
generate_exp.py, voice-detection.py, spk-change-detection.py and
spk-clustering.py in succession.
For full help, use:
$ ./spk-diarization2.py -h
Notes:
- Paths for the other scripts and features must be provided.
- Since this script is a convenient wrapper for the other scripts of the family, it doesn't have options for all the settings of the other scripts, just some defaults. If you want to tune them, edit this script directly.
- Some scripts have a 2 version. Usage of that one is preferable.
Brendan Cunnie (@saintbrendan, [email protected]) and Brian Cunnie (@cunnie, [email protected]) contributed the Dockerfile. Tran Tu (@tran2, [email protected]) added ffmpeg to it for non-wav files support.