Streaming S2ST and S2TT Results Remain in English When tgt_lang is Set to 'cmn‘

[Zhenzi-Weng]

Hello @kauterry , I tested the example you provided in the Seamless Tutorial (https://github.com/facebookresearch/seamless_communication/blob/main/Seamless_Tutorial.ipynb) about building a SeamlessStreaming S2ST + S2TT agent. In the example you provided, the input audio is in English, the target language is Spanish ("spa"), and the source_segment_size=320ms. However, when I changed the target language to Chinese ("cmn"), I found that the translated results for both S2ST and S2TT were still in English. Only when I set the source_segment_size to around 700ms did the output result in Chinese. Could you help explain this?

More important, how can I force the final translation to be in Chinese (even if the result is poor), regardless of how small the source_segment_size is set?

[Zhenzi-Weng]

Does anyone can answer this question?