Add translation funcs to utils

[shashank-iitbhu]

Contributor checklist

• This pull request is on a separate branch and not the main branch

---

Description

• Implemented batch processing for translation of words for a batch_size of 100, this way it is significantly faster to translate.
• Added four functions get_language_dir_path , translation_interrupt_handler, get_target_langcodes and translate_to_other_languages.
• Added doc strings.

Related issue

• Create English to all other languages translation process #72 , Create French to all other languages translation process #73 , Create German to all other languages translation process #74 , Create Italian to all other languages translation process #75 , Create Portuguese to all other languages translation process #76 , Create Russian to all other languages translation process #77 , Create Spanish to all other languages translation process #78 , Create Swedish to all other languages translation process #79

[github-actions]

Thank you for the pull request!

The Scribe team will do our best to address your contribution as soon as we can. The following is a checklist for maintainers to make sure this process goes as well as possible. Feel free to address the points below yourself in further commits if you realize that actions are needed :)

If you're not already a member of our public Matrix community, please consider joining! We'd suggest using Element as your Matrix client, and definitely join the General and Data rooms once you're in. It'd be great to have you!

Maintainer checklist

• The commit messages for the remote branch should be checked to make sure the contributor's email is set up correctly so that they receive credit for their contribution

  • The contributor's name and icon in remote commits should be the same as what appears in the PR
  • If there's a mismatch, the contributor needs to make sure that the email they use for GitHub matches what they have for git config user.email in their local Scribe-Data repo

• The CHANGELOG has been updated with a description of the changes for the upcoming release and the corresponding issue (if necessary)

[shashank-iitbhu]

Here, it tokenizes the batch of words and converts them into a format suitable for the model. Due to this it becomes relatively faster to translate words.

[wkyoshida]

Comparing this PR with #89, it appears to me all changes here are already reflected in the other PR.

I am thinking of simply closing this one here and continuing on #89 directly - is that alright? Mostly to avoid making any changes here and then later having to redo/reconcile the same on the other PR.

CC @andrewtavis

[shashank-iitbhu]

Yeah!, The other PR was checked from this this branch, merging that one makes sense.

[wkyoshida]

Great! Sounds good then - I'll do my review on that other PR 👍

[andrewtavis]

Thanks both! 😊