CE7455--Roberta-Text-Classification

CE7455 - Final Project

Yeo Wei Jie, Lin YuKun, Luqman Alka

Fine-tuning Roberta on text classification task

6 google colab notebooks

6_class_emotion_TF - results of evaluation on 6-class emotion dataset with Transfer learning applied on SST-2 and 4-class Emotion dataset
Roberta_optimization_fine_tuning - results of applying Raytune on optimizer choice between Adam, AdamW and SGD
Emotion_dataset_Raytune - Evaluation on 4-class emotion dataset with individual as well as overall HP fine-tuning
Finetuning Optuna - Hyperparameter space exploration using Optuna on 4-class emotion dataset and custom BPE tokenizer creation and model training
SST2-HP- HP fine-tuning
SST2_baseline - Baseline result of SST2

Name		Name	Last commit message	Last commit date
Latest commit History 20 Commits
6_Class_Emotion_TF.ipynb		6_Class_Emotion_TF.ipynb
CE7455_Roberta_optimizer_tuning.ipynb		CE7455_Roberta_optimizer_tuning.ipynb
Emotion_dataset_with_RayTune.ipynb		Emotion_dataset_with_RayTune.ipynb
Finetuning Optuna.ipynb		Finetuning Optuna.ipynb
README.md		README.md
SST2-Hyperparameter-Tuning.ipynb		SST2-Hyperparameter-Tuning.ipynb
SST2_baseline.ipynb		SST2_baseline.ipynb

Provide feedback