Help Needed with Fine-Tuning Hyperparameters for Training Script

[ep0p]

I’m working on fine-tuning crnn_vgg16_b recognition model.

I’ve run into a bit of a challenge: my training loss is fluctuating rapidly, and I haven’t been able to stabilize it despite trying a few different setups.

Since I’m still learning the ropes, I’d appreciate any advice you could provide on the following hyperparameters to help improve stability and performance:

1. Number of Epochs: How many epochs would you recommend starting with, given my dataset size?
2. Learning Rate: Any tips on the initial learning rate and strategies for adjusting it during training?
3. Batch Size: What batch size would you suggest for optimal performance and stability?

Here’s a quick summary of my setup:

Dataset size: 1 million words
Train/Validation split: 80%/20%
Tried Hyperparameters: --epochs 20 --lr 0.0001 --batch_size 16
--epochs 50 --lr 0.000001 --batch_size 32
--epochs 20 --lr 0.000001 --batch_size 32

[ep0p]

Figured it out eventually.