lr not updated upon niter change

[keywae]

I've noticed that if you update niter mid training, it displays the correct new 'lr steps', but it does not correct the current 'lr rate', in accordance with the new steps. Looks like, it just keep the old lr rate from 'latest.state' file.

Example:
When i change niter from 100,000 to 500,000, following were the logs:

• Updating lr_steps from [10000, 20000, 40000, 60000] to [50000, 100000, 200000, 300000]
• INFO: <epoch:432, iter: 46,600, lr:1.250e-05, ......

Herer is the settings in config file:
lr_steps_rel: [0.1, 0.2, 0.4, 0.6]
lr_G: 0.0001