Add lr_scheduler check for inference.

Add lr_scheduler check for inference. #896