Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

getting Nan Value while training yolov4 on custom data #198

Open
arpitvw opened this issue Sep 17, 2020 · 1 comment
Open

getting Nan Value while training yolov4 on custom data #198

arpitvw opened this issue Sep 17, 2020 · 1 comment

Comments

@arpitvw
Copy link

arpitvw commented Sep 17, 2020

Hello Team ,
I am using yolov4 for object detection and training it on custom dataset
after 300 iteration i am getting Nan value for weights
weights used:

  1. yolov4.conv.137 (after 6000 iteration also not able to detect object
  2. Tried to train it from scratch with below command but getting Nan value
    !./darknet detector train data/obj.data cfg/yolo-obj.cfg yolov4.weights -clear -dont_show -map

image

Note: Training data is related to crops

@harshays98
Copy link

solutions:
1.Decrease the learning rate suppose, for example, if you are using learning rate as 0.00001, use 0.0000001.
2.adjust the learning_decay
3.add clipnorm value (the last option but it is optional)
4. Increase the validation data

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants