Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

'ggnn_epoch5_step14000.pt' have a a bit lower mIOU - 69 #42

Open
LetsGoFir opened this issue Jun 4, 2020 · 4 comments
Open

'ggnn_epoch5_step14000.pt' have a a bit lower mIOU - 69 #42

LetsGoFir opened this issue Jun 4, 2020 · 4 comments

Comments

@LetsGoFir
Copy link

I change the data path, edit the path in ggnn.json, and test it with torch1.2/ptyhon3, got a mIoU 69, which is a bit lower than the result published in the paper - 71.38.
And I cannot load the 'ggnn_epoch8', can you give me a json file for it?
Thanks for you great work!

@LetsGoFir
Copy link
Author

Number of instances
----------------
car: 4517
person: 3239
rider: 537
motorcycle: 148
bicycle: 1129
truck: 93
bus: 98
train: 23
----------------

IOUs
----------------
car: MEAN: 0.7801381199070497 STD: 0.21180478329576186
person: MEAN: 0.7080233897022424 STD: 0.19231650411717952
rider: MEAN: 0.683552623387134 STD: 0.15404026738050183
motorcycle: MEAN: 0.5923347781394875 STD: 0.23855743029070062
bicycle: MEAN: 0.5936849702304672 STD: 0.22490588463020722
truck: MEAN: 0.7594397312370428 STD: 0.19188913178823006
bus: MEAN: 0.8004330341129232 STD: 0.21623632056871203
train: MEAN: 0.5991739700064996 STD: 0.30193679686664776
ALL MEAN: 0.6895975770903557
----------------

N corrections
----------------
car MEAN: 0.0 STD: 0.0
person MEAN: 0.0 STD: 0.0
rider MEAN: 0.0 STD: 0.0
motorcycle MEAN: 0.0 STD: 0.0
bicycle MEAN: 0.0 STD: 0.0
truck MEAN: 0.0 STD: 0.0
bus MEAN: 0.0 STD: 0.0
train MEAN: 0.0 STD: 0.0
ALL MEAN: 0.0
----------------

@LetsGoFir
Copy link
Author

And if I skip multi-component objects

IOUs
----------------
car: MEAN: 0.8120224407143601 STD: 0.17786273781972428
person: MEAN: 0.7364667286577709 STD: 0.1642026361339306
rider: MEAN: 0.6996582492880937 STD: 0.14832665964677744
motorcycle: MEAN: 0.6420486222188827 STD: 0.21690518847619442
bicycle: MEAN: 0.6435299546578587 STD: 0.19451260283938904
truck: MEAN: 0.7717278280049291 STD: 0.2065501260934808
bus: MEAN: 0.8789496184596746 STD: 0.14563499165817012
train: MEAN: 0.7870879152792436 STD: 0.27245314275328497
ALL MEAN: 0.7464364196601017

@LetsGoFir
Copy link
Author

Do you skip the multi-component objects when evaluation @amlankar? Or maybe there are some problems with my env..

@diehualong
Copy link

评估时是否跳过多组件对象@amlankar? 或者也许我的环境有一些问题..
Hi, how did you find the code?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants