Reproducible configs and checkpoints This folder contains:
Reproducible config of Table.1 in the paper of LibFewShot.
Reproducible config of Table.2 in the paper of LibFewShot.
Reproduction results on miniImageNet (Results may different from the paper. Here are up-to-date results with checkpoints and configs.)
Method
Embed.
5-way 1-shot
5-way 5-shot
Reported
Ours
Reported
Ours
Baseline
Conv64F
42.11
42.34
62.53
62.18
ResNet18
51.75
51.18
74.27
74.06
Baseline++ Conv64F
48.24
46.21
66.43
65.18
ResNet18
51.87
53.60
75.68
73.63
RFS-simple ResNet12
62.02
62.80
79.64
79.57
RFS-distill ResNet12
64.82
63.44
82.14
80.17
SKD-GEN0 ResNet12
65.93
66.40
83.15
83.06
SKD-GEN1 ResNet12
67.04
67.35
83.54
80.30
NegCos ResNet12
63.85
63.28
81.57
81.24
MAML Conv32F
48.70
47.41
63.11
65.24
Versa Conv64F†
53.40
51.92
67.37
66.26
R2D2 Conv64F
49.50
47.57
65.40
66.68
Conv64F‡
51.80
55.53
68.40
70.79
ANIL Conv32F
46.70
48.44
61.50
64.35
BOIL Conv64F
49.61
48.00
66.45
64.39
ResNet12**
-
58.87
71.30
72.88
MTL ResNet12
60.20
60.20
74.30
75.86
ProtoNet† Conv64F
46.14
46.30
65.77
66.24
RelationNet Conv64F
50.44
51.75
65.32
66.77
CovaMNet Conv64F
51.19
53.36
67.65
68.17
DN4 Conv64F
51.24
51.95
71.02
71.42
ResNet12†
54.37
57.76
74.44
77.57
CAN ResNet12
63.85
66.62
79.44
78.96
RENet ResNet12
67.60
66.83
82.58
82.13
The overview picture of the SOTAs
Method
Venue
Type
miniImageNet
tieredImageNet
1-shot
5-shot
1-shot
5-shot
Baseline ICLR’19
Non-episodic
44.90
63.96
48.20
68.96
Baseline++ ICML’19
Non-episodic
48.86
63.29
55.94
73.80
RFS-simple ECCV’20
Non-episodic
47.97
65.88
52.21
71.82
SKD-GEN0 BMVC'20
Non-episodic
48.14
66.36
51.78
70.65
NegCos ECCV’20
Non-episodic
47.34
65.97
51.21
71.57
MAML ICML’17
Meta
49.55
64.92
50.98
67.12
Versa NeurIPS’18
Meta
52.75
67.40
52.28
69.41
R2D2 ICLR’19
Meta
51.19
67.29
52.18
69.19
LEO ICLR’19
Meta
53.31
67.47
58.15
74.21
MTL CVPR’19
Meta
40.97
57.12
42.36
64.87
ANIL ICLR’20
Meta
48.01
63.88
49.05
66.32
BOIL ICLR’21
Meta
47.92
64.39
50.04
65.51
ProtoNet NeurIPS’17
Metric
47.05
68.56
46.11
70.07
RelationNet CVPR’18
Metric
51.52
66.76
54.37
71.93
CovaMNet AAAI’19
Metric
51.59
67.65
51.92
69.76
DN4 CVPR’19
Metric
54.47
72.15
56.07
75.75
CAN NeurIPS’19
Metric
55.88
70.98
55.96
70.52
RENet ICCV’21
Metric
57.62
74.14
61.62
76.74
Method
Venue
Type
miniImageNet
tieredImageNet
1-shot
5-shot
1-shot
5-shot
Baseline ICLR’19
Non-episodic
56.39
76.18
65.54
83.46
Baseline++ ICML’19
Non-episodic
56.75
66.36
65.95
82.25
RFS-simple ECCV’20
Non-episodic
61.65
78.88
70.55
84.74
SKD-GEN0 BMVC'20
Non-episodic
66.40
83.06
71.90
86.20
NegCos ECCV’20
Non-episodic
60.60
78.80
70.15
84.94
Versa NeurIPS’18
Meta
55.71
70.05
57.14
75.48
R2D2 ICLR’19
Meta
59.52
74.61
65.07
83.04
LEO ICLR’19
Meta
53.58
68.24
64.75
81.42
MTL CVPR’19
Meta
61.18
79.14
68.29
83.77
ANIL ICLR’20
Meta
52.77
68.11
55.65
73.53
BOIL ICLR’21
Meta
58.87
72.88
64.66
80.38
ProtoNet NeurIPS’17
Metric
58.61
75.02
62.93
83.30
RelationNet CVPR’18
Metric
55.22
69.25
56.86
74.66
CovaMNet AAAI’19
Metric
56.95
71.41
58.49
76.34
DN4 CVPR’19
Metric
58.68
74.70
64.41
82.59
CAN NeurIPS’19
Metric
59.82
76.54
70.46
84.50
RENet ICCV’21
Metric
64.81
79.90
70.14
82.70
Method
Venue
Type
miniImageNet
tieredImageNet
1-shot
5-shot
1-shot
5-shot
Baseline ICLR’19
Non-episodic
54.11
74.44
64.65
82.73
Baseline++ ICML’19
Non-episodic
52.70
75.36
65.85
83.33
RFS-simple ECCV’20
Non-episodic
61.65
76.60
69.14
83.21
SKD-GEN0 BMVC'20
Non-episodic
66.18
82.21
70.00
84.70
NegCos ECCV’20
Non-episodic
60.99
76.30
68.36
83.77
Versa NeurIPS’18
Meta
55.08
69.16
57.30
75.67
R2D2 ICLR’19
Meta
58.36
75.69
64.73
83.40
LEO ICLR’19
Meta
57.51
69.33
64.02
78.89
MTL CVPR’19
Meta
60.29
76.25
65.12
79.99
ANIL ICLR’20
Meta
52.96
65.88
55.81
73.53
BOIL ICLR’21
Meta
57.85
70.84
60.85
77.74
ProtoNet NeurIPS’17
Metric
58.48
75.16
63.50
82.51
RelationNet CVPR’18
Metric
53.98
71.27
60.80
77.94
CovaMNet AAAI’19
Metric
55.83
70.97
54.12
73.51
DN4 CVPR’19
Metric
57.92
75.50
64.83
82.77
CAN NeurIPS’19
Metric
62.33
77.12
71.70
84.61
RENet ICCV’21
Metric
66.21
81.20
71.53
84.55