-
Notifications
You must be signed in to change notification settings - Fork 9
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
feat: allow conversion to numbers (#222)
* feat: all conversion to numbers * fix: preserve device
- Loading branch information
Showing
2 changed files
with
36 additions
and
7 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
b0fd2a0
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Reactant.jl Benchmarks
ViT base (256 x 256 x 3 x 32)/forward/CUDA/Reactant (optimize = :after_enzyme)
1256872102
ns1206417685
ns1.04
ViT base (256 x 256 x 3 x 32)/forward/CUDA/Reactant
1333443649
ns1214871383
ns1.10
ViT base (256 x 256 x 3 x 32)/forward/CUDA/Reactant (optimize = :before_enzyme)
1185122837
ns1200999245
ns0.99
ViT base (256 x 256 x 3 x 32)/forward/CUDA/Reactant (optimize = :only_enzyme)
3031400324
ns2749115179
ns1.10
ViT base (256 x 256 x 3 x 32)/forward/CUDA/Lux
220916486
ns220152561
ns1.00
ViT base (256 x 256 x 3 x 32)/forward/CPU/Reactant (optimize = :after_enzyme)
7130674872
ns5954497792
ns1.20
ViT base (256 x 256 x 3 x 32)/forward/CPU/Reactant
5034713515
ns5547013317
ns0.91
ViT base (256 x 256 x 3 x 32)/forward/CPU/Reactant (optimize = :before_enzyme)
5072244215
ns5953205389
ns0.85
ViT base (256 x 256 x 3 x 32)/forward/CPU/Reactant (optimize = :only_enzyme)
7332305315
ns7769274161
ns0.94
ViT base (256 x 256 x 3 x 32)/forward/CPU/Lux
33343934482
ns29042431211
ns1.15
ViT small (256 x 256 x 3 x 4)/forward/CUDA/Reactant (optimize = :after_enzyme)
1218677413
ns1466527087
ns0.83
ViT small (256 x 256 x 3 x 4)/forward/CUDA/Reactant
1234638573.5
ns1271259724.5
ns0.97
ViT small (256 x 256 x 3 x 4)/forward/CUDA/Reactant (optimize = :before_enzyme)
1311424337.5
ns1220631229.5
ns1.07
ViT small (256 x 256 x 3 x 4)/forward/CUDA/Reactant (optimize = :only_enzyme)
2867765274
ns2955830416
ns0.97
ViT small (256 x 256 x 3 x 4)/forward/CUDA/Lux
8677702
ns8809576
ns0.99
ViT small (256 x 256 x 3 x 4)/forward/CPU/Reactant (optimize = :after_enzyme)
1555217423.5
ns1632601737
ns0.95
ViT small (256 x 256 x 3 x 4)/forward/CPU/Reactant
1544020815
ns1615677017
ns0.96
ViT small (256 x 256 x 3 x 4)/forward/CPU/Reactant (optimize = :before_enzyme)
1545762311.5
ns1612188044
ns0.96
ViT small (256 x 256 x 3 x 4)/forward/CPU/Reactant (optimize = :only_enzyme)
3286621346
ns3470065078
ns0.95
ViT small (256 x 256 x 3 x 4)/forward/CPU/Lux
2857108371
ns2295456922
ns1.24
ViT tiny (256 x 256 x 3 x 32)/forward/CUDA/Reactant (optimize = :after_enzyme)
1272248465.5
ns1454883401
ns0.87
ViT tiny (256 x 256 x 3 x 32)/forward/CUDA/Reactant
1253802424.5
ns1282969154
ns0.98
ViT tiny (256 x 256 x 3 x 32)/forward/CUDA/Reactant (optimize = :before_enzyme)
1213693005
ns1275643905.5
ns0.95
ViT tiny (256 x 256 x 3 x 32)/forward/CUDA/Reactant (optimize = :only_enzyme)
3281264577
ns2832382223
ns1.16
ViT tiny (256 x 256 x 3 x 32)/forward/CUDA/Lux
22707295.5
ns22539732.5
ns1.01
ViT tiny (256 x 256 x 3 x 32)/forward/CPU/Reactant (optimize = :after_enzyme)
2133484502
ns2223968702
ns0.96
ViT tiny (256 x 256 x 3 x 32)/forward/CPU/Reactant
2121542869
ns2223076468
ns0.95
ViT tiny (256 x 256 x 3 x 32)/forward/CPU/Reactant (optimize = :before_enzyme)
2114356826
ns2233158724
ns0.95
ViT tiny (256 x 256 x 3 x 32)/forward/CPU/Reactant (optimize = :only_enzyme)
3896755968
ns4094621805
ns0.95
ViT tiny (256 x 256 x 3 x 32)/forward/CPU/Lux
6263782616
ns6063156187.5
ns1.03
ViT tiny (256 x 256 x 3 x 4)/forward/CUDA/Reactant (optimize = :after_enzyme)
1227311824.5
ns1278819728.5
ns0.96
ViT tiny (256 x 256 x 3 x 4)/forward/CUDA/Reactant
1291628216.5
ns1248655937
ns1.03
ViT tiny (256 x 256 x 3 x 4)/forward/CUDA/Reactant (optimize = :before_enzyme)
1244002051
ns1311559501.5
ns0.95
ViT tiny (256 x 256 x 3 x 4)/forward/CUDA/Reactant (optimize = :only_enzyme)
3118021900
ns2882409531
ns1.08
ViT tiny (256 x 256 x 3 x 4)/forward/CUDA/Lux
7152965
ns6611350
ns1.08
ViT tiny (256 x 256 x 3 x 4)/forward/CPU/Reactant (optimize = :after_enzyme)
1417433358.5
ns1465556368
ns0.97
ViT tiny (256 x 256 x 3 x 4)/forward/CPU/Reactant
1405986386
ns1461960298
ns0.96
ViT tiny (256 x 256 x 3 x 4)/forward/CPU/Reactant (optimize = :before_enzyme)
1391770564
ns1433405185
ns0.97
ViT tiny (256 x 256 x 3 x 4)/forward/CPU/Reactant (optimize = :only_enzyme)
3124123780
ns3212094865
ns0.97
ViT tiny (256 x 256 x 3 x 4)/forward/CPU/Lux
1152850766
ns1042273863
ns1.11
ViT tiny (256 x 256 x 3 x 16)/forward/CUDA/Reactant (optimize = :after_enzyme)
1298963457
ns1299522709
ns1.00
ViT tiny (256 x 256 x 3 x 16)/forward/CUDA/Reactant
1321624559.5
ns1266625759.5
ns1.04
ViT tiny (256 x 256 x 3 x 16)/forward/CUDA/Reactant (optimize = :before_enzyme)
1228743753.5
ns1199316274.5
ns1.02
ViT tiny (256 x 256 x 3 x 16)/forward/CUDA/Reactant (optimize = :only_enzyme)
3141106256
ns2847580453
ns1.10
ViT tiny (256 x 256 x 3 x 16)/forward/CUDA/Lux
12274730.5
ns12144311
ns1.01
ViT tiny (256 x 256 x 3 x 16)/forward/CPU/Reactant (optimize = :after_enzyme)
1701322034
ns1732841938
ns0.98
ViT tiny (256 x 256 x 3 x 16)/forward/CPU/Reactant
1696176663
ns1736374516
ns0.98
ViT tiny (256 x 256 x 3 x 16)/forward/CPU/Reactant (optimize = :before_enzyme)
1686548008
ns1737563947
ns0.97
ViT tiny (256 x 256 x 3 x 16)/forward/CPU/Reactant (optimize = :only_enzyme)
3445787389
ns3537460358
ns0.97
ViT tiny (256 x 256 x 3 x 16)/forward/CPU/Lux
3140343700.5
ns3164282300
ns0.99
ViT small (256 x 256 x 3 x 16)/forward/CUDA/Reactant (optimize = :after_enzyme)
1308923747
ns1195368902
ns1.09
ViT small (256 x 256 x 3 x 16)/forward/CUDA/Reactant
1285000527
ns1222022759.5
ns1.05
ViT small (256 x 256 x 3 x 16)/forward/CUDA/Reactant (optimize = :before_enzyme)
1255551465.5
ns1209980754
ns1.04
ViT small (256 x 256 x 3 x 16)/forward/CUDA/Reactant (optimize = :only_enzyme)
3175248554
ns3057829023
ns1.04
ViT small (256 x 256 x 3 x 16)/forward/CUDA/Lux
27225045
ns27300237
ns1.00
ViT small (256 x 256 x 3 x 16)/forward/CPU/Reactant (optimize = :after_enzyme)
2141752079
ns2217674882
ns0.97
ViT small (256 x 256 x 3 x 16)/forward/CPU/Reactant
2120471203
ns2213440570
ns0.96
ViT small (256 x 256 x 3 x 16)/forward/CPU/Reactant (optimize = :before_enzyme)
2125844215
ns2212843779
ns0.96
ViT small (256 x 256 x 3 x 16)/forward/CPU/Reactant (optimize = :only_enzyme)
3892667998
ns4023171863
ns0.97
ViT small (256 x 256 x 3 x 16)/forward/CPU/Lux
5059333048.5
ns5808870489
ns0.87
ViT small (256 x 256 x 3 x 32)/forward/CUDA/Reactant (optimize = :after_enzyme)
1244546410
ns1273797452
ns0.98
ViT small (256 x 256 x 3 x 32)/forward/CUDA/Reactant
1244188168
ns1258136707
ns0.99
ViT small (256 x 256 x 3 x 32)/forward/CUDA/Reactant (optimize = :before_enzyme)
1456657537
ns1295078250
ns1.12
ViT small (256 x 256 x 3 x 32)/forward/CUDA/Reactant (optimize = :only_enzyme)
3045543887
ns3124884909
ns0.97
ViT small (256 x 256 x 3 x 32)/forward/CUDA/Lux
52743562.5
ns52782039
ns1.00
ViT small (256 x 256 x 3 x 32)/forward/CPU/Reactant (optimize = :after_enzyme)
2953298455
ns3152861032
ns0.94
ViT small (256 x 256 x 3 x 32)/forward/CPU/Reactant
2971048669
ns3116586732
ns0.95
ViT small (256 x 256 x 3 x 32)/forward/CPU/Reactant (optimize = :before_enzyme)
3053641042
ns3125795636
ns0.98
ViT small (256 x 256 x 3 x 32)/forward/CPU/Reactant (optimize = :only_enzyme)
4884156519
ns5054882478
ns0.97
ViT small (256 x 256 x 3 x 32)/forward/CPU/Lux
9364284339
ns9000472087
ns1.04
ViT base (256 x 256 x 3 x 16)/forward/CUDA/Reactant (optimize = :after_enzyme)
1409383874
ns1296586618
ns1.09
ViT base (256 x 256 x 3 x 16)/forward/CUDA/Reactant
1312408615
ns1284476181
ns1.02
ViT base (256 x 256 x 3 x 16)/forward/CUDA/Reactant (optimize = :before_enzyme)
1300800117
ns1212095690
ns1.07
ViT base (256 x 256 x 3 x 16)/forward/CUDA/Reactant (optimize = :only_enzyme)
3068426125
ns3178477034
ns0.97
ViT base (256 x 256 x 3 x 16)/forward/CUDA/Lux
70749333.5
ns70924805.5
ns1.00
ViT base (256 x 256 x 3 x 16)/forward/CPU/Reactant (optimize = :after_enzyme)
3143918589
ns3244919853
ns0.97
ViT base (256 x 256 x 3 x 16)/forward/CPU/Reactant
3077221269
ns3677731020
ns0.84
ViT base (256 x 256 x 3 x 16)/forward/CPU/Reactant (optimize = :before_enzyme)
3183700916
ns3206184434
ns0.99
ViT base (256 x 256 x 3 x 16)/forward/CPU/Reactant (optimize = :only_enzyme)
5000845941
ns5266676547
ns0.95
ViT base (256 x 256 x 3 x 16)/forward/CPU/Lux
13624219305
ns13901530015
ns0.98
ViT base (256 x 256 x 3 x 4)/forward/CUDA/Reactant (optimize = :after_enzyme)
1281095534
ns1293777394
ns0.99
ViT base (256 x 256 x 3 x 4)/forward/CUDA/Reactant
1305561574
ns1285741954.5
ns1.02
ViT base (256 x 256 x 3 x 4)/forward/CUDA/Reactant (optimize = :before_enzyme)
1346306927.5
ns1200435469
ns1.12
ViT base (256 x 256 x 3 x 4)/forward/CUDA/Reactant (optimize = :only_enzyme)
3137623892
ns2909812931
ns1.08
ViT base (256 x 256 x 3 x 4)/forward/CUDA/Lux
20759677.5
ns20593219
ns1.01
ViT base (256 x 256 x 3 x 4)/forward/CPU/Reactant (optimize = :after_enzyme)
1859442749
ns1898829192
ns0.98
ViT base (256 x 256 x 3 x 4)/forward/CPU/Reactant
1832501006
ns1886577590
ns0.97
ViT base (256 x 256 x 3 x 4)/forward/CPU/Reactant (optimize = :before_enzyme)
1848302233
ns1888126659
ns0.98
ViT base (256 x 256 x 3 x 4)/forward/CPU/Reactant (optimize = :only_enzyme)
3580451934
ns3697218074
ns0.97
ViT base (256 x 256 x 3 x 4)/forward/CPU/Lux
3224128269
ns3235249605
ns1.00
This comment was automatically generated by workflow using github-action-benchmark.