Jagged tensor micro-benchmarks #3156

q10 · 2024-09-19T22:45:05Z

Summary:
X-link: https://github.com/facebookresearch/FBGEMM/pull/250

Add jagged tensor micro-benchmarks

(foo) bash-5.1$ python -W ignore jagged_tensor_benchmark.py device --embedding-dim 512
INFO:root:######## Jagged (2D) to Dense ########
INFO:root:FBGEMM JaggedTensor: 5.746198445558548e-05 sec 438.11657809101143 GB/s
INFO:root:PyTorch NestedTensor: 6.370197981595993e-05 sec 395.1842010676863 GB/s
INFO:root:
INFO:root:######## Dense to Jagged (2D) ########
INFO:root:FBGEMM JaggedTensor: 3.12004815787077e-05 sec 806.880109734599 GB/s
INFO:root:PyTorch NestedTensor: 0.0014418727159500122 sec 17.459249850229323 GB/s
INFO:root:
INFO:root:######## Jagged (x) Dense -> Jagged ########
INFO:root:(+) FBGEMM JaggedTensor: 4.031049832701683e-05 sec 624.9347699856205 GB/s
INFO:root:(+) PyTorch NestedTensor: 0.001540895700454712 sec 16.348564015439923 GB/s
INFO:root:(*) FBGEMM JaggedTensor: 4.03628796339035e-05 sec 624.1237550068162 GB/s
INFO:root:(*) PyTorch NestedTensor: 0.0015746270418167114 sec 15.998348390445281 GB/s
INFO:root:
INFO:root:######## Jagged + Dense + Dense -> Jagged ########
INFO:root:FBGEMM JaggedTensor: 5.2013471722602845e-05 sec 645.7602403302756 GB/s
INFO:root:PyTorch NestedTensor: 0.0028932960033416747 sec 11.608985724656774 GB/s
INFO:root:
INFO:root:######## Jagged (1D) to Dense ########
INFO:root:FBGEMM JaggedTensor: 1.526080071926117e-05 sec 6.511322821651443 GB/s
INFO:root:PyTorch NestedTensor: 3.976528346538544e-05 sec 2.4729108264901147 GB/s
INFO:root:
INFO:root:######## Dense to Jagged (1D) ########
INFO:root:FBGEMM JaggedTensor: 1.5250975266098977e-05 sec 6.51551774665078 GB/s
INFO:root:PyTorch NestedTensor: 0.0014563246965408326 sec 0.06752340342340878 GB/s
INFO:root:
(foo) bash-5.1$

Differential Revision: D59973955

netlify · 2024-09-19T22:45:22Z

✅ Deploy Preview for pytorch-fbgemm-docs ready!

Name	Link
🔨 Latest commit	`9e105ab`
🔍 Latest deploy log	https://app.netlify.com/sites/pytorch-fbgemm-docs/deploys/66edb97331fe8000071ba94a
😎 Deploy Preview	https://deploy-preview-3156--pytorch-fbgemm-docs.netlify.app
📱 Preview on mobile	Toggle QR Code... Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

facebook-github-bot · 2024-09-19T22:45:29Z

This pull request was exported from Phabricator. Differential Revision: D59973955

facebook-github-bot · 2024-09-20T00:09:23Z

This pull request was exported from Phabricator. Differential Revision: D59973955

Summary: Pull Request resolved: pytorch#3156 X-link: facebookresearch/FBGEMM#250 - Add jagged tensor micro-benchmarks ``` (foo) bash-5.1$ python -W ignore jagged_tensor_benchmark.py device --embedding-dim 512 INFO:root:######## Jagged (2D) to Dense ######## INFO:root:FBGEMM JaggedTensor: 5.746198445558548e-05 sec 438.11657809101143 GB/s INFO:root:PyTorch NestedTensor: 6.370197981595993e-05 sec 395.1842010676863 GB/s INFO:root: INFO:root:######## Dense to Jagged (2D) ######## INFO:root:FBGEMM JaggedTensor: 3.12004815787077e-05 sec 806.880109734599 GB/s INFO:root:PyTorch NestedTensor: 0.0014418727159500122 sec 17.459249850229323 GB/s INFO:root: INFO:root:######## Jagged (x) Dense -> Jagged ######## INFO:root:(+) FBGEMM JaggedTensor: 4.031049832701683e-05 sec 624.9347699856205 GB/s INFO:root:(+) PyTorch NestedTensor: 0.001540895700454712 sec 16.348564015439923 GB/s INFO:root:(*) FBGEMM JaggedTensor: 4.03628796339035e-05 sec 624.1237550068162 GB/s INFO:root:(*) PyTorch NestedTensor: 0.0015746270418167114 sec 15.998348390445281 GB/s INFO:root: INFO:root:######## Jagged + Dense + Dense -> Jagged ######## INFO:root:FBGEMM JaggedTensor: 5.2013471722602845e-05 sec 645.7602403302756 GB/s INFO:root:PyTorch NestedTensor: 0.0028932960033416747 sec 11.608985724656774 GB/s INFO:root: INFO:root:######## Jagged (1D) to Dense ######## INFO:root:FBGEMM JaggedTensor: 1.526080071926117e-05 sec 6.511322821651443 GB/s INFO:root:PyTorch NestedTensor: 3.976528346538544e-05 sec 2.4729108264901147 GB/s INFO:root: INFO:root:######## Dense to Jagged (1D) ######## INFO:root:FBGEMM JaggedTensor: 1.5250975266098977e-05 sec 6.51551774665078 GB/s INFO:root:PyTorch NestedTensor: 0.0014563246965408326 sec 0.06752340342340878 GB/s INFO:root: (foo) bash-5.1$ ``` Differential Revision: D59973955

facebook-github-bot · 2024-09-20T00:13:51Z

This pull request was exported from Phabricator. Differential Revision: D59973955

Summary: Pull Request resolved: pytorch#3156 X-link: facebookresearch/FBGEMM#250 - Add jagged tensor micro-benchmarks ``` (foo) bash-5.1$ python -W ignore jagged_tensor_benchmark.py device --embedding-dim 512 INFO:root:######## Jagged (2D) to Dense ######## INFO:root:FBGEMM JaggedTensor: 5.746198445558548e-05 sec 438.11657809101143 GB/s INFO:root:PyTorch NestedTensor: 6.370197981595993e-05 sec 395.1842010676863 GB/s INFO:root: INFO:root:######## Dense to Jagged (2D) ######## INFO:root:FBGEMM JaggedTensor: 3.12004815787077e-05 sec 806.880109734599 GB/s INFO:root:PyTorch NestedTensor: 0.0014418727159500122 sec 17.459249850229323 GB/s INFO:root: INFO:root:######## Jagged (x) Dense -> Jagged ######## INFO:root:(+) FBGEMM JaggedTensor: 4.031049832701683e-05 sec 624.9347699856205 GB/s INFO:root:(+) PyTorch NestedTensor: 0.001540895700454712 sec 16.348564015439923 GB/s INFO:root:(*) FBGEMM JaggedTensor: 4.03628796339035e-05 sec 624.1237550068162 GB/s INFO:root:(*) PyTorch NestedTensor: 0.0015746270418167114 sec 15.998348390445281 GB/s INFO:root: INFO:root:######## Jagged + Dense + Dense -> Jagged ######## INFO:root:FBGEMM JaggedTensor: 5.2013471722602845e-05 sec 645.7602403302756 GB/s INFO:root:PyTorch NestedTensor: 0.0028932960033416747 sec 11.608985724656774 GB/s INFO:root: INFO:root:######## Jagged (1D) to Dense ######## INFO:root:FBGEMM JaggedTensor: 1.526080071926117e-05 sec 6.511322821651443 GB/s INFO:root:PyTorch NestedTensor: 3.976528346538544e-05 sec 2.4729108264901147 GB/s INFO:root: INFO:root:######## Dense to Jagged (1D) ######## INFO:root:FBGEMM JaggedTensor: 1.5250975266098977e-05 sec 6.51551774665078 GB/s INFO:root:PyTorch NestedTensor: 0.0014563246965408326 sec 0.06752340342340878 GB/s INFO:root: (foo) bash-5.1$ ``` Differential Revision: D59973955

facebook-github-bot · 2024-09-20T00:18:23Z

This pull request was exported from Phabricator. Differential Revision: D59973955

Summary: Pull Request resolved: pytorch#3156 X-link: facebookresearch/FBGEMM#250 - Add jagged tensor micro-benchmarks ``` (foo) bash-5.1$ python -W ignore jagged_tensor_benchmark.py device --embedding-dim 512 INFO:root:######## Jagged (2D) to Dense ######## INFO:root:FBGEMM JaggedTensor: 5.746198445558548e-05 sec 438.11657809101143 GB/s INFO:root:PyTorch NestedTensor: 6.370197981595993e-05 sec 395.1842010676863 GB/s INFO:root: INFO:root:######## Dense to Jagged (2D) ######## INFO:root:FBGEMM JaggedTensor: 3.12004815787077e-05 sec 806.880109734599 GB/s INFO:root:PyTorch NestedTensor: 0.0014418727159500122 sec 17.459249850229323 GB/s INFO:root: INFO:root:######## Jagged (x) Dense -> Jagged ######## INFO:root:(+) FBGEMM JaggedTensor: 4.031049832701683e-05 sec 624.9347699856205 GB/s INFO:root:(+) PyTorch NestedTensor: 0.001540895700454712 sec 16.348564015439923 GB/s INFO:root:(*) FBGEMM JaggedTensor: 4.03628796339035e-05 sec 624.1237550068162 GB/s INFO:root:(*) PyTorch NestedTensor: 0.0015746270418167114 sec 15.998348390445281 GB/s INFO:root: INFO:root:######## Jagged + Dense + Dense -> Jagged ######## INFO:root:FBGEMM JaggedTensor: 5.2013471722602845e-05 sec 645.7602403302756 GB/s INFO:root:PyTorch NestedTensor: 0.0028932960033416747 sec 11.608985724656774 GB/s INFO:root: INFO:root:######## Jagged (1D) to Dense ######## INFO:root:FBGEMM JaggedTensor: 1.526080071926117e-05 sec 6.511322821651443 GB/s INFO:root:PyTorch NestedTensor: 3.976528346538544e-05 sec 2.4729108264901147 GB/s INFO:root: INFO:root:######## Dense to Jagged (1D) ######## INFO:root:FBGEMM JaggedTensor: 1.5250975266098977e-05 sec 6.51551774665078 GB/s INFO:root:PyTorch NestedTensor: 0.0014563246965408326 sec 0.06752340342340878 GB/s INFO:root: (foo) bash-5.1$ ``` Differential Revision: D59973955

facebook-github-bot · 2024-09-20T00:25:43Z

This pull request was exported from Phabricator. Differential Revision: D59973955

Summary: Pull Request resolved: pytorch#3156 X-link: facebookresearch/FBGEMM#250 - Add jagged tensor micro-benchmarks ``` (foo) bash-5.1$ python -W ignore jagged_tensor_benchmark.py device --embedding-dim 512 INFO:root:######## Jagged (2D) to Dense ######## INFO:root:FBGEMM JaggedTensor: 5.746198445558548e-05 sec 438.11657809101143 GB/s INFO:root:PyTorch NestedTensor: 6.370197981595993e-05 sec 395.1842010676863 GB/s INFO:root: INFO:root:######## Dense to Jagged (2D) ######## INFO:root:FBGEMM JaggedTensor: 3.12004815787077e-05 sec 806.880109734599 GB/s INFO:root:PyTorch NestedTensor: 0.0014418727159500122 sec 17.459249850229323 GB/s INFO:root: INFO:root:######## Jagged (x) Dense -> Jagged ######## INFO:root:(+) FBGEMM JaggedTensor: 4.031049832701683e-05 sec 624.9347699856205 GB/s INFO:root:(+) PyTorch NestedTensor: 0.001540895700454712 sec 16.348564015439923 GB/s INFO:root:(*) FBGEMM JaggedTensor: 4.03628796339035e-05 sec 624.1237550068162 GB/s INFO:root:(*) PyTorch NestedTensor: 0.0015746270418167114 sec 15.998348390445281 GB/s INFO:root: INFO:root:######## Jagged + Dense + Dense -> Jagged ######## INFO:root:FBGEMM JaggedTensor: 5.2013471722602845e-05 sec 645.7602403302756 GB/s INFO:root:PyTorch NestedTensor: 0.0028932960033416747 sec 11.608985724656774 GB/s INFO:root: INFO:root:######## Jagged (1D) to Dense ######## INFO:root:FBGEMM JaggedTensor: 1.526080071926117e-05 sec 6.511322821651443 GB/s INFO:root:PyTorch NestedTensor: 3.976528346538544e-05 sec 2.4729108264901147 GB/s INFO:root: INFO:root:######## Dense to Jagged (1D) ######## INFO:root:FBGEMM JaggedTensor: 1.5250975266098977e-05 sec 6.51551774665078 GB/s INFO:root:PyTorch NestedTensor: 0.0014563246965408326 sec 0.06752340342340878 GB/s INFO:root: (foo) bash-5.1$ ``` Differential Revision: D59973955

facebook-github-bot · 2024-09-20T00:30:12Z

This pull request was exported from Phabricator. Differential Revision: D59973955

Summary: Pull Request resolved: pytorch#3156 X-link: facebookresearch/FBGEMM#250 - Add jagged tensor micro-benchmarks ``` (foo) bash-5.1$ python -W ignore jagged_tensor_benchmark.py device --embedding-dim 512 INFO:root:######## Jagged (2D) to Dense ######## INFO:root:FBGEMM JaggedTensor: 5.746198445558548e-05 sec 438.11657809101143 GB/s INFO:root:PyTorch NestedTensor: 6.370197981595993e-05 sec 395.1842010676863 GB/s INFO:root: INFO:root:######## Dense to Jagged (2D) ######## INFO:root:FBGEMM JaggedTensor: 3.12004815787077e-05 sec 806.880109734599 GB/s INFO:root:PyTorch NestedTensor: 0.0014418727159500122 sec 17.459249850229323 GB/s INFO:root: INFO:root:######## Jagged (x) Dense -> Jagged ######## INFO:root:(+) FBGEMM JaggedTensor: 4.031049832701683e-05 sec 624.9347699856205 GB/s INFO:root:(+) PyTorch NestedTensor: 0.001540895700454712 sec 16.348564015439923 GB/s INFO:root:(*) FBGEMM JaggedTensor: 4.03628796339035e-05 sec 624.1237550068162 GB/s INFO:root:(*) PyTorch NestedTensor: 0.0015746270418167114 sec 15.998348390445281 GB/s INFO:root: INFO:root:######## Jagged + Dense + Dense -> Jagged ######## INFO:root:FBGEMM JaggedTensor: 5.2013471722602845e-05 sec 645.7602403302756 GB/s INFO:root:PyTorch NestedTensor: 0.0028932960033416747 sec 11.608985724656774 GB/s INFO:root: INFO:root:######## Jagged (1D) to Dense ######## INFO:root:FBGEMM JaggedTensor: 1.526080071926117e-05 sec 6.511322821651443 GB/s INFO:root:PyTorch NestedTensor: 3.976528346538544e-05 sec 2.4729108264901147 GB/s INFO:root: INFO:root:######## Dense to Jagged (1D) ######## INFO:root:FBGEMM JaggedTensor: 1.5250975266098977e-05 sec 6.51551774665078 GB/s INFO:root:PyTorch NestedTensor: 0.0014563246965408326 sec 0.06752340342340878 GB/s INFO:root: (foo) bash-5.1$ ``` Differential Revision: D59973955

facebook-github-bot · 2024-09-20T00:36:44Z

This pull request was exported from Phabricator. Differential Revision: D59973955

Summary: Pull Request resolved: pytorch#3156 X-link: facebookresearch/FBGEMM#250 - Add jagged tensor micro-benchmarks ``` (foo) bash-5.1$ python -W ignore jagged_tensor_benchmark.py device --embedding-dim 512 INFO:root:######## Jagged (2D) to Dense ######## INFO:root:FBGEMM JaggedTensor: 5.746198445558548e-05 sec 438.11657809101143 GB/s INFO:root:PyTorch NestedTensor: 6.370197981595993e-05 sec 395.1842010676863 GB/s INFO:root: INFO:root:######## Dense to Jagged (2D) ######## INFO:root:FBGEMM JaggedTensor: 3.12004815787077e-05 sec 806.880109734599 GB/s INFO:root:PyTorch NestedTensor: 0.0014418727159500122 sec 17.459249850229323 GB/s INFO:root: INFO:root:######## Jagged (x) Dense -> Jagged ######## INFO:root:(+) FBGEMM JaggedTensor: 4.031049832701683e-05 sec 624.9347699856205 GB/s INFO:root:(+) PyTorch NestedTensor: 0.001540895700454712 sec 16.348564015439923 GB/s INFO:root:(*) FBGEMM JaggedTensor: 4.03628796339035e-05 sec 624.1237550068162 GB/s INFO:root:(*) PyTorch NestedTensor: 0.0015746270418167114 sec 15.998348390445281 GB/s INFO:root: INFO:root:######## Jagged + Dense + Dense -> Jagged ######## INFO:root:FBGEMM JaggedTensor: 5.2013471722602845e-05 sec 645.7602403302756 GB/s INFO:root:PyTorch NestedTensor: 0.0028932960033416747 sec 11.608985724656774 GB/s INFO:root: INFO:root:######## Jagged (1D) to Dense ######## INFO:root:FBGEMM JaggedTensor: 1.526080071926117e-05 sec 6.511322821651443 GB/s INFO:root:PyTorch NestedTensor: 3.976528346538544e-05 sec 2.4729108264901147 GB/s INFO:root: INFO:root:######## Dense to Jagged (1D) ######## INFO:root:FBGEMM JaggedTensor: 1.5250975266098977e-05 sec 6.51551774665078 GB/s INFO:root:PyTorch NestedTensor: 0.0014563246965408326 sec 0.06752340342340878 GB/s INFO:root: (foo) bash-5.1$ ``` Differential Revision: D59973955

facebook-github-bot · 2024-09-20T00:41:57Z

This pull request was exported from Phabricator. Differential Revision: D59973955

Summary: Pull Request resolved: pytorch#3156 X-link: facebookresearch/FBGEMM#250 - Add jagged tensor micro-benchmarks ``` (foo) bash-5.1$ python -W ignore jagged_tensor_benchmark.py device --embedding-dim 512 INFO:root:######## Jagged (2D) to Dense ######## INFO:root:FBGEMM JaggedTensor: 5.746198445558548e-05 sec 438.11657809101143 GB/s INFO:root:PyTorch NestedTensor: 6.370197981595993e-05 sec 395.1842010676863 GB/s INFO:root: INFO:root:######## Dense to Jagged (2D) ######## INFO:root:FBGEMM JaggedTensor: 3.12004815787077e-05 sec 806.880109734599 GB/s INFO:root:PyTorch NestedTensor: 0.0014418727159500122 sec 17.459249850229323 GB/s INFO:root: INFO:root:######## Jagged (x) Dense -> Jagged ######## INFO:root:(+) FBGEMM JaggedTensor: 4.031049832701683e-05 sec 624.9347699856205 GB/s INFO:root:(+) PyTorch NestedTensor: 0.001540895700454712 sec 16.348564015439923 GB/s INFO:root:(*) FBGEMM JaggedTensor: 4.03628796339035e-05 sec 624.1237550068162 GB/s INFO:root:(*) PyTorch NestedTensor: 0.0015746270418167114 sec 15.998348390445281 GB/s INFO:root: INFO:root:######## Jagged + Dense + Dense -> Jagged ######## INFO:root:FBGEMM JaggedTensor: 5.2013471722602845e-05 sec 645.7602403302756 GB/s INFO:root:PyTorch NestedTensor: 0.0028932960033416747 sec 11.608985724656774 GB/s INFO:root: INFO:root:######## Jagged (1D) to Dense ######## INFO:root:FBGEMM JaggedTensor: 1.526080071926117e-05 sec 6.511322821651443 GB/s INFO:root:PyTorch NestedTensor: 3.976528346538544e-05 sec 2.4729108264901147 GB/s INFO:root: INFO:root:######## Dense to Jagged (1D) ######## INFO:root:FBGEMM JaggedTensor: 1.5250975266098977e-05 sec 6.51551774665078 GB/s INFO:root:PyTorch NestedTensor: 0.0014563246965408326 sec 0.06752340342340878 GB/s INFO:root: (foo) bash-5.1$ ``` Differential Revision: D59973955

facebook-github-bot · 2024-09-20T00:47:18Z

This pull request was exported from Phabricator. Differential Revision: D59973955

Summary: Pull Request resolved: pytorch#3156 X-link: facebookresearch/FBGEMM#250 - Add jagged tensor micro-benchmarks ``` (foo) bash-5.1$ python -W ignore jagged_tensor_benchmark.py device --embedding-dim 512 INFO:root:######## Jagged (2D) to Dense ######## INFO:root:FBGEMM JaggedTensor: 5.746198445558548e-05 sec 438.11657809101143 GB/s INFO:root:PyTorch NestedTensor: 6.370197981595993e-05 sec 395.1842010676863 GB/s INFO:root: INFO:root:######## Dense to Jagged (2D) ######## INFO:root:FBGEMM JaggedTensor: 3.12004815787077e-05 sec 806.880109734599 GB/s INFO:root:PyTorch NestedTensor: 0.0014418727159500122 sec 17.459249850229323 GB/s INFO:root: INFO:root:######## Jagged (x) Dense -> Jagged ######## INFO:root:(+) FBGEMM JaggedTensor: 4.031049832701683e-05 sec 624.9347699856205 GB/s INFO:root:(+) PyTorch NestedTensor: 0.001540895700454712 sec 16.348564015439923 GB/s INFO:root:(*) FBGEMM JaggedTensor: 4.03628796339035e-05 sec 624.1237550068162 GB/s INFO:root:(*) PyTorch NestedTensor: 0.0015746270418167114 sec 15.998348390445281 GB/s INFO:root: INFO:root:######## Jagged + Dense + Dense -> Jagged ######## INFO:root:FBGEMM JaggedTensor: 5.2013471722602845e-05 sec 645.7602403302756 GB/s INFO:root:PyTorch NestedTensor: 0.0028932960033416747 sec 11.608985724656774 GB/s INFO:root: INFO:root:######## Jagged (1D) to Dense ######## INFO:root:FBGEMM JaggedTensor: 1.526080071926117e-05 sec 6.511322821651443 GB/s INFO:root:PyTorch NestedTensor: 3.976528346538544e-05 sec 2.4729108264901147 GB/s INFO:root: INFO:root:######## Dense to Jagged (1D) ######## INFO:root:FBGEMM JaggedTensor: 1.5250975266098977e-05 sec 6.51551774665078 GB/s INFO:root:PyTorch NestedTensor: 0.0014563246965408326 sec 0.06752340342340878 GB/s INFO:root: (foo) bash-5.1$ ``` Differential Revision: D59973955

facebook-github-bot · 2024-09-20T00:52:03Z

This pull request was exported from Phabricator. Differential Revision: D59973955

Summary: Pull Request resolved: pytorch#3156 X-link: facebookresearch/FBGEMM#250 - Add jagged tensor micro-benchmarks ``` (foo) bash-5.1$ python -W ignore jagged_tensor_benchmark.py device --embedding-dim 512 INFO:root:######## Jagged (2D) to Dense ######## INFO:root:FBGEMM JaggedTensor: 5.746198445558548e-05 sec 438.11657809101143 GB/s INFO:root:PyTorch NestedTensor: 6.370197981595993e-05 sec 395.1842010676863 GB/s INFO:root: INFO:root:######## Dense to Jagged (2D) ######## INFO:root:FBGEMM JaggedTensor: 3.12004815787077e-05 sec 806.880109734599 GB/s INFO:root:PyTorch NestedTensor: 0.0014418727159500122 sec 17.459249850229323 GB/s INFO:root: INFO:root:######## Jagged (x) Dense -> Jagged ######## INFO:root:(+) FBGEMM JaggedTensor: 4.031049832701683e-05 sec 624.9347699856205 GB/s INFO:root:(+) PyTorch NestedTensor: 0.001540895700454712 sec 16.348564015439923 GB/s INFO:root:(*) FBGEMM JaggedTensor: 4.03628796339035e-05 sec 624.1237550068162 GB/s INFO:root:(*) PyTorch NestedTensor: 0.0015746270418167114 sec 15.998348390445281 GB/s INFO:root: INFO:root:######## Jagged + Dense + Dense -> Jagged ######## INFO:root:FBGEMM JaggedTensor: 5.2013471722602845e-05 sec 645.7602403302756 GB/s INFO:root:PyTorch NestedTensor: 0.0028932960033416747 sec 11.608985724656774 GB/s INFO:root: INFO:root:######## Jagged (1D) to Dense ######## INFO:root:FBGEMM JaggedTensor: 1.526080071926117e-05 sec 6.511322821651443 GB/s INFO:root:PyTorch NestedTensor: 3.976528346538544e-05 sec 2.4729108264901147 GB/s INFO:root: INFO:root:######## Dense to Jagged (1D) ######## INFO:root:FBGEMM JaggedTensor: 1.5250975266098977e-05 sec 6.51551774665078 GB/s INFO:root:PyTorch NestedTensor: 0.0014563246965408326 sec 0.06752340342340878 GB/s INFO:root: (foo) bash-5.1$ ``` Differential Revision: D59973955

facebook-github-bot · 2024-09-20T00:57:47Z

This pull request was exported from Phabricator. Differential Revision: D59973955

Summary: Pull Request resolved: pytorch#3156 X-link: facebookresearch/FBGEMM#250 - Add jagged tensor micro-benchmarks ``` (foo) bash-5.1$ python -W ignore jagged_tensor_benchmark.py device --embedding-dim 512 INFO:root:######## Jagged (2D) to Dense ######## INFO:root:FBGEMM JaggedTensor: 5.746198445558548e-05 sec 438.11657809101143 GB/s INFO:root:PyTorch NestedTensor: 6.370197981595993e-05 sec 395.1842010676863 GB/s INFO:root: INFO:root:######## Dense to Jagged (2D) ######## INFO:root:FBGEMM JaggedTensor: 3.12004815787077e-05 sec 806.880109734599 GB/s INFO:root:PyTorch NestedTensor: 0.0014418727159500122 sec 17.459249850229323 GB/s INFO:root: INFO:root:######## Jagged (x) Dense -> Jagged ######## INFO:root:(+) FBGEMM JaggedTensor: 4.031049832701683e-05 sec 624.9347699856205 GB/s INFO:root:(+) PyTorch NestedTensor: 0.001540895700454712 sec 16.348564015439923 GB/s INFO:root:(*) FBGEMM JaggedTensor: 4.03628796339035e-05 sec 624.1237550068162 GB/s INFO:root:(*) PyTorch NestedTensor: 0.0015746270418167114 sec 15.998348390445281 GB/s INFO:root: INFO:root:######## Jagged + Dense + Dense -> Jagged ######## INFO:root:FBGEMM JaggedTensor: 5.2013471722602845e-05 sec 645.7602403302756 GB/s INFO:root:PyTorch NestedTensor: 0.0028932960033416747 sec 11.608985724656774 GB/s INFO:root: INFO:root:######## Jagged (1D) to Dense ######## INFO:root:FBGEMM JaggedTensor: 1.526080071926117e-05 sec 6.511322821651443 GB/s INFO:root:PyTorch NestedTensor: 3.976528346538544e-05 sec 2.4729108264901147 GB/s INFO:root: INFO:root:######## Dense to Jagged (1D) ######## INFO:root:FBGEMM JaggedTensor: 1.5250975266098977e-05 sec 6.51551774665078 GB/s INFO:root:PyTorch NestedTensor: 0.0014563246965408326 sec 0.06752340342340878 GB/s INFO:root: (foo) bash-5.1$ ``` Differential Revision: D59973955

facebook-github-bot · 2024-09-20T01:02:54Z

This pull request was exported from Phabricator. Differential Revision: D59973955

Summary: Pull Request resolved: pytorch#3156 X-link: facebookresearch/FBGEMM#250 - Add jagged tensor micro-benchmarks ``` (foo) bash-5.1$ python -W ignore jagged_tensor_benchmark.py device --embedding-dim 512 INFO:root:######## Jagged (2D) to Dense ######## INFO:root:FBGEMM JaggedTensor: 5.746198445558548e-05 sec 438.11657809101143 GB/s INFO:root:PyTorch NestedTensor: 6.370197981595993e-05 sec 395.1842010676863 GB/s INFO:root: INFO:root:######## Dense to Jagged (2D) ######## INFO:root:FBGEMM JaggedTensor: 3.12004815787077e-05 sec 806.880109734599 GB/s INFO:root:PyTorch NestedTensor: 0.0014418727159500122 sec 17.459249850229323 GB/s INFO:root: INFO:root:######## Jagged (x) Dense -> Jagged ######## INFO:root:(+) FBGEMM JaggedTensor: 4.031049832701683e-05 sec 624.9347699856205 GB/s INFO:root:(+) PyTorch NestedTensor: 0.001540895700454712 sec 16.348564015439923 GB/s INFO:root:(*) FBGEMM JaggedTensor: 4.03628796339035e-05 sec 624.1237550068162 GB/s INFO:root:(*) PyTorch NestedTensor: 0.0015746270418167114 sec 15.998348390445281 GB/s INFO:root: INFO:root:######## Jagged + Dense + Dense -> Jagged ######## INFO:root:FBGEMM JaggedTensor: 5.2013471722602845e-05 sec 645.7602403302756 GB/s INFO:root:PyTorch NestedTensor: 0.0028932960033416747 sec 11.608985724656774 GB/s INFO:root: INFO:root:######## Jagged (1D) to Dense ######## INFO:root:FBGEMM JaggedTensor: 1.526080071926117e-05 sec 6.511322821651443 GB/s INFO:root:PyTorch NestedTensor: 3.976528346538544e-05 sec 2.4729108264901147 GB/s INFO:root: INFO:root:######## Dense to Jagged (1D) ######## INFO:root:FBGEMM JaggedTensor: 1.5250975266098977e-05 sec 6.51551774665078 GB/s INFO:root:PyTorch NestedTensor: 0.0014563246965408326 sec 0.06752340342340878 GB/s INFO:root: (foo) bash-5.1$ ``` Differential Revision: D59973955

Summary: Pull Request resolved: pytorch#3156 X-link: facebookresearch/FBGEMM#250 - Add jagged tensor micro-benchmarks ``` (foo) bash-5.1$ python -W ignore jagged_tensor_benchmark.py device --embedding-dim 512 INFO:root:######## Jagged (2D) to Dense ######## INFO:root:FBGEMM JaggedTensor: 5.746198445558548e-05 sec 438.11657809101143 GB/s INFO:root:PyTorch NestedTensor: 6.370197981595993e-05 sec 395.1842010676863 GB/s INFO:root: INFO:root:######## Dense to Jagged (2D) ######## INFO:root:FBGEMM JaggedTensor: 3.12004815787077e-05 sec 806.880109734599 GB/s INFO:root:PyTorch NestedTensor: 0.0014418727159500122 sec 17.459249850229323 GB/s INFO:root: INFO:root:######## Jagged (x) Dense -> Jagged ######## INFO:root:(+) FBGEMM JaggedTensor: 4.031049832701683e-05 sec 624.9347699856205 GB/s INFO:root:(+) PyTorch NestedTensor: 0.001540895700454712 sec 16.348564015439923 GB/s INFO:root:(*) FBGEMM JaggedTensor: 4.03628796339035e-05 sec 624.1237550068162 GB/s INFO:root:(*) PyTorch NestedTensor: 0.0015746270418167114 sec 15.998348390445281 GB/s INFO:root: INFO:root:######## Jagged + Dense + Dense -> Jagged ######## INFO:root:FBGEMM JaggedTensor: 5.2013471722602845e-05 sec 645.7602403302756 GB/s INFO:root:PyTorch NestedTensor: 0.0028932960033416747 sec 11.608985724656774 GB/s INFO:root: INFO:root:######## Jagged (1D) to Dense ######## INFO:root:FBGEMM JaggedTensor: 1.526080071926117e-05 sec 6.511322821651443 GB/s INFO:root:PyTorch NestedTensor: 3.976528346538544e-05 sec 2.4729108264901147 GB/s INFO:root: INFO:root:######## Dense to Jagged (1D) ######## INFO:root:FBGEMM JaggedTensor: 1.5250975266098977e-05 sec 6.51551774665078 GB/s INFO:root:PyTorch NestedTensor: 0.0014563246965408326 sec 0.06752340342340878 GB/s INFO:root: (foo) bash-5.1$ ``` Reviewed By: spcyppt Differential Revision: D59973955

facebook-github-bot · 2024-09-20T18:05:38Z

This pull request was exported from Phabricator. Differential Revision: D59973955

facebook-github-bot · 2024-09-20T19:32:35Z

This pull request has been merged in f305522.

facebook-github-bot added the cla signed label Sep 19, 2024

facebook-github-bot added the fb-exported label Sep 19, 2024

q10 force-pushed the export-D59973955 branch from 50b724e to 8981eb7 Compare September 20, 2024 00:09

q10 force-pushed the export-D59973955 branch from 8981eb7 to c9e615c Compare September 20, 2024 00:13

q10 force-pushed the export-D59973955 branch from c9e615c to 567ffd8 Compare September 20, 2024 00:18

q10 force-pushed the export-D59973955 branch from 567ffd8 to 73cdee8 Compare September 20, 2024 00:25

q10 force-pushed the export-D59973955 branch from 73cdee8 to 9fda157 Compare September 20, 2024 00:30

q10 force-pushed the export-D59973955 branch from 9fda157 to d3f072c Compare September 20, 2024 00:36

q10 force-pushed the export-D59973955 branch from d3f072c to 0f563b2 Compare September 20, 2024 00:42

q10 force-pushed the export-D59973955 branch from 0f563b2 to 785674f Compare September 20, 2024 00:47

q10 force-pushed the export-D59973955 branch from 785674f to 2c8fe4b Compare September 20, 2024 00:52

q10 force-pushed the export-D59973955 branch from 2c8fe4b to 610c3ce Compare September 20, 2024 00:57

q10 force-pushed the export-D59973955 branch from 610c3ce to 317dae9 Compare September 20, 2024 01:03

q10 force-pushed the export-D59973955 branch from 317dae9 to 9e105ab Compare September 20, 2024 18:05

facebook-github-bot closed this in f305522 Sep 20, 2024

facebook-github-bot added the Merged label Sep 20, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Jagged tensor micro-benchmarks #3156

Jagged tensor micro-benchmarks #3156

q10 commented Sep 19, 2024

netlify bot commented Sep 19, 2024 •

edited

Loading

facebook-github-bot commented Sep 19, 2024

facebook-github-bot commented Sep 20, 2024

facebook-github-bot commented Sep 20, 2024

facebook-github-bot commented Sep 20, 2024

facebook-github-bot commented Sep 20, 2024

facebook-github-bot commented Sep 20, 2024

facebook-github-bot commented Sep 20, 2024

facebook-github-bot commented Sep 20, 2024

facebook-github-bot commented Sep 20, 2024

facebook-github-bot commented Sep 20, 2024

facebook-github-bot commented Sep 20, 2024

facebook-github-bot commented Sep 20, 2024

facebook-github-bot commented Sep 20, 2024

facebook-github-bot commented Sep 20, 2024

Jagged tensor micro-benchmarks #3156

Jagged tensor micro-benchmarks #3156

Conversation

q10 commented Sep 19, 2024

netlify bot commented Sep 19, 2024 • edited Loading

✅ Deploy Preview for pytorch-fbgemm-docs ready!

facebook-github-bot commented Sep 19, 2024

facebook-github-bot commented Sep 20, 2024

facebook-github-bot commented Sep 20, 2024

facebook-github-bot commented Sep 20, 2024

facebook-github-bot commented Sep 20, 2024

facebook-github-bot commented Sep 20, 2024

facebook-github-bot commented Sep 20, 2024

facebook-github-bot commented Sep 20, 2024

facebook-github-bot commented Sep 20, 2024

facebook-github-bot commented Sep 20, 2024

facebook-github-bot commented Sep 20, 2024

facebook-github-bot commented Sep 20, 2024

facebook-github-bot commented Sep 20, 2024

facebook-github-bot commented Sep 20, 2024

netlify bot commented Sep 19, 2024 •

edited

Loading