Skip to content

Blobfuse2 Performance Improvements

Vikas Bhansali edited this page Oct 19, 2022 · 7 revisions
Use Case Improvement over v1
Git Clone of large repo 50%
FIO Sequential Read 40%
FIO Sequential Write 40%
FIO Random Read 25%
FIO Random Write 25%
Multiple small file upload in parallel 6%
Multiple large file download in parallel 11%
ResNet50 image classification job (1.3Million images) 8%
1-Billion files listing v1 does not support this

Notes

  • For the FIO test the following command is used

fio --randrepeat=1 --ioengine=libaio --gtod_reduce=1 --name=test--bs=4k --iodepth=64 --rw=rw --rwmixread=75 --size=4G --filename=testfile4G

fio --randrepeat=1 --ioengine=libaio --gtod_reduce=1 --name=test--bs=4k --iodepth=64 --readwrite=randrw --rwmixread=75 --size=4G --filename=testfile4G