Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Question regarding settings for streaming video content (> 20GiB larger) #1540

Open
calexandre opened this issue Oct 15, 2024 · 1 comment
Open
Assignees
Milestone

Comments

@calexandre
Copy link

calexandre commented Oct 15, 2024

Hey all,
I'm trying to configure blobfuse2 for a video streaming application with recording feature and would like optimize it for the following scenario:

  • It will handle big streams with 4 to 5 hours long using standard 1080p h264, which means each recorded stream may reach about 20GiB
  • Blobfuse2 is mounted on a VM size Standard F4s v2 (4 vcpus, 8 GiB memory)
  • The storage account is a Premium Storage Account with Block Blob configured.

Currently using the poor man's benchmark tool dd if=/dev/zero of=/home/azureuser/blobfuse-mount bs=100M count=10 oflag=dsync I'm getting roughly 115MB/s.

Do you think its possible to squeeze some additional throughput using blobfuse2?

I would love to hear your thoughts on this...

This is the configuration I'm using:

allow_other: true

logging:
  type: syslog
  level: log_warning

components:
  - libfuse
  - stream
  - attr_cache
  - azstorage

libfuse:
  attribute-expiration-sec: 120
  entry-expiration-sec: 120
  negative-entry-expiration-sec: 240

stream:
  block-size-mb: 64
  max-buffers: 16
  buffer-size-mb: 128
  file-caching: false

attr_cache:
  max-size-mb: 1024
  timeout-sec: 3600

azstorage:
  type: block
@vibhansa-msft
Copy link
Member

"stream" is not a good option to choose here. Use "block-cache" instead. You can refer our sample block-cache config here

@vibhansa-msft vibhansa-msft added this to the v2-2.4.0 milestone Oct 15, 2024
@vibhansa-msft vibhansa-msft self-assigned this Oct 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants