[Camera Support]: Trouble with audio and video streams #13341
Replies: 3 comments 8 replies
-
|
Audio transcoding is very lightweight. I wouldn't be overly concerned about having to transcode. Have you tried not using ffmpeg in your go2rtc config? |
Beta Was this translation helpful? Give feedback.
-
|
Yes I have. It seems it absolutely won't work. I can post errors if it would help though. I'd definitely prefer that. |
Beta Was this translation helpful? Give feedback.
-
|
Also, what do you see differently if you run ffprobe on this:
compared to your go2rtc audio transcoded stream?
I noticed that your ffprobe output you posted direct from the camera has an error parsing the audio stream's headers: |
Beta Was this translation helpful? Give feedback.
-
|
I also noticed all the errors when trying to determine the audio stream. If I look at the two stream, like you mentioned I see this: And the transcoded stream: There is an interested error in there. Additionally, the audio stream is 8Khz, and the camera is actually 16Khz. These cannot be changed. |
Beta Was this translation helpful? Give feedback.
-
|
Yep, it looks like the AAC encoding from the camera is what's causing your issue then. Transcoding looks like it's your way forward since the audio errors go away in the transcoded stream. |
Beta Was this translation helpful? Give feedback.
-
|
Do you see any other method to reduce CPU overhead? I have 4 cameras, but would eventually like to add more.
Could I have a different system do the transcoding and use web2rtc to have frigate use the already transcoded stream? |
Beta Was this translation helpful? Give feedback.
-
|
Your go2rtc CPU usage (which is doing the transcoding) is quite low already (~7%). Offloading go2rtc to another machine may save you a couple of percentage points, but in my opinion it wouldn't really be worth it. Your system has plenty of capacity for more cameras. Your cameras do seem to be running object detection actively according to your screenshot. If you don't actually have objects on those cameras at the moment, you might want to tune your motion detection using the Motion Tuner in Settings. |
Beta Was this translation helpful? Give feedback.
-
|
I'll check the debug tools and try to add some motion/object masks. Thanks! |
Beta Was this translation helpful? Give feedback.
-
|
Happy to help. Be sure to read the recent tips writeup we did on motion masks: #13040 |
Beta Was this translation helpful? Give feedback.
-
|
Also, check the motion tuning docs: https://docs.frigate.video/configuration/motion_detection/#tuning-motion-detection-during-the-day |
Beta Was this translation helpful? Give feedback.
-
Describe the problem you are having
I have had a functional system, and now I am trying to make it a little more efficient. My camera supports H264/H265 and AAC audio. I am trying to use go2rtc and do as little transcoding as possible.
If I disable audio, and do not reference it in the config, frigate starts and I can browse the web interface and see my stream in Home Assistant. If I enable AAC audio (which MSE wants) I get all kinds of errors and the stream cannot be processed.
If I enable the default audio stream on the camera of G.711A and encode it to AAC then everything works.
I would really like to minimize how much transcoding I have to do, and would like some input.
Version
0.14.0-da913d8
What browser(s) are you using?
Firefox, Edge
Frigate config file
Relevant Frigate log output
Relevant go2rtc log output
FFprobe output from your camera
Frigate stats
{"cameras":{"Front_Door":{"audio_dBFS":0.0,"audio_rms":0.0,"camera_fps":0.0,"capture_pid":476,"detection_enabled":true,"detection_fps":0.0,"ffmpeg_pid":995,"pid":473,"process_fps":0.0,"skipped_fps":0.0}},"cpu_usages":{"1":{"cmdline":"/package/admin/s6/command/s6-svscan -d4 -- /run/service","cpu":"0.0","cpu_average":"0","mem":"0.0"},"1002":{"cmdline":"sleep 30s","cpu":"0.0","cpu_average":"0","mem":"0.0"},"104":{"cmdline":"bash ./run.user go2rtc-healthcheck","cpu":"0.0","cpu_average":"0","mem":"0.0"},"125":{"cmdline":"python3 -u -m frigate","cpu":"0.8","cpu_average":"1","mem":"3.5"},"134":{"cmdline":"nginx: master process nginx","cpu":"0.0","cpu_average":"0","mem":"0.2"},"15":{"cmdline":"s6-supervise s6-linux-init-shutdownd","cpu":"0.0","cpu_average":"0","mem":"0.0"},"16":{"cmdline":"/package/admin/s6-linux-init/command/s6-linux-init-shutdownd -c /run/s6/basedir -g 3000 -C -B","cpu":"0.0","cpu_average":"0","mem":"0.0"},"162":{"cmdline":"nginx: worker process","cpu":"0.1","cpu_average":"0","mem":"0.1"},"163":{"cmdline":"nginx: worker process","cpu":"0.1","cpu_average":"0","mem":"0.1"},"164":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.1"},"170":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.1"},"181":{"cmdline":"nginx: cache manager process","cpu":"0.0","cpu_average":"0","mem":"0.1"},"24":{"cmdline":"s6-supervise go2rtc-log","cpu":"0.0","cpu_average":"0","mem":"0.0"},"25":{"cmdline":"s6-supervise go2rtc","cpu":"0.0","cpu_average":"0","mem":"0.0"},"26":{"cmdline":"s6-supervise certsync","cpu":"0.0","cpu_average":"0","mem":"0.0"},"27":{"cmdline":"s6-supervise s6rc-oneshot-runner","cpu":"0.0","cpu_average":"0","mem":"0.0"},"28":{"cmdline":"s6-supervise frigate","cpu":"0.0","cpu_average":"0","mem":"0.0"},"29":{"cmdline":"s6-supervise certsync-log","cpu":"0.0","cpu_average":"0","mem":"0.0"},"30":{"cmdline":"s6-supervise nginx-log","cpu":"0.0","cpu_average":"0","mem":"0.0"},"31":{"cmdline":"s6-supervise go2rtc-healthcheck","cpu":"0.0","cpu_average":"0","mem":"0.0"},"313":{"cmdline":"bash ./run.user certsync","cpu":"0.0","cpu_average":"0","mem":"0.0"},"32":{"cmdline":"s6-supervise s6rc-fdholder","cpu":"0.0","cpu_average":"0","mem":"0.0"},"33":{"cmdline":"s6-supervise nginx","cpu":"0.0","cpu_average":"0","mem":"0.0"},"34":{"cmdline":"s6-supervise frigate-log","cpu":"0.0","cpu_average":"0","mem":"0.0"},"342":{"cmdline":"frigate.logger ","cpu":"0.1","cpu_average":"0","mem":"1.5"},"425":{"cmdline":"frigate.recording_manager","cpu":"0.2","cpu_average":"0","mem":"1.6"},"427":{"cmdline":"frigate.review_segment_manager","cpu":"0.1","cpu_average":"0","mem":"1.6"},"45":{"cmdline":"/package/admin/s6-2.11.3.2/command/s6-fdholderd -1 -i data/rules","cpu":"0.0","cpu_average":"0","mem":"0.0"},"453":{"cmdline":"/usr/bin/python3 -c from multiprocessing.resource_tracker import main;main(57)","cpu":"0.0","cpu_average":"0","mem":"0.1"},"454":{"cmdline":"frigate.detector.coral","cpu":"0.0","cpu_average":"0","mem":"1.8"},"456":{"cmdline":"frigate.output ","cpu":"0.2","cpu_average":"0","mem":"1.7"},"46":{"cmdline":"/package/admin/s6/command/s6-ipcserverd -1 -- /package/admin/s6/command/s6-ipcserver-access -v0 -E -l0 -i data/rules -- /package/admin/s6/command/s6-sudod -t 30000 -- /package/admin/s6-rc/command/s6-rc-oneshot-run -l ../.. --","cpu":"0.0","cpu_average":"0","mem":"0.0"},"473":{"cmdline":"frigate.process:Front_Door","cpu":"0.1","cpu_average":"0","mem":"1.7"},"476":{"cmdline":"frigate.capture:Front_Door","cpu":"0.2","cpu_average":"0","mem":"1.7"},"490":{"cmdline":"ffmpeg -threads 1 -f rawvideo -pix_fmt yuv420p -video_size 640x360 -i pipe: -threads 1 -f mpegts -s 1280x720 -codec:v mpeg1video -q 8 -bf 0 pipe:","cpu":"0.0","cpu_average":"0","mem":"0.3"},"499":{"cmdline":"ffmpeg -threads 1 -f rawvideo -pix_fmt yuv420p -video_size 1280x720 -i pipe: -threads 1 -f mpegts -s 1280x720 -codec:v mpeg1video -q 8 -bf 0 pipe:","cpu":"0.0","cpu_average":"0","mem":"0.2"},"642":{"cmdline":"bash","cpu":"0.0","cpu_average":"0","mem":"0.1"},"84":{"cmdline":"s6-log -b -- T 1 n0 s10000000 T /dev/shm/logs/nginx","cpu":"0.0","cpu_average":"0","mem":"0.0"},"87":{"cmdline":"s6-log -b -- T 1 n0 s10000000 T /dev/shm/logs/go2rtc","cpu":"0.0","cpu_average":"0","mem":"0.0"},"89":{"cmdline":"s6-log -b -- T 1 n0 s10000000 T /dev/shm/logs/frigate","cpu":"0.0","cpu_average":"0","mem":"0.0"},"90":{"cmdline":"s6-log -b -- T 1 n0 s10000000 T /dev/shm/logs/certsync","cpu":"0.0","cpu_average":"0","mem":"0.0"},"96":{"cmdline":"/usr/local/go2rtc/bin/go2rtc -config=/dev/shm/go2rtc.yaml","cpu":"0.3","cpu_average":"0","mem":"0.3"},"969":{"cmdline":"ffmpeg -hide_banner -v error -allowed_media_types video+audio -fflags nobuffer -flags low_delay -timeout 5000000 -user_agent go2rtc/ffmpeg -rtsp_flags prefer_tcp -i rtsp://192.168.88.20:554/h264cif?username=admin&password=123456 -c copy -user_agent ffmpeg/go2rtc -rtsp_transport tcp -f rtsp rtsp://127.0.0.1:8554/54b8575b196c78a3f81dde5f24fe3fde","cpu":"0.5","cpu_average":"0","mem":"0.3"},"983":{"cmdline":"sleep 60","cpu":"0.0","cpu_average":"0","mem":"0.0"},"997":{"cmdline":"ffmpeg -hide_banner -v error -allowed_media_types video+audio -fflags nobuffer -flags low_delay -timeout 5000000 -user_agent go2rtc/ffmpeg -rtsp_flags prefer_tcp -i rtsp://192.168.88.20:554/h264cif?username=admin&password=123456 -c copy -user_agent ffmpeg/go2rtc -rtsp_transport tcp -f rtsp rtsp://127.0.0.1:8554/54b8575b196c78a3f81dde5f24fe3fde","cpu":"0.0","cpu_average":"0","mem":"0.3"},"999":{"cmdline":"ffmpeg -hide_banner -v error -allowed_media_types video+audio -fflags nobuffer -flags low_delay -timeout 5000000 -user_agent go2rtc/ffmpeg -rtsp_flags prefer_tcp -i rtsp://192.168.88.20:554/h264?username=admin&password=123456 -c copy -user_agent ffmpeg/go2rtc -rtsp_transport tcp -f rtsp rtsp://127.0.0.1:8554/9b3c1f1a9a21e4cfd0a49119e119a4b9","cpu":"0.0","cpu_average":"0","mem":"0.3"},"frigate.full_system":{"cpu":"3.1","mem":"20.2"}},"detection_fps":0.0,"detectors":{"coral":{"detection_start":0.0,"inference_speed":10.0,"pid":454}},"gpu_usages":{"intel-vaapi":{"gpu":"0.0%","mem":"-%"}},"processes":{"go2rtc":{"pid":96},"logger":{"pid":342},"recording":{"pid":425},"review_segment":{"pid":427}},"service":{"last_updated":1724617930,"latest_version":"0.14.0","storage":{"/dev/shm":{"free":127.4,"mount_type":"tmpfs","total":128.0,"used":0.6},"/media/frigate/clips":{"free":73609.2,"mount_type":"ext4","total":110638.2,"used":31363.8},"/media/frigate/recordings":{"free":73609.2,"mount_type":"ext4","total":110638.2,"used":31363.8},"/tmp/cache":{"free":950.2,"mount_type":"tmpfs","total":953.7,"used":3.5}},"temperatures":{},"uptime":228,"version":"0.14.0-da913d8"}}Operating system
Debian
Install method
Docker CLI
Object Detector
Coral
Network connection
Wired
Camera make and model
Hikvision/Uniview Compatible IP Turret Camera (4MP)-IPC-XD400
Screenshots of the Frigate UI's System metrics pages
Didn't provide any, unless necessary to solve
Any other information that may be helpful
No response
Beta Was this translation helpful? Give feedback.
All reactions