[Camera Support]: No audio I cannot get audio to work either live or recorded. #13301

mworsnop · 2024-08-23T20:37:47Z

mworsnop
Aug 23, 2024

Describe the problem you are having

This is a new installation. I cannot get audio to work either live or recorded.

OK trying to debug this..., what I did is installed go2RTC as a standalone. I stopped frigate from running and started go2rtc by itself. I then went to the web on Port 1984 and the camera looked good and has full audio. Works great

I then copied the streams configuration and pasted it into the frigate yaml. I shut off the standalone go2RTC. I started frigate and went to the same web on Port 1984. The picture looks good, but there's no audio.

I have some weird configuration or what. I think it should've worked whether it was running standalone or as part of the bundle with frigate. I am completely lost about what to try now. I've only been messing with this for a couple of days so I'm not an expert at all.

Version

0.14

What browser(s) are you using?

Chrome Version 128.0.6613.84 (Official Build) (arm64)

Frigate config file

mqtt:
  enabled: false
  host: 10.215.81.5
  port: 1883
  topic_prefix: frigate
  client_id: frigate
  user: mqtt-user
  password: monte
  stats_interval: 60

# database:
#   path: /database/frigate.db

detectors:
  coral:
    type: edgetpu
    device: usb

ffmpeg:
  output_args:
    record: preset-record-generic-audio-aac

go2rtc:
  streams:
    A1_Test:
      - rtsp://admin:[email protected]:554/cam/realmonitor?channel=1&subtype=0
      - ffmpeg:camera.A1_Test#audio=aac

audio: # <- enable audio events for all camera
  enabled: True

record:
  enabled: True
  retain:
    days: 3
    mode: all
  events:
    retain:
      default: 30
      mode: motion

snapshots:
  enabled: true
  timestamp: true
  bounding_box: true
  retain:
    default: 3

cameras:
  A1_Test:
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://admin:[email protected]:554/cam/realmonitor?channel=1&subtype=0
          roles:
            - record
            - detect
            - audio

    objects:
      track:
        - person
      filters:
        person:
          threshold: 0.7

    audio:
      enabled: true
      max_not_heard: 30
      min_volume: 300
      listen:
        - scream
        - speech
        - yell
        - car
        - bark
        - bike
        - motorcycle

    detect:
      enabled: true #
      width: 1280
      height: 720

  W2_Test:
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://admin:[email protected]:554/cam/realmonitor?channel=1&subtype=0
          roles:
            - record
            - detect
            - audio

    objects:
      track:
        - person
      filters:
        person:
          threshold: 0.7

    detect:
      enabled: true #
      width: 1280
      height: 720

version: 0.14

Relevant Frigate log output

2024-08-23 20:19:31.899827669  [2024-08-23 13:19:31] frigate.util.config            INFO    : frigate config does not need migration...
2024-08-23 20:19:32.013135608  [2024-08-23 13:19:32] frigate.util.services          INFO    : Automatically detected vaapi hwaccel for video decoding
2024-08-23 20:19:32.031262037  [2024-08-23 13:19:32] peewee_migrate.logs            INFO    : Starting migrations
2024-08-23 20:19:32.031524052  [2024-08-23 13:19:32] peewee_migrate.logs            INFO    : There is nothing to migrate
2024-08-23 20:19:32.037645344  [2024-08-23 13:19:32] frigate.app                    INFO    : Recording process started: 437
2024-08-23 20:19:32.040422127  [2024-08-23 13:19:32] frigate.app                    INFO    : Recording process started: 441
2024-08-23 20:19:32.041763843  [2024-08-23 13:19:32] frigate.app                    INFO    : go2rtc process pid: 97
2024-08-23 20:19:32.052766223  [2024-08-23 13:19:32] detector.coral                 INFO    : Starting detection process: 465
2024-08-23 20:19:34.792267501  [2024-08-23 13:19:32] frigate.app                    INFO    : Output process started: 467
2024-08-23 20:19:34.794780751  [2024-08-23 13:19:32] frigate.detectors.plugins.edgetpu_tfl INFO    : Attempting to load TPU as usb
2024-08-23 20:19:34.794786059  [2024-08-23 13:19:32] frigate.app                    INFO    : Camera processor started for A1_Test: 484
2024-08-23 20:19:34.794814994  [2024-08-23 13:19:34] frigate.detectors.plugins.edgetpu_tfl INFO    : TPU found
2024-08-23 20:19:34.794843817  [2024-08-23 13:19:32] frigate.app                    INFO    : Camera processor started for W2_Test: 490
2024-08-23 20:19:34.794873483  [2024-08-23 13:19:32] frigate.app                    INFO    : Capture process started for A1_Test: 498
2024-08-23 20:19:34.794899536  [2024-08-23 13:19:32] frigate.app                    INFO    : Capture process started for W2_Test: 504
2024-08-23 20:19:34.794939764  [2024-08-23 13:19:32] frigate.app                    INFO    : Audio process started: 508
2024-08-23 20:19:40.930339704  [INFO] Starting go2rtc healthcheck service...
2024-08-23 20:19:54.808632623  127.0.0.1 - - [23/Aug/2024:13:19:54 -0700] "POST /api/events/A1_Test/speech/create HTTP/1.1" 200 95 "-" "python-requests/2.32.3" "-"
2024-08-23 20:19:54.938287001  127.0.0.1 - - [23/Aug/2024:13:19:54 -0700] "POST /api/events/W2_Test/speech/create HTTP/1.1" 200 95 "-" "python-requests/2.32.3" "-"
s6-rc: info: service legacy-services: stopping
s6-rc: info: service legacy-services successfully stopped
s6-rc: info: service go2rtc-healthcheck: stopping
s6-rc: info: service certsync: stopping
2024-08-23 20:20:15.859598944  [INFO] The go2rtc-healthcheck service exited with code 256 (by signal 15)
s6-rc: info: service go2rtc-healthcheck successfully stopped
2024-08-23 20:20:15.860156264  [INFO] Service CERTSYNC exited with code 256 (by signal 15)
s6-rc: info: service certsync successfully stopped
s6-rc: info: service nginx: stopping
s6-rc: info: service certsync-log: stopping
s6-rc: info: service certsync-log successfully stopped
2024-08-23 20:20:15.898132596  [INFO] Service NGINX exited with code 0 (by signal 0)
s6-rc: info: service nginx successfully stopped
s6-rc: info: service nginx-log: stopping
s6-rc: info: service frigate: stopping
s6-rc: info: service nginx-log successfully stopped
2024-08-23 20:20:15.900570901  [2024-08-23 13:20:15] frigate.app                    INFO    : Flask has exited...
2024-08-23 20:20:15.900671204  [2024-08-23 13:20:15] frigate.app                    INFO    : Stopping...
2024-08-23 20:20:15.901591070  [2024-08-23 13:20:15] frigate.watchdog               INFO    : Exiting watchdog...
2024-08-23 20:20:15.901767187  [2024-08-23 13:20:15] frigate.storage                INFO    : Exiting storage maintainer...
2024-08-23 20:20:15.901817805  [2024-08-23 13:20:15] frigate.events.cleanup         INFO    : Exiting event cleanup...
2024-08-23 20:20:15.902103175  [2024-08-23 13:20:15] frigate.record.cleanup         INFO    : Exiting recording cleanup...
2024-08-23 20:20:15.902168504  [2024-08-23 13:20:15] frigate.ptz.autotrack          INFO    : Exiting autotracker...
2024-08-23 20:20:15.902534252  [2024-08-23 13:20:15] frigate.stats.emitter          INFO    : Exiting stats emitter...
2024-08-23 20:20:15.952039032  [2024-08-23 13:20:15] frigate.object_processing      INFO    : Exiting object processor...
2024-08-23 20:20:15.959378049  [2024-08-23 13:20:15] frigate.events.maintainer      INFO    : Exiting event processor...
2024-08-23 20:20:16.131929141  [2024-08-23 13:20:16] audio.A1_Test                  INFO    : Terminating the existing ffmpeg process...
2024-08-23 20:20:16.132052957  [2024-08-23 13:20:16] audio.A1_Test                  INFO    : Waiting for ffmpeg to exit gracefully...
2024-08-23 20:20:16.231038291  [2024-08-23 13:20:16] audio.W2_Test                  INFO    : Terminating the existing ffmpeg process...
2024-08-23 20:20:16.231169704  [2024-08-23 13:20:16] audio.W2_Test                  INFO    : Waiting for ffmpeg to exit gracefully...
2024-08-23 20:20:16.360358767  [2024-08-23 13:20:16] frigate.app                    INFO    : Waiting for capture process for A1_Test to stop
2024-08-23 20:20:16.361203680  [2024-08-23 13:20:16] watchdog.A1_Test               INFO    : Terminating the existing ffmpeg process...
2024-08-23 20:20:16.361274243  [2024-08-23 13:20:16] watchdog.A1_Test               INFO    : Waiting for ffmpeg to exit gracefully...
2024-08-23 20:20:16.399362270  [2024-08-23 13:20:16] frigate.app                    INFO    : Waiting for capture process for W2_Test to stop
2024-08-23 20:20:16.399635342  [2024-08-23 13:20:16] watchdog.W2_Test               INFO    : Terminating the existing ffmpeg process...
2024-08-23 20:20:16.399685070  [2024-08-23 13:20:16] watchdog.W2_Test               INFO    : Waiting for ffmpeg to exit gracefully...
2024-08-23 20:20:16.455814063  [2024-08-23 13:20:16] frigate.app                    INFO    : Waiting for process for A1_Test to stop
2024-08-23 20:20:17.365527344  [2024-08-23 13:20:17] frigate.video                  INFO    : A1_Test: emptying frame queue
2024-08-23 20:20:17.365645841  [2024-08-23 13:20:17] frigate.video                  INFO    : A1_Test: exiting subprocess
2024-08-23 20:20:17.374383980  [2024-08-23 13:20:17] frigate.app                    INFO    : Closing frame queue for A1_Test
2024-08-23 20:20:17.875483917  [2024-08-23 13:20:17] frigate.app                    INFO    : Waiting for process for W2_Test to stop
2024-08-23 20:20:18.372692603  [2024-08-23 13:20:18] frigate.video                  INFO    : W2_Test: emptying frame queue
2024-08-23 20:20:18.372868453  [2024-08-23 13:20:18] frigate.video                  INFO    : W2_Test: exiting subprocess
2024-08-23 20:20:18.382366809  [2024-08-23 13:20:18] frigate.app                    INFO    : Closing frame queue for W2_Test
2024-08-23 20:20:18.883362587  [2024-08-23 13:20:18] root                           INFO    : Waiting for detection process to exit gracefully...
2024-08-23 20:20:18.883505281  [2024-08-23 13:20:18] detector.coral                 INFO    : Signal to exit detection process...
2024-08-23 20:20:19.373249726  [2024-08-23 13:20:19] detector.coral                 INFO    : Exited detection process...
2024-08-23 20:20:19.382223483  [2024-08-23 13:20:19] root                           INFO    : Detection process has exited...
2024-08-23 20:20:19.883431293  [2024-08-23 13:20:19] frigate.app                    INFO    : Detection queue closed
2024-08-23 20:20:20.384673243  [2024-08-23 13:20:20] frigate.app                    INFO    : Detected frames queue closed
2024-08-23 20:20:20.885922163  [2024-08-23 13:20:20] frigate.app                    INFO    : Timeline queue closed
2024-08-23 20:20:21.465114221  [2024-08-23 13:20:21] frigate.output.output          INFO    : exiting output process...
2024-08-23 20:20:22.968266676  /usr/lib/python3.9/multiprocessing/resource_tracker.py:216: UserWarning: resource_tracker: There appear to be 2 leaked shared_memory objects to clean up at shutdown
2024-08-23 20:20:22.968269589    warnings.warn('resource_tracker: There appear to be %d '
2024-08-23 20:20:22.968271106  /usr/lib/python3.9/multiprocessing/resource_tracker.py:229: UserWarning: resource_tracker: '/W2_Test1724444394.763407': [Errno 2] No such file or directory: '/W2_Test1724444394.763407'
2024-08-23 20:20:22.968272217    warnings.warn('resource_tracker: %r: %s' % (name, e))
2024-08-23 20:20:22.968290256  /usr/lib/python3.9/multiprocessing/resource_tracker.py:229: UserWarning: resource_tracker: '/A1_Test1724444394.778789': [Errno 2] No such file or directory: '/A1_Test1724444394.778789'
2024-08-23 20:20:22.968291017    warnings.warn('resource_tracker: %r: %s' % (name, e))
2024-08-23 20:20:23.118004174  [2024-08-23 13:20:23] frigate.comms.ws               INFO    : Exiting websocket client...
2024-08-23 20:20:23.312583001  [2024-08-23 13:20:23] peewee.sqliteq                 INFO    : writer received shutdown request, exiting.
2024-08-23 20:20:24.334391755  /usr/lib/python3.9/multiprocessing/resource_tracker.py:216: UserWarning: resource_tracker: There appear to be 8 leaked shared_memory objects to clean up at shutdown
2024-08-23 20:20:24.334397452    warnings.warn('resource_tracker: There appear to be %d '
2024-08-23 20:20:24.336178174  [INFO] Service Frigate exited with code 0 (by signal 0)
s6-rc: info: service frigate successfully stopped
s6-rc: info: service go2rtc: stopping
s6-rc: info: service frigate-log: stopping
2024-08-23 20:20:24.337921101  exit with signal: terminated
s6-rc: info: service frigate-log successfully stopped
2024-08-23 20:20:24.341197879  [INFO] The go2rtc service exited with code 0 (by signal 0)
s6-rc: info: service go2rtc successfully stopped
s6-rc: info: service go2rtc-log: stopping
s6-rc: info: service go2rtc-log successfully stopped
s6-rc: info: service log-prepare: stopping
s6-rc: info: service s6rc-fdholder: stopping
s6-rc: info: service log-prepare successfully stopped
s6-rc: info: service legacy-cont-init: stopping
s6-rc: info: service s6rc-fdholder successfully stopped
s6-rc: info: service legacy-cont-init successfully stopped
s6-rc: info: service fix-attrs: stopping
s6-rc: info: service fix-attrs successfully stopped
s6-rc: info: service s6rc-oneshot-runner: stopping
s6-rc: info: service s6rc-oneshot-runner successfully stopped

Relevant go2rtc log output

FFprobe output from your camera

I dont know how to do this

Frigate stats

No response

Operating system

HassOS

Install method

HassOS Addon

Object Detector

Coral

Network connection

Wired

Camera make and model

Amcrest Dahua IPC-T549M-ALED-2.8mm-S3

Screenshots of the Frigate UI's System metrics pages and any other screenshots pertinent to your issue.

No response

Any other information that may be helpful

No response

Answered by NickM-27

Aug 23, 2024

    ffmpeg:
      inputs:
        - path: rtsp://admin:[email protected]:554/cam/realmonitor?channel=1&subtype=0

should be

    ffmpeg:
      input_args: preset-rtsp-restream
      inputs:
        - path: rtsp://127.0.0.1:8554/A1_Test

View full answer

NickM-27 · 2024-08-23T20:42:52Z

NickM-27
Aug 23, 2024
Collaborator Sponsor

the difference is that frigate has internal audio preference for AAC, your camera is likely using pcm by default. You almost had the config right with

go2rtc:
  streams:
    A1_Test:
      - rtsp://admin:[email protected]:554/cam/realmonitor?channel=1&subtype=0
      - ffmpeg:camera.A1_Test#audio=aac

except camera. is a home assistant thing not a frigate thing. If you change the config to

go2rtc:
  streams:
    A1_Test:
      - rtsp://admin:[email protected]:554/cam/realmonitor?channel=1&subtype=0
      - ffmpeg:A1_Test#audio=aac

you will have the correct audio

0 replies

mworsnop · 2024-08-23T20:50:51Z

mworsnop
Aug 23, 2024
Author

No, the camera is working properly because I set the settings myself and they are AAC. I changed the frigate yaml configuration and took out the word camera. I tried running I'm port 1984 again, I still did not get any audio. I haven't even got as far as trying to run it under frigate yet for audio anyway.

5 replies

NickM-27 Aug 23, 2024
Collaborator Sponsor

use the info button in the go2rtc dashboard and paste that here

mworsnop Aug 23, 2024
Author

{
  "producers": [
    {
      "url": "rtsp://admin:[email protected]:554/cam/realmonitor?channel=1\u0026subtype=0"
    },
    {
      "url": "ffmpeg:A1_Test#audio=aac"
    }
  ],
  "consumers": []
}

NickM-27 Aug 23, 2024
Collaborator Sponsor

sorry, you need to run it while the stream is playing

mworsnop Aug 23, 2024
Author

{
  "producers": [
    {
      "type": "RTSP active producer",
      "url": "rtsp://10.215.81.42:554/cam/realmonitor?channel=1\u0026subtype=0/",
      "remote_addr": "10.215.81.42:554",
      "user_agent": "go2rtc/1.9.2",
      "sdp": "v=0\r\no=- 2251961887 2251961887 IN IP4 0.0.0.0\r\ns=Media Server\r\nc=IN IP4 0.0.0.0\r\nt=0 0\r\na=control:*\r\na=packetization-supported:DH\r\na=rtppayload-supported:DH\r\na=range:npt=now-\r\na=x-packetization-supported:IV\r\na=x-rtppayload-supported:IV\r\na=x-summary:Oversea\r\nm=video 0 RTP/AVP 96\r\na=control:trackID=0\r\na=framerate:25.000000\r\na=rtpmap:96 H264/90000\r\na=fmtp:96 packetization-mode=1;profile-level-id=4D6033;sprop-parameter-sets=Z01gM4mNUBUAX9CAAAADAIAAABkHixNQAA==,KO4HcgA=\r\na=recvonly\r\nm=audio 0 RTP/AVP 97\r\na=control:trackID=1\r\na=rtpmap:97 MPEG4-GENERIC/8000\r\na=fmtp:97 streamtype=5;profile-level-id=1;mode=AAC-hbr;sizelength=13;indexlength=3;indexdeltalength=3;config=1588\r\na=recvonly\r\n",
      "medias": [
        "video, recvonly, H.264 Main 5.1",
        "audio, recvonly, MPEG4-GENERIC/8000"
      ],
      "receivers": [
        "96 H264, bytes=5873506, senders=1",
        "97 MPEG4-GENERIC/8000, bytes=17809, senders=0"
      ],
      "recv": 5943367
    },
    {
      "url": "ffmpeg:A1_Test#audio=aac"
    }
  ],
  "consumers": [
    {
      "type": "WebRTC/WebSocket async passive consumer",
      "remote_addr": "tcp4 prflx 10.215.81.15:52163 related :0",
      "user_agent": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/128.0.0.0 Safari/537.36",
      "medias": [
        "video, sendonly, VP8, VP9, H264, AV1",
        "audio, sendonly, OPUS/48000/2, G722/8000, PCMU/8000, PCMA/8000, L16, PCML"
      ],
      "senders": [
        "102 H264, bytes=5873506, receivers=1"
      ],
      "send": 5935913
    }
  ]
}

NickM-27 Aug 23, 2024
Collaborator Sponsor

okay, we have confirmed that your camera is set to AAC. In that case the secondary designation in the config is redundant and it should instead be set to OPUS

go2rtc:
  streams:
    A1_Test:
      - rtsp://admin:[email protected]:554/cam/realmonitor?channel=1&subtype=0
      - ffmpeg:A1_Test#audio=opus

mworsnop · 2024-08-23T20:54:50Z

mworsnop
Aug 23, 2024
Author

3 replies

mworsnop Aug 23, 2024
Author

Awesome that was the problem. Now I have sound that far into it.

What do I need to change in the frigate camera section?

NickM-27 Aug 23, 2024
Collaborator Sponsor

    ffmpeg:
      inputs:
        - path: rtsp://admin:[email protected]:554/cam/realmonitor?channel=1&subtype=0

should be

    ffmpeg:
      input_args: preset-rtsp-restream
      inputs:
        - path: rtsp://127.0.0.1:8554/A1_Test

Answer selected by mworsnop

mworsnop Aug 23, 2024
Author

It sure seems to be working. I don't think all they will dare add on another camera, but I will try one at a time and see what happens. Thank you so much for all your help everybody whoever is there.

Nick I appreciate it.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Camera Support]: No audio I cannot get audio to work either live or recorded. #13301

{{title}}

Replies: 3 comments 8 replies

{{title}}

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

Select a reply

[Camera Support]: No audio I cannot get audio to work either live or recorded. #13301

mworsnop Aug 23, 2024

Describe the problem you are having

Version

What browser(s) are you using?

Frigate config file

Relevant Frigate log output

Relevant go2rtc log output

FFprobe output from your camera

Frigate stats

Operating system

Install method

Object Detector

Network connection

Camera make and model

Screenshots of the Frigate UI's System metrics pages and any other screenshots pertinent to your issue.

Any other information that may be helpful

Replies: 3 comments · 8 replies

NickM-27 Aug 23, 2024 Collaborator Sponsor

mworsnop Aug 23, 2024 Author

NickM-27 Aug 23, 2024 Collaborator Sponsor

mworsnop Aug 23, 2024 Author

NickM-27 Aug 23, 2024 Collaborator Sponsor

mworsnop Aug 23, 2024 Author

NickM-27 Aug 23, 2024 Collaborator Sponsor

mworsnop Aug 23, 2024 Author

mworsnop Aug 23, 2024 Author

NickM-27 Aug 23, 2024 Collaborator Sponsor

mworsnop Aug 23, 2024 Author

mworsnop
Aug 23, 2024

Replies: 3 comments 8 replies

NickM-27
Aug 23, 2024
Collaborator Sponsor

mworsnop
Aug 23, 2024
Author

NickM-27 Aug 23, 2024
Collaborator Sponsor

mworsnop Aug 23, 2024
Author

NickM-27 Aug 23, 2024
Collaborator Sponsor

mworsnop Aug 23, 2024
Author

NickM-27 Aug 23, 2024
Collaborator Sponsor

mworsnop
Aug 23, 2024
Author

mworsnop Aug 23, 2024
Author

NickM-27 Aug 23, 2024
Collaborator Sponsor

mworsnop Aug 23, 2024
Author