[Config Support]: Getting 2-Way Audio working with HA #13418
-
Describe the problem you are havingIve tried everyway i could find online, everything works with my reolink doorbell but no mic button in HA. im on https internally and externally. (but not between frigate and ha) Version0.14.0-da913d8 Frigate config filemqtt:
enabled: true
user: frigate_mqtt
password: password
host: 192.168.1.1
ffmpeg:
hwaccel_args: preset-vaapi
cameras:
steps_cam: # <------ Name the camera
enabled: true
audio:
enabled: true
ffmpeg:
inputs:
- path: rtsp://wb:[email protected]:8544/steps-cam # <----- The stream you want to use for detection
roles:
- record
- detect
- audio
output_args:
record: preset-record-generic-audio-copy
objects:
track:
- dog
- person
review:
detections:
labels:
- dog
- person
required_zones: steps
zones:
steps:
coordinates: 0.412,0.006,0.222,1,0.824,1,0.578,0.009
loitering_time: 0
motion:
mask: 0.723,0.938,0.974,0.933,0.976,0.98,0.723,0.979
doorbell:
enabled: true
audio:
enabled: true
ffmpeg:
inputs:
- path: rtsp://127.0.0.1:8554/doorbell?video=copy&audio=aac
input_args: preset-rtsp-restream-low-latency
roles:
- record
- path: rtsp://127.0.0.1:8554/doorbell_sub?video=copy&audio=aac
input_args: preset-rtsp-restream-low-latency
roles:
- detect
- audio
output_args:
record: preset-record-generic-audio-copy
live:
stream_name: doorbell_main
objects:
track:
- dog
- person
- car
- motorcycle
- cat
- bicycle
- fedex
- ups
- amazon
- face
- package
- license_plate
review:
#alerts:
# labels:
# - dog
detections:
labels:
- dog
- person
version: 0.14
go2rtc:
streams:
steps_Cam:
- rtsp://wb:[email protected]:8544/steps-cam
- ffmpeg:rtsp_cam#audio=opus
doorbell:
- rtsp://admin:[email protected]:554/h264Preview_01_main#backchannel=0
- rtsp://admin:[email protected]:554/h264Preview_01_sub
- ffmpeg:doorbell#audio=opus#hardware
doorbell_sub:
- rtsp://admin:[email protected]:554/h264Preview_01_sub
- ffmpeg:doorbell_sub#audio=opus#hardware
doorbell_snapshot:
- onvif://admin:[email protected]:8000?subtype=MediaProfile00000&snapshot
webrtc:
candidates:
- 192.168.1.1:8555
- stun:8555
ffmpeg:
bin: ffmpeg
volume: "-af \"volume=30dB\""
detectors:
coral:
type: edgetpu
device: pci
model:
width: 300
height: 300
input_tensor: nhwc
input_pixel_format: bgr
model_type: ssd
path: plus://plusapi
review:
alerts:
labels:
- person
- dog
detections:
labels:
- person
- dog
record:
enabled: true
retain:
days: 7
mode: motion
audio:
enabled: true
listen:
- bark
- fire_alarm
- scream
- speech
- yell
detect:
enabled: true # <---- disable detection until you have a working camera feed
width: 800
height: 480
stationary:
interval: 50
threshold: 50
birdseye:
enabled: true
mode: continuous #motion #objects
snapshots:
enabled: True
timestamp: true
bounding_box: true
retain:
default: 30Relevant Frigate log outputthere are no errors that i can see in the logsRelevant go2rtc log outputthere is no errorsFrigate stats{"cameras":{"doorbell":{"audio_dBFS":-50.7993,"audio_rms":94.5116,"camera_fps":5.0,"capture_pid":416,"detection_enabled":true,"detection_fps":0.7,"ffmpeg_pid":423,"pid":404,"process_fps":5.0,"skipped_fps":0.0},"steps_cam":{"audio_dBFS":-50.0088,"audio_rms":103.5168,"camera_fps":5.0,"capture_pid":412,"detection_enabled":false,"detection_fps":0.0,"ffmpeg_pid":419,"pid":398,"process_fps":5.0,"skipped_fps":0.0}},"cpu_usages":{"1":{"cmdline":"/package/admin/s6/command/s6-svscan -d4 -- /run/service","cpu":"0.0","cpu_average":"0","mem":"0.0"},"121":{"cmdline":"python3 -u -m frigate","cpu":"6.1","cpu_average":"6","mem":"2.9"},"125":{"cmdline":"bash ./run.user go2rtc-healthcheck","cpu":"0.0","cpu_average":"0","mem":"0.0"},"132":{"cmdline":"nginx: master process nginx","cpu":"0.0","cpu_average":"0","mem":"0.1"},"1347":{"cmdline":"ffmpeg -hide_banner -v error -fflags nobuffer -flags low_delay -timeout 5000000 -user_agent go2rtc/ffmpeg -rtsp_flags prefer_tcp -i rtsp://127.0.0.1:8554/doorbell?audio -c:a libopus -application:a lowdelay -min_comp 0 -vn -user_agent ffmpeg/go2rtc -rtsp_transport tcp -f rtsp rtsp://127.0.0.1:8554/db910ae337eb132611ed80a6aa61d16b","cpu":"2.7","cpu_average":"2","mem":"0.1"},"14434":{"cmdline":"/usr/bin/python3 -c from multiprocessing.resource_tracker import main;main(48)","cpu":"0.0","cpu_average":"0","mem":"0.1"},"15":{"cmdline":"s6-supervise s6-linux-init-shutdownd","cpu":"0.0","cpu_average":"0","mem":"0.0"},"158":{"cmdline":"nginx: worker process","cpu":"0.2","cpu_average":"0","mem":"0.1"},"159":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.1"},"160":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.1"},"161":{"cmdline":"nginx: worker process","cpu":"0.0","cpu_average":"0","mem":"0.1"},"16168":{"cmdline":"sleep 60","cpu":"0.0","cpu_average":"0","mem":"0.0"},"16241":{"cmdline":"sleep 30s","cpu":"0.0","cpu_average":"0","mem":"0.0"},"164":{"cmdline":"nginx: cache manager process","cpu":"0.0","cpu_average":"0","mem":"0.0"},"17":{"cmdline":"/package/admin/s6-linux-init/command/s6-linux-init-shutdownd -c /run/s6/basedir -g 3000 -C -B","cpu":"0.0","cpu_average":"0","mem":"0.0"},"24":{"cmdline":"s6-supervise go2rtc","cpu":"0.0","cpu_average":"0","mem":"0.0"},"25":{"cmdline":"s6-supervise s6rc-oneshot-runner","cpu":"0.0","cpu_average":"0","mem":"0.0"},"26":{"cmdline":"s6-supervise certsync","cpu":"0.0","cpu_average":"0","mem":"0.0"},"27":{"cmdline":"s6-supervise nginx","cpu":"0.0","cpu_average":"0","mem":"0.0"},"28":{"cmdline":"s6-supervise s6rc-fdholder","cpu":"0.0","cpu_average":"0","mem":"0.0"},"29":{"cmdline":"s6-supervise nginx-log","cpu":"0.0","cpu_average":"0","mem":"0.0"},"30":{"cmdline":"s6-supervise frigate","cpu":"0.0","cpu_average":"0","mem":"0.0"},"31":{"cmdline":"s6-supervise certsync-log","cpu":"0.0","cpu_average":"0","mem":"0.0"},"312":{"cmdline":"bash ./run.user certsync","cpu":"0.0","cpu_average":"0","mem":"0.0"},"32":{"cmdline":"s6-supervise go2rtc-log","cpu":"0.0","cpu_average":"0","mem":"0.0"},"33":{"cmdline":"s6-supervise frigate-log","cpu":"0.0","cpu_average":"0","mem":"0.0"},"338":{"cmdline":"frigate.logger ","cpu":"0.1","cpu_average":"0","mem":"0.7"},"34":{"cmdline":"s6-supervise go2rtc-healthcheck","cpu":"0.0","cpu_average":"0","mem":"0.0"},"340":{"cmdline":"frigate.recording_manager","cpu":"2.8","cpu_average":"2","mem":"1.0"},"349":{"cmdline":"frigate.review_segment_manager","cpu":"0.5","cpu_average":"0","mem":"0.8"},"368":{"cmdline":"/usr/bin/python3 -c from multiprocessing.resource_tracker import main;main(59)","cpu":"0.3","cpu_average":"0","mem":"0.1"},"369":{"cmdline":"frigate.detector.coral","cpu":"0.3","cpu_average":"0","mem":"0.9"},"372":{"cmdline":"frigate.output ","cpu":"1.9","cpu_average":"2","mem":"0.9"},"398":{"cmdline":"frigate.process:steps_cam","cpu":"0.6","cpu_average":"2","mem":"0.9"},"404":{"cmdline":"frigate.process:doorbell","cpu":"5.3","cpu_average":"5","mem":"0.9"},"412":{"cmdline":"frigate.capture:steps_cam","cpu":"1.3","cpu_average":"1","mem":"0.8"},"416":{"cmdline":"frigate.capture:doorbell","cpu":"1.3","cpu_average":"1","mem":"0.8"},"419":{"cmdline":"ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel_flags allow_profile_mismatch -hwaccel vaapi -hwaccel_device /dev/dri/renderD128 -hwaccel_output_format vaapi -user_agent FFmpeg Frigate/0.14.0-da913d8 -avoid_negative_ts make_zero -fflags +genpts+discardcorrupt -rtsp_transport tcp -timeout 5000000 -use_wallclock_as_timestamps 1 -i rtsp://*:*@192.168.9.94:8544/steps-cam -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c copy /tmp/cache/steps_cam@%Y%m%d%H%M%S%z.mp4 -r 5 -vf fps=5,scale_vaapi=w=800:h=480:format=nv12,hwdownload,format=nv12,format=yuv420p -threads 2 -f rawvideo -pix_fmt yuv420p pipe:","cpu":"2.7","cpu_average":"2","mem":"0.3"},"421":{"cmdline":"frigate.audio_manager","cpu":"0.3","cpu_average":"0","mem":"0.9"},"423":{"cmdline":"ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel_flags allow_profile_mismatch -hwaccel vaapi -hwaccel_device /dev/dri/renderD128 -hwaccel_output_format vaapi -user_agent FFmpeg Frigate/0.14.0-da913d8 -rtsp_transport tcp -timeout 5000000 -fflags nobuffer -flags low_delay -i rtsp://127.0.0.1:8554/doorbell_sub?video=copy&audio=aac -r 5 -vf fps=5,scale_vaapi=w=800:h=480:format=nv12,hwdownload,format=nv12,format=yuv420p -threads 2 -f rawvideo -pix_fmt yuv420p pipe:","cpu":"1.9","cpu_average":"1","mem":"0.2"},"439":{"cmdline":"ffmpeg -vn -threads 1 -hide_banner -loglevel warning -threads 2 -user_agent FFmpeg Frigate/0.14.0-da913d8 -avoid_negative_ts make_zero -fflags +genpts+discardcorrupt -rtsp_transport tcp -timeout 5000000 -use_wallclock_as_timestamps 1 -i rtsp://*:*@192.168.9.94:8544/steps-cam -threads 1 -f s16le -ar 16000 -ac 1 -y pipe:","cpu":"0.6","cpu_average":"0","mem":"0.1"},"440":{"cmdline":"ffmpeg -hide_banner -loglevel warning -threads 2 -hwaccel_flags allow_profile_mismatch -hwaccel vaapi -hwaccel_device /dev/dri/renderD128 -hwaccel_output_format vaapi -user_agent FFmpeg Frigate/0.14.0-da913d8 -rtsp_transport tcp -timeout 5000000 -fflags nobuffer -flags low_delay -i rtsp://127.0.0.1:8554/doorbell?video=copy&audio=aac -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c copy /tmp/cache/doorbell@%Y%m%d%H%M%S%z.mp4","cpu":"1.6","cpu_average":"1","mem":"0.1"},"449":{"cmdline":"ffmpeg -vn -threads 1 -hide_banner -loglevel warning -threads 2 -user_agent FFmpeg Frigate/0.14.0-da913d8 -rtsp_transport tcp -timeout 5000000 -fflags nobuffer -flags low_delay -i rtsp://127.0.0.1:8554/doorbell_sub?video=copy&audio=aac -threads 1 -f s16le -ar 16000 -ac 1 -y pipe:","cpu":"0.5","cpu_average":"0","mem":"0.1"},"45":{"cmdline":"/package/admin/s6-2.11.3.2/command/s6-fdholderd -1 -i data/rules","cpu":"0.0","cpu_average":"0","mem":"0.0"},"46":{"cmdline":"/package/admin/s6/command/s6-ipcserverd -1 -- /package/admin/s6/command/s6-ipcserver-access -v0 -E -l0 -i data/rules -- /package/admin/s6/command/s6-sudod -t 30000 -- /package/admin/s6-rc/command/s6-rc-oneshot-run -l ../.. --","cpu":"0.0","cpu_average":"0","mem":"0.0"},"489":{"cmdline":"ffmpeg -threads 1 -f rawvideo -pix_fmt yuv420p -video_size 800x480 -i pipe: -threads 1 -f mpegts -s 1200x720 -codec:v mpeg1video -q 8 -bf 0 pipe:","cpu":"0.0","cpu_average":"0","mem":"0.2"},"494":{"cmdline":"ffmpeg -threads 1 -f rawvideo -pix_fmt yuv420p -video_size 800x480 -i pipe: -threads 1 -f mpegts -s 1200x720 -codec:v mpeg1video -q 8 -bf 0 pipe:","cpu":"2.5","cpu_average":"0","mem":"0.2"},"499":{"cmdline":"ffmpeg -threads 1 -f rawvideo -pix_fmt yuv420p -video_size 1280x720 -i pipe: -threads 1 -f mpegts -s 1280x720 -codec:v mpeg1video -q 8 -bf 0 pipe:","cpu":"0.0","cpu_average":"0","mem":"0.1"},"85":{"cmdline":"s6-log -b -- T 1 n0 s10000000 T /dev/shm/logs/nginx","cpu":"0.0","cpu_average":"0","mem":"0.0"},"88":{"cmdline":"s6-log -b -- T 1 n0 s10000000 T /dev/shm/logs/frigate","cpu":"0.0","cpu_average":"0","mem":"0.0"},"89":{"cmdline":"s6-log -b -- T 1 n0 s10000000 T /dev/shm/logs/certsync","cpu":"0.0","cpu_average":"0","mem":"0.0"},"90":{"cmdline":"s6-log -b -- T 1 n0 s10000000 T /dev/shm/logs/go2rtc","cpu":"0.0","cpu_average":"0","mem":"0.0"},"97":{"cmdline":"/usr/local/go2rtc/bin/go2rtc -config=/dev/shm/go2rtc.yaml","cpu":"37.0","cpu_average":"30","mem":"0.4"},"frigate.full_system":{"cpu":"22.9","mem":"15.0"}},"detection_fps":0.7,"detectors":{"coral":{"detection_start":0.0,"inference_speed":6.12,"pid":369}},"gpu_usages":{"intel-vaapi":{"gpu":"0.87%","mem":"-%"}},"processes":{"audio_detector":{"pid":421},"go2rtc":{"pid":97},"logger":{"pid":338},"recording":{"pid":340},"review_segment":{"pid":349}},"service":{"last_updated":1724957098,"latest_version":"unknown","storage":{"/dev/shm":{"free":8189.0,"mount_type":"tmpfs","total":8192.0,"used":3.0},"/media/frigate/clips":{"free":3718068.8,"mount_type":"nfs4","total":3743423.9,"used":25239.1},"/media/frigate/recordings":{"free":3718068.8,"mount_type":"nfs4","total":3743423.9,"used":25239.1},"/tmp/cache":{"free":941.1,"mount_type":"tmpfs","total":953.7,"used":12.6}},"temperatures":{"apex_0":49.3},"uptime":4616,"version":"0.14.0-da913d8"}}Operating systemDebian Install methodDocker Compose Object DetectorCoral Screenshots of the Frigate UI's System metrics pages
Any other information that may be helpfulha config ```type:` custom:frigate-card
|
Beta Was this translation helpful? Give feedback.
Answered by
hawkeye217
Aug 29, 2024
Replies: 5 comments 37 replies
-
|
Can you provide the output of |
Beta Was this translation helpful? Give feedback.
0 replies
-
{
"consumers": [
{
"medias": [
"video, sendonly, ANY",
"audio, sendonly, MPEG4-GENERIC"
],
"remote_addr": "127.0.0.1:51082",
"sdp": "v=0\r\no=- 1 1 IN IP4 0.0.0.0\r\ns=go2rtc/1.9.2\r\nc=IN IP4 0.0.0.0\r\nt=0 0\r\nm=video 0 RTP/AVP 96\r\na=rtpmap:96 H264/90000\r\na=fmtp:96 packetization-mode=1;profile-level-id=640033;sprop-parameter-sets=Z2QAM6wVFKAoAPGQ,aO48sA==\r\na=control:trackID=0\r\nm=audio 0 RTP/AVP 97\r\na=rtpmap:97 MPEG4-GENERIC/16000\r\na=fmtp:97 streamtype=5;profile-level-id=1;mode=AAC-hbr;sizelength=13;indexlength=3;indexdeltalength=3;config=1408\r\na=control:trackID=1\r\n",
"send": 7142439,
"senders": [
"96 H264, bytes=7007522, receivers=1",
"97 MPEG4-GENERIC/16000, bytes=51621, receivers=1"
],
"type": "RTSP passive consumer",
"url": "rtsp://127.0.0.1:8554/doorbell?video=copy&audio=aac",
"user_agent": "FFmpeg Frigate/0.14.0-da913d8"
},
{
"medias": [
"audio, sendonly, ANY"
],
"remote_addr": "127.0.0.1:60660",
"sdp": "v=0\r\no=- 1 1 IN IP4 0.0.0.0\r\ns=go2rtc/1.9.2\r\nc=IN IP4 0.0.0.0\r\nt=0 0\r\nm=audio 0 RTP/AVP 96\r\na=rtpmap:96 MPEG4-GENERIC/16000\r\na=fmtp:96 streamtype=5;profile-level-id=1;mode=AAC-hbr;sizelength=13;indexlength=3;indexdeltalength=3;config=1408\r\na=control:trackID=0\r\n",
"send": 533,
"senders": [
"96 MPEG4-GENERIC/16000, bytes=501, receivers=1"
],
"type": "RTSP passive consumer",
"url": "rtsp://127.0.0.1:8554/doorbell?audio",
"user_agent": "go2rtc/ffmpeg"
},
{
"medias": [
"video, sendonly, ALL",
"audio, sendonly, ALL",
"audio, recvonly, ANY"
],
"remote_addr": "127.0.0.1:35858",
"senders": [
"96 H264, bytes=0, receivers=1",
"97 MPEG4-GENERIC/16000, bytes=0, receivers=1",
"96 OPUS/48000/2, bytes=0, receivers=1"
],
"type": "probe",
"user_agent": "python-requests/2.32.3"
}
],
"producers": [
{
"medias": [
"video, recvonly, H.264 High 5.1",
"audio, recvonly, MPEG4-GENERIC/16000"
],
"receivers": [
"96 H264, bytes=7007522, senders=2",
"97 MPEG4-GENERIC/16000, bytes=51621, senders=3"
],
"recv": 7121999,
"remote_addr": "192.168.9.127:554",
"sdp": "v=0\r\no=- 1724929999352691 1 IN IP4 192.168.9.127\r\ns=Session streamed by \"preview\"\r\nt=0 0\r\na=tool:BC Streaming Media v202210012022.10.01\r\na=type:broadcast\r\na=control:*\r\na=range:npt=now-\r\na=x-qt-text-nam:Session streamed by \"preview\"\r\nm=video 0 RTP/AVP 96\r\nc=IN IP4 0.0.0.0\r\nb=AS:8192\r\na=rtpmap:96 H264/90000\r\na=fmtp:96 packetization-mode=1;profile-level-id=640033;sprop-parameter-sets=Z2QAM6wVFKAoAPGQ,aO48sA==\r\na=recvonly\r\na=control:track1\r\nm=audio 0 RTP/AVP 97\r\nc=IN IP4 0.0.0.0\r\nb=AS:8192\r\na=rtpmap:97 MPEG4-GENERIC/16000\r\na=fmtp:97 streamtype=5;profile-level-id=1;mode=AAC-hbr;sizelength=13;indexlength=3;indexdeltalength=3;config=1408\r\na=recvonly\r\na=control:track2\r\n",
"type": "RTSP active producer",
"url": "rtsp://192.168.9.127/Preview_01_main/",
"user_agent": "go2rtc/1.9.2"
},
{
"medias": [
"audio, recvonly, OPUS/48000/2"
],
"receivers": [
"96 OPUS/48000/2, bytes=0, senders=1"
],
"remote_addr": "127.0.0.1:60668",
"sdp": "v=0\r\no=- 0 0 IN IP4 127.0.0.1\r\ns=go2rtc/1.9.2\r\nc=IN IP4 127.0.0.1\r\nt=0 0\r\na=tool:libavformat LIBAVFORMAT_VERSION\r\nm=audio 0 RTP/AVP 96\r\nb=AS:64\r\na=rtpmap:96 opus/48000/2\r\na=control:streamid=0\r\n",
"type": "RTSP passive producer",
"url": "rtsp://127.0.0.1:8554/db910ae337eb132611ed80a6aa61d16b",
"user_agent": "ffmpeg/go2rtc"
}
]
} |
Beta Was this translation helpful? Give feedback.
13 replies
-
|
You should be using the recommended Reolink config for go2rtc as well. |
Beta Was this translation helpful? Give feedback.
-
|
@hawkeye217 had tried that no dice. even just reverted back to that,. still no mic. |
Beta Was this translation helpful? Give feedback.
-
|
Just to make sure, you say "still no mic" - are you referring to the Frigate UI, HA, or both? |
Beta Was this translation helpful? Give feedback.
-
|
@hawkeye217 both. i assume if i dont get it in frigate. i wont get it in HA. i did read that scrypted the new firmware is working with mic, so i dont think its the firmware? |
Beta Was this translation helpful? Give feedback.
-
|
Now that you've made the changes to your config, can you paste the output of |
Beta Was this translation helpful? Give feedback.
-
|
starting new thread with new export {
"consumers": [
{
"medias": [
"video, sendonly, ANY",
"audio, sendonly, MPEG4-GENERIC"
],
"remote_addr": "127.0.0.1:40080",
"sdp": "v=0\r\no=- 1 1 IN IP4 0.0.0.0\r\ns=go2rtc/1.9.2\r\nc=IN IP4 0.0.0.0\r\nt=0 0\r\nm=video 0 RTP/AVP 96\r\na=rtpmap:96 H264/90000\r\na=fmtp:96 packetization-mode=1; sprop-parameter-sets=Z2QAM6wVFKAoAPGQ,aO48sA==; profile-level-id=640033\r\na=control:trackID=0\r\nm=audio 0 RTP/AVP 97\r\na=rtpmap:97 MPEG4-GENERIC/16000\r\na=fmtp:97 profile-level-id=1;mode=AAC-hbr;sizelength=13;indexlength=3;indexdeltalength=3; config=1408\r\na=control:trackID=1\r\n",
"send": 434054368,
"senders": [
"96 H264, bytes=426017189, receivers=1",
"97 MPEG4-GENERIC/16000, bytes=3193019, receivers=1"
],
"type": "RTSP passive consumer",
"url": "rtsp://127.0.0.1:8554/doorbell?video=copy&audio=aac",
"user_agent": "FFmpeg Frigate/0.14.0-da913d8"
},
{
"medias": [
"video, sendonly, ALL",
"audio, sendonly, ALL",
"audio, recvonly, ANY"
],
"receivers": [
"0 ANY, bytes=0, senders=1"
],
"remote_addr": "127.0.0.1:60992",
"senders": [
"96 H264, bytes=0, receivers=1",
"96 H264, bytes=0, receivers=1",
"97 MPEG4-GENERIC/16000, bytes=0, receivers=1",
"98 OPUS/48000/2, bytes=0, receivers=1",
"97 MPEG4-GENERIC/16000, bytes=0, receivers=1"
],
"type": "probe",
"user_agent": "python-requests/2.32.3"
}
],
"producers": [
{
"medias": [
"video, recvonly, H.264 High 5.1",
"audio, recvonly, MPEG4-GENERIC/16000",
"audio, recvonly, OPUS/48000/2"
],
"receivers": [
"96 H264, bytes=426017189, senders=2",
"97 MPEG4-GENERIC/16000, bytes=3193019, senders=2",
"98 OPUS/48000/2, bytes=7094977, senders=1"
],
"recv": 440439693,
"remote_addr": "127.0.0.1:40100",
"sdp": "v=0\r\no=- 0 0 IN IP4 127.0.0.1\r\ns=No Name\r\nc=IN IP4 127.0.0.1\r\nt=0 0\r\na=tool:libavformat LIBAVFORMAT_VERSION\r\nm=video 0 RTP/AVP 96\r\na=rtpmap:96 H264/90000\r\na=fmtp:96 packetization-mode=1; sprop-parameter-sets=Z2QAM6wVFKAoAPGQ,aO48sA==; profile-level-id=640033\r\na=control:streamid=0\r\nm=audio 0 RTP/AVP 97\r\na=rtpmap:97 MPEG4-GENERIC/16000/1\r\na=fmtp:97 profile-level-id=1;mode=AAC-hbr;sizelength=13;indexlength=3;indexdeltalength=3; config=1408\r\na=control:streamid=1\r\nm=audio 0 RTP/AVP 98\r\nb=AS:64\r\na=rtpmap:98 opus/48000/2\r\na=control:streamid=2\r\n",
"type": "RTSP passive producer",
"url": "rtsp://127.0.0.1:8554/239c70893e317de35be73cd89b4d4849",
"user_agent": "ffmpeg/go2rtc"
},
{
"medias": [
"video, recvonly, H264",
"audio, recvonly, MPEG4-GENERIC/16000",
"audio, sendonly, PCMU/8000"
],
"receivers": [
"96 H264, bytes=0, senders=1",
"97 MPEG4-GENERIC/16000, bytes=0, senders=1"
],
"remote_addr": "192.168.9.127:554",
"sdp": "v=0\r\no=- 1724929999466423 1 IN IP4 192.168.9.127\r\ns=Session streamed by \"preview\"\r\nt=0 0\r\na=tool:BC Streaming Media v202210012022.10.01\r\na=type:broadcast\r\na=control:*\r\na=range:npt=now-\r\na=x-qt-text-nam:Session streamed by \"preview\"\r\nm=video 0 RTP/AVP 96\r\nc=IN IP4 0.0.0.0\r\nb=AS:8192\r\na=rtpmap:96 H264/90000\r\na=control:track1\r\nm=audio 0 RTP/AVP 97\r\nc=IN IP4 0.0.0.0\r\nb=AS:8192\r\na=rtpmap:97 MPEG4-GENERIC/16000\r\na=fmtp:97 streamtype=5;profile-level-id=1;mode=AAC-hbr;sizelength=13;indexlength=3;indexdeltalength=3;config=1408\r\na=recvonly\r\na=control:track2\r\nm=audio 0 RTP/AVP 0\r\na=control:track3\r\na=rtpmap:0 PCMU/8000\r\na=sendonly",
"senders": [
"0 PCMU/8000, bytes=0, receivers=1"
],
"type": "RTSP active producer",
"url": "rtsp://192.168.9.127/Preview_01_sub/",
"user_agent": "go2rtc/1.9.2"
}
]
} |
Beta Was this translation helpful? Give feedback.
15 replies
-
|
Could you paste the card config? |
Beta Was this translation helpful? Give feedback.
-
type: custom:frigate-card
cameras:
- camera_entity: camera.doorbell
live_provider: go2rtc
go2rtc:
modes:
- webrtc
stream: doorbell
menu:
style: overlay
buttons:
microphone:
enabled: true
type: toggle
alignment: opposing
recordings:
enabled: false
frigate:
enabled: false
cameras:
enabled: false
snapshots:
enabled: false
mute:
enabled: true
performance:
profile: high
live:
microphone:
always_connected: false
|
Beta Was this translation helpful? Give feedback.
-
|
I don't think |
Beta Was this translation helpful? Give feedback.
-
|
I removed it and it didn't change behavior. Almost like HA isn't sending the data or reading it for forward to frigate? But I can't find anything in any logs |
Beta Was this translation helpful? Give feedback.
-
|
With HA and the card open and playing video, can you grab And then press and hold the mic button, and grab |
Beta Was this translation helpful? Give feedback.
-
|
HA card open and playing video {
"consumers": [
{
"medias": [
"video, sendonly, ANY",
"audio, sendonly, MPEG4-GENERIC"
],
"remote_addr": "127.0.0.1:42946",
"sdp": "v=0\r\no=- 1 1 IN IP4 0.0.0.0\r\ns=go2rtc/1.9.2\r\nc=IN IP4 0.0.0.0\r\nt=0 0\r\nm=video 0 RTP/AVP 96\r\na=rtpmap:96 H264/90000\r\na=fmtp:96 packetization-mode=1; sprop-parameter-sets=Z2QAM6wVFKAoAPGQ,aO48sA==; profile-level-id=640033\r\na=control:trackID=0\r\nm=audio 0 RTP/AVP 97\r\na=rtpmap:97 MPEG4-GENERIC/16000\r\na=fmtp:97 profile-level-id=1;mode=AAC-hbr;sizelength=13;indexlength=3;indexdeltalength=3; config=1408\r\na=control:trackID=1\r\n",
"send": 2086504441,
"senders": [
"96 H264, bytes=2047895847, receivers=1",
"97 MPEG4-GENERIC/16000, bytes=15326370, receivers=1"
],
"type": "RTSP passive consumer",
"url": "rtsp://127.0.0.1:8554/doorbell?video=copy&audio=aac",
"user_agent": "FFmpeg Frigate/0.14.0-da913d8"
},
{
"medias": [
"video, sendonly, VP8, VP9, H264, AV1",
"audio, sendonly, OPUS/48000/2, G722/8000, PCMU/8000, PCMA/8000, L16, PCML"
],
"remote_addr": "udp4 prflx 192.168.7.78:53151 related :0",
"send": 1992378417,
"senders": [
"102 H264, bytes=1937799047, receivers=1",
"111 OPUS/48000/2, bytes=31696997, receivers=1"
],
"type": "WebRTC/JSON sync passive consumer",
"user_agent": "HomeAssistant/2024.8.3 aiohttp/3.10.5 Python/3.12"
},
{
"medias": [
"video, sendonly, VP8, VP9, H264, AV1",
"audio, sendonly, OPUS/48000/2, G722/8000, PCMU/8000, PCMA/8000, L16, PCML"
],
"remote_addr": "udp4 prflx 192.168.7.78:60381 related :0",
"send": 840434459,
"senders": [
"102 H264, bytes=817510965, receivers=1",
"111 OPUS/48000/2, bytes=13266968, receivers=1"
],
"type": "WebRTC/WebSocket async passive consumer",
"user_agent": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/127.0.0.0 Safari/537.36"
},
{
"medias": [
"video, sendonly, ALL",
"audio, sendonly, ALL",
"audio, recvonly, ANY"
],
"receivers": [
"0 ANY, bytes=0, senders=1"
],
"remote_addr": "127.0.0.1:51994",
"senders": [
"96 H264, bytes=0, receivers=1",
"96 H264, bytes=0, receivers=1",
"97 MPEG4-GENERIC/16000, bytes=0, receivers=1",
"98 OPUS/48000/2, bytes=0, receivers=1",
"97 MPEG4-GENERIC/16000, bytes=0, receivers=1"
],
"type": "probe",
"user_agent": "python-requests/2.32.3"
}
],
"producers": [
{
"medias": [
"video, recvonly, H.264 High 5.1",
"audio, recvonly, MPEG4-GENERIC/16000",
"audio, recvonly, OPUS/48000/2"
],
"receivers": [
"96 H264, bytes=2047895847, senders=4",
"97 MPEG4-GENERIC/16000, bytes=15326370, senders=2",
"98 OPUS/48000/2, bytes=33644858, senders=3"
],
"recv": 2116734979,
"remote_addr": "127.0.0.1:42976",
"sdp": "v=0\r\no=- 0 0 IN IP4 127.0.0.1\r\ns=No Name\r\nc=IN IP4 127.0.0.1\r\nt=0 0\r\na=tool:libavformat LIBAVFORMAT_VERSION\r\nm=video 0 RTP/AVP 96\r\na=rtpmap:96 H264/90000\r\na=fmtp:96 packetization-mode=1; sprop-parameter-sets=Z2QAM6wVFKAoAPGQ,aO48sA==; profile-level-id=640033\r\na=control:streamid=0\r\nm=audio 0 RTP/AVP 97\r\na=rtpmap:97 MPEG4-GENERIC/16000/1\r\na=fmtp:97 profile-level-id=1;mode=AAC-hbr;sizelength=13;indexlength=3;indexdeltalength=3; config=1408\r\na=control:streamid=1\r\nm=audio 0 RTP/AVP 98\r\nb=AS:64\r\na=rtpmap:98 opus/48000/2\r\na=control:streamid=2\r\n",
"type": "RTSP passive producer",
"url": "rtsp://127.0.0.1:8554/239c70893e317de35be73cd89b4d4849",
"user_agent": "ffmpeg/go2rtc"
},
{
"medias": [
"video, recvonly, H264",
"audio, recvonly, MPEG4-GENERIC/16000",
"audio, sendonly, PCMU/8000"
],
"receivers": [
"96 H264, bytes=0, senders=1",
"97 MPEG4-GENERIC/16000, bytes=0, senders=1"
],
"remote_addr": "192.168.9.127:554",
"sdp": "v=0\r\no=- 1724929999466423 1 IN IP4 192.168.9.127\r\ns=Session streamed by \"preview\"\r\nt=0 0\r\na=tool:BC Streaming Media v202210012022.10.01\r\na=type:broadcast\r\na=control:*\r\na=range:npt=now-\r\na=x-qt-text-nam:Session streamed by \"preview\"\r\nm=video 0 RTP/AVP 96\r\nc=IN IP4 0.0.0.0\r\nb=AS:8192\r\na=rtpmap:96 H264/90000\r\na=control:track1\r\nm=audio 0 RTP/AVP 97\r\nc=IN IP4 0.0.0.0\r\nb=AS:8192\r\na=rtpmap:97 MPEG4-GENERIC/16000\r\na=fmtp:97 streamtype=5;profile-level-id=1;mode=AAC-hbr;sizelength=13;indexlength=3;indexdeltalength=3;config=1408\r\na=recvonly\r\na=control:track2\r\nm=audio 0 RTP/AVP 0\r\na=control:track3\r\na=rtpmap:0 PCMU/8000\r\na=sendonly",
"senders": [
"0 PCMU/8000, bytes=0, receivers=1"
],
"type": "RTSP active producer",
"url": "rtsp://192.168.9.127/Preview_01_sub/",
"user_agent": "go2rtc/1.9.2"
}
]
}pressing and holding mic {
"consumers": [
{
"medias": [
"video, sendonly, ANY",
"audio, sendonly, MPEG4-GENERIC"
],
"remote_addr": "127.0.0.1:42946",
"sdp": "v=0\r\no=- 1 1 IN IP4 0.0.0.0\r\ns=go2rtc/1.9.2\r\nc=IN IP4 0.0.0.0\r\nt=0 0\r\nm=video 0 RTP/AVP 96\r\na=rtpmap:96 H264/90000\r\na=fmtp:96 packetization-mode=1; sprop-parameter-sets=Z2QAM6wVFKAoAPGQ,aO48sA==; profile-level-id=640033\r\na=control:trackID=0\r\nm=audio 0 RTP/AVP 97\r\na=rtpmap:97 MPEG4-GENERIC/16000\r\na=fmtp:97 profile-level-id=1;mode=AAC-hbr;sizelength=13;indexlength=3;indexdeltalength=3; config=1408\r\na=control:trackID=1\r\n",
"send": 2135813578,
"senders": [
"96 H264, bytes=2096293756, receivers=1",
"97 MPEG4-GENERIC/16000, bytes=15688398, receivers=1"
],
"type": "RTSP passive consumer",
"url": "rtsp://127.0.0.1:8554/doorbell?video=copy&audio=aac",
"user_agent": "FFmpeg Frigate/0.14.0-da913d8"
},
{
"medias": [
"video, sendonly, VP8, VP9, H264, AV1",
"audio, sendonly, OPUS/48000/2, G722/8000, PCMU/8000, PCMA/8000, L16, PCML"
],
"remote_addr": "udp4 prflx 192.168.7.78:53151 related :0",
"send": 2042146817,
"senders": [
"102 H264, bytes=1986196956, receivers=1",
"111 OPUS/48000/2, bytes=32494922, receivers=1"
],
"type": "WebRTC/JSON sync passive consumer",
"user_agent": "HomeAssistant/2024.8.3 aiohttp/3.10.5 Python/3.12"
},
{
"medias": [
"video, sendonly, VP8, VP9, H264, AV1",
"audio, sendonly, OPUS/48000/2, G722/8000, PCMU/8000, PCMA/8000, L16, PCML"
],
"remote_addr": "udp4 prflx 192.168.7.78:60381 related :0",
"send": 890202859,
"senders": [
"102 H264, bytes=865908874, receivers=1",
"111 OPUS/48000/2, bytes=14064893, receivers=1"
],
"type": "WebRTC/WebSocket async passive consumer",
"user_agent": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/127.0.0.0 Safari/537.36"
},
{
"medias": [
"video, sendonly, H264, H265, VP8, VP9, AV1",
"audio, sendonly, OPUS/48000/2, G722/8000, PCMU/8000, PCMA/8000, L16, PCML"
],
"remote_addr": "udp4 prflx 192.168.7.185:50089 related :0",
"send": 7348222,
"senders": [
"96 H264, bytes=7149924, receivers=1",
"111 OPUS/48000/2, bytes=113857, receivers=1"
],
"type": "WebRTC/WebSocket async passive consumer",
"user_agent": "Mozilla/5.0 (iPhone; CPU iPhone OS 18_1 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Home Assistant/2024.9 (io.robbie.HomeAssistant; build:2024.799; iOS 18.1.0) Mobile/HomeAssistant, like Safari"
},
{
"medias": [
"video, sendonly, ALL",
"audio, sendonly, ALL",
"audio, recvonly, ANY"
],
"receivers": [
"0 ANY, bytes=0, senders=1"
],
"remote_addr": "127.0.0.1:50682",
"senders": [
"96 H264, bytes=0, receivers=1",
"96 H264, bytes=0, receivers=1",
"97 MPEG4-GENERIC/16000, bytes=0, receivers=1",
"98 OPUS/48000/2, bytes=0, receivers=1",
"97 MPEG4-GENERIC/16000, bytes=0, receivers=1"
],
"type": "probe",
"user_agent": "python-requests/2.32.3"
}
],
"producers": [
{
"medias": [
"video, recvonly, H.264 High 5.1",
"audio, recvonly, MPEG4-GENERIC/16000",
"audio, recvonly, OPUS/48000/2"
],
"receivers": [
"96 H264, bytes=2096293756, senders=5",
"97 MPEG4-GENERIC/16000, bytes=15688398, senders=2",
"98 OPUS/48000/2, bytes=34442783, senders=4"
],
"recv": 2166761673,
"remote_addr": "127.0.0.1:42976",
"sdp": "v=0\r\no=- 0 0 IN IP4 127.0.0.1\r\ns=No Name\r\nc=IN IP4 127.0.0.1\r\nt=0 0\r\na=tool:libavformat LIBAVFORMAT_VERSION\r\nm=video 0 RTP/AVP 96\r\na=rtpmap:96 H264/90000\r\na=fmtp:96 packetization-mode=1; sprop-parameter-sets=Z2QAM6wVFKAoAPGQ,aO48sA==; profile-level-id=640033\r\na=control:streamid=0\r\nm=audio 0 RTP/AVP 97\r\na=rtpmap:97 MPEG4-GENERIC/16000/1\r\na=fmtp:97 profile-level-id=1;mode=AAC-hbr;sizelength=13;indexlength=3;indexdeltalength=3; config=1408\r\na=control:streamid=1\r\nm=audio 0 RTP/AVP 98\r\nb=AS:64\r\na=rtpmap:98 opus/48000/2\r\na=control:streamid=2\r\n",
"type": "RTSP passive producer",
"url": "rtsp://127.0.0.1:8554/239c70893e317de35be73cd89b4d4849",
"user_agent": "ffmpeg/go2rtc"
},
{
"medias": [
"video, recvonly, H264",
"audio, recvonly, MPEG4-GENERIC/16000",
"audio, sendonly, PCMU/8000"
],
"receivers": [
"96 H264, bytes=0, senders=1",
"97 MPEG4-GENERIC/16000, bytes=0, senders=1"
],
"remote_addr": "192.168.9.127:554",
"sdp": "v=0\r\no=- 1724929999466423 1 IN IP4 192.168.9.127\r\ns=Session streamed by \"preview\"\r\nt=0 0\r\na=tool:BC Streaming Media v202210012022.10.01\r\na=type:broadcast\r\na=control:*\r\na=range:npt=now-\r\na=x-qt-text-nam:Session streamed by \"preview\"\r\nm=video 0 RTP/AVP 96\r\nc=IN IP4 0.0.0.0\r\nb=AS:8192\r\na=rtpmap:96 H264/90000\r\na=control:track1\r\nm=audio 0 RTP/AVP 97\r\nc=IN IP4 0.0.0.0\r\nb=AS:8192\r\na=rtpmap:97 MPEG4-GENERIC/16000\r\na=fmtp:97 streamtype=5;profile-level-id=1;mode=AAC-hbr;sizelength=13;indexlength=3;indexdeltalength=3;config=1408\r\na=recvonly\r\na=control:track2\r\nm=audio 0 RTP/AVP 0\r\na=control:track3\r\na=rtpmap:0 PCMU/8000\r\na=sendonly",
"senders": [
"0 PCMU/8000, bytes=0, receivers=1"
],
"type": "RTSP active producer",
"url": "rtsp://192.168.9.127/Preview_01_sub/",
"user_agent": "go2rtc/1.9.2"
}
]
} |
Beta Was this translation helpful? Give feedback.
6 replies
-
|
The iPhone app mic works fine with assist. But not with the card. The card isn't triggering need for the mic in the app |
Beta Was this translation helpful? Give feedback.
-
|
Yeah, mic permissions probably isn't implemented in the HA companion app yet. If you have an internal url set in your HA app, it may not be connecting via https. Nonetheless, you've got a few ways to use the mic now - in Frigate and in the phone browser. |
Beta Was this translation helpful? Give feedback.
-
|
Yea the app works fine with assist voice but maybe they haven't expanded to cards in Lovelace. Yes I do have a way. Thanks for the great support |
Beta Was this translation helpful? Give feedback.
-
|
As a summary of this thread for any future viewers:
|
Beta Was this translation helpful? Give feedback.
Answer selected by
JoshuaSeidel
-
|
@JoshuaSeidel - would you mind posting your working frigate configuration please? I'm having a similar problem, I've been following this thread and am not able to get this:
|
Beta Was this translation helpful? Give feedback.
3 replies
-
|
I think I am having the same issue as @peetipablo: #13532 |
Beta Was this translation helpful? Give feedback.
-
I was able to resolve my issue using the following go2rtc configuration for the doorbell streams: |
Beta Was this translation helpful? Give feedback.
-
|
This did the trick, thank you! Now just to deal with setting up HTTPS on my Home Assistant instance. |
Beta Was this translation helpful? Give feedback.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
As a summary of this thread for any future viewers: