[Detector Support]: Crying not detected

[pappasaj]

Describe the problem you are having

I'm attempting to use my IP camera as a baby monitor, but I can not for the life of me get it to trigger the crying event. I've had the baby right in front of the camera crying really loudly..still nothing.

Version

0.13.2-6476F8A

Frigate config file

detectors:
  coral:
    type: edgetpu
    device: usb

mqtt:
  host: 192.168.86.XXX # <---- same mqtt broker that home assistant uses
  port: 1883
  user: XXX
  password: XXXX

detect:
  stationary:
    interval: 50
    threshold: 50

birdseye:
  enabled: true
  restream: true
  mode: motion

objects:
  track:
    - person
    - dog

audio:
  enabled: true
  listen:
    - crying
    - bark
    - fire_alarm
    - scream
    - yell
    - groan
    - wheeze
    - sneeze
    - chatter
    - smoke_detector
    - breaking
    - smash
    - fart

record:
  enabled: true
  retain:
    days: 2
    mode: motion
  events:
    retain:
      default: 3
      mode: motion

snapshots:
  enabled: true
  retain:
    default: 15
    mode: motion

go2rtc:
  streams:
    Mason:
      - rtsp://admin:XXXXXX@XXXXXXX:554/cam/realmonitor?channel=1&subtype=0
      - "ffmpeg:Mason#audio=aac"

cameras:
  Mason:
    ffmpeg:
      output_args:
        record: preset-record-generic-audio-copy
      inputs:
#        - path: rtsp://admin:XXXXXXXXX:554/cam/realmonitor?channel=1&subtype=1
#          roles:
#            - audio
#            - detect
        - path: rtsp://127.0.0.1:8554/Mason
          input_args: preset-rtsp-restream
          roles:
            - record
            - detect
            - audio
    zones:
      Garage:
        coordinates: 0,931,0,0,148,52,1231,78,1920,125,1920,1031
    detect:
      height: 1080
      width: 1920
      fps: 5
    onvif:
      host: 192.168.86.XX
      port: 80
      user: onvif
      password: XXXXX

docker-compose file or Docker CLI command

Docker-compose

Relevant log output

No logs

Operating system

HassOS

Install method

HassOS Addon

Coral version

USB

Any other information that may be helpful

Speach, and a whole list of other audio events are triggered correctly, so I don't think its a setting that I have incorrect, and because of that I haven't tried modifying any thresholds.

[NickM-27]

probably need to lower the threshold for crying

[pappasaj]

lowered the threshold to the lowest possible setting of 0.5. Still didn't detect my son crying this morning for over 10 minutes. There is a white noise machine that is going in the background, but its able to pick up other sounds so I'm curious if anyone has any ideas. Is there a way to reduce white noise using the ffmpeg protocol inside frigate audio stream? Running out of ideas to detect that one noise.

[totalitarian]

lowered the threshold to the lowest possible setting of 0.5. Still didn't detect my son crying this morning for over 10 minutes. There is a white noise machine that is going in the background, but its able to pick up other sounds so I'm curious if anyone has any ideas. Is there a way to reduce white noise using the ffmpeg protocol inside frigate audio stream? Running out of ideas to detect that one noise.

Ever solve this? I can see frigate rms triggering but crying is not detected

[Kevin-mckiernan]

I have tried modifying the thresholds as well and cannot get crying detection. Was really trying to get rid of the baby cams. Any resolution here?

[pappasaj]

I could never get it working. I have tried using the FFmpeg Noise integration and trying to modify the settings to reduce the white noise machine. From there I was going to create a tiered noise detection alert automation that slowly escalated, but once I switched form my raspberrypi 4 to the 5, I can't seem to get it dialed in anymore so I have given up for now.

[Kevin-mckiernan]

Got it. I might give the tiered noise detection a try. Seems like the Crying detection would be an easy one to classify thought. I feel like something else is going on.

[pappasaj]

If I set my camera up on my desk and find a youtube video of a baby crying, I can get it trigger all day long. But the second I put it in our babies room, it never triggers the crying alert

[pappasaj]

I used exactly what you were saying, utilizing the ffmpeg protocol and spent days dialing it in. I got to a point where the white noise was properly getting reduced out, but the crying detection still sucked. Than we moved the sound machine, lowered the volume, and all that dialing in got reverted and it stopped working like it should so I just let it die and turned it off and just rely on my baby camera still and not home assistant at all for the kido.

…

On Oct 10, 2024, at 10:58 AM, totalitarian ***@***.***> wrote: lowered the threshold to the lowest possible setting of 0.5. Still didn't detect my son crying this morning for over 10 minutes. There is a white noise machine that is going in the background, but its able to pick up other sounds so I'm curious if anyone has any ideas. Is there a way to reduce white noise using the ffmpeg protocol inside frigate audio stream? Running out of ideas to detect that one noise. Ever solve this? I can see frigate rms triggering but crying is not detected — Reply to this email directly, view it on GitHub <#10241 (reply in thread)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AALXT7Z2ZTYF474VZ4FVM7TZ22W5DAVCNFSM6AAAAABPXHDAY2VHI2DSMVQWIX3LMV43URDJONRXK43TNFXW4Q3PNVWWK3TUHMYTAOJQGY3TOMY>. You are receiving this because you authored the thread.

[totalitarian]

Aww man that's a shame as I wanted to block my camera from the internet and just rely on home assistant. For now i'm just going to use the frigate sound level as a trigger. My little one will be in a room on her own, so any noise in there will usually mean she's crying. Thanks for the reply.