Frigate & Google Coral and Proxmox VM

Bought items:

Good Youtube Tutorial: https://www.youtube.com/watch?v=zKk9dnAp8FM

In Proxmox Node:

lsusb

root@orange:/etc/pve/lxc# lsusb
Bus 008 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub
Bus 007 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
Bus 006 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub
Bus 005 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
Bus 004 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub
Bus 003 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
Bus 002 Device 003: ID 18d1:9302 Google Inc. 
Bus 002 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub
Bus 001 Device 002: ID 8087:0029 Intel Corp. AX200 Bluetooth
Bus 001 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub

Setup Ubuntu VM and Add USB device:

Restart VM

run lsusb to see if the vm has the USB

Install Docker and Portainer

Add this Docker Compose to install frigate

version: "3.9"
services:
  frigate:
    
    container_name: frigate
    privileged: true # this may not be necessary for all setups
    restart: unless-stopped
    stop_grace_period: 30s # allow enough time to shut down the various services
    image: ghcr.io/blakeblackshear/frigate:stable
    shm_size: "512mb" # update for your cameras based on calculation above
    devices:
      - /dev/bus/usb:/dev/bus/usb # Passes the USB Coral, needs to be modified for other versions
      - /dev/apex_0:/dev/apex_0 # Passes a PCIe Coral, follow driver instructions here https://coral.ai/docs/m2/get-started/#2a-on-linux
      #- /dev/video11:/dev/video11 # For Raspberry Pi 4B
      #- /dev/dri/renderD128:/dev/dri/renderD128 # For intel hwaccel, needs to be updated for your hardware
    volumes:
      - /etc/localtime:/etc/localtime:ro
      - /mnt/portainer2/frigate/config:/config
      - /mnt/portainer2/frigate/storage:/media/frigate
      - type: tmpfs # Optional: 1GB of memory, reduces SSD/SD Card wear
        target: /tmp/cache
        tmpfs:
          size: 1000000000
    ports:
      - "8971:8971"
      - "5000:5000" # Internal unauthenticated access. Expose carefully.
      - "8554:8554" # RTSP feeds
      - "8555:8555/tcp" # WebRTC over tcp
      - "8555:8555/udp" # WebRTC over udp
    environment:
      FRIGATE_RTSP_PASSWORD: "strong@pwd"

go to path VM IP:5000 to view the Frigate UI Configuration Editor

Twist your config like mine:

make sure to change username , password and ip address. Below is the 3 tapo c110 configuration url address

mqtt:
  enabled: false

cameras:
  tapo_username001: # <------ Name the camera
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://tapo_username001:yourpassw@192.168.1.xxx:554/stream1 # <----- The stream you want to use for detection
          roles:
            - detect
            - record
    detect:
      enabled: true # <---- disable detection until you have a working camera feed
      width: 2304
      height: 1296
      fps: 5
    motion:
      threshold: 30
      contour_area: 28
      improve_contrast: true
    record:
      enabled: true
      retain:
        days: 30
        mode: motion
    snapshots:
      enabled: true
      timestamp: true
      bounding_box: true
      retain:
        default: 30
  tapo_username002: # <------ Name the camera
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://tapo_username002:yourpassw@192.168.1.xxx:554/stream1 # <----- The stream you want to use for detection
          roles:
            - detect
            - record
    detect:
      enabled: true # <---- disable detection until you have a working camera feed
      width: 2304
      height: 1296
      fps: 5
    motion:
      threshold: 30
      contour_area: 28
      improve_contrast: true
    record:
      enabled: true
      retain:
        days: 30
        mode: motion
    snapshots:
      enabled: true
      timestamp: true
      bounding_box: true
      retain:
        default: 30
  tapo_username003: # <------ Name the camera
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://tapo_username003:yourpassw@192.168.1.xxx:554/stream1 # <----- The stream you want to use for detection
          roles:
            - detect
            - record
    detect:
      enabled: true # <---- disable detection until you have a working camera feed
      width: 2304
      height: 1296
      fps: 5
    motion:
      threshold: 30
      contour_area: 28
      improve_contrast: true
    record:
      enabled: true
      retain:
        days: 30
        mode: motion
    snapshots:
      enabled: true
      timestamp: true
      bounding_box: true
      retain:
        default: 30


record:
  enabled: true
  retain:
    days: 30
    mode: active_objects
  alerts:
    retain:
      days: 30
      mode: motion
  detections:
    retain:
      days: 30
      mode: motion

detectors:
  coral:
    type: edgetpu
    device: usb

objects:
  track:
    - person
    - face
    - printer
    - toy
    - filament
    - print_bed
    - extruder
    - tool
    - wrench
    - screw
    - spaghetti
    - failed_print


version: 0.15-1
camera_groups:
  SonA1:
    order: 1
    icon: LuFingerprint
    cameras:
      - tapo_username001
      - tapo_username002
      - tapo_username003

Click save and restart button

Tips:

Make sure to disable detection on your tapo settings, disable the local recording ( we don't need to use sd card for storage )

Go to the UI > Settings > Motion Tuner to update the Threshold and Contour Area to match your needs.

If you have google coral, it should have red label around the images.

Well done.

PCI Devices mapping in Proxmox

if you restart your VM or Host, the usb address id could change so that you need to map your host usb into your vm usb. Here is a quick run:

Remove your PCI Device in your VM Hardware setting.

SSH into your host pc which has the coral usb plugged in, mine is Orange 

lsusb -t

/:  Bus 08.Port 1: Dev 1, Class=root_hub, Driver=xhci_hcd/1p, 10000M
/:  Bus 07.Port 1: Dev 1, Class=root_hub, Driver=xhci_hcd/1p, 480M
/:  Bus 06.Port 1: Dev 1, Class=root_hub, Driver=xhci_hcd/1p, 10000M
/:  Bus 05.Port 1: Dev 1, Class=root_hub, Driver=xhci_hcd/1p, 480M
/:  Bus 04.Port 1: Dev 1, Class=root_hub, Driver=xhci_hcd/1p, 10000M
/:  Bus 03.Port 1: Dev 1, Class=root_hub, Driver=xhci_hcd/1p, 480M
/:  Bus 02.Port 1: Dev 1, Class=root_hub, Driver=xhci_hcd/2p, 10000M
    |__ Port 2: Dev 3, If 0, Class=Vendor Specific Class, Driver=usbfs, 5000M << this is the one
/:  Bus 01.Port 1: Dev 1, Class=root_hub, Driver=xhci_hcd/5p, 480M
    |__ Port 5: Dev 2, If 0, Class=Wireless, Driver=btusb, 12M
    |__ Port 5: Dev 2, If 1, Class=Wireless, Driver=btusb, 12M

Bus 02, Port 2 → Driver=xhci_hcd → PCIe USB controller 

readlink -f /sys/bus/usb/devices/usb2

/sys/devices/pci0000:00/0000:00:08.1/0000:c5:00.3/usb2

PCI address: 0000:c5:00.3

Go to Data Center > Resource Mappings > Under PCI Devices Panel , click Add > Choose Mapping on Node: Orange

Scroll down and pick the id like the above, which is 0000:c5:00.3

give it a short Name: coralusb

click Create

Now go back to your VM and add your pci device into your vm hardware setting:

Pick your mapped device:

Done. Restart the VM.

Update on 29 May 2025, here is my frigate yaml configuration for both google coral and beelink ser7 gpu. This include go2rtc which will stream one connection to the camera and stream out to everything else.

mqtt:
  enabled: false
go2rtc:
  webrtc:
    candidates:
      - 192.168.1.114:8555
      - portainer2.kyluat.lan:8555
      - frigate:8555
  streams:
    son_user001:
      - rtsp://user001:{FRIGATE_RTSP_PASSWORD}@192.168.1.100:554/stream2
      - tapo://{FRIGATE_TAPO_PASSWORD}@192.168.1.100
      - ffmpeg:son_user001#audio=opus
    son_user001_record:
      - ffmpeg:rtsp://user001:{FRIGATE_RTSP_PASSWORD}@192.168.1.100:554/stream2#video=copy
      - tapo://{FRIGATE_TAPO_PASSWORD}@192.168.1.100

    # son_user001_sub:
    #   - rtsp://user001:{{FRIGATE_RTSP_PASSWORD}}@192.168.1.100:554/stream2?timeout=92&rtsp_transport=tcp#video=copy
    #   - ffmpeg:son_user001#audio=opus
    son_user002:
      - rtsp://user002:{FRIGATE_RTSP_PASSWORD}@192.168.1.101:554/stream2
      - tapo://{FRIGATE_TAPO_PASSWORD}@192.168.1.101
      - ffmpeg:son_user002#audio=opus
    son_user002_record:
      - ffmpeg:rtsp://user002:{FRIGATE_RTSP_PASSWORD}@192.168.1.101:554/stream2#video=copy
      - tapo://{FRIGATE_TAPO_PASSWORD}@192.168.1.101
    # son_user002_sub:
    #   - rtsp://user002:{{FRIGATE_RTSP_PASSWORD}}@192.168.1.101:554/stream2?timeout=92&rtsp_transport=tcp#video=copy
    #   - ffmpeg:son_user002_sub#audio=opus
    son_user003:
      - rtsp://user003:{FRIGATE_RTSP_PASSWORD}@192.168.1.102:554/stream2
      - tapo://{FRIGATE_TAPO_PASSWORD}@192.168.1.102
      - ffmpeg:son_user003#audio=opus
    son_user003_record:
      - ffmpeg:rtsp://user003:{FRIGATE_RTSP_PASSWORD}@192.168.1.102:554/stream2#video=copy
      - tapo://{FRIGATE_TAPO_PASSWORD}@192.168.1.102
      
    # son_user003_sub:
    #   - rtsp://user003:{{FRIGATE_RTSP_PASSWORD}}@192.168.1.102:554/stream2?timeout=92&rtsp_transport=tcp#video=copy
    #   - ffmpeg:son_user003_sub#audio=opus
    # son_user004:
    #   - rtsp://admin:{FRIGATE_TAPO_PASSWORD}@192.168.1.190:554/cam/realmonitor?channel=1&subtype=0#video=copy
    son_user004:
      - rtsp://admin:{FRIGATE_TAPO_PASSWORD}@192.168.1.190:554/cam/realmonitor?channel=1&subtype=1#video=copy
      - ffmpeg:son_user004_sub#audio=opus
    # son_user005:
    #   - rtsp://admin:{FRIGATE_TAPO_PASSWORD}@192.168.1.181:554/cam/realmonitor?channel=1&subtype=0#video=copy
    son_user005:
      - rtsp://admin:{FRIGATE_TAPO_PASSWORD}@192.168.1.181:554/cam/realmonitor?channel=1&subtype=1#video=copy
      - ffmpeg:son_user005_sub#audio=opus
    # son_user006:
    #   - rtsp://admin:{FRIGATE_TAPO_PASSWORD}@192.168.1.182:554/cam/realmonitor?channel=1&subtype=0#video=copy # L2C67C0F
    son_user006:
      - rtsp://admin:{FRIGATE_TAPO_PASSWORD}@192.168.1.182:554/cam/realmonitor?channel=1&subtype=1#video=copy # L2C67C0F
      - ffmpeg:son_user006_sub#audio=opus

cameras:
  son_user004: # <------ Name the camera
    enabled: true
    ffmpeg:
      output_args:
        record: preset-record-generic-audio-aac
      inputs:
        - path: rtsp://127.0.0.1:8554/son_user004 # <----- The stream you want to use for detection
          input_args: preset-rtsp-restream
          roles:
            - record
        # - path: rtsp://127.0.0.1:8554/son_user004_sub # <----- The stream you want to use for detection
        #   input_args: preset-rtsp-restream
        #   roles:
            - detect
            - audio

    detect:
      enabled: true # <---- disable detection until you have a working camera feed
      fps: 5
    motion:
      threshold: 80
      contour_area: 100
      improve_contrast: false
    snapshots:
      enabled: true
      timestamp: true
      bounding_box: true
      retain:
        default: 90
    zones:
      person_zone:
        coordinates: 0.997,0.902,0.255,0.746,0.322,0.009,0.77,0.004,0.68,0.191,0.996,0.071
        loitering_time: 0
    birdseye:
      order: 1
    review:
      detections:
        required_zones: person_zone
      alerts:
        required_zones: person_zone
    objects: {}
  son_user005: # <------ Name the camera
    enabled: true
    ffmpeg:
      output_args:
        record: preset-record-generic-audio-aac
      inputs:
        - path: rtsp://127.0.0.1:8554/son_user005 # <----- The stream you want to use for detection
          input_args: preset-rtsp-restream
          roles:
            - record
        # - path: rtsp://127.0.0.1:8554/son_user005_sub # <----- The stream you want to use for detection
        #   input_args: preset-rtsp-restream
        #   roles:
            - detect
            - audio
    detect:
      enabled: true # <---- disable detection until you have a working camera feed
      fps: 5
    motion:
      threshold: 34
      contour_area: 43
      improve_contrast: false
    snapshots:
      enabled: true
      timestamp: true
      bounding_box: true
      retain:
        default: 90
    zones:
      person_zone:
        coordinates: 0.229,0.03,0.217,1,0.415,0.991,0.96,0.957,0.982,0.004
        loitering_time: 0
        inertia: 3
    birdseye:
      order: 1
    review:
      alerts:
        required_zones: person_zone
      detections:
        required_zones: person_zone
    objects: {}
  son_user006: # <------ Name the camera
    enabled: true
    ffmpeg:
      output_args:
        record: preset-record-generic-audio-aac
      inputs:
        - path: rtsp://127.0.0.1:8554/son_user006 # <----- The stream you want to use for detection
          input_args: preset-rtsp-restream
          roles:
            - record
        # - path: rtsp://127.0.0.1:8554/son_user006_sub # <----- The stream you want to use for detection
        #   input_args: preset-rtsp-restream
        #   roles:
            - detect
            - audio

    detect:
      enabled: true # <---- disable detection until you have a working camera feed
      fps: 5
    motion:
      threshold: 80
      contour_area: 100
      improve_contrast: true
      mask: 0.614,0.276,0.605,0.598,0.726,0.617,0.724,0.28
    snapshots:
      enabled: true
      timestamp: true
      bounding_box: true
      retain:
        default: 90
    zones:
      person_zone:
        coordinates: 0.099,0.257,0.1,0.997,1,1,1,0.29
        loitering_time: 0
    birdseye:
      order: 1
    review:
      alerts:
        required_zones: person_zone
      detections:
        required_zones: person_zone
    objects:
      mask: 0.727,0.219,0.725,0.392,0.914,0.41,0.896,0.207
  son_user001: # <------ Name the camera
    enabled: true
    ffmpeg:
      output_args:
        record: preset-record-generic-audio-aac
      inputs:
        - path: rtsp://127.0.0.1:8554/son_user001_record # <----- The stream you want to use for record
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/son_user001 # <----- The stream you want to use for detect
          input_args: preset-rtsp-restream
          roles:
            - detect
            - audio
    record:
      enabled: true
      retain:
        days: 90       # Keep recordings for 7 days (adjust as needed)
        mode: all     # Options: motion | active_objects | all
    detect:
      enabled: true # <---- disable detection until you have a working camera feed
      fps: 5
    motion:
      threshold: 80
      contour_area: 100
      improve_contrast: true
    snapshots:
      enabled: true
      timestamp: true
      bounding_box: true
      retain:
        default: 90
    zones:
      plate:
        coordinates: 
          0.269,0,0.276,0.29,0,0.568,0.145,1,0.404,1,0.896,1,1,0.583,0.943,0.413,0.803,0.297,0.795,0
        loitering_time: 0
        inertia: 3
    birdseye:
      order: 1
    review:
      detections:
        required_zones: plate
      alerts:
        required_zones: plate
    objects: {}
  son_user002: # <------ Name the camera
    enabled: true
    ffmpeg:
      output_args:
        record: preset-record-generic-audio-aac
      inputs:
        - path: rtsp://127.0.0.1:8554/son_user002_record # <----- The stream you want to use for detection
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/son_user002 # <----- The stream you want to use for detection
          input_args: preset-rtsp-restream
          roles:
            - detect
            - audio
    record:
      enabled: true
      retain:
        days: 90       # Keep recordings for 7 days (adjust as needed)
        mode: all     # Options: motion | active_objects | all
    detect:
      enabled: true # <---- disable detection until you have a working camera feed
      fps: 5
    motion:
      threshold: 80
      contour_area: 100
      improve_contrast: false
      mask:
        - 0,0,0.442,0,0.463,0.456,0.165,0.544,0,0.84
        - 0.667,0,0.675,0.274,0.999,0.399,0.998,0
    snapshots:
      enabled: true
      timestamp: true
      bounding_box: true
      retain:
        default: 90
    zones:
      plate:
        coordinates: 
          0.163,0.551,0.462,0.458,0.444,0.003,0.664,0,0.674,0.276,0.998,0.399,1,0.996,0,0.996,0.001,0.851
        loitering_time: 0
    birdseye:
      order: 2
    review:
      detections:
        required_zones: plate
      alerts:
        required_zones: plate
    objects: {}
  son_user003: # <------ Name the camera
    enabled: true
    ffmpeg:
      output_args:
        record: preset-record-generic-audio-aac
      inputs:
        - path: rtsp://127.0.0.1:8554/son_user003_record # <----- The stream you want to use for detection
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/son_user003 # <----- The stream you want to use for detection
          input_args: preset-rtsp-restream
          roles:
            - detect
            - audio
    record:
      enabled: true
      retain:
        days: 90       # Keep recordings for 7 days (adjust as needed)
        mode: all     # Options: motion | active_objects | all
    detect:
      #enabled: false # <---- disable detection until you have a working camera feed
      fps: 5
    motion:
      threshold: 30
      contour_area: 10
      improve_contrast: true
      mask: 0.362,0.172,0.359,0.421,0.457,0.421,0.459,0.222
    snapshots:
      enabled: true
      timestamp: true
      bounding_box: true
      retain:
        default: 30
    zones:
      person_zone:
        coordinates: 
          0.467,0.087,0.606,0.078,0.613,0.332,0.89,0.109,1,0.106,0.999,0.997,0.001,0.999,0.005,0.047,0.23,0.117,0.337,0.599,0.457,0.421
        loitering_time: 0
        objects: person
        inertia: 3
    birdseye:
      order: 3
    review:
      alerts:
        required_zones: person_zone
      detections:
        required_zones: person_zone
    objects:
      mask: 0.472,0.542,0.48,0.013,0.541,0.013,0.524,0.52
record:
  enabled: true
  export:
    timelapse_args: -vf setpts=PTS/60 -r 25
  sync_recordings: true
  retain:
    days: 90
    mode: all
  alerts:
    retain:
      days: 90
      mode: motion
  detections:
    retain:
      days: 90
      mode: motion

detectors:
  coral:
    type: edgetpu
    device: usb

objects:
  track:
    - person
    - cat
    - dog

audio:
  enabled: false
  listen:
    - bark
    - fire_alarm
    - scream
    - speech
    - yell
    - dog
    - footsteps
    - laughter
    - pets
    - cat
    - meow
    - electric_piano
    - piano
    - telephone
    - television




birdseye:
  enabled: true
  width: 1280
  height: 720
  mode: continuous
  inactivity_threshold: 15
  layout:
    max_cameras: 6
    scaling_factor: 1.0




ffmpeg:
  hwaccel_args: preset-vaapi
  output_args:
    record: preset-record-generic-audio-aac



version: 0.16-0
camera_groups:
  SonA1:
    order: 1
    icon: LuFingerprint
    cameras:
      - son_user001
      - son_user002
      - son_user003
      - son_user004
      - son_user005
      - son_user006
  Bird:
    order: 2
    icon: LuBird
    cameras: birdseye
semantic_search:
  enabled: true
  reindex: false
  model_size: large
detect:
  enabled: true
face_recognition:
  enabled: true
  model_size: large
lpr:
  enabled: true
classification:
  bird:
    enabled: true

Firewall and Allow Ports for Dahua Cam:

When you first init setup your dahua cam, don't use pi hole dns, use 1.1.1.1 dns instead.

1.device that integrates only the P2P function.

To use UDP hole punch technology for remote access, the firewall output of the device must allow the following ports:


● UDP ports: 0-65535

● TCP ports: 9116, 9118, 12366, 12367

● Dahua servers use dynamic IP addresses, their domain names and functions are:

2.Device supporting P2P and Cloud Business

To use UDP hole punch technology for remote access and normal operation of video surveillance services, the firewall output of the device must allow the following ports:


● UDP ports: 0-65535

● TCP ports: 443, 9112, 9113, 9116, 9118, 10000, 12367, 15100, 15101, 15301, 15600, 15900, 16759

● Dahua servers use dynamic IP addresses, their domain names and functions are: