hermes-gemini-live.yaml 2.4 KB

123456789101112131415161718192021222324252627282930313233343536373839
  1. name: hermes-gemini-live
  2. repo: https://github.com/skappafrost/hermes-gemini-live
  3. sha: cf549e7f8af858568936ccb434c7e1104eb200e9
  4. description: >-
  5. Realtime duplex voice with the Gemini Live API, built around handing real work to Hermes.
  6. A single control in the composer (not a floating panel): tap, speak, hear the model, and when
  7. the ask needs files, a terminal, the web or memory the voice model delegates the job to the
  8. api server and keeps talking, reading the outcome aloud when it lands. Three verbs rather than
  9. thirty schemas — hermes_task starts, hermes_tasks reads the call's task board, and
  10. hermes_task_update denies, steers or stops a task. A task that stops to ask permission
  11. reaches the user as a spoken prompt and a "Hermes needs you" indicator with Approve and Deny
  12. buttons; only the user's press approves it, never the voice model.
  13. Multi-task is one Live session plus a board, not a session per task. Mute drops the uplink
  14. without hanging up, and the call survives composer remounts, so opening a session mid-sentence
  15. does not kill it. Full-proxy architecture: the plugin backend owns the upstream Live socket and
  16. the key, and the renderer is never given either, because the Live API carries the credential in
  17. the socket URL. Ships no Python dependencies of its own, which keeps it out of the uv workspace
  18. and lets one clone serve several profiles. Tested model behaviour is published in the README,
  19. including that gemini-3.8-live-extended-thinking accepts a function declaration and then
  20. delegates only about 2 times in 5, which is why gemini-3.8-live is the default. Disclosure —
  21. pressing Start captures microphone audio and streams it through the local backend to
  22. generativelanguage.googleapis.com using GEMINI_API_KEY from the Hermes home's .env; delegated
  23. work runs as a Hermes run in the serving profile's own memory with the profile's full toolset
  24. via the local api_server and API_SERVER_KEY, and those runs' results (up to 4000 characters
  25. each), the task board and approval prompts are sent back to Gemini as text. Nothing is sent
  26. anywhere else and no telemetry is emitted.
  27. maintainer: skappafrost
  28. tier: community
  29. version: "0.1.0"
  30. category: voice
  31. docs_url: https://github.com/skappafrost/hermes-gemini-live#readme
  32. requires_hermes: ">=0.21.5"
  33. platforms: []
  34. capabilities:
  35. provides_tools: []
  36. provides_hooks: []
  37. provides_middleware: []
  38. requires_env:
  39. - GEMINI_API_KEY