fish-audio.yaml 5.6 KB

12345678910111213141516171819202122232425262728293031323334
  1. name: fish-audio
  2. title: Fish Audio
  3. repo: https://github.com/100yenadmin/fish-audio-hermes
  4. sha: 606afb54aa1a354cc8eac0b17f3da3a105ac55a7
  5. description: "Lifelike voices for your agent: Fish Audio's expressive text-to-speech in 80+ languages, plus transcription, voice cloning and a voice library. The official Fish Audio plugin: Fish's Drama 3 model with word-level direction, speech-to-text, Fish Audio's community voice library, voice cloning and voice design, with a Voices page in Hermes Desktop. Fish Audio becomes a Hermes speech and transcription provider for voice replies, read-aloud, voice notes and Desktop dictation, with sentence-by-sentence streaming in CLI voice mode and Desktop, and word-by-word live dictation captions on Hermes 0.21.6+ (stt.streaming: true). Adds the fish_speak, fish_voices and fish_transcribe tools, /fish and hermes fish commands, and four skills. Disclosure — sends your Fish API key and the text, audio (with file names) and voice titles, tags, descriptions, cover images and design instructions you ask it to process to api.fish.audio, or to the base_url you configure, and reads your Fish wallet for balances and model choice; with live dictation on, microphone audio streams to Fish's native realtime speech-to-text at api.fish.audio (transcribe-stream-1, Preview) while you speak, billed $0.36 per hour of open session, per second, including silence; a session opens with the first audio and closes once Fish confirms the last words (the plugin stops waiting after 15 seconds), or 30 seconds after the last audio of a cancelled recording; the live_transcription: compat setting uses Fish's older realtime endpoint instead, billed per committed phrase rounded up to a second; synthesis, transcription, cloning and voice design are paid requests billed to your Fish account, except the free s2.1-pro-free model (free through 30 November 2026), whose requests Fish may use to improve its models. The key comes from the profile's secret scope (Hermes stores it in the profile .env; a single-profile install may also read FISH_API_KEY from the environment). Generated audio and subtitles are written to Hermes's audio cache; clone samples and recordings it uploads must be regular audio files, and Hermes config, secret and credential paths are refused. Cloning and deleting voices from chat or the model tools go through Hermes's approval gate and follow your approval settings. The Desktop Voices page and a Fish Audio settings page add gateway routes under /api/plugins/fish-audio/, behind the Hermes dashboard's existing authentication. On the Voices page, previews, clones and voice designs are billed; cloning a voice or saving a designed one creates a voice in your Fish account; cloning and deleting are confirmed on the page (a speaker-consent box, a typed voice name) instead of through Hermes's approval gate; and Use sets the profile's Fish voice, and its speech provider when none is set. The settings page and /fish alias can set or reset the profile's Fish model and voice and save up to 50 voice names in the profile's config. Preview and design audio files are deleted from the gateway once returned; a design's audio is held in gateway memory so you can save it, until it is saved, a later design or save finds it over an hour old, or the gateway stops; clone uploads are deleted after the clone, or by the next upload once idle for 15 minutes. With a key set, Desktop reads your Fish wallet when an agent is selected and about every five minutes, for the status-bar credit; favourites stay in Desktop's plugin storage on that computer, and fetched previews stay in the window's memory until it closes. Includes a report-a-problem skill: the agent drafts a bug report and files it to this plugin's repository as a public GitHub issue or comment with your gh login only after you approve the exact text; reports leave out keys, credit amounts and your own voice ids, and security problems go to the repository's private advisory form instead. No telemetry."
  6. maintainer: 100yenadmin
  7. tier: community
  8. category: voice
  9. requires_hermes: ">=0.21.6"
  10. docs_url: https://github.com/100yenadmin/fish-audio-hermes#readme
  11. version: "1.9.0"
  12. image: https://raw.githubusercontent.com/100yenadmin/fish-audio-hermes/606afb54aa1a354cc8eac0b17f3da3a105ac55a7/docs/media/banner.png
  13. screenshots:
  14. - https://raw.githubusercontent.com/100yenadmin/fish-audio-hermes/606afb54aa1a354cc8eac0b17f3da3a105ac55a7/docs/media/screenshot-desktop-library.png
  15. - https://raw.githubusercontent.com/100yenadmin/fish-audio-hermes/606afb54aa1a354cc8eac0b17f3da3a105ac55a7/docs/media/screenshot-desktop-create.png
  16. - https://raw.githubusercontent.com/100yenadmin/fish-audio-hermes/606afb54aa1a354cc8eac0b17f3da3a105ac55a7/docs/media/screenshot-desktop-account.png
  17. - https://raw.githubusercontent.com/100yenadmin/fish-audio-hermes/606afb54aa1a354cc8eac0b17f3da3a105ac55a7/docs/media/screenshot-setup.png
  18. readme: true
  19. platforms: [linux, macos]
  20. known_issues:
  21. - "Hermes's text normaliser alters <|speaker:N|> markup and Drama 3 closing tags such as </whisper> on the plain text_to_speech path; use fish_speak for multi-speaker speech and Drama 3 word tags (NousResearch/hermes-agent#133131)."
  22. - "In the dark theme an empty API key field in Settings is very hard to see; a fix is proposed (NousResearch/hermes-agent#138994)."
  23. - "Under plugins.isolation: host the hermes fish terminal command is unavailable and voice replies use whole-file speech instead of streaming; /fish, the tools and both providers still work."
  24. capabilities:
  25. provides_tools:
  26. - fish_speak
  27. - fish_voices
  28. - fish_transcribe
  29. provides_hooks:
  30. - transform_llm_output
  31. - pre_tool_call
  32. provides_middleware: []
  33. requires_env:
  34. - FISH_API_KEY