Nous Research Seeks Suggestions to Expand Hermes Agent Plugin Interfaces

Get a lay of the land on our current plugins system and state of things here:

https://hermes-agent.nousresearch.com/docs/user-guide/features/plugins

@Teknium @NousResearch Happy 4th of July.

Teknium if we can expand more on the area of personal finances it would be great.

I started integrating with Plaid here https://github.com/NousResearch/hermes-agent/pull/51983

@Teknium

oh boy thats exactly the right move

but the problem will be how many different plugins can be installed together so if done wrong community forks and splits

thus a standard plugin/module protocol is needed which enables different plugins from different devs to run together

maybe we need a plugin installer or a plugin manager

@SOntheotherside We do have a standardized plugins interface:

https://hermes-agent.nousresearch.com/docs/user-guide/features/plugins

@outsideobserver I'd love to do what we can to make it so you need no fork and can just load your custom set of plugins to make it into exactly what you're looking for! Will see what we can do 🫡🫡

@cobi_bean @Teknium @NousResearch Yes it would be awesome. Can’t wait to give my agent access to my bank and start creating some crazy stuff with it and provide some finance education using AI

Big ask from the Hermes Browser Extension side is to make API server/gateway plugins first class

Stable hooks for run/session lifecycle, tool-event streaming, approvals/interrupts, capability discovery, scoped auth/CORS, and browser context providers would let us ship richer integrations without patching core files...

Also would love a versioned plugin manifest + permissions/capabilities model so community plugins can coexist cleanly instead of everyone maintaining forks or one-off patches

@iamlukethedev @Teknium @NousResearch ohhh shit - been looking for this.

@Teknium -- merge this or use as inspiration!

@Teknium Not necessarily plugin related, as I love the modularity of skills and scripts. But it would be great if there was some sort of auto resolve on dependencies. As a plugin you can obv package that, but for skill based stuff requiring certain dependencies it would be a nice check.

@Teknium Great idea! But how would it be diffferent compared to loca patches?

@Teknium Having more accessibility to API for voice, gateway, etc! ❤️

@Teknium happy 4th man. plugins over pr purgatory is the move, let the devs cook

@Teknium @NousResearch I feel like we should consider modularity in the Linux kernel as a analogous set of requirements.

Different boundaries and standards for device drives vs. modules, and for netfilter vs. BPF or LSM, for example.

Some brainstorming on @poe_platform: https://poe.com/s/RJZUTTocl4aVcR7hOpdL

@Teknium This is the way, thanks 👑!

@Teknium I'd like a ctx.register_wallpaper_provider() plugin interface for the Desktop app that accepts image paths/URLs and renders them as the chat background. Paired with a /wallpaper set <name> slash command that plugins can register. This lets community members ship wallpaper packs

@Teknium the MOA feature made my chinese models hallucinate even more, horrible hermes feature

@Teknium extensible plugin surfaces over monolithic core is genuinely the right call for a project at this stage, lets the ecosystem breathe

@Teknium We use transform_llm_output to play .wav after every response. Works but everyone writes their own. A register_sound_pack() API would let community publish sound packs (RA2 EVA, Mario, Portal) — install one plugin, pick via config or /sound, done.