LLM for Unity support?

[JohnP]

I am currently looking at purchasing "Dialogue System for Unity Addon for OpenAI, ElevenLabs & Other Generative AI" but for my game I need to generate dialogue/quests in real time (using the game state) whilst offline. I noticed that Ollama is supported but that seems to be for generating content in the editor and cloud services (OpenAI/Eleven labs) are used for real time generation?

Is it possible to have support for LLM for Unity as a realtime provider?

If you don't have time or can't do soon, can you suggest a good starting point for integration?

https://assetstore.unity.com/packages/t ... ity-273604

[Tony Li]

Hi,

You can use Ollama for runtime, too:

ollama.png (67.32 KiB) Viewed 138 times

[JohnP]

Does Ollama work in builds?

If so, does it also require the user to have Ollama installed? (LLM for Unity is self contained)

[Tony Li]

Yes, it requires Ollama to be installed.

[JohnP]

In order to avoid complications for users I'd prefer to avoid having to have them install extra software and keep everything in the build. I don't think Ollama works on mobile/console.

Would you consider adding support for LLM for Unity in play mode? (It doesn't work outside of play mode but I could use Ollama/OpenAI for that)

I don't know if you've already looked at it but it can receive string input (prompt) so it shouldn't be too much of a hassle to add?

[Tony Li]

Hi,

I'll look into it. Next up on the roadmap is ElevenLabs Flash model integration, but I can evaluate LLM for Unity after that.

[JohnP]

Thanks, and for the prompt replies.