Page 1 of 1

LLM for Unity support?

Posted: Thu Jun 12, 2025 4:41 pm
by JohnP
I am currently looking at purchasing "Dialogue System for Unity Addon for OpenAI, ElevenLabs & Other Generative AI" but for my game I need to generate dialogue/quests in real time (using the game state) whilst offline. I noticed that Ollama is supported but that seems to be for generating content in the editor and cloud services (OpenAI/Eleven labs) are used for real time generation?

Is it possible to have support for LLM for Unity as a realtime provider?

If you don't have time or can't do soon, can you suggest a good starting point for integration?

https://assetstore.unity.com/packages/t ... ity-273604

Re: LLM for Unity support?

Posted: Thu Jun 12, 2025 7:00 pm
by Tony Li
Hi,

You can use Ollama for runtime, too:

ollama.png
ollama.png (67.32 KiB) Viewed 320 times

Re: LLM for Unity support?

Posted: Thu Jun 12, 2025 7:33 pm
by JohnP
Does Ollama work in builds?

If so, does it also require the user to have Ollama installed? (LLM for Unity is self contained)

Re: LLM for Unity support?

Posted: Thu Jun 12, 2025 7:34 pm
by Tony Li
Yes, it requires Ollama to be installed.

Re: LLM for Unity support?

Posted: Thu Jun 12, 2025 7:53 pm
by JohnP
In order to avoid complications for users I'd prefer to avoid having to have them install extra software and keep everything in the build. I don't think Ollama works on mobile/console.

Would you consider adding support for LLM for Unity in play mode? (It doesn't work outside of play mode but I could use Ollama/OpenAI for that)

I don't know if you've already looked at it but it can receive string input (prompt) so it shouldn't be too much of a hassle to add?

Re: LLM for Unity support?

Posted: Thu Jun 12, 2025 8:29 pm
by Tony Li
Hi,

I'll look into it. Next up on the roadmap is ElevenLabs Flash model integration, but I can evaluate LLM for Unity after that.

Re: LLM for Unity support?

Posted: Thu Jun 12, 2025 8:40 pm
by JohnP
Thanks, and for the prompt replies. :mrgreen: