Show HN: First AI Game Master that can run combat on a battlemap

youtube.com

2 points by willliuwillliu 7 days ago

Here's a demo video I made for our AI game master who can now generate a battlemap and run combat! Franz (our AI GM), can now generate character voices, move tokens around the map, update/track everything, and more. We also added voice input/output!

I don't want to toot my own horn too much but I just think it's so fricken cool that this is possible now.

Here are some notes that you guys might find interesting: - The main turn loop is a workflow, but parts of it are agentic. For example, npc turns are agentic. See https://www.anthropic.com/engineering/building-effective-age... for more info about workflow vs agentic - Most of the decision making is handled by LLMs, but more mechanical aspects are handled programmatically and then given to the LLM as context. For example, damage calculations are done programmatically. The hardest part about building this was deciding what to let the LLM do and what to do via code. - This would not have been possible a year ago without advancements in token speed and quality, especially with tool calling! - We use gemini-2.0-flash mostly

Happy to answer any questions about how we built this