python tech rigging scripting brotools ai

BroAI Tests

2024-12-22

A while ago I showcased my experiment in integrating ChatGPT with Maya .

It was a while ago and since then a lot has happened in the AI world and also in my experience and understanding of AI technology and specifically LLMs. I worked with them and built tools around them since then, and finally got to a point where I know where I want to take this tool further.

My goal is to bring not just ChatGPT but best frontier LLM models into Maya, as well as support local options like Ollama , Ooba TextGen WebUI and more.

Currently I already have "integrations" for OpenAI compatible APIs (OpenAI, Text GenWebUI, Ollama, llama.cpp) and Anthropic API (Claude).

I have some ideas about how to make this thing smarter. I believe that in the future this tool will help replace a lot of small utility tools like renamers, sorters, but this is short term. Long term this tool might be able to do much more complex tasks, when paired with the right models. For example LLAMA-Mesh is capable of generating meshes vertex by vertex.

Here are some examples with Anthropic integration.