Custom Providers in the Assistant

As a Roblox developer, it is currently too hard to attach a custom provider to the assistant other than choosing between Anthropic, OpenAI, and Google

If Roblox is able to address this issue, it would improve my development experience because it would allow us to use cheaper inference provider alternatives (ex. DeepInfra) and/or allow us to use local models via Ollama or llama.cpp

It would be easy to implement this as almost all providers have some sort of implementation of the OpenAI API Schema. Along with that, I have noticed that some of the newer Anthropic models are missing from the model picker (notably Opus 4.6 and Fable 5)

Screenshot of the problem:


(There should be an option to add a custom provider)

3 Likes