Giving LLM Text Vision and Self Awareness in Luau [OPEN SOURCE]

[Magus_ArtStudios]

The chatmodule is not required the most up to date version of this module is Text Vision Awareness Judgement Description Library for LLMs in Video Games [Open Source]
Sorry for the confusion. I would recommend the newest version.
This is the link to the page about the Chatmodule library in addition to its previous public build and examples.
Lua Trainable Ai Chatbot Library, Emoji Generate ,Emotion Classifier Context Database,Math/Geometry Data Generator Geometry+Worded Math Solver RAG
Designed to create a retrieval based chatbot and provide rag for LLMs.

		--local DeterminantAgent=require(game.ReplicatedStorage.GlobalSpells.ChatbotAlgorithm.DeterminantAgent)
		--local personality=personal[1]
		local awarobserve=personal[2]
		--identify..timeod..awareobserve
		print(personal)
		--local Resulttable,speakers=cm.LocalZephyrStory(str,npcnam,{[1]=persona,[2]=awareobserve,[3]=identity,[4]=timeod},Player)
		local identity=personal[3]
		local timeod=personal[4]
	local insight=personal[5]
	local botter=player.Name
	if personal[8]~=nil then
		botter=personal[8]
	end
		--local memory=personal[7]
		--local previousconversation=personal[6]
	local systemsg =timeod.."\n"..identity.."\n"..awarobserve.."\n"..insight--Time of day, npc identity, awareness of surroundings and response from local chatbot in addition to previous memories.
	print(systemsg)
		-- Parse story dialogues with "..person..": and "..Playername..": .\n</s>\n<|"..Playername.."|>\n"..quer.." </s>\n<|assistant|>"..previousconversation
	return Agent.SendMessage(player,msg,npc,systemsg,memories,botter)

In this example I show the end result of how a system message is engineered via Time of day, npc identity, awareness of surroundings the response from local chatbot in addition to previous memories.
I tried to make sure all dependencies were checked with it but any dependant functions can be omitted. Only a few things are not usable with the open sourced version, such as certain effects that require a effects library that is not included and animations library. Although, I have published some standalone modules that provide emojis and intelligent emotes as well as animations dataset, in addition to the awareness synthesis algorithm. I would not publish my entire library due to my intellectual property, I would rather provide code and pieces to build one from scratch.
If you need any advice on how to set up a chatbot lmk and I could help you out with specific questions.

Chatbot Music Player - ROBLOX Audio Catalogue Scraper bot Instance.new("AudioSearchParams")

I have created this tool which is a module that is a dynamic music player that loads in assets from the Catalogue and plays either a single song or a playlist based on the query. . Eliza DJ - Creator Store (roblox.com) This is based off a Tool I created for a Large Language Model. This can be used to create an efficient and diverse music player. =] Here’s an example of how to use the code cm=require(workspace.MusicPlayer:Clone()) print(cm.DiscJockey(" play some haunted music"),game.Players.L…

Intelligent Emotes from Text: Module/Animation Library [Open Source]

You can now skip the importing process and implement this module instead to use this animation llibrary Custom LoadAnimation (Load any Animation) - Resources / Community Resources - Developer Forum | Roblox

SmallEmoji V1.2 - Insert Emoji to Sentence Algorithm [Open Source] Update: Sigmoid

New update to this module is this code snippet here! Sigmoid Function: A custom sigmoid function is defined to normalize values. It behaves differently for x > 1 and x <= 1 to adjust the curve steepness based on the input. For x > 1, it uses the square root of x in the exponent to flatten the curve for large x values. For x <= 1, it uses x directly, which allows for a steeper curve at lower values. Vocabulary Count: The code iterates over a dataset (emojis) to count the frequency of each…

Chatbot & LLM Artificial Intelligence Model API Code Documentation FREE (Open Source) and Other Useful APIs

Here’s a new Model Documentation for start_of_turn model formats! This is the model released by Google yesterday called Gemma You can replace the api url with any of these model endpoints API_URL = “https://api-inference.huggingface.co/models/google/gemma-2b-it” API_URL = “https://api-inference.huggingface.co/models/google/gemma-7b-it” API_URL = “https://api-inference.huggingface.co/models/google/gemma-2b” API_URL = “https://api-inference.huggingface.co/models/google/gemma-7b” local Beare…

These are the relevant resources I have provided to help make chatbots easier for people to create.
This module is a abstract implementation of awareness to perform context based actions based on the surroundings.
NEW Action Token AI Framework LLM Utility/Chatbot Luau [Open Source] - Resources / Community Resources - Developer Forum | Roblox
It utilizes the Awareness library.
The Chatmodule library is much more in depth, and not as concise as the other resources but it allows you to query your data and find the best conversational response to your query. There are some examples in the linked lua trainable Chatbot library. I posted a large 233,000 dataset on there. I was querying it in sections based on emotional tonality evaluation and grouped by starting word to interesting results, but I opted for more engineering the idea of intelligent responses based on smaller, custom high-quality datasets.
with the flow of local chatbot handles short responses and greetings then a LLM API handles long form queries and utilizes data from the local chatbot to engineer the system prompt, while recalling summarizations of previous conversations.