This module gives Text-Vision to a Large language model. When you set up your workspace accordingly. It creates a table of entries describing the scene in different ways.
UPDATE
--[[ {
[1] = "I notice, a medium-small plant called upside down Mint Chocolate cone is kind of near to the west.",
[2] = "I glimpse a Grape Lollipop is extremely near behind me to the right, and their are a quartet of trees that are carved or decorated.",
[3] = "I perceive, a piece of tiny rubble embedded with a Halloween Cupcake with Sprinkles is kind of near to the northwest.",
[4] = "So I notice, a medium-small plant called upside down Mint Chocolate cone is kind of near to the west, and a Grape Lollipop is very near behind me to the right. .",
[5] = "I am walking on a cherry heart cake, and a chunk of mini rock embedded with a Halloween Cupcake with Sprinkles is kind of not far to the northwest.",
[6] = "Their are a quartet of trees that form the scene.",
[7] = "I glimpse a medium-small plant called upside down Mint Chocolate cone is somewhat near westward, a Grape Lollipop is very close behind me to the right, and their are a quartet of trees that are carved or decorated. A piece of tiny rubble embedded with a Halloween Cupcake with Sprinkles is somewhat near to the northwest, I notice, a medium-small plant called upside down Mint Chocolate cone is somewhat near westward, and a Grape Lollipop is very close behind me to the right. I also am aware, I am walking on a cherry heart cake, and a chunk of tiny rock embedded with a Halloween Cupcake with Sprinkles is somewhat near to the northwest. ",
[8] = "A medium-small plant called upside down Mint Chocolate cone is pretty near to the west",
[9] = "I am walking on a cherry heart cake. What I notice is a medium-small plant called upside down Mint Chocolate cone is kind of close to the west, a Grape Lollipop is very close behind me to the right, a quartet of trees that form the scene, and a chunk of tiny rock embedded with a Halloween Cupcake with Sprinkles is kind of close to the northwest. "
} - Client - Awareness:3509 ]]--
I use this module for other things as well it has a very efficient array handler that updates based on a refresh rate to prevent spamming of duplicate arrays.
This is great framework to build your game on! All of these categories would keep your game organized and you can build with LLMs on top of it.
You can easily change the names of the directories where each object type is stored!
local tablekeys = {
["mapobject"] = {{["datatable"] = nil, ["writetime"] = ticktime.Value, ["refreshrate"] = 30}, workspace.MapObjects},--name of folder
New Features include the awareness now includes what the root humanoid is standing on!
It also includes if their is water in the distance. It also produces more observations by combining observations in different ways.
The nearest function now has a query parameter to search for specific objects in the array.
–Updated link
(100) Awareness Text-Vision LLM Utility Luau Code- Roblox
This is a old video of my AI in Action!
I’m currently using this with Zephyr 7b with a experiment to inject the system message with the awareness! It’s been very successful!
New demonstration of This Awareness module being used to Illustrate Candyland to a Large Language model!
The code is too long for this post but here is part of it.
Check out my Patreon and get the latest releases for Open-sourced code I create!
Magus Art game developer and resource creator | Patreon