AI Assistant performs tasks it's not asked to do

This has happened a few times where the Assistant tends to edit whatever script it sees fit even if this script isn’t open, selected, or referenced in the question / prompt. Just now, I was editing my PhysicsController module (in ReplicatedStorage) and asked it a question. I didn’t even highlight code, or use the module, I copy pasted code into the Assistant and asked a question. It took that and gave me an answer. I copied the code it gave me, and the answer worked! But then I went to click play, and it turns out the Assistant edited my main Server script in a completely different location (ServerScriptService), overwriting everything in it. It also felt the need to create it’s own module that I didn’t tell it to. I had no idea since it didn’t even open the script. The only way I would have known is if I read the very bottom of the answer (attached image). So I click play and realize it’s broken, and when I go to ctrl + z to revert it, the version history didn’t track it properly so I was unable to undo the changes it made.

My prompt: how can I choose a random color from any point in a number sequence and apply that color to a part?

the bottom part of the long response:

System Info:

  • OS: Windows 11 Pro
  • Processor: Processor Intel i9-14900KF
  • GPU: NVIDIA GeForce RTX 4090
  • Ram: 64 GB

I also apologize if this isn’t the correct category for the bug, I didn’t see anything that was specific to the AI Assistant.

Expected behavior

I expect it to respond and give me the correct answer (which it did), but it should never edit, or insert anything unless explicitly told. It’s very unintuitive for it to start inserting things wherever it sees fit based on just a simple question about code. The way I imagine it is “ChatGPT but with better Roblox specific knowledge”, so it’s a bit jarring when it takes complete control and does whatever it wants to.

3 Likes