Assistant gives error about too many characters even though the request is only two normal sentences in length

Bug Reports Creator Hub (create.roblox.com) Bugs
#1

Problem

When making a query to the Roblox Assistant to build a complete table of all the locales that Roblox supports, the initial results is that the table is half populated. When I modify the request to reinforce the complete list, it errors out saying that there’s too many characters in the input even though the amount of characters is less than 255.


Additional Information

The queries to generate these responses are as follows:

  • Provide a complete list in LUA table format of the locales that Roblox supports.
  • Provide a complete list in LUA table format of the locales that Roblox supports. Make sure to include Spanish, Polish, Russian, etc... languages.
Parameter Value
Problem Area Roblox Creator Website
Problem Component Assistant
First Noticed 23 Feb 2024
Priority Moderate
Impact Moderate (AI Processing Error)
Annoyance Level Moderate

The specific URL where this occurs is at the following:
https://create.roblox.com/docs/assistant


Expectations

What I expect to happen is that my request is processed with error and that I am provided with what I asked for. I do understand that the AI can (and does) make mistakes so I’m not worried about that. It’s the processing error that is the issue.


Visuals

The initial request.

image
image1213×118 12.9 KB

The response.

image
image1176×1526 508 KB

A second query ordering the assistant to provide a complete list with some of the languages missing.

image
image1235×293 47.7 KB


Reproduction

To reproduce the issue, perform the following steps.

  1. Navigate to the above mentioned website URL.
  2. Enter the first prompt.
  3. Observe the results (incomplete table).
  4. Enter the second prompt.
  5. Observe the results (processing error).

Page URL: https://create.roblox.com/docs/assistant

EDIT:

After playing with it a bit, it seems the issue isn’t the size of the input, but the size of the output, and if I tell it to start at a particular letter, it won’t go further and says that the table is incomplete even though I asked for completeness.

2 Likes
#2

Found someone to look at this! Hang tight :slight_smile:

2 Likes
#3

@music_man1996 Is there an estimated time to when this will be fixed? It’s not exactly urgent at the moment since I was able to use ChatGPT to do what I needed done.

1 Like
#4

It’s possibly because there was a lot of characters in the previous answer from assistant. And not a bug

1 Like
#5

Hi Maelstorm_1973!

Thanks for reporting this issue. The alert about character limit was being shown because the conversation had reached the limit, not your most recent message. The wording on that was unclear so thank you for pointing that out.

To resolve this issue, we’ve made a couple major improvements:

  1. We’ve massively increased the character limit. This should be very hard to hit during normal usage.
  2. When a conversation gets too long, the older messages get dropped. You’ll still see them when you scroll up, but the Assistant won’t see those messages while writing its reply. This isn’t always ideal, but it makes it possible to keep the conversation going while the Assistant remains aware of the recent messages.

I’m going to mark this as resolved, but please let us know if you are still having issues!

1 Like