Number dividing issue

Help and Feedback Scripting Support
#1

While dividing, the output is incorrect?

print(1e23 / 1e21)

output:

99.9999999999

It should be 100?

#2 
print(math.floor(1e23 / 1e21))

Math.floor returns the closest integer to the given number. (99.9999999999 = 100)

#3

math.floor rounds down meaning 99.99999 would return 99?

#4

Math.rad(), apologies.

charrrrrrrrrrrrrrrrrrrrrrrrrrr

#5

You’re talking about math.ceil or math.round but neither would be useful in my case

#6

Solved it. Apparently in studio dividing numbers doesn’t work properly. So I had to test it in game.

1 Like
#7

Maybe try

local number = 1e23 / 1e21
print(math.ceil(number))

Also why is this needed? Just wondering.

Edit: while typing OP solved it

#8

It’s for my number abbreviation system.

#9

Welcome to the world of floating-point precision errors. This isn’t an issue with studio, this is a caveat of computer science with how decimals are represented and operated on in binary. It’s technically not an error since this behaviour is expected with the nature of how the math works, so you have to work around this kind of stuff.

#10

It is actually a studio issue, I tested it inside of the game and it printed 100, and in studio it was 99.99999999

#11

And I’m guessing the studio issue may be caused by a floating point error. There’s no other explanation I know of at least.