Server Authority: rollback issues after Parenting character

If you have a server authority game and try to parent a character outside workspace, and then back to workspace (all with a server script), the client starts rollingback forever and having sync/prediction issues

Expected behavior

Character should go back to workspace as soon as the server reparents it, and the character resyncs.