When a WeldConstraint suspending an unanchored part is destroyed, the part will remain floating. The physics of the part will only be applied when touched by another unanchored object. This can be easily replicated by using a weldconstraint to attach one unanchored part to another, and then destroying the constraint.
You deleted the WeldConstraint in client mode. It did not replicate to server which controls the physics.
Further elaboration; there are two modes while testing solo. Server or client mode. You can see what is happening in one client in client mode while you can see what is replicated in server. Assume that the WeldConstraint was deleted in client. Due to FilteringEnabled, the WeldConstraint did not delete itself in server, which still held it up.
Try destroying it on both the client and the server (one or the other or both). If the issue persists or you’ve already done this, file a bug report or ask a Lead Top Contributor for assistance in moving your thread over to #platform-feedback:engine-bugs.