This is not a bug, this has been the case ever since rotation on GUI objects were released, and it has been made that way due to the fact that the paradigm (convex clipping) that could accomplish this is inefficient for real-time updates to the interface compared to clipping in axis-aligned GUI objects.