DragDetectors in ViewportFrame

I am trying to make a preview of a ball with textures with viewportframes, and I want it to be dragged in rotation. (like Enum.DragDetectorDragStyle.RotateTrackball)

However, when I put the dragdetector inside a part, which is inside a viewportFrame, it doesnt work. Does someone know how to make it work? (Or make the part be draggable in VPF)

I would recommend instead of using it in a UI, making it float as a 3D object in front of the camera, you can put any UI which you would use behind it via surface GUIs, there are quite a few resources like these. Else you can look up resources related to custom draggers, but they probably will not be the same like the roblox one.