As a Roblox developer, it is currently impossible to move attachments according to their rotation.
Attachments don’t support local movement mode (which can be toggled with Ctrl+L). Local movement mode allows parts to move according to their own axes instead of the global axes. It would be useful for attachments to support this, too.
If Roblox is able to address this issue, it would make it easier to move attachments around.