Welds have a C0 which is a CFrame offset that you can apply.
FYI: Don’t use the second argument of Instance.new (Parent argument), you’ll learn why here:
An alternative solution to Welds would be to use the underrated Accessory system, you just have setup an Attachment in both the Accessory’s Handle and the limb you want it to attach to. Of course, Attachments have more customisable properties.