Hey thanks for flagging this.
We are looking into solutions for this. The first step will be to preform a playability check before entering an experience, so that you wont be able to click join on experiences that arent playable. Please keep an eye out for this in the next 3-4 months or so (lots of other improvements are coming to Xbox in the meantime)