This only happens when testing on a server but the problem does not happen testing the game locally.
Playing locally:
On a server or in a public game:
After messing around I concluded it to be a engine bug because the script actually does go through the code it just never actually creates the button.
There is no ContextActionGui.
I guess my fix going forward is to create the buttons myself until there is a fix.