Aside from the fact that the Chat button looks terrible on Retina devices and doesn’t fit in at all with the rest of the CoreGui, setting the visibility of the chat gui does not remove the Chat button.
Not sure if this is intended behavior or just a bug, but it’s annoying since the chat bar doesn’t stay when the chat is invisible on PC.