Hiya supreme, you can edit permissions for each command or make custom ranks with only certain permissions, you have 2 options, remove the ability for every rank besides the private server admin or turn off saving data.
You want to only give private server admin the ability to serverban and kick, a server ban only applies to the server they are in.