Came across this github repo which does exactally what I want for a HA kubernetets master setup: https://github.com/salmanb/Kubernetes-HA-on-baremetal . Using coreos makes this a bit different but it is still easily adaptable.

# kubectl get nodes
NAME                 STATUS    ROLES     AGE       VERSION
node01.testbed.lan   Ready     master    23d       v1.9.0
node02.testbed.lan   Ready     master    23d       v1.9.0
node03.testbed.lan   Ready     master    23d       v1.9.0
node04.testbed.lan   Ready     node      23d       v1.9.0
node05.testbed.lan   Ready     node      23d       v1.9.0
node06.testbed.lan   Ready     node      23d       v1.9.0
node07.testbed.lan   Ready     node      12d       v1.9.0
node08.testbed.lan   Ready     node      12h       v1.9.0