I think one big master will always be better.
If you want to install plugins, run maintenance server, keep back up and upgrade and perform other management stuffs, it will be easier to do on one big master rather doing it on multiple small ones.
I hope that it will help you decide which option to chose.