I have a cluster built with docker-swarm in which we run apache spark apps. In the cluster, I have a manager node and 3 worker nodes.I am scaling the number of worker nodes by using following command.
sudo docker service scale spark_worker=<number of workers>
When I increase the number of worker, I want to create new containers on worker node not on manager node.