Changing port for Block Managers

Question

I have observed that the port on which the block managers listen to keep changing every time. How can I set to port to the desired number?

Answer 1

By default, the port of which the block managers listen to is random. To set it to the desired port, you can do the following:

val sc = new SparkContext(new SparkConf())

./bin/spark-submit <all your existing options> --spark.blockManager.port= <port number>