Dynamic allocation Set minimum number of executor

Question

Please tell me how to set minimum number of executors for dynamic allocation. Thanks in advance.

Answer 1

You cans et it dynamically like this: 

val sc = new SparkContext(new SparkConf())

./bin/spark-submit <all your existing options> --spark.dynamicAllocation.minExecutors=<number of executors>