What are the parameters in local a b c explains

Question

While submitting a job we use we give the address of the master as

--master local[a, b, c]

where a, b, & c are integers. What does this integer address?

Answer 1

SparkContext.createTaskScheduler property parses the master parameter

• Local: 1 thread.
• local[N]: N threads.
• local[*]: uses threads equal to cores.
• local[N, M]: set the maximal task failures to M.