Error Zookeeper address not found from MapRFilesystem

Question

I am getting the below error while running Spark on Yarn using the below command:

bin/run-example --master yarn --deploy-mode client SparkPi 10

Can anyone suggest how to come out of this?

Answer 1

Hey,

Yarn is configured with the "zero-configuration failover". So basically, the yarn-site.xml is pretty much "empty" apart from declaring these properties :

<property>

<name>yarn.resourcemanager.ha.custom-ha-enabled</name>

<value>

true

</value>

<description>MapR Zookeeper based RM Reconnect Enabled. If 

this 

is

true

, set the failover proxy to be the

class

MapRZKBasedRMFailoverProxyProvider</description>

</property>

<property>

<name>yarn.client.failover-proxy-provider</name>

<value>org.apache.hadoop.yarn.client.MapRZKBasedRMFailoverProxyProvider</value>

<description>Zookeeper based reconnect proxy provider. Should be set

if

and only

if

mapr-ha-enabled property is

true

.</description>

\</property>

<property>

<name>yarn.resourcemanager.recovery.enabled</name>

<value>

true

</value>

<description>RM Recovery Enabled</description>

</property>