questions/apache-spark/page/8
Variable declaration can be done in two ...READ MORE
Hey, Reduce action converts an RDD to a ...READ MORE
Hi, Spark’s RDDs are by default recomputed each ...READ MORE
Hi, Yes, in scala there is a guard condition where ...READ MORE
Hi, Spark ecosystem libraries are composed of various ...READ MORE
There is a difference between the two: mapValues ...READ MORE
For spark.read.textFile we need spark-2.x. Please try ...READ MORE
The statement display(id, name, salary) is written before the display function ...READ MORE
You have to specify a comma-separated list ...READ MORE
You cans set extra JVM options that ...READ MORE
By default, each task is allocated with ...READ MORE
You can change the location where you ...READ MORE
To generate the output file, you can ...READ MORE
Run below commands spark-class org.apache.spark.deploy.master.Master spark-class org.apache.spark.deploy.worker.Worker spark://192.168.254.1:7077 NOTE: The ...READ MORE
First create a Spark session like this: val ...READ MORE
To get command prompt for Scala open ...READ MORE
Every spark application has same fixed heap ...READ MORE
Spark by default won't let you overwrite ...READ MORE
Fold in spark Fold is a very powerful ...READ MORE
It is not like a CPU to ...READ MORE
The default time that the Yarn application waits ...READ MORE
To enable cleanup, open the spark shell ...READ MORE
You can disable it like this: val sc ...READ MORE
To change to version 2, run the ...READ MORE
You can do it dynamically like this: val ...READ MORE
You can run the Spark shell for ...READ MORE
I don't think you can copy and ...READ MORE
By default, the maximum number of times ...READ MORE
To make Spark store the event logs, ...READ MORE
If you are running history server and ...READ MORE
There are different methods to achieve optimization ...READ MORE
Use the following command to increase the ...READ MORE
You need to set the secret key ...READ MORE
Yield is used in sequence comprehensions. It is ...READ MORE
Yes. You can use extra listeners by setting ...READ MORE
When a Spark application is running, the ...READ MORE
You have to set the path to ...READ MORE
// Collect data from input avro file ...READ MORE
You can change the scheduling mode as ...READ MORE
First, store upload this archive to hdfs and ...READ MORE
Open Spark shell and run the following ...READ MORE
Hi @Raunak. You can change the replication ...READ MORE
Spark allows you to retrieve the key ...READ MORE
You have set Zookeeper as the recovery ...READ MORE
Whenever a series of transformations are performed ...READ MORE
You can increase the memory dynamically by ...READ MORE
By default, only one core is used for ...READ MORE
You can set it by assigning the ...READ MORE
In case Yarn does not support schemes ...READ MORE
OR
At least 1 upper-case and 1 lower-case letter
Minimum 8 characters and Maximum 50 characters
Already have an account? Sign in.