Installing Spark on Ubuntu

0 votes
Can someone help me with the steps for installing Spark on Ubuntu machine?
Feb 20, 2019 in Apache Spark by Raj
1,918 views

1 answer to this question.

0 votes

Hey. Follow these steps to install Spark on Ubuntu:

Go to this link and download Spark:

https://spark.apache.org/downloads.html

Then open terminal and extract the files:

$ cd Downloads

$ tar -xvf spark-2.3.3-bin-hadoop2.7.tgz

Now the Spark directory will be extracted.

Next, go to the bin directory in the spark directory:

$ cd spark-2.3.3-bin-hadoop2.7/bin/

And to start spark shell, run the following command:

$ ./spark-shell

This will start the Spark shell where you can run spark commands.

(You might get some warnings, ignore them.)

answered Feb 20, 2019 by Omkar
• 69,220 points

Related Questions In Apache Spark

0 votes
1 answer

How to stop messages from being displayed on spark console?

In your log4j.properties file you need to ...READ MORE

answered Apr 24, 2018 in Apache Spark by kurt_cobain
• 9,350 points
5,560 views
0 votes
1 answer
0 votes
3 answers

Filtering a row in Spark DataFrame based on matching values from a list

Use the function as following: var notFollowingList=List(9.8,7,6,3,1) df.filter(col("uid").isin(notFollowingList:_*)) You can ...READ MORE

answered Jun 6, 2018 in Apache Spark by Shubham
• 13,490 points
92,736 views
0 votes
1 answer

When running Spark on Yarn, do I need to install Spark on all nodes of Yarn Cluster?

No, it is not necessary to install ...READ MORE

answered Jun 14, 2018 in Apache Spark by nitinrawat895
• 11,380 points
6,261 views
+1 vote
2 answers
+1 vote
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
11,034 views
0 votes
1 answer

hadoop.mapred vs hadoop.mapreduce?

org.apache.hadoop.mapred is the Old API  org.apache.hadoop.mapreduce is the ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
2,540 views
+2 votes
11 answers

hadoop fs -put command?

Hi, You can create one directory in HDFS ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
108,856 views
0 votes
1 answer

Unresolved dependency issue on sbt package command

Check if you are able to access ...READ MORE

answered Jan 3, 2019 in Apache Spark by Omkar
• 69,220 points
2,971 views
–1 vote
1 answer

Not able to use sc in spark shell

Seems like master and worker are not ...READ MORE

answered Jan 3, 2019 in Apache Spark by Omkar
• 69,220 points
1,762 views
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP