Components of Spark

0 votes
Can you please give a one-line description on the components of Spark to make a quick-revision note?
Mar 8, 2019 in Apache Spark by Giri
 • 682 views

1 answer to this question.

0 votes

Spark core: The base engine that offers large-scale distributed and parallel data processing.

Spark SQL: Relational functionality that works in tandem with Spark’s API.

GraphX: offers all graph related features.

MLib: Machine learning library.

Spark Streaming: Offers real-time streaming data processing.

answered Mar 8, 2019 by Raj

Related Questions In Apache Spark

0 votes
1 answer

By which components spark ecosystem libraries are composed of?

Hi, Spark ecosystem libraries are composed of various ...READ MORE

answered Jul 1, 2019 in Apache Spark by Gitika
 • 65,770 points • 680 views
+1 vote
2 answers

Hadoop 3 compatibility with older versions of Hive, Pig, Sqoop and Spark

Hadoop 3 is not widely used in ...READ MORE

answered Apr 20, 2018 in Apache Spark by kurt_cobain
 • 9,350 points • 6,028 views
0 votes
1 answer

How to import the dependencies of Spark MLlib into eclipse project?

I would recommend you create & build ...READ MORE

answered May 31, 2018 in Apache Spark by Shubham
 • 13,490 points • 2,021 views
0 votes
1 answer

How to find the number of elements present in the array in a Spark DataFame column?

You can select the column and apply ...READ MORE

answered Jun 6, 2018 in Apache Spark by Shubham
 • 13,490 points • 22,457 views
+1 vote
2 answers

How do I get number of columns in each line from a delimited file??

Instead of spliting on '\n'. You should ...READ MORE

answered Aug 7, 2019 in Apache Spark by ashish
 • 5,617 views
+1 vote
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
 • 11,380 points • 11,103 views
0 votes
1 answer

hadoop.mapred vs hadoop.mapreduce?

org.apache.hadoop.mapred is the Old API  org.apache.hadoop.mapreduce is the ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
 • 11,380 points • 2,599 views
+2 votes
11 answers

hadoop fs -put command?

Hi, You can create one directory in HDFS ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 109,205 views
0 votes
1 answer

What is Spark Core?

It is not like a CPU to ...READ MORE

answered Mar 8, 2019 in Apache Spark by Raj
 • 3,569 views
0 votes
1 answer

Array of RDD

You can create an array of RDDs ...READ MORE

answered Mar 8, 2019 in Apache Spark by Raj
 • 1,754 views
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP
"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.