Recent questions tagged bigdata

0 votes
1 answer

How Namenode handles data node failures?

Jul 11, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 6,328 views
0 votes
1 answer

Not able to fetch messages from Kafka cluster

Jul 10, 2018 in Apache Kafka by coldcode
 • 2,090 points • 3,064 views
0 votes
1 answer

Re-balancing error while reading messages from Kafka.

Jul 10, 2018 in Apache Kafka by coldcode
 • 2,090 points • 2,926 views
0 votes
1 answer

Hive Precedence Order

Jul 9, 2018 in Big Data Hadoop by Data_Nerd
 • 2,390 points • 965 views
0 votes
1 answer

Are there any Limitations of Pig?

Jul 6, 2018 in Big Data Hadoop by Data_Nerd
 • 2,390 points • 1,764 views
+1 vote
2 answers

How can I convert Spark Dataframe to Spark RDD?

Jul 4, 2018 in Apache Spark by code799
 • 20,725 views
0 votes
1 answer

Difference between Spark ML & Spark MLlib package

Jul 4, 2018 in Apache Spark by code799
 • 2,182 views
0 votes
3 answers

Sorting rows in descending order in Spark SQL

Jul 4, 2018 in Apache Spark by code799
 • 16,700 views
0 votes
1 answer

Spark streaming with Kafka dependency error

Jul 4, 2018 in Apache Spark by code799
 • 1,346 views
+11 votes
52 answers

What could be the heights of smart homes in the future?

Jul 3, 2018 in Career Counselling by bug_seeker
 • 15,510 points • 6,472 views
0 votes
1 answer

Checkpointing in Hadoop

Jul 3, 2018 in Big Data Hadoop by shams
 • 3,670 points • 1,331 views
0 votes
1 answer

Hadoop Nodes for Multiple Disks

Jul 3, 2018 in Big Data Hadoop by Data_Nerd
 • 2,390 points • 1,984 views
0 votes
1 answer

How to analyze block placement on datanodes and rebalancing data across Hadoop nodes?

Jun 21, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 1,002 views
0 votes
2 answers

What is the difference between the Smart Data Access of SAP HANA and SAP HANA Vora?

Jun 21, 2018 in Big Data Hadoop by shelly
 • 120 points • 1,333 views
0 votes
1 answer

Is there any way to setup Hadoop nodes (data nodes/namenodes) to use multiple volumes/disks?

Jun 20, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 978 views
0 votes
3 answers

Lineage Graph in Spark

Jun 19, 2018 in Apache Spark by Data_Nerd
 • 2,390 points • 11,880 views
0 votes
1 answer

Minimizing Data Transfers in Spark

Jun 19, 2018 in Apache Spark by shams
 • 3,670 points • 1,408 views
0 votes
1 answer

NameNode Status Check

Jun 18, 2018 in Big Data Hadoop by Data_Nerd
 • 2,390 points • 2,340 views
0 votes
1 answer

What is Speculative Execution?

Jun 18, 2018 in Big Data Hadoop by Data_Nerd
 • 2,390 points • 555 views
0 votes
1 answer

Is it mandatory to start Hadoop to run spark application?

Jun 14, 2018 in Apache Spark by kurt_cobain
 • 9,350 points • 854 views
0 votes
1 answer

Different Hadoop Modes

Jun 13, 2018 in Big Data Hadoop by Data_Nerd
 • 2,390 points • 13,109 views
0 votes
1 answer

HDFS usage for small files

Jun 12, 2018 in Big Data Hadoop by Data_Nerd
 • 2,390 points • 592 views
0 votes
1 answer

NameNode & DataNode memory

Jun 12, 2018 in Big Data Hadoop by shams
 • 3,670 points • 1,430 views
0 votes
1 answer

NAS and HDFS Comparison

Jun 11, 2018 in Big Data Hadoop by shams
 • 3,670 points • 1,682 views
0 votes
1 answer

Replication and Calculations

Jun 11, 2018 in Big Data Hadoop by shams
 • 3,670 points • 829 views
0 votes
1 answer

Persistence Levels in Spark

Jun 8, 2018 in Apache Spark by Data_Nerd
 • 2,390 points • 6,086 views
0 votes
1 answer

What is Shark?

Jun 8, 2018 in Apache Spark by shams
 • 3,670 points • 1,007 views
0 votes
1 answer

How to find the number of elements present in the array in a Spark DataFame column?

Jun 6, 2018 in Apache Spark by code799
 • 22,454 views
0 votes
3 answers

Filtering a row in Spark DataFrame based on matching values from a list

Jun 6, 2018 in Apache Spark by code799
 • 92,816 views
0 votes
1 answer

Convert the given Spar rdd object to Spark DataFrame.

Jun 6, 2018 in Apache Spark by code799
 • 1,154 views
0 votes
1 answer

JobTracker Task Scheduling

Jun 5, 2018 in Big Data Hadoop by Data_Nerd
 • 2,390 points • 913 views
+5 votes
2 answers

Hive to HDFS transfer

Jun 5, 2018 in Big Data Hadoop by shams
 • 3,670 points • 3,995 views
0 votes
1 answer

Different Spark Ecosystem

Jun 4, 2018 in Apache Spark by shams
 • 3,670 points • 901 views
0 votes
1 answer

InputSplit vs HDFS Block

Jun 1, 2018 in Big Data Hadoop by shams
 • 3,670 points • 4,459 views
0 votes
1 answer

Hadoop mandatory for Spark?

Jun 1, 2018 in Apache Spark by shams
 • 3,670 points • 595 views
0 votes
1 answer

How to import the dependencies of Spark MLlib into eclipse project?

May 31, 2018 in Apache Spark by hack236
 • 2,020 views
0 votes
1 answer

Spark Machine Learning pipeline works fine in Spark 1.6, but it gives error when executed on Spark 2.x?

May 31, 2018 in Apache Spark by hack236
 • 1,011 views
0 votes
1 answer

Akka in Spark

May 31, 2018 in Apache Spark by kurt_cobain
 • 9,350 points • 2,145 views
0 votes
1 answer

Sqoop vs distCP

May 30, 2018 in Big Data Hadoop by shams
 • 3,670 points • 1,346 views
0 votes
2 answers

What is Shuffle Phase?

May 30, 2018 in Big Data Hadoop by shams
 • 3,670 points • 1,692 views
+1 vote
1 answer

How can I write a text file in HDFS not from an RDD, in Spark program?

May 29, 2018 in Apache Spark by code799
 • 8,508 views
0 votes
5 answers

How to change the spark Session configuration in Pyspark?

May 29, 2018 in Apache Spark by code799
 • 125,842 views
0 votes
1 answer

What are the parameters in local[a,b,c] explains?

May 29, 2018 in Apache Spark by code799
 • 701 views
0 votes
1 answer

How to save and retrieve the Spark RDD from HDFS?

May 29, 2018 in Apache Spark by code799
 • 13,586 views
0 votes
1 answer

NameNode without any data

May 29, 2018 in Big Data Hadoop by Data_Nerd
 • 2,390 points • 1,311 views
0 votes
1 answer

Is it possible to run Spark and Mesos along with Hadoop?

May 29, 2018 in Apache Spark by shams
 • 3,670 points • 852 views
0 votes
1 answer

What is Sliding Window?

May 28, 2018 in Apache Spark by shams
 • 3,670 points • 2,569 views
0 votes
1 answer

Spark 2.3? What is new in it?

May 28, 2018 in Apache Spark by Data_Nerd
 • 2,390 points • 813 views
0 votes
1 answer

How can I compare the elements of the RDD using MapReduce?

May 24, 2018 in Apache Spark by code799
 • 3,467 views
0 votes
3 answers

How to transpose Spark DataFrame?

May 24, 2018 in Apache Spark by anonymous
 • 20,003 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.