Recent questions tagged bigdata

0 votes
1 answer

How Namenode handles data node failures?

Jul 11, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 6,295 views
0 votes
1 answer

Not able to fetch messages from Kafka cluster

Jul 10, 2018 in Apache Kafka by coldcode
 • 2,090 points • 3,030 views
0 votes
1 answer

Re-balancing error while reading messages from Kafka.

Jul 10, 2018 in Apache Kafka by coldcode
 • 2,090 points • 2,900 views
0 votes
1 answer

Hive Precedence Order

Jul 9, 2018 in Big Data Hadoop by Data_Nerd
 • 2,390 points • 948 views
0 votes
1 answer

Are there any Limitations of Pig?

Jul 6, 2018 in Big Data Hadoop by Data_Nerd
 • 2,390 points • 1,724 views
+1 vote
2 answers

How can I convert Spark Dataframe to Spark RDD?

Jul 4, 2018 in Apache Spark by code799
 • 20,643 views
0 votes
1 answer

Difference between Spark ML & Spark MLlib package

Jul 4, 2018 in Apache Spark by code799
 • 2,103 views
0 votes
3 answers

Sorting rows in descending order in Spark SQL

Jul 4, 2018 in Apache Spark by code799
 • 16,672 views
0 votes
1 answer

Spark streaming with Kafka dependency error

Jul 4, 2018 in Apache Spark by code799
 • 1,321 views
+11 votes
52 answers

What could be the heights of smart homes in the future?

Jul 3, 2018 in Career Counselling by bug_seeker
 • 15,510 points • 6,155 views
0 votes
1 answer

Checkpointing in Hadoop

Jul 3, 2018 in Big Data Hadoop by shams
 • 3,670 points • 1,300 views
0 votes
1 answer

Hadoop Nodes for Multiple Disks

Jul 3, 2018 in Big Data Hadoop by Data_Nerd
 • 2,390 points • 1,951 views
0 votes
1 answer

How to analyze block placement on datanodes and rebalancing data across Hadoop nodes?

Jun 21, 2018 in Big Data Hadoop by Shubham
 • 13,490 points • 985 views
0 votes
2 answers

What is the difference between the Smart Data Access of SAP HANA and SAP HANA Vora?

Jun 21, 2018 in Big Data Hadoop by shelly
 • 120 points • 1,314 views
0 votes
1 answer

Is there any way to setup Hadoop nodes (data nodes/namenodes) to use multiple volumes/disks?

Jun 20, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 959 views
0 votes
3 answers

Lineage Graph in Spark

Jun 19, 2018 in Apache Spark by Data_Nerd
 • 2,390 points • 11,729 views
0 votes
1 answer

Minimizing Data Transfers in Spark

Jun 19, 2018 in Apache Spark by shams
 • 3,670 points • 1,379 views
0 votes
1 answer

NameNode Status Check

Jun 18, 2018 in Big Data Hadoop by Data_Nerd
 • 2,390 points • 2,323 views
0 votes
1 answer

What is Speculative Execution?

Jun 18, 2018 in Big Data Hadoop by Data_Nerd
 • 2,390 points • 531 views
0 votes
1 answer

Is it mandatory to start Hadoop to run spark application?

Jun 14, 2018 in Apache Spark by kurt_cobain
 • 9,350 points • 831 views
0 votes
1 answer

Different Hadoop Modes

Jun 13, 2018 in Big Data Hadoop by Data_Nerd
 • 2,390 points • 13,063 views
0 votes
1 answer

HDFS usage for small files

Jun 12, 2018 in Big Data Hadoop by Data_Nerd
 • 2,390 points • 560 views
0 votes
1 answer

NameNode & DataNode memory

Jun 12, 2018 in Big Data Hadoop by shams
 • 3,670 points • 1,393 views
0 votes
1 answer

NAS and HDFS Comparison

Jun 11, 2018 in Big Data Hadoop by shams
 • 3,670 points • 1,642 views
0 votes
1 answer

Replication and Calculations

Jun 11, 2018 in Big Data Hadoop by shams
 • 3,670 points • 813 views
0 votes
1 answer

Persistence Levels in Spark

Jun 8, 2018 in Apache Spark by Data_Nerd
 • 2,390 points • 6,028 views
0 votes
1 answer

What is Shark?

Jun 8, 2018 in Apache Spark by shams
 • 3,670 points • 988 views
0 votes
1 answer

How to find the number of elements present in the array in a Spark DataFame column?

Jun 6, 2018 in Apache Spark by code799
 • 22,395 views
0 votes
3 answers

Filtering a row in Spark DataFrame based on matching values from a list

Jun 6, 2018 in Apache Spark by code799
 • 92,729 views
0 votes
1 answer

Convert the given Spar rdd object to Spark DataFrame.

Jun 6, 2018 in Apache Spark by code799
 • 1,103 views
0 votes
1 answer

JobTracker Task Scheduling

Jun 5, 2018 in Big Data Hadoop by Data_Nerd
 • 2,390 points • 893 views
+5 votes
2 answers

Hive to HDFS transfer

Jun 5, 2018 in Big Data Hadoop by shams
 • 3,670 points • 3,960 views
0 votes
1 answer

Different Spark Ecosystem

Jun 4, 2018 in Apache Spark by shams
 • 3,670 points • 870 views
0 votes
1 answer

InputSplit vs HDFS Block

Jun 1, 2018 in Big Data Hadoop by shams
 • 3,670 points • 4,403 views
0 votes
1 answer

Hadoop mandatory for Spark?

Jun 1, 2018 in Apache Spark by shams
 • 3,670 points • 577 views
0 votes
1 answer

How to import the dependencies of Spark MLlib into eclipse project?

May 31, 2018 in Apache Spark by hack236
 • 2,001 views
0 votes
1 answer

Spark Machine Learning pipeline works fine in Spark 1.6, but it gives error when executed on Spark 2.x?

May 31, 2018 in Apache Spark by hack236
 • 986 views
0 votes
1 answer

Akka in Spark

May 31, 2018 in Apache Spark by kurt_cobain
 • 9,350 points • 2,113 views
0 votes
1 answer

Sqoop vs distCP

May 30, 2018 in Big Data Hadoop by shams
 • 3,670 points • 1,326 views
0 votes
2 answers

What is Shuffle Phase?

May 30, 2018 in Big Data Hadoop by shams
 • 3,670 points • 1,621 views
+1 vote
1 answer

How can I write a text file in HDFS not from an RDD, in Spark program?

May 29, 2018 in Apache Spark by code799
 • 8,453 views
0 votes
5 answers

How to change the spark Session configuration in Pyspark?

May 29, 2018 in Apache Spark by code799
 • 125,595 views
0 votes
1 answer

What are the parameters in local[a,b,c] explains?

May 29, 2018 in Apache Spark by code799
 • 680 views
0 votes
1 answer

How to save and retrieve the Spark RDD from HDFS?

May 29, 2018 in Apache Spark by code799
 • 13,541 views
0 votes
1 answer

NameNode without any data

May 29, 2018 in Big Data Hadoop by Data_Nerd
 • 2,390 points • 1,291 views
0 votes
1 answer

Is it possible to run Spark and Mesos along with Hadoop?

May 29, 2018 in Apache Spark by shams
 • 3,670 points • 823 views
0 votes
1 answer

What is Sliding Window?

May 28, 2018 in Apache Spark by shams
 • 3,670 points • 2,551 views
0 votes
1 answer

Spark 2.3? What is new in it?

May 28, 2018 in Apache Spark by Data_Nerd
 • 2,390 points • 796 views
0 votes
1 answer

How can I compare the elements of the RDD using MapReduce?

May 24, 2018 in Apache Spark by code799
 • 3,440 views
0 votes
3 answers

How to transpose Spark DataFrame?

May 24, 2018 in Apache Spark by anonymous
 • 19,910 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.