Trending questions in Big Data Hadoop

0 votes
1 answer

Hadoop job getting executed in local mode only?

Basically, you have not configured the mapreduce.framework.name ...READ MORE

May 3, 2018 in Big Data Hadoop by Atul
• 10,240 points
2,474 views
0 votes
1 answer

NameNode without any data

There does not exist any NameNode without ...READ MORE

May 29, 2018 in Big Data Hadoop by kurt_cobain
• 9,350 points
1,314 views
0 votes
1 answer

Is a HDFS block sequential ?

It seems like you are confused between the ...READ MORE

May 21, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
1,638 views
0 votes
1 answer

Disabling Kerberos authentication in Hadoop

Make the following changes: core-site.xml(Hadoop_Dir/etc/hadoop): ...READ MORE

May 16, 2018 in Big Data Hadoop by Shubham
• 13,490 points
1,867 views
0 votes
1 answer

Hadoop Command to merge edit logs with fsimage

You can use this command to save ...READ MORE

May 11, 2018 in Big Data Hadoop by Shubham
• 13,490 points
2,072 views
0 votes
1 answer

JobTracker Task Scheduling

The task tracker send out heartbeat messages ...READ MORE

Jun 5, 2018 in Big Data Hadoop by kurt_cobain
• 9,350 points
914 views
0 votes
1 answer

HDFS usage for small files

Well, the HDFS works more reliably with ...READ MORE

Jun 12, 2018 in Big Data Hadoop by BigData_is_my_ex
596 views
0 votes
1 answer

Types of Hadoop Clusters

Below is the difference given between Standalone, ...READ MORE

Mar 26, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
3,782 views
0 votes
1 answer

Changing hostname in fs.default.name property puts Hadoop in safemode

First of all, in Safe mode the ...READ MORE

Apr 27, 2018 in Big Data Hadoop by Shubham
• 13,490 points
2,384 views
0 votes
1 answer

How can I write text in HDFS using CMD?

Hadoop put & appendToFile only reads standard ...READ MORE

Apr 27, 2018 in Big Data Hadoop by Shubham
• 13,490 points
2,371 views
0 votes
1 answer

What is the command to find the free space in HDFS?

You can use dfsadmin which runs a ...READ MORE

Apr 29, 2018 in Big Data Hadoop by Shubham
• 13,490 points
2,250 views
0 votes
1 answer

Moving files in Hadoop using the Java API?

I would recommend you to use FileSystem.rename(). ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
• 13,490 points
2,703 views
0 votes
1 answer

What are some of the famous visualization tools which can be integrated with Hadoop & Hive?

I have personally used two visualization tools ...READ MORE

May 1, 2018 in Big Data Hadoop by coldcode
• 2,090 points
2,014 views
0 votes
1 answer

Submitting MapReduce job using jobConf object vs job object

Both JobConf & Job objects are used ...READ MORE

May 4, 2018 in Big Data Hadoop by Shubham
• 13,490 points
1,872 views
0 votes
1 answer

How to change the checkpointing duration in Hadoop

Answer: The default duration of checkpointing is 3600 ...READ MORE

May 11, 2018 in Big Data Hadoop by Shubham
• 13,490 points
1,526 views
0 votes
1 answer

What is Hue?

As you said, Hue is a web ...READ MORE

Mar 22, 2018 in Big Data Hadoop by Ashish
• 2,650 points

edited Mar 22, 2018 by Ashish 3,677 views
0 votes
1 answer

Visualization Tool in Cloudera CDH

Cloudera CDH comes with a Hadoop ecosystem ...READ MORE

May 16, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
1,208 views
0 votes
1 answer

Namenode not getting started

You need to delete the contents of the ...READ MORE

Apr 23, 2018 in Big Data Hadoop by kurt_cobain
• 9,350 points
2,184 views
0 votes
1 answer

Can we use Apache Mahout without Hadoop dependency?

Yes. Not all of the Mahout depends ...READ MORE

May 17, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
1,109 views
0 votes
1 answer

Differences between Hadoop-common, Hadoop-core and Hadoop-client?

To help provide some additional details regarding ...READ MORE

Mar 29, 2018 in Big Data Hadoop by kurt_cobain
• 9,350 points
3,212 views
0 votes
1 answer

How do we authenticate user from http.signature.secret file?

hadoop.http.authentication.signature.secret.file: The signature secret file for signing ...READ MORE

Apr 24, 2018 in Big Data Hadoop by Shubham
• 13,490 points
2,039 views
0 votes
1 answer

Hadoop query regarding setJarByClass method of Job class

setJarByClass method basically tells the nodes where ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
• 13,490 points
2,407 views
0 votes
1 answer

What is difference between Oozie workflow, coordinator and bundle ?

Workflow does not have time specifications to ...READ MORE

Mar 29, 2018 in Big Data Hadoop by kurt_cobain
• 9,350 points
3,164 views
0 votes
1 answer

What is the difference between a zero reducer and identity reducer in Hadoop Mapreduce?

A Zero reducer as the name suggests ...READ MORE

Apr 10, 2018 in Big Data Hadoop by kurt_cobain
• 9,350 points
2,606 views
0 votes
1 answer

Sqoop vs Oracle Hadoop Connectors

Most of the connectors would have the ...READ MORE

May 18, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
963 views
0 votes
1 answer

Can we use HDFS to store git repositories?

Yes, it is possible to use HDFS ...READ MORE

May 7, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
1,435 views
0 votes
1 answer

What is new in Hadoop 3?

Here are few changes in Hadoop 3 1. ...READ MORE

May 28, 2018 in Big Data Hadoop by kurt_cobain
• 9,350 points
523 views
0 votes
1 answer

GUI for using Hadoop

Hue is open source and works well ...READ MORE

Apr 24, 2018 in Big Data Hadoop by kurt_cobain
• 9,350 points
2,012 views
0 votes
1 answer

Could not find the Sqoop directory in HDP 2.2

You can find the Sqoop lib directory ...READ MORE

May 4, 2018 in Big Data Hadoop by Shubham
• 13,490 points
1,512 views
0 votes
1 answer

Setting the Number of Map tasks and Reduce Tasks not Working

The command that you are running is ...READ MORE

May 4, 2018 in Big Data Hadoop by Ashish
• 2,650 points
1,531 views
0 votes
1 answer

Which Data Structure is used in case of Map Reduce?

In case of Hadoop, HDFS is used ...READ MORE

May 4, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
1,485 views
0 votes
1 answer

Hdfs Service Systemd - startup

I guess the issue you are facing ...READ MORE

Mar 29, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
2,995 views
0 votes
1 answer

Cannot connect to Hive from MicroStrategy BI tool

The problem is with your hive authentication. ...READ MORE

May 8, 2018 in Big Data Hadoop by Shubham
• 13,490 points
1,271 views
0 votes
1 answer

How to practice programming with Hadoop?

Well there are multiple ways to solve ...READ MORE

Mar 30, 2018 in Big Data Hadoop by kurt_cobain
• 9,350 points
2,977 views
0 votes
1 answer

ApplicationMaster in YARN Architecture

Let me help you with your confusion: YARN ...READ MORE

May 8, 2018 in Big Data Hadoop by Ashish
• 2,650 points
1,279 views
0 votes
1 answer

How Sqoop and Tera Data Connector for Hadoop differ from each other?

In order to make use of TD ...READ MORE

May 2, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
1,486 views
0 votes
1 answer

Setting Hive/Hadoop property using Hive Query

You can set Hadoop & Hive conf ...READ MORE

Apr 18, 2018 in Big Data Hadoop by Shubham
• 13,490 points
2,029 views
0 votes
1 answer

What does count command in Hadoop tells?

The output of the count command are: ...READ MORE

Apr 23, 2018 in Big Data Hadoop by kurt_cobain
• 9,350 points
1,823 views
0 votes
1 answer

How do I connect my Spark based HDInsight cluster to my blob storage?

Go through this blog: https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-hadoop-use-blob-storage#access-blobs I went through this ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
• 13,490 points
2,118 views
0 votes
1 answer

How to transfer data from Netezza to HDFS using Apache Sqoop?

Remove the --direct option. It gives issue ...READ MORE

Apr 23, 2018 in Big Data Hadoop by kurt_cobain
• 9,350 points
1,781 views
0 votes
1 answer

Getting error in MapReduce job.setInputFormatClass

In old Hadoop API(i.e. below Hadoop 0.20.0), ...READ MORE

Apr 15, 2018 in Big Data Hadoop by Shubham
• 13,490 points
2,093 views
0 votes
1 answer

How to set the number of Map & Reduce tasks?

The map tasks created for a job ...READ MORE

Apr 18, 2018 in Big Data Hadoop by Shubham
• 13,490 points
1,957 views
0 votes
1 answer

Sqoop version compatible with Hadoop 0.20?

Apache Sqoop has 2 major projects i.e. ...READ MORE

May 9, 2018 in Big Data Hadoop by Shubham
• 13,490 points
1,026 views
0 votes
1 answer

How to install Hadoop in Ubuntu?

Follow the steps as mentioned in the ...READ MORE

May 17, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
676 views
0 votes
1 answer

How to tune Spark jobs & optimize the performance?

You need to know the cluster properly ...READ MORE

Apr 18, 2018 in Big Data Hadoop by coldcode
• 2,090 points
1,911 views
0 votes
1 answer

What is the $HIVE_HOME in Hortonworks sandbox

You can find the hive-site.xml file /etc/hive/conf.install/hive-site.xml ...READ MORE

Apr 23, 2018 in Big Data Hadoop by Shubham
• 13,490 points
1,690 views
0 votes
1 answer

How to create a FileSystem object that can be used for reading from and writing to HDFS?

Read operation on HDFS In order to read ...READ MORE

Mar 21, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points

edited Mar 22, 2018 by nitinrawat895 3,098 views
0 votes
1 answer

Joining Multiple Spark Dataframes

You can run the below code to ...READ MORE

Mar 26, 2018 in Big Data Hadoop by Bharani
• 4,660 points
2,874 views
0 votes
1 answer

Hadoop combiners with aggregator functions

Both combiner & aggregator fulfill partly the ...READ MORE

May 16, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
639 views
0 votes
1 answer

Can we use Apache Sqoop and Hive both together? What is the difference between the two?

Yes, you can. In fact many people ...READ MORE

Mar 26, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
2,825 views