2 datanodes is slower how to get those details what is your approach as hadoop admin

+1 vote
2 datanodes is slower ,how to get those details .what is your approach as hadoop admin ?
Sep 21, 2019 in Big Data Hadoop by raghavendra
• 160 points
1,726 views

1 answer to this question.

+1 vote

First, enable the detection of slow nodes. You can do this by setting the value of dfs.namenode.peer.stats.enabled property to true. 

<property>
 <name>dfs.datanode.peer.stats.enabled</name>
 <value>true</value> 
</property>

Let the cluster run for sometime. 

To access the details, visit: http://<namenode_host>:50070/jmx

Here you will see the time taken by datanodes. After you have detected the datanodes that are slow, you have to check for the bottlenecks in data flow. 

answered Sep 23, 2019 by Riya

Related Questions In Big Data Hadoop

0 votes
11 answers
0 votes
1 answer
0 votes
1 answer

What is Custom partitioner in Hadoop? How to write partition function ?

Don't think that in Hadoop the same ...READ MORE

answered Sep 18, 2018 in Big Data Hadoop by Frankie
• 9,830 points
1,559 views
0 votes
1 answer

What is Modeling data in Hadoop and how to do it?

I suggest spending some time with Apache ...READ MORE

answered Sep 19, 2018 in Big Data Hadoop by Frankie
• 9,830 points
1,779 views
0 votes
1 answer

What is the command to find the free space in HDFS?

You can use dfsadmin which runs a ...READ MORE

answered Apr 29, 2018 in Big Data Hadoop by Shubham
• 13,490 points
2,169 views
0 votes
1 answer

How to find the used cache in HDFS

hdfs dfsadmin -report This command tells fs ...READ MORE

answered May 4, 2018 in Big Data Hadoop by Shubham
• 13,490 points
2,458 views
+1 vote
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
11,015 views
0 votes
1 answer

hadoop.mapred vs hadoop.mapreduce?

org.apache.hadoop.mapred is the Old API  org.apache.hadoop.mapreduce is the ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
2,528 views
+2 votes
1 answer

how to escape delimiter in hive?

Refer to the below code used to ...READ MORE

answered Oct 31, 2019 in Big Data Hadoop by Kiran
7,601 views
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP