Hadoop Data node acknowledgement

0 votes

Will the first data node waits to send acknowledgment to core switch until it receives acknowledgment from the other(second ) data node?

Dec 18, 2018 in Big Data Hadoop by slayer
• 29,370 points
829 views

1 answer to this question.

0 votes
Let's understand full write mechanism so that you can get the full concept of this structure.

DS --> DN1 -->DN4 --> DN6

The above structure of data nodes shows that the order can't be a break so that the Data streamer should know how the data is traversing and to which data node to data node the data is been copied.

Data Streamer will transfer data to Data node 1 and Datanode 1 will transfer data to Data Node 4 and the process continues.

While receiving Acknowledgement data Node 6 will first respond that data is copied in me and it will send acknowledgment to Data Node 4 then data Node 4 will send acknowledgement to data node 1 that in data node 6 and on my data is been written  then data node 1 will be responding data streamer that pleases acknowledge name node that the data is been written to all three data nodes.

This process is followed in data transfer state.

When transferring data node 1 to data node 4 this is the flow:

DN1--> switch on rack 1 -->core switch-->switchon rack 5 -->DN4

Switch involvement comes only in data transferring not in sending acknowledgement state.

Coming to the scenario of Blocks

Data is very vast so we have divided into two blocks A and B.

A is stored in Rack 1 and then it is stored in Rack 4 which is fulfilling Rack awareness 3 rules.

B is randomly stored in Rack 1 randomly than in a different rack, it needs to store another replica so it chooses that fulfils rack 7 and 2 and 3 rule of rack awareness.

Hope this helps.
answered Dec 18, 2018 by Omkar
• 69,220 points

Related Questions In Big Data Hadoop

0 votes
1 answer

Understanding Hadoop Master Node, Slave Node and Data Node.

The NameNode and the JobTracker are single ...READ MORE

answered Sep 6, 2018 in Big Data Hadoop by Frankie
• 9,830 points
2,666 views
0 votes
1 answer

How to install and configure a multi-node Hadoop cluster?

I would recommend you to install Cent ...READ MORE

answered Mar 22, 2018 in Big Data Hadoop by Shubham
• 13,490 points
2,407 views
0 votes
1 answer
0 votes
1 answer

Hadoop vs Data Lake

A data lake is a storage repository that holds ...READ MORE

answered Mar 26, 2018 in Big Data Hadoop by Ashish
• 2,650 points
1,921 views
+1 vote
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
11,015 views
0 votes
1 answer

hadoop.mapred vs hadoop.mapreduce?

org.apache.hadoop.mapred is the Old API  org.apache.hadoop.mapreduce is the ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
2,528 views
+2 votes
11 answers

hadoop fs -put command?

Hi, You can create one directory in HDFS ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
108,740 views
–1 vote
1 answer

Hadoop dfs -ls command?

In your case there is no difference ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by kurt_cobain
• 9,350 points
4,605 views
0 votes
1 answer

Hadoop: “Unhealthy Node local-dirs and log-dirs are bad”

You can increase the threshold in yarn-site.xml <property> ...READ MORE

answered Nov 8, 2018 in Big Data Hadoop by Omkar
• 69,220 points
4,247 views
0 votes
1 answer

Hadoop Hive: How to insert data in Hive table?

First, copy data into HDFS. Then create ...READ MORE

answered Nov 12, 2018 in Big Data Hadoop by Omkar
• 69,220 points
9,782 views
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP