Why we are configuring mapred job tracker in YARN

0 votes

With the introduction of YARN JobTracker and TaskTracker was replaced with Resource Manager and NodeManager. But, in some of the tutorials for installing Hadoop 2.6.0 or 2.7.0 or 2.8, I have noticed that they are still setting mapreduce.framework.name property to yarn. Besides this, they are also setting mapred.job.tracker property.

I checked the official doc and I found the the description for mapred.job.tracker property as

"The host and port that the MapReduce job tracker runs at. If "local", then jobs are run in-process as a single map and reduce task."

Now, I am curious and confused at the same time about the fact that why we need to configure JobTracker in case of YARN?

Please let me know the reason behind this.

Mar 29, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
1,856 views

1 answer to this question.

0 votes

I really dont know the reason behind setting job tracker in YARN w.r.t. The tutorials that you have visited. To be honest, I think they have not read about YARN and are just following their old habit of configuring job tracker. One other plausible reason for doing so to run the hadoop without YARN, just for sake of back up (may be - just a hunch).

Strictly speaking, the JobTracker and TaskTracker does not come with YARN. Even if add theses properties, they will be ignored. In fact the properties has been changed. Here are the new properties w.r.t. Resource manager (JobTracker) and node manager (TaskTracker):

yarn.resourcemanager.address to replace mapred.jobtracker.address.

answered Mar 29, 2018 by Ashish
• 2,650 points

Related Questions In Big Data Hadoop

+1 vote
1 answer

Why minimum 3 Journal Nodes are required in Hadoop HA architecture?

Initially in Hadoop 1.x, the NameNode was ...READ MORE

answered Apr 20, 2018 in Big Data Hadoop by kurt_cobain
• 9,350 points
11,652 views
0 votes
2 answers

Why we use --split by command in Sqoop?

In simple explanation, When specify SPLIT_BY only ...READ MORE

answered Feb 6, 2020 in Big Data Hadoop by Ramji Sridaran
15,107 views
0 votes
1 answer

Why we use 'help' command in Hadoop Sqoop?

Hi, The command sqoop help lists the tools ...READ MORE

answered Feb 4, 2020 in Big Data Hadoop by MD
• 95,460 points
895 views
0 votes
1 answer

What are the different daemons in yarn?

Hi, The different Daemons in YARN are:- Resources Manager:- Runs ...READ MORE

answered Apr 24, 2019 in Big Data Hadoop by Gitika
• 65,770 points
5,244 views
0 votes
1 answer

Apache Hadoop Yarn example program

You can go to this location $Yarn_Home/share/hadoop/mapreduce . You'll ...READ MORE

answered Apr 4, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
1,185 views
+1 vote
1 answer

Hadoop Mapreduce word count Program

Firstly you need to understand the concept ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
11,015 views
0 votes
1 answer

hadoop.mapred vs hadoop.mapreduce?

org.apache.hadoop.mapred is the Old API  org.apache.hadoop.mapreduce is the ...READ MORE

answered Mar 16, 2018 in Data Analytics by nitinrawat895
• 11,380 points
2,528 views
+2 votes
11 answers

hadoop fs -put command?

Hi, You can create one directory in HDFS ...READ MORE

answered Mar 16, 2018 in Big Data Hadoop by nitinrawat895
• 11,380 points
108,740 views
0 votes
1 answer

Not able to start Job History Server in Hadoop 2.8.1

You have to start JobHistoryServer process specifically ...READ MORE

answered Mar 30, 2018 in Big Data Hadoop by Ashish
• 2,650 points
2,572 views
0 votes
1 answer

ApplicationMaster in YARN Architecture

Let me help you with your confusion: YARN ...READ MORE

answered May 8, 2018 in Big Data Hadoop by Ashish
• 2,650 points
1,261 views
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP