Is JobTracker a single point of failure too (besides NameNode) in Hadoop?
NickName:user2938723 Ask DateTime:2014-05-02T14:11:12

Is JobTracker a single point of failure too (besides NameNode) in Hadoop?

I am new to Hadoop. In hadoop, I know that when a NameNode fails the entire Hadoop framework goes down. So it's a single point of failure in Hadoop. Is it same for JobTracker? Because if the JobTracker goes down, there would be no daemon to contact Namenode after a job submission and also no point for running the TaskTrackers. How is this handled exactly?

Copyright Notice：Content Author:「user2938723」，Reproduced under the CC 4.0 BY-SA copyright license with a link to the original source and this disclaimer.
Link to original article：https://stackoverflow.com/questions/23421890/is-jobtracker-a-single-point-of-failure-too-besides-namenode-in-hadoop

Answers
Andrey Sozykin 2014-05-02T07:11:52

Yes, JobTracker is a single point of failure in MRv1. In case of JobTracker failure all running jobs are halted (http://wiki.apache.org/hadoop/JobTracker).\n\nIn YARN, Resource manager is not a single point of failure.\n\nIf you need MRv1, you can use MapR distribution, which provides the JobTracker high availability (http://www.mapr.com/resources/videos/demo-hadoop-jobtracker-failing-and-recovering-mapr-cluster). ",

SachinJose 2014-05-02T08:57:44

Jobtracker HA(High Availability using Active and Standby) can be configured in Cloudera Hadoop distribution. See the following link, this feature is available from CDH4.2.1 onwards:\n\nhttp://www.cloudera.com/content/cloudera-content/cloudera-docs/CDH4/latest/CDH4-High-Availability-Guide/cdh4hag_topic_3_1.html\n\nThe same can be configured in Hortwonworks distribution also \nhttp://docs.hortonworks.com/HDPDocuments/HDP1/HDP-1.3.2/bk_hdp1-system-admin-guide/content/sysadminguides_ha_chap2_5_5.html\n\nIn MR2 master service is ResourceManager, which is not Single Point of Failure",

Products recommended by Amazon
More >>>
SanDisk 128GB microSDXC-Card, Licensed for Nintendo-Switch - SDSQXAO-128G-GNCZN
SanDisk 128GB microSDXC-Card, Licensed for Nintendo-Switch - SDSQXAO-128G-GNCZN
 HUANUO Dual Monitor Stand - Adjustable Spring Monitor Desk Mount Swivel Vesa Bracket with C Clamp, Grommet Mounting Base for 13 to 27 Inch Computer Screens - Each Arm Holds 4.4 to 14.3lbs
HUANUO Dual Monitor Stand - Adjustable Spring Monitor Desk Mount Swivel Vesa Bracket with C Clamp, Grommet Mounting Base for 13 to 27 Inch Computer Screens - Each Arm Holds 4.4 to 14.3lbs
 AMD Ryzen 5 5600X 6-core, 12-Thread Unlocked Desktop Processor with Wraith Stealth Cooler
AMD Ryzen 5 5600X 6-core, 12-Thread Unlocked Desktop Processor with Wraith Stealth Cooler
 Timberland Men's 6-Inch Premium Waterproof Boot
Timberland Men's 6-Inch Premium Waterproof Boot
More about “Is JobTracker a single point of failure too (besides NameNode) in Hadoop?” related questions
Is JobTracker a single point of failure too (besides NameNode) in Hadoop?

I am new to Hadoop. In hadoop, I know that when a NameNode fails the entire Hadoop framework goes down. So it's a single point of failure in Hadoop. Is it same for JobTracker? Because if the JobTra...

Show Detail
Hadoop namenode : Single point of failure

The Namenode in the Hadoop architecture is a single point of failure. How do people who have large Hadoop clusters cope with this problem?. Is there an industry-accepted solution that has worked...

Show Detail
Hadoop Installation: no jobtracker to stop no namenode to stop

Hadoop-0.20.2 Single Node Setup FAIL!!!! The jobtracker and namenode do not start :( Any suggestions would be welcome. As far as i know, i have set core-site.xml, hdfs-site.xml and mapred-site.xml

Show Detail
Namenode and Jobtracker information on Hadoop cluster

How can i get the following information on the Hadoop Cluster ? 1. namenode and jobtracker name 2. list of all nodes with their roles on the cluster

Show Detail
Namenode failure and recovery in Hadoop

How does Hadoop determine that the Namenode has failed or is not working? I know that in Hadoop the Namenode is the main point which keeps all the metadata, recognizes the failure of datanodes by

Show Detail
how does hadoop v 2 handles the failure of namenode

In hadoop v 1 namenode is single point of failure but hadoop v 2 overcome to this problem but how does hadoop v 2 handles the failure of namenode

Show Detail
Mitigating Hadoop's Achilles tendons

I just gave this Hadoop tuorial a read which state that Hadoop has an Achilles' tendon (a single point of failure) in JobTracker: The JobTracker is a single point of failure for the Hadoop MapRe...

Show Detail
Does using Standby Masters with ZooKeeper with hadoop prevent single point of failure

In hadoop namenodes are a single point of failure. If you use a spark along side hadoop does Zookeeper take care of the single point of failure hadoop would normally have on its own? Or does it still

Show Detail
JobTracker in hadoop not running

Actually i installed and configured my hadoop single cluster using http://wiki.apache.org/hadoop/Running_Hadoop_On_Ubuntu_Linux_%28Single-Node_Cluster%29 Now when i am using NameNode - (http://

Show Detail
hadoop conf/masters and conf/slaves on jobtracker?

In a hadoop cluster (1.x version) where the NameNode and JobTracker are not the same server, does conf/masters and conf/slaves need to be specified on both the NameNode and the JobTracker or just o...

Show Detail