can single point of failure in Hadoop can be addressed by integrating Zookeeper?
NickName:aman446 Ask DateTime:2012-02-16T07:21:21

can single point of failure in Hadoop can be addressed by integrating Zookeeper?

I am looking for addressing the issue of single point failure by integrating Zookeeper and allow Hadoop to use the namespace from Zookeeper? Is it possible? how can we address this ?

Copyright Notice:Content Author:「aman446」,Reproduced under the CC 4.0 BY-SA copyright license with a link to the original source and this disclaimer.
Link to original article:https://stackoverflow.com/questions/9303109/can-single-point-of-failure-in-hadoop-can-be-addressed-by-integrating-zookeeper

Answers
Donald Miner 2012-02-15T23:30:38

Sure, it might be technically possible, but this is not something that has been implemented in any shape or form just yet. You can't just plug it into ZooKeeper... it'll take some engineering effort to get it done (by you perhaps?!).\n\nHere are a couple pointers to solutions of this:\n\n\nAvatarNode\nMapR (commercial software)\nA high-availability NameNode has been in the works and might end up soon in a future release\n",


More about “can single point of failure in Hadoop can be addressed by integrating Zookeeper?” related questions

can single point of failure in Hadoop can be addressed by integrating Zookeeper?

I am looking for addressing the issue of single point failure by integrating Zookeeper and allow Hadoop to use the namespace from Zookeeper? Is it possible? how can we address this ?

Show Detail

Does using Standby Masters with ZooKeeper with hadoop prevent single point of failure

In hadoop namenodes are a single point of failure. If you use a spark along side hadoop does Zookeeper take care of the single point of failure hadoop would normally have on its own? Or does it still

Show Detail

Hadoop namenode : Single point of failure

The Namenode in the Hadoop architecture is a single point of failure. How do people who have large Hadoop clusters cope with this problem?. Is there an industry-accepted solution that has worked...

Show Detail

Is JobTracker a single point of failure too (besides NameNode) in Hadoop?

I am new to Hadoop. In hadoop, I know that when a NameNode fails the entire Hadoop framework goes down. So it's a single point of failure in Hadoop. Is it same for JobTracker? Because if the JobTra...

Show Detail

Hadoop with zookeeper

I am new to apache zookeeper and I read from an article that Zookeeper manages the entire workflow of starting and stopping various nodes in the Hadoop’s cluster. If it so, can anyone tell me how..

Show Detail

How to integrate hadoop with zookeeper and hbase

I have set up a single node cluster of Hadoop 2.6 but i need to integrate zookeeper and hbase with it. I am a beginner with no prior experience in big data tools. How do you set up zookeeper to

Show Detail

Regarding Hadoop failure and new HBase?

I have 2 questions: 1. Is NameNode still single point of failure in Hadoop YARN or new version of Hadoop e.g. 2.5? What is the single point of failure in Hadoop? 2. I saw Facebook is using Hydr...

Show Detail

Where does zookeeper and Kafka fit in hadoop 2.6 cluster

Hadoop 2.6 uses Yarn as a next generation map reduce and also is cluster manager. Do we still need to use zookeeper with the hadoop 2.6 for cluster managing services? How do we setup zookeeper. Ho...

Show Detail

Zookeeper Kafka

according to this link : https://www.kumarchetan.com/blog/2016/12/07/how-to-setup-and-run-multiple-zookeeper-instances-on-one-box/ we can setup zookeeper multiple instance on single node. as far a...

Show Detail

Hadoop Hbasee Zookeeper error

Hello & thanks for taking the time to look at this issue I am having. Any help is appreciated as I just started working with hadoop and noSQL... HBase login: I start a hbase shell in throug...

Show Detail