Hadoop 2.6 uses Yarn as a next generation map reduce and also is cluster manager. Do we still need to use zookeeper with the hadoop 2.6 for cluster managing services? How do we setup zookeeper.
How does Kafka connectivity is installed for hadoop cluster. What would be the consumer and producer for kafka to send data to hadoop file system.
Where does they all fit in.
I have setup a hadoop 2.6 single node cluster. Now next, The way I understand it is to have zookeeper and Kafka for data streaming to hadoop file system.
And I don't have any idea how to use kafka for hadoop or its api.
Copyright Notice:Content Author:「Umer」,Reproduced under the CC 4.0 BY-SA copyright license with a link to the original source and this disclaimer.
Link to original article:https://stackoverflow.com/questions/31651980/where-does-zookeeper-and-kafka-fit-in-hadoop-2-6-cluster