1
我试图使用Cloudera Manager设置单个节点群集,这里是我遇到的最新问题。使用Cloudera Manager以伪分布模式设置Hadoop - Datanode不会启动
当我尝试启动所有服务,HDFS将无法启动,这似乎是与Datanode的一个问题 - 它给人的致命错误消息是
Initialization failed for block pool Block pool BP-1896453393-127.0.1.1-1382183730690 (storage id DS-185043233-127.0.1.1-50010-1382183775494) service to Hadoop1/127.0.1.1:8022
org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.server.protocol.DisallowedDatanodeException): Datanode denied communication with namenode: DatanodeRegistration(127.0.0.1, storageID=DS-185043233-127.0.1.1-50010-1382183775494, infoPort=50075, ipcPort=50020, storageInfo=lv=-40;cid=cluster25;nsid=1577346304;c=0)
at org.apache.hadoop.hdfs.server.blockmanagement.DatanodeManager.registerDatanode(DatanodeManager.java:656)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.registerDatanode(FSNamesystem.java:3495)
at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.registerDatanode(NameNodeRpcServer.java:899)
at
...
当我运行主机检查器中,它提供了以下警告:
The following errors were found while checking /etc/hosts...
The hostname Hadoop1 maps to 127.0.1.1 in /etc/hosts.
This setting, typically found in Debian and Ubuntu environments, typically causes issues.
We recommend either using the standard loopback address (127.0.0.1) or specifying the appropriate IP address for your host.
从谷歌上搜索,似乎这个问题是关系到使用的IP地址,而问题的根源可能是我的/ etc/hosts文件,它看起来像这样。
127.0.0.1 localhost
127.0.1.1 Hadoop1
# The following lines are desirable for IPv6 capable hosts
::1 ip6-localhost ip6-loopback
fe00::0 ip6-localnet
ff00::0 ip6-mcastprefix
ff02::1 ip6-allnodes
ff02::2 ip6-allrouters