2015-08-20 76 views
2

我使用的共享实例为Fiware Cosmos(意思是我没有root权限)。直到今天,我一直使用jdbc和Hive CLI成功地在hive中成功处理和管理表。 但是从蜂巢CLI时,现在我收到此错误:Fiware Cosmos Hive授权问题

log4j:ERROR Could not instantiate class [org.apache.hadoop.hive.shims.HiveEventCounter]. 
java.lang.RuntimeException: Could not load shims in class org.apache.hadoop.log.metrics.EventCounter 
    at org.apache.hadoop.hive.shims.ShimLoader.createShim(ShimLoader.java:123) 
    at org.apache.hadoop.hive.shims.ShimLoader.loadShims(ShimLoader.java:115) 
    at org.apache.hadoop.hive.shims.ShimLoader.getEventCounter(ShimLoader.java:98) 
    at org.apache.hadoop.hive.shims.HiveEventCounter.<init>(HiveEventCounter.java:34) 
    at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) 
    at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39) 
    at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) 
    at java.lang.reflect.Constructor.newInstance(Constructor.java:513) 
    at java.lang.Class.newInstance0(Class.java:357) 
    at java.lang.Class.newInstance(Class.java:310) 
    at org.apache.log4j.helpers.OptionConverter.instantiateByClassName(OptionConverter.java:330) 
    at org.apache.log4j.helpers.OptionConverter.instantiateByKey(OptionConverter.java:121) 
    at org.apache.log4j.PropertyConfigurator.parseAppender(PropertyConfigurator.java:664) 
    at org.apache.log4j.PropertyConfigurator.parseCategory(PropertyConfigurator.java:647) 
    at org.apache.log4j.PropertyConfigurator.configureRootCategory(PropertyConfigurator.java:544) 
    at org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurator.java:440) 
    at org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurator.java:476) 
    at org.apache.log4j.PropertyConfigurator.configure(PropertyConfigurator.java:354) 
    at org.apache.hadoop.hive.common.LogUtils.initHiveLog4jDefault(LogUtils.java:127) 
    at org.apache.hadoop.hive.common.LogUtils.initHiveLog4jCommon(LogUtils.java:77) 
    at org.apache.hadoop.hive.common.LogUtils.initHiveLog4j(LogUtils.java:58) 
    at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:641) 
    at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625) 
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) 
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) 
    at java.lang.reflect.Method.invoke(Method.java:597) 
    at org.apache.hadoop.util.RunJar.main(RunJar.java:197) 
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.log.metrics.EventCounter 
    at java.net.URLClassLoader$1.run(URLClassLoader.java:202) 
    at java.security.AccessController.doPrivileged(Native Method) 
    at java.net.URLClassLoader.findClass(URLClassLoader.java:190) 
    at java.lang.ClassLoader.loadClass(ClassLoader.java:306) 
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) 
    at java.lang.ClassLoader.loadClass(ClassLoader.java:247) 
    at java.lang.Class.forName0(Native Method) 
    at java.lang.Class.forName(Class.java:171) 
    at org.apache.hadoop.hive.shims.ShimLoader.createShim(ShimLoader.java:120) 
    ... 27 more 
log4j:ERROR Could not instantiate appender named "EventCounter". 

Logging initialized using configuration in jar:file:/usr/local/apache-hive-0.13.0-bin/lib/hive-common-0.13.0.jar!/hive-log4j.properties 

我可以然而进行选择,并在蜂巢CLI创建。 如果我再尝试远程访问蜂房,我得到这个:

Connecting to jdbc:hive://x.x.x.x:10000/default?user=user&password=XXXXXXXXXX 
Could not establish connection: java.net.ConnectException: Connection refused 

我没有做的代码或命令的错误之前的任何变化出现了,围绕谷歌搜索后,我还没有发现任何的工作方案。

如果有人能指导我问题出在哪里,或者如何找到它,甚至更好的解决方法,我将不胜感激。

在此先感谢!

回答

1

HiveServer2 (蜂房JDBC服务)非常不稳定片shoftware的。在我们的Prod集群中,我们有一个CRON任务来每天重新启动每个实例,即使这样,有时它会吹出OutOfMemory错误,然后只是像您所示的那样挂起Connection refused。打开Hadoop管理员的入场券,以便他/她回避该死的服务。

在另一方面,org.apache.hadoop.log.metrics.EventCounter消息闻起来像有人试图在某处更改共享配置(或试图升级一些JAR文件),现在蜂巢认为,它运行在一个非常,非常老版本的Hadoop

的=>例如Hive-4133MapR support post

+0

感谢您的帮助!我已要求管理员进行调查。 关于共享配置虽然,我可以检查,甚至修复?我在哪里看? – Elin

+0

这也是管理员工作...: -/ –

+0

看起来你并不是唯一受苦的人:stackoverflow.com/questions/32134341/my-hive-client-stopped-working-with-cosmos-instance/32134464 –