查看: 11312|回复: 4
项目一启动就报hive初始化错误,跪求大神进来看看!!
主题帖子积分
注册会员, 积分 82, 距离下一级还需 118 积分
注册会员, 积分 82, 距离下一级还需 118 积分
首先,我们项目是因为hive版本太低,以前为0.13版,现在要升级为1.1版.
删除的jar包(0.13版)为:
&exclude name=&hive-cli-0.13.1.jar& /&
&exclude name=&hive-common-0.13.1.jar& /&
&exclude name=&hive-exec-0.13.1.jar& /&
&exclude name=&hive-metastore-0.13.1.jar& /&
&exclude name=&hive-service-0.13.1.jar& /&
新增的jar包(1.1版)为:
&exclude name=&hive-ant-1.1.0-cdh5.4.2.jar& /&
&exclude name=&hive-cli-1.1.0-cdh5.4.2.jar& /&
&exclude name=&hive-common-1.1.0-cdh5.4.2.jar& /&
&exclude name=&hive-contrib-1.1.0-cdh5.4.2.jar& /&
&exclude name=&hive-exec-1.1.0-cdh5.4.2.jar& /&
&exclude name=&hive-hwi-1.1.0-cdh5.4.2.jar& /&
&exclude name=&hive-jdbc-1.1.0-cdh5.4.2.jar& /&
&exclude name=&hive-metastore-1.1.0-cdh5.4.2.jar& /&
&exclude name=&hive-serde-1.1.0-cdh5.4.2.jar& /&
&exclude name=&hive-service-1.1.0-cdh5.4.2.jar& /&
&exclude name=&hive-shims-1.1.0-cdh5.4.2.jar& /&
&exclude name=&hive-testutils-1.1.0-cdh5.4.2.jar& /&
然后项目一启动就报以下错误:
org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'paHiveUserDao' defined in file [/appcom/tomcat/webapps/gbdide/WEB-INF/classes/com/paic/hadoop/gbd/hive/dao/PaHiveUserDao.class]: Cannot resolve reference to bean 'hiveSqlSessionFactory' while setting bean property 'sqlSessionFactory'; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'hiveSqlSessionFactory' defined in class path resource [spring-mybatis.xml]: Cannot resolve reference to bean 'hiveDataSource' while setting bean property 'dataSource'; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'hiveDataSource' defined in class path resource [spring-mybatis.xml]: Invocation o nested exception is java.lang.NoClassDefFoundError: Could not initialize class org.apache.hadoop.hive.conf.HiveConf
& && &&&at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:329)
& && &&&at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:107)
& && &&&at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyPropertyValues(AbstractAutowireCapableBeanFactory.java:1387)
& && &&&at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1128)
& && &&&at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:519)
& && &&&at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:458)
& && &&&at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:295)
& && &&&at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:223)
& && &&&at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:292)
& && &&&at org.springframework.beans.factory.support.AbstractBeanFactory.getTypeForFactoryBean(AbstractBeanFactory.java:1368)
& && &&&at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.getTypeForFactoryBean(AbstractAutowireCapableBeanFactory.java:720)
& && &&&at org.springframework.beans.factory.support.AbstractBeanFactory.isTypeMatch(AbstractBeanFactory.java:523)
& && &&&at org.springframework.beans.factory.support.DefaultListableBeanFactory.doGetBeanNamesForType(DefaultListableBeanFactory.java:356)
& && &&&at org.springframework.beans.factory.support.DefaultListableBeanFactory.getBeanNamesForType(DefaultListableBeanFactory.java:334)
& && &&&at org.springframework.beans.factory.BeanFactoryUtils.beanNamesForTypeIncludingAncestors(BeanFactoryUtils.java:187)
& && &&&at org.springframework.beans.factory.support.DefaultListableBeanFactory.findAutowireCandidates(DefaultListableBeanFactory.java:897)
& && &&&at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:855)
& && &&&at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:770)
& && &&&at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.inject(AutowiredAnnotationBeanPostProcessor.java:486)
& && &&&at org.springframework.beans.factory.annotation.InjectionMetadata.inject(InjectionMetadata.java:87)
& && &&&at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor.postProcessPropertyValues(AutowiredAnnotationBeanPostProcessor.java:285)
& && &&&at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1116)
& && &&&at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:519)
& && &&&at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:458)
& && &&&at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:295)
& && &&&at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:223)
& && &&&at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:292)
& && &&&at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:194)
& && &&&at org.springframework.beans.factory.support.DefaultListableBeanFactory.findAutowireCandidates(DefaultListableBeanFactory.java:912)
& && &&&at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:855)
& && &&&at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:770)
& && &&&at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.inject(AutowiredAnnotationBeanPostProcessor.java:486)
& && &&&at org.springframework.beans.factory.annotation.InjectionMetadata.inject(InjectionMetadata.java:87)
& && &&&at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor.postProcessPropertyValues(AutowiredAnnotationBeanPostProcessor.java:285)
& && &&&at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1116)
& && &&&at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:519)
& && &&&at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:458)
& && &&&at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:295)
& && &&&at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:223)
& && &&&at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:292)
& && &&&at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:194)
& && &&&at org.springframework.beans.factory.support.DefaultListableBeanFactory.findAutowireCandidates(DefaultListableBeanFactory.java:912)
& && &&&at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:855)
& && &&&at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:770)
& && &&&at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.inject(AutowiredAnnotationBeanPostProcessor.java:486)
& && &&&at org.springframework.beans.factory.annotation.InjectionMetadata.inject(InjectionMetadata.java:87)
& && &&&at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor.postProcessPropertyValues(AutowiredAnnotationBeanPostProcessor.java:285)
& && &&&at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1116)
& && &&&at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:519)
& && &&&at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:458)
& && &&&at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:295)
& && &&&at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:223)
& && &&&at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:292)
& && &&&at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:194)
& && &&&at org.springframework.beans.factory.support.DefaultListableBeanFactory.findAutowireCandidates(DefaultListableBeanFactory.java:912)
& && &&&at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:855)
& && &&&at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:770)
& && &&&at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.inject(AutowiredAnnotationBeanPostProcessor.java:486)
& && &&&at org.springframework.beans.factory.annotation.InjectionMetadata.inject(InjectionMetadata.java:87)
& && &&&at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor.postProcessPropertyValues(AutowiredAnnotationBeanPostProcessor.java:285)
& && &&&at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1116)
& && &&&at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:519)
& && &&&at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:458)
& && &&&at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:295)
& && &&&at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:223)
& && &&&at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:292)
& && &&&at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:194)
& && &&&at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:628)
& && &&&at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:932)
& && &&&at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:479)
& && &&&at org.springframework.web.servlet.FrameworkServlet.configureAndRefreshWebApplicationContext(FrameworkServlet.java:651)
& && &&&at org.springframework.web.servlet.FrameworkServlet.createWebApplicationContext(FrameworkServlet.java:599)
& && &&&at org.springframework.web.servlet.FrameworkServlet.createWebApplicationContext(FrameworkServlet.java:665)
& && &&&at org.springframework.web.servlet.FrameworkServlet.initWebApplicationContext(FrameworkServlet.java:518)
& && &&&at org.springframework.web.servlet.FrameworkServlet.initServletBean(FrameworkServlet.java:459)
& && &&&at org.springframework.web.servlet.HttpServletBean.init(HttpServletBean.java:136)
& && &&&at javax.servlet.GenericServlet.init(GenericServlet.java:158)
& && &&&at org.apache.catalina.core.StandardWrapper.initServlet(StandardWrapper.java:1284)
& && &&&at org.apache.catalina.core.StandardWrapper.loadServlet(StandardWrapper.java:1197)
& && &&&at org.apache.catalina.core.StandardWrapper.allocate(StandardWrapper.java:864)
& && &&&at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:134)
& && &&&at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122)
& && &&&at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:501)
& && &&&at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170)
& && &&&at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:98)
& && &&&at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950)
& && &&&at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116)
& && &&&at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:408)
& && &&&at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1040)
& && &&&at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:607)
& && &&&at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:313)
& && &&&at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
& && &&&at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
& && &&&at java.lang.Thread.run(Thread.java:745)
Caused by: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'hiveSqlSessionFactory' defined in class path resource [spring-mybatis.xml]: Cannot resolve reference to bean 'hiveDataSource' while setting bean property 'dataSource'; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'hiveDataSource' defined in class path resource [spring-mybatis.xml]: Invocation o nested exception is java.lang.NoClassDefFoundError: Could not initialize class org.apache.hadoop.hive.conf.HiveConf
& && &&&at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:329)
& && &&&at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:107)
& && &&&at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyPropertyValues(AbstractAutowireCapableBeanFactory.java:1387)
& && &&&at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1128)
& && &&&at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:519)
& && &&&at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:458)
& && &&&at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:295)
& && &&&at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:223)
& && &&&at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:292)
& && &&&at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:194)
& && &&&at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:323)
& && &&&... 93 more
Caused by: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'hiveDataSource' defined in class path resource [spring-mybatis.xml]: Invocation o nested exception is java.lang.NoClassDefFoundError: Could not initialize class org.apache.hadoop.hive.conf.HiveConf
& && &&&at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1482)
& && &&&at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:521)
& && &&&at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:458)
& && &&&at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:295)
& && &&&at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:223)
& && &&&at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:292)
& && &&&at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:194)
& && &&&at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:323)
& && &&&... 103 more
Caused by: java.lang.NoClassDefFoundError: Could not initialize class org.apache.hadoop.hive.conf.HiveConf
& && &&&at com.paic.hadoop.gbd.ide.hive.HiveUtils.getDefaultConf(HiveUtils.java:51)
& && &&&at com.paic.hadoop.gbd.ide.security.PaDataSourceFactory.createDataSource(PaDataSourceFactory.java:221)
& && &&&at com.paic.hadoop.gbd.ide.security.PaDataSourceFactory.init(PaDataSourceFactory.java:251)
& && &&&at sun.reflect.GeneratedMethodAccessor47.invoke(Unknown Source)
& && &&&at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
& && &&&at java.lang.reflect.Method.invoke(Method.java:606)
& && &&&at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.invokeCustomInitMethod(AbstractAutowireCapableBeanFactory.java:1608)
& && &&&at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.invokeInitMethods(AbstractAutowireCapableBeanFactory.java:1549)
& && &&&at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1479)
& && &&&... 110 more
错误定位的代码为:
public static HiveConf getDefaultConf() {
& & & & & & & & HiveConf hiveConf = new HiveConf(HiveUtils.class);& & //最后锁定的是这一行报的错(HiveUtils.java:51)
& & & & & & & & hiveConf.addResource(&mapred-site.xml&);
& & & & & & & & hiveConf.addResource(&gbd-ide.xml&);
& & & & & & & & hiveConf.set(&hive.metastore.uris&, &&);
& & & & & & & & return hiveC
请大神们帮忙看看,万分感谢!!!
主题帖子积分
高级会员, 积分 2030, 距离下一级还需 2970 积分
高级会员, 积分 2030, 距离下一级还需 2970 积分
升级不是简单的替换包问题，还包含很多步骤。下面仅供参考
Hive升级时遇到的几个小问题以及解决办法
hive版本升级问题
主题帖子积分
中级会员, 积分 349, 距离下一级还需 651 积分
中级会员, 积分 349, 距离下一级还需 651 积分
Invocation o nested exception is java.lang.NoClassDefFoundError: Could not initialize class org.apache.hadoop.hive.conf.HiveConf
从这个地方入手找一下异常吧，看异常信息是初始化HiveConf时出错了，给我的感觉是jar包版本不对；
原来的是不是原来该类对应的的jar包没有删除。
主题帖子积分
注册会员, 积分 82, 距离下一级还需 118 积分
注册会员, 积分 82, 距离下一级还需 118 积分
升级不是简单的替换包问题，还包含很多步骤。下面仅供参考
Hive升级时遇到的几个小问题以及解决办法
你好！你说的这种情况是服务器环境升级，我们环境已经是hadoop2.0+hive1.1了，但是我自己的项目还是hadoop2.0+hive0.13！现在是我把项目中的jar包替换成1.1的jar包，然后打成war包到环境上去运行，然后报错了。
主题帖子积分
中级会员, 积分 242, 距离下一级还需 758 积分
中级会员, 积分 242, 距离下一级还需 758 积分
错误提示很明显是找不到类，那应该就是jar包引入错误，你本地的类路径引入是根据旧版的jar来的，在服务器新环境下应该不识别，建议更新本地环境，重新打包上传
站长推荐 /3
会员注册不成功的原因
新手获取积分方法
hadoop3.0学习：零基础安装部署hadoop集群
Powered by}