hadoop client/hive client去连接 微软云Azure上的HDI报错:
创新互联专业为企业提供独山子网站建设、独山子做网站、独山子网站设计、独山子网站制作等企业网站建设、网页设计与制作、独山子企业网站模板建站服务,10余年独山子做网站经验,不只是建网站,更提供有价值的思路和整体网络服务。hive --service metastore
Exception in thread "main" org.apache.thrift.transport.TTransportException: Could not create ServerSocket on address 0.0.0.0/0.0.0.0:9083.
根本原因是这里使用的是HDI
1、这两个配置文件都改(centos和ubuntu有区别)
# vim /usr/hdp/2.2.0.0-2041/hive/conf/hive-site.xml
# vim /etc/hive/conf/hive-site.xml
<?xml version="1.0" encoding="UTF-8" standalone="no"?> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?> <configuration supports_final="true"> <!-- Hive Configuration can either be stored in this file or in the hadoop configuration files that are implied by Hadoop setup variables. Aside from Hadoop setup variables - this file is provided as a convenience so that Hive users do not have to edit hadoop configuration files (that may be managed as a centralized resource). --> <property> <name>hive.metastore.warehouse.dir</name> <value>/hive/warehouse</value> <description>location of default database for the warehouse</description> </property> <property> <name>hive.metastore.uris</name> <value>thrift://headnodehost:9083</value> <description>Thrift URI for the remote metastore. Used by metastore client to connect to remote metastore.</description> </property> </configuration>
2、修改hosts
vim /etc/hosts
内容是来自于HDI的windows机器上的配置
10.0.2.7 headnodehost # SlaveNodeManager 10.0.2.7 jobtrackerhost # SlaveNodeManager 10.0.2.7 namenodehost # SlaveNodeManager
hive普通用户报错:
1、报错
Booting Derby (version The Apache Software Foundation - Apache Derby - 10.10.1.1 - (1458268)) instance a816c00e-0154-2ed3-cbb2-00000e1ebc98
on database directory /var/lib/hive/metastore/metastore_db in READ ONLY mode with class loader sun.misc.Launcher$AppClassLoader@7cc355be.
Loaded fromfile:/usr/hdp/2.2.0.0-2041/hive/lib/derby-10.10.1.1.jar.
问题:明显是metastore数据库read only,没有写权限
解决办法:
# cd /var/lib/hive/metastore/
# chmod -R a+w metastore_db/
2、报错如下,但是hive还是进来了
Booting Derby version The Apache Software Foundation - Apache Derby - 10.10.1.1 - (1458268): instance a816c00e-0154-3155-87b8-00000e0b5a08
on database directory /var/lib/hive/metastore/metastore_db with class loader sun.misc.Launcher$AppClassLoader@7cc355be
Loaded from file:/usr/hdp/2.2.0.0-2041/hive/lib/derby-10.10.1.1.jar
java.vendor=Oracle Corporation
java.runtime.version=1.8.0_51-b16
user.dir=/var/lib/hive
os.name=Linux
os.arch=amd64
os.version=2.6.32-573.1.1.el6.x86_64
derby.system.home=null
Database Class Loader started - derby.database.classpath=''
hive>
>
还是权限问题:/var/lib/hive# chown -R hive:hive metastore/
另外有需要云服务器可以了解下创新互联scvps.cn,海内外云服务器15元起步,三天无理由+7*72小时售后在线,公司持有idc许可证,提供“云服务器、裸金属服务器、高防服务器、香港服务器、美国服务器、虚拟主机、免备案服务器”等云主机租用服务以及企业上云的综合解决方案,具有“安全稳定、简单易用、服务可用性高、性价比高”等特点与优势,专为企业上云打造定制,能够满足用户丰富、多元化的应用场景需求。
本文标题:hive一些问题-创新互联
链接URL:https://www.cdcxhl.com/article30/dspppo.html
成都网站建设公司_创新互联,为您提供软件开发、虚拟主机、微信公众号、品牌网站建设、网站维护、手机网站建设
声明:本网站发布的内容(图片、视频和文字)以用户投稿、用户转载内容为主,如果涉及侵权请尽快告知,我们将会在第一时间删除。文章观点不代表本网站立场,如需处理请联系客服。电话:028-86922220;邮箱:631063699@qq.com。内容未经允许不得转载,或转载时需注明来源: 创新互联