hadoop client/hive client去连接 微软云Azure上的HDI报错:
让客户满意是我们工作的目标,不断超越客户的期望值来自于我们对这个行业的热爱。我们立志把好的技术通过有效、简单的方式提供给客户,将通过不懈努力成为客户在信息化领域值得信任、有价值的长期合作伙伴,公司提供的服务项目有:国际域名空间、网站空间、营销软件、网站建设、若羌网站维护、网站推广。
hive --service metastore
Exception in thread "main" org.apache.thrift.transport.TTransportException: Could not create ServerSocket on address 0.0.0.0/0.0.0.0:9083.
根本原因是这里使用的是HDI
1、这两个配置文件都改(centos和ubuntu有区别)
# vim /usr/hdp/2.2.0.0-2041/hive/conf/hive-site.xml
# vim /etc/hive/conf/hive-site.xml
<?xml version="1.0" encoding="UTF-8" standalone="no"?> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?> <configuration supports_final="true"> <!-- Hive Configuration can either be stored in this file or in the hadoop configuration files that are implied by Hadoop setup variables. Aside from Hadoop setup variables - this file is provided as a convenience so that Hive users do not have to edit hadoop configuration files (that may be managed as a centralized resource). --> <property> <name>hive.metastore.warehouse.dir</name> <value>/hive/warehouse</value> <description>location of default database for the warehouse</description> </property> <property> <name>hive.metastore.uris</name> <value>thrift://headnodehost:9083</value> <description>Thrift URI for the remote metastore. Used by metastore client to connect to remote metastore.</description> </property> </configuration>
2、修改hosts
vim /etc/hosts
内容是来自于HDI的windows机器上的配置
10.0.2.7 headnodehost # SlaveNodeManager 10.0.2.7 jobtrackerhost # SlaveNodeManager 10.0.2.7 namenodehost # SlaveNodeManager
hive普通用户报错:
1、报错
Booting Derby (version The Apache Software Foundation - Apache Derby - 10.10.1.1 - (1458268)) instance a816c00e-0154-2ed3-cbb2-00000e1ebc98
on database directory /var/lib/hive/metastore/metastore_db in READ ONLY mode with class loader sun.misc.Launcher$AppClassLoader@7cc355be.
Loaded fromfile:/usr/hdp/2.2.0.0-2041/hive/lib/derby-10.10.1.1.jar.
问题:明显是metastore数据库read only,没有写权限
解决办法:
# cd /var/lib/hive/metastore/
# chmod -R a+w metastore_db/
2、报错如下,但是hive还是进来了
Booting Derby version The Apache Software Foundation - Apache Derby - 10.10.1.1 - (1458268): instance a816c00e-0154-3155-87b8-00000e0b5a08
on database directory /var/lib/hive/metastore/metastore_db with class loader sun.misc.Launcher$AppClassLoader@7cc355be
Loaded from file:/usr/hdp/2.2.0.0-2041/hive/lib/derby-10.10.1.1.jar
java.vendor=Oracle Corporation
java.runtime.version=1.8.0_51-b16
user.dir=/var/lib/hive
os.name=Linux
os.arch=amd64
os.version=2.6.32-573.1.1.el6.x86_64
derby.system.home=null
Database Class Loader started - derby.database.classpath=''
hive>
>
还是权限问题:/var/lib/hive# chown -R hive:hive metastore/
网站栏目:hive一些问题
网站路径:https://www.cdcxhl.com/article42/jhsdhc.html
成都网站建设公司_创新互联,为您提供静态网站、用户体验、手机网站建设、网站维护、电子商务、品牌网站建设
声明:本网站发布的内容(图片、视频和文字)以用户投稿、用户转载内容为主,如果涉及侵权请尽快告知,我们将会在第一时间删除。文章观点不代表本网站立场,如需处理请联系客服。电话:028-86922220;邮箱:631063699@qq.com。内容未经允许不得转载,或转载时需注明来源: 创新互联