20180716:
Unable to obtain hostName
java.net.UnknownHostException: hadoop100: hadoop100
解决方案:
vi /etc/hosts 查看集群对应ip 名称
192.168.77.100 master
192.168.77.101 slave1
192.168.77.102 slave2
192.168.77.103 slave3
192.168.77.104 slave4
192.168.77.105 slave5
192.168.77.106 slave6
192.168.77.107 slave7
我使用的机器是100
vi /etc/sysconfig/network 查看本机名称
我的本机名称是 hadoop100 则将 HOSTNAME改为master 即可
NETWORKING=yes
HOSTNAME=master
退出保存。
sync
reboot
在执行命令
hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.6.jar grep test_input/ test_output 'dfs[a-z.]+
发现可以正常执行,不报错了。
20170803
关于hive
This command is not allowed on an ACID table XXX with a non-ACID
transaction manager.failed command select * from tb
解决方案
Configuration
Minimally, these configuration parameters must be set appropriately to turn on transaction support in Hive:
Client Side
- hive.support.concurrency – true
- hive.enforce.bucketing – true (Not required as of Hive 2.0)
- hive.exec.dynamic.partition.mode – nonstrict
- hive.txn.manager – org.apache.hadoop.hive.ql.lockmgr.DbTxnManager
Server Side (Metastore)
- hive.compactor.initiator.on – true (See table below for more details)
- hive.compactor.worker.threads – a positive number on at least one instance of the Thrift metastore service
The following sections list all of the configuration parameters that affect Hive transactions and compaction. Also see Limitations above and Table Properties below.
参考:https://cwiki.apache.org/confluence/display/Hive/Hive+Transactions