After Ambari2.7.3 by installing HDP3.1.0 successful, go through the spark sql query hive tables are not able to query data found
HDP3.0 integrated spark hive 3.0 and 2.3, but it can not read the data spark hive table is accurate within the data table.
The reason
after 3.0 hive ACID function is enabled by default, and the default new table is ACID table. The spark does not currently support the ACID hive function, can not read data ACID table.
See: https: //issues.apache.org/jira/browse/SPARK-15348
Solution
Modify the following parameters so that the new table is not the default acid form.
hive.strict.managed.tables=false hive.create.as.insert.only=false metastore.create.as.acid=false