Spark creates hive table error ROW FORMAT DELIMITED is only compatible with 'textfile', not 'orc'

Failed to create hive table:

 Error exception information:

Operation not allowed: ROW FORMAT DELIMITED is only compatible with 'textfile', not 'orc'(line 1, pos 0) == SQL == create table src_test1111( ^^^ id string comment '序号', name string comment '姓名' )comment '测试表' row format delimited fields terminated by ''stored as orc org.apache.spark.sql.catalyst.parser.ParserUtils$.operationNotAllowed(ParserUtils.scala:39),
org.apache.spark.sql.execution.SparkSqlAstBuilder.org$apache$spark$sql$execution$SparkSqlAstBuilder$$validateRowFormatFileFormat(SparkSqlParser.scala:1256),
org.apache.spark.sql.execution.SparkSqlAstBuilder$$anonfun$visitCreateTable$1.apply(SparkSqlParser.scala:1028),
org.apache.spark.sql.execution.SparkSqlAstBuilder$$anonfun$visitCreateTable$1.apply(SparkSqlParser.scala:990),
org.apache.spark.sql.catalyst.parser.ParserUtils$.withOrigin(ParserUtils.scala:93),
org.apache.spark.sql.execution.SparkSqlAstBuilder.visitCreateTable(SparkSqlParser.scala:990)

The reason should be that spark does not provide orc's delimited operation

Looking at the quote from this boss, it is estimated that the new version has been repaired, but the old version still does not work

Daxie original text and reference:

Spark creates hive table error ROW FORMAT DELIMITED is only compatible with 'textfile', not 'parquet'_jast-CSDN blog scene: When spark analyzes data, creating hive table fails. Exception: 19/10/09 10:59:18 INFO execution.SparkSqlParser: Parsing command: CREATE EXTERNAL TABLE IF NOT EXISTSdm_xxx.user_area(biFollowersCount String,city String,creat... https://blog.csdn.net/ zhangshenghang/article/details/102459033 [SPARK-15279] Disallow ROW FORMAT and STORED AS (parquet | orc | avro etc.) - ASF JIRA https://issues.apache.org/jira/browse/SPARK-15279

Guess you like

Origin blog.csdn.net/m0_46282787/article/details/122963933