【SQL】Spark HiveSQL常见报错

-- 无权限更新
Authorization failed:No privilege 'Update' found for outputs

-- 库或表对象不存在
com.microsoft.sqlserver.jdbc.SQLServerException: Invalid object name

-- 列数或类型不一致，无法插入表
Cannot insert into target table because column number/types are different

-- 表无分区
FAILED: SemanticException table is not partitioned but partition spec exists

-- 任务被取消
WARN Attempting to kill the process 

-- 无查询权限
Authorization failed:No privilege 'Select' found for inputs

-- Hive语法错误
FAILED: SemanticException Column

-- 表的别名错误
FAILED: SemanticException [Error 10009]:

-- 表分区错误
FAILED: SemanticException [Error 10041]:

-- Shell命令不存在
: command not found

-- Sql语法错误：可能是列数不对
Schema of both sides of union should match

-- 分区指定错误
FAILED: SemanticException Partition spec

-- 分区表未指定分区
Need to specify partition columns because the destination table is partitioned

-- group by语法错误
Repeated key in GROUP BY
或 FAILED: SemanticException [Error 10025]

-- 无权限
Use SHOW GRANT to get more details
或 Authorization failed:No privilege 'Select' found for inputs 

-- Hive语法错误
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. null
或  TOK_ALLCOLREF is not supported in current context

-- 表不存在
Error in query: Table or view '\w*' not found in database '\w*'
或 FAILED: SemanticException [Error 10001]:

-- sql语法错误
mismatched input '(.*)' expecting/
extraneous input '(.*)' expecting

-- spark语法错误：某些字段没有group by
Error in query: expression (.*) is neither present in the group by, nor is it an aggregate function

-- 语法错误：函数参数不正确
Error in query: Invalid number of arguments for function

-- group by字段不能有map类型，可以用map里面的key进行分组
cannot be used as a grouping expression because its data type map(.*) is not an orderable data type

-- group by的语句中不能存在一些不确定的函数，例如regexp_extract()正则解析函数
Error in query: nondeterministic expression (.*) should not appear in grouping expression

-- map类型错误
Error in query: Cannot have map type columns in DataFrame which calls set operations\(intersect, except, etc.\)

-- 字段不明确
Error in query: Reference (.*) is ambiguous

-- 未非分区表
Table (.*) is not a partitioned table

-- 某列字段错误
org.apache.spark.sql.AnalysisException: cannot resolve (.*) given input columns

-- 字段不明确/有歧义
org.apache.spark.sql.AnalysisException: Reference (.*) is ambiguous
或
java.lang.IllegalArgumentException: Field (.*) does not exist

-- 不支持开窗函数
Error in query: Expression (.*) not supported within a window function

-- spark 语法错误
no viable alternative at input

-- 有字段是非聚合函数
Error in query: grouping expressions sequence is empty, and (.*) is not an aggregate function

-- union时字段不同
java.lang.IllegalArgumentException: transpose requires all collections have the same size 或
Error in query: Union can only be performed on tables with the same number of columns

-- 不允许嵌套聚合函数
Not yet supported place for UDAF

-- 插入的数据与表的列数不对
java.sql.SQLException: Column count doesn't match value count at row