hive on spark reports an error
executing the hive command is an error

[42000][3] Error while processing statement: FAILED: Execution Error, return code 3 from org.apache.hadoop.hive.ql.exec.spark.SparkTask. Spark job failed during runtime. Please check stacktrace for the root cause.

[Reason]
View running tasks on yarn, Query error results from error log

Map operator initialization failed: org.apache.hadoop.hive.ql.metadata.HiveException: Unexpected column vector type LIST

List type error
List corresponds to array in hive, array corresponds to list in Java

[Solution]
Temporarily change the execution engine to MR

set hive.execution.engine=mr;

There are many bugs in hive on spark, When an unknown error occurs, First try to replace the underlying execution engine with MR, to execute the sql statement.

[Subsequent modification]
1. View the current execution engine of hive:

set hive.execution.engine;

2. Manually set hive’s current execution engine to Spark

set hive.execution.engine=spark;

3. Manually set hive’s current execution engine to MR

set hive.execution.engine=mr;

Read More:

• org.apache.hadoop.hive.ql.exec.spark.SparkTask. Failed to create Spark client for Spark session 0354
• Run spark to report error while identifying ‘ org.apache.spark . sql.hive.HiveSessionState ‘
• [Solved] hiveonspark:Execution Error, return code 30041 from org.apache.hadoop.hive.ql.exec.spark.SparkTask
• Spark shell startup error, error: not found: value spark (low level solved)
• Error while instantiating ‘org.apache.spark.sql.hive.HiveExternalCatalog’:
• The docker runtime container reported an error: error response from daemon: OCI runtime create failed
• [Solved] Spark SQL Error: File xxx could only be written to 0 of the 1 minReplication nodes.
• Spark SQL startup error: error creating transactional connection factory
• spark SQL Export Data to Kafka error [How to Solve]
• Stop: job failed while stopping
• org.apache.flink.runtime.client.JobSubmissionException: Failed to submit JobGraph
• Job for network.service Failed because the control process exited with error code. See “SystemC
• Job for docker.service failed because the control process exited with error code. See systemctl sta
• Error response from daemon: OCI runtime exec failed: exec failed: container_linux.go:345:
• Job for apache2.service failed apache2 cannot be started
• termux Failed to initialize runtime
• Initctl: Job failed to start appears when installing VMware-tools
• Oracle stops a job
• systemctl start docker Job for docker.service failed because the control process exited with error
• Several ways to view spark task log