This is a known issue (see README of the base image).
I've managed establish a connection from spark to hive by simply upgrading to Spark 3.0.1, but I'm getting a hive-ql error when actually executing a query on it.
This runs: spark.sql("SELECT * FROM grades")
This throws a hive-ql error error: spark.sql("SELECT * FROM grades").show()
Any ideas of how to solve this? Having Spark work with Hive in a docker environment would be awesome!
This is a known issue (see README of the base image).
I've managed establish a connection from spark to hive by simply upgrading to Spark 3.0.1, but I'm getting a hive-ql error when actually executing a query on it.
This runs:
spark.sql("SELECT * FROM grades")This throws a hive-ql error error:
spark.sql("SELECT * FROM grades").show()Any ideas of how to solve this? Having Spark work with Hive in a docker environment would be awesome!