You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository was archived by the owner on Dec 15, 2021. It is now read-only.
I am a newbie in Spark & Scala. I ran this package in local SBT and everything worked fine.
But now I am trying to do the connection in Google cloud dataproc and executed the command:
But after that when I am trying to run the following command at scala prompt:
val table = sqlContext.bigQueryTable("bigquery-public-data:samples.shakespeare")
It can't recognize 'sqlContext' command.
Am I missing something?
I am a newbie in Spark & Scala. I ran this package in local SBT and everything worked fine.
But now I am trying to do the connection in Google cloud dataproc and executed the command:
spark-shell --packages com.spotify:spark-bigquery_2.10:0.2.0
But after that when I am trying to run the following command at scala prompt:
val table = sqlContext.bigQueryTable("bigquery-public-data:samples.shakespeare")
It can't recognize 'sqlContext' command.
Am I missing something?