Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Job in state DEFINE instead of RUNNING for scala wordcount example #320

Open
badgujarsupriya opened this issue Mar 25, 2019 · 0 comments
Open
Labels
api: bigtable Issues related to the GoogleCloudPlatform/cloud-bigtable-examples API. type: question Request for information or clarification. Not an issue.

Comments

@badgujarsupriya
Copy link

Hi,
I am trying your example from spark-shell of dataproc cluster:
https://github.com/GoogleCloudPlatform/cloud-bigtable-examples/blob/master/scala/spark-wordcount/src/main/scala/com/example/bigtable/spark/wordcount/WordCount.scala

Its giving me error at the line:
val job = new Job(conf)

Error:
java.lang.IllegalStateException: Job in state DEFINE instead of RUNNING

Solution i tried:
I changed above line as below:
val job = new org.apache.hadoop.mapreduce.Job(conf)

still it is giving me the same error.
When i searched on google for the same issue, some people are saying 'run it on spark-submit' instead of 'spark-shell'.
but i want to run on spark-shell only.
Please suggest me a solution for how can i achieve the same using spark-shell?

@product-auto-label product-auto-label bot added the api: bigtable Issues related to the GoogleCloudPlatform/cloud-bigtable-examples API. label Feb 3, 2021
@meredithslota meredithslota added the type: question Request for information or clarification. Not an issue. label Oct 13, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
api: bigtable Issues related to the GoogleCloudPlatform/cloud-bigtable-examples API. type: question Request for information or clarification. Not an issue.
Projects
None yet
Development

No branches or pull requests

2 participants