Jussi Jousimo created SPARK-18644:

             Summary: spark-submit fails to run python scripts with specific 
                 Key: SPARK-18644
                 URL: https://issues.apache.org/jira/browse/SPARK-18644
             Project: Spark
          Issue Type: Bug
          Components: PySpark, Spark Submit
    Affects Versions: 2.0.2
         Environment: Ubuntu 16.04
            Reporter: Jussi Jousimo
            Priority: Minor

I'm trying to run simple python script named tokenize.py with spark-submit. The 
script only imports SparkContext:
from pyspark import SparkContext

And I run it with:
spark-submit --packages org.apache.spark:spark-streaming-kafka-0-8_2.11:2.0.2 

However, the script fails:
ImportError: cannot import name SparkContext

I have set all necessary environment variables, etc. Strangely, it seems the 
filename is causing this error. If I rename the file to, e.g., tokenizer.py and 
run again, it runs fine.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to