Annamalai Venugopal created SPARK-22802: -------------------------------------------
Summary: Regarding max tax size Key: SPARK-22802 URL: https://issues.apache.org/jira/browse/SPARK-22802 Project: Spark Issue Type: Question Components: PySpark Affects Versions: 2.2.1 Environment: Windows,Pycharm Reporter: Annamalai Venugopal 17/12/15 17:15:55 WARN TaskSetManager: Stage 15 contains a task of very large size (895 KB). The maximum recommended task size is 100 KB. Traceback (most recent call last): File "C:\Users\avenugopal\AppData\Local\Programs\Python\Python36\lib\runpy.py", line 193, in _run_module_as_main "__main__", mod_spec) File "C:\Users\avenugopal\AppData\Local\Programs\Python\Python36\lib\runpy.py", line 85, in _run_code exec(code, run_globals) File "C:\Users\avenugopal\Downloads\spark-2.2.0-bin-hadoop2.7\python\lib\pyspark.zip\pyspark\worker.py", line 216, in <module> File "C:\Users\avenugopal\Downloads\spark-2.2.0-bin-hadoop2.7\python\lib\pyspark.zip\pyspark\worker.py", line 202, in main File "C:\Users\avenugopal\Downloads\spark-2.2.0-bin-hadoop2.7\python\lib\pyspark.zip\pyspark\serializers.py", line 577, in read_int EOFError -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org