Annamalai Venugopal created SPARK-22802:
-------------------------------------------
Summary: Regarding max tax size
Key: SPARK-22802
URL: https://issues.apache.org/jira/browse/SPARK-22802
Project: Spark
Issue Type: Question
Components: PySpark
Affects Versions: 2.2.1
Environment: Windows,Pycharm
Reporter: Annamalai Venugopal
17/12/15 17:15:55 WARN TaskSetManager: Stage 15 contains a task of very large
size (895 KB). The maximum recommended task size is 100 KB.
Traceback (most recent call last):
File
"C:\Users\avenugopal\AppData\Local\Programs\Python\Python36\lib\runpy.py", line
193, in _run_module_as_main
"__main__", mod_spec)
File
"C:\Users\avenugopal\AppData\Local\Programs\Python\Python36\lib\runpy.py", line
85, in _run_code
exec(code, run_globals)
File
"C:\Users\avenugopal\Downloads\spark-2.2.0-bin-hadoop2.7\python\lib\pyspark.zip\pyspark\worker.py",
line 216, in <module>
File
"C:\Users\avenugopal\Downloads\spark-2.2.0-bin-hadoop2.7\python\lib\pyspark.zip\pyspark\worker.py",
line 202, in main
File
"C:\Users\avenugopal\Downloads\spark-2.2.0-bin-hadoop2.7\python\lib\pyspark.zip\pyspark\serializers.py",
line 577, in read_int
EOFError
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
