Hi Matthias,
Thanks for your thorough explanations and suggestions! But I observed some
strange behaviors when reducing the driver size.
Say, I simply reduced the driver size to 10GB with anything else unchanged,
it worked fine for 20GB case, but errors occurred for 10GB case. Similar
behaviors h
1) It's hard to debug these cases remotely, but errors like "Size
exceeds Integer.MAX_VALUE" usually come from too large partitions that
exceed Spark's 2GB limitation. The logs would be helpful here,
especially the number of partitions of the second (i.e., post-shuffle)
stage of csvrblk.
2) I
Hi Krishna,
We are working on putting together some proposals. I created is for a GPU
based project.
https://issues.apache.org/jira/browse/SYSTEMML-1436
Be on the lookout for more.
Thanks,
Nakul
On Tue, Mar 21, 2017 at 10:01 AM, Krishna Kalyan
wrote:
> Hello Adina and Arvind thanks you for
