GitHub user ganonp opened a pull request:
https://github.com/apache/spark/pull/4120
[SPARK-5311][core] Corrected EventLoggingListener throws exception if log
directory does not exist
Corrected exception handling:
Now instead of blocking execution, when the baselogpath refers to a
nonexistant directory, one is created at the baselogpath location. As intended,
if the baselogpath is a file and not a directory, an exception is thrown.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/ganonp/spark apache-master
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/4120.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #4120
----
commit 1867869f5dbc19584e9f2827c440bd0134ab84e9
Author: ganonp <[email protected]>
Date: 2014-12-14T23:05:01Z
Added setMinCount method to Word2Vec
Converted minCount from val to var and created setMinCount method.
Allows one to set the minimum number of times a word must be present to
be included into the vocabulary.
commit 3060b24c682e9230da7aa8e4612fe33204309fc6
Author: ganonp <[email protected]>
Date: 2015-01-19T07:14:58Z
Revert "Added setMinCount method to Word2Vec"
This reverts commit 1867869f5dbc19584e9f2827c440bd0134ab84e9.
commit be3cd809c9e371d7f5d13191457e1f0cc1ad075e
Author: ganonp <[email protected]>
Date: 2015-01-19T07:15:42Z
update
commit f06caccb71ed73d8e5b9d8e1d9f7218845bf1fbf
Author: ganonp <[email protected]>
Date: 2015-01-19T07:15:54Z
Merge branch 'master' of https://github.com/apache/spark into apache-master
commit f5774d27cfb3388b6c9f4f3ae673df90f7e84a0b
Author: Ganon <[email protected]>
Date: 2015-01-20T09:15:46Z
Corrects Issue SPARK-5311
Issue Description: EventLoggingListener throws exception if log directory
does not exist
Replaced with code that uses a try catch with getFileStatus method to first
determine if the file exists (if it doesn't it is created in the catch block),
if it does exist, then an exception is thrown if the file is not a directory.
commit 13391307406224898d6abbff47aa3eaa9069208f
Author: Ganon <[email protected]>
Date: 2015-01-20T09:57:22Z
Update EventLoggingListener.scala
commit 7b106e2312c7a1a06bd9c77de701e23c82cb5221
Author: Ganon <[email protected]>
Date: 2015-01-20T10:16:20Z
Update EventLoggingListener.scala
commit 3df637b551be58ed94f92e11a9735232ba95686c
Author: Ganon <[email protected]>
Date: 2015-01-20T10:31:56Z
Update EventLoggingListener.scala
commit 4d3b84b84fe53a84bafebd57c15c51434caa6fa7
Author: Ganon <[email protected]>
Date: 2015-01-20T10:48:34Z
Update EventLoggingListener.scala
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
