GitHub user zsxwing opened a pull request:
https://github.com/apache/spark/pull/6588
[SPARK-3586][streaming]Support nested directories in Spark Streaming
Closes #2765
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/zsxwing/spark pr2765
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/6588.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #6588
----
commit 4a7eef4ceb32c627644d367dcfbf52cb73899e9d
Author: wangxiaojing <[email protected]>
Date: 2014-10-11T08:22:31Z
Support nested directories in Spark Streaming
commit 50ad7d40a1317da9264c7c67e52328fdec63e52c
Author: wangxiaojing <[email protected]>
Date: 2014-10-12T05:27:22Z
change Nit
commit c14def13058d96ad2fcffd8e3039dd1c248a7612
Author: wangxiaojing <[email protected]>
Date: 2014-10-17T03:46:01Z
support depth
commit bfbec510d8963a2382ec29abc20b2b6208edce12
Author: wangxiaojing <[email protected]>
Date: 2014-10-17T06:22:12Z
Change space before brace
commit 0a8ecf8079560b5f581dda983e35a186db483f3a
Author: wangxiaojing <[email protected]>
Date: 2014-10-17T07:24:38Z
change process any files created in nested directories
commit 1ce623d37a7c23149d630687a9c015aa15152ff9
Author: wangxiaojing <[email protected]>
Date: 2014-10-24T07:12:17Z
reformat code
commit fe6e5ca2a61bc473cedcf1e0e982c05dce441d20
Author: wangxiaojing <[email protected]>
Date: 2014-10-24T07:54:09Z
add a require(depth >= 0)
commit 70319401d068b9b4c58cfca957e4612941be7300
Author: wangxiaojing <[email protected]>
Date: 2014-10-24T08:54:03Z
reformat code
commit 7bd4811358de035b75c61ae50f5cffbde8fa31a0
Author: wangxiaojing <[email protected]>
Date: 2014-10-28T02:52:01Z
change performance
commit 05b5fba4a8944c6942f01f36f3381c46d2d0a7f2
Author: wangxiaojing <[email protected]>
Date: 2014-10-28T08:48:37Z
change filter name
commit e66b16650d4f7fedea0a96b881b988f5564fc7bb
Author: wangxiaojing <[email protected]>
Date: 2014-11-03T09:55:46Z
change line exceeds 100 columns
commit a63c5a3fa63f68a8179c9f61ad6e75886597c8c8
Author: wangxiaojing <[email protected]>
Date: 2014-11-10T05:47:09Z
line over 100
commit 0b4812eef0ab065b7ef5a6b2e2a269baa6bfe542
Author: wangxiaojing <[email protected]>
Date: 2014-12-04T09:27:12Z
remove line
commit 8990c3576ae91bc822dece2d1ef8a63a0465d13e
Author: wangxiaojing <[email protected]>
Date: 2014-12-04T10:21:19Z
style
commit a20743f5946310f1babcd0815be0363ae4bd470a
Author: wangxiaojing <[email protected]>
Date: 2014-12-17T04:49:36Z
change get depth
commit d7f4880903f4b270bd1be2a5261fdc0b2403234b
Author: wangxiaojing <[email protected]>
Date: 2014-12-24T06:07:43Z
Use 'isDir' to modify the compatibility
commit 99b05d6c6851b9f7184139d5d8ed40b27c861971
Author: wangxiaojing <[email protected]>
Date: 2015-01-07T09:36:30Z
rebase
commit b6788a366e54575ce2fef7055fb3ffa093357fb9
Author: wangxiaojing <[email protected]>
Date: 2015-01-12T05:26:59Z
support java Api
commit d2f606c80ee77aaf29ad57ec765312f5700a990f
Author: wangxiaojing <[email protected]>
Date: 2015-01-12T11:18:02Z
Add support python api
commit 8e3a0544d93abe4c518ba1b05954688e5a41dfae
Author: wangxiaojing <[email protected]>
Date: 2015-01-13T03:20:07Z
Additional excludes for checking of Spark's binary compatibility
commit 571730ade679f07c1cc1e04ad8b6778d611e565f
Author: wangxiaojing <[email protected]>
Date: 2015-01-30T05:58:48Z
rebase
commit a4bfac244d637cf65a582c2ffc54b6daaa744dda
Author: wangxiaojing <[email protected]>
Date: 2015-02-27T09:02:01Z
rebase
commit 5e3fd3d79d85085ca3ac71a81b497391ee9a0e3e
Author: wangxiaojing <[email protected]>
Date: 2015-02-28T04:03:49Z
change API
commit e4b9c22f85aca7cc81b71646ffec77706cbcbe6e
Author: wangxiaojing <[email protected]>
Date: 2015-03-02T07:54:42Z
change MiMa failures
commit 1a2aae91bbf39e0d1546e2e135f6428946410420
Author: wangxiaojing <[email protected]>
Date: 2015-05-20T07:25:10Z
rebase
commit 0a916cc893f2a597850f80c7be75829bfb57a970
Author: zsxwing <[email protected]>
Date: 2015-06-02T12:33:04Z
Merge branch 'master' into pr2765
commit 26dce26d4bc513e6fefe28f767b4802b3b76e3b4
Author: zsxwing <[email protected]>
Date: 2015-06-02T12:47:00Z
Address comments
commit 2d85159fdd5c603edbe9938f2b12f7137d326c81
Author: zsxwing <[email protected]>
Date: 2015-06-02T14:01:04Z
Refactor PR and handle some corner cases
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
