[GitHub] spark pull request: [SPARK-15472][SQL][Streaming] Add partitioned ...

2016-05-26 Thread lw-lin
Github user lw-lin commented on the pull request: https://github.com/apache/spark/pull/13258#issuecomment-222035774 @zsxwing sure let's add an abstract layer. I'll rebase and do this in the next two days or so. Thanks for the review! :-) --- If your project is set up for it, you can

[GitHub] spark pull request: [SPARK-15472][SQL][Streaming] Add partitioned ...

2016-05-25 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/13258#issuecomment-221702705 @lw-lin I'm wondering if you can add an abstract layer (e.g., AbstractOutputWriterFactory and AbstractOutputWriter) to eliminate the duplicated codes. There are a lot

[GitHub] spark pull request: [SPARK-15472][SQL][Streaming] Add partitioned ...

2016-05-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13258#issuecomment-221171715 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-15472][SQL][Streaming] Add partitioned ...

2016-05-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13258#issuecomment-221171716 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-15472][SQL][Streaming] Add partitioned ...

2016-05-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13258#issuecomment-221171564 **[Test build #59176 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59176/consoleFull)** for PR 13258 at commit

[GitHub] spark pull request: [SPARK-15472][SQL][Streaming] Add partitioned ...

2016-05-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13258#issuecomment-221148286 **[Test build #59176 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59176/consoleFull)** for PR 13258 at commit

[GitHub] spark pull request: [SPARK-15472][SQL][Streaming] Add partitioned ...

2016-05-23 Thread lw-lin
Github user lw-lin commented on the pull request: https://github.com/apache/spark/pull/13258#issuecomment-220917708 @marmbrus @tdas @zsxwing would you mind taking a look? Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: [SPARK-15472][SQL][Streaming] Add partitioned ...

2016-05-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13258#issuecomment-220906144 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-15472][SQL][Streaming] Add partitioned ...

2016-05-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13258#issuecomment-220906143 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-15472][SQL][Streaming] Add partitioned ...

2016-05-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13258#issuecomment-220905923 **[Test build #59123 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59123/consoleFull)** for PR 13258 at commit

[GitHub] spark pull request: [SPARK-15472][SQL][Streaming] Add partitioned ...

2016-05-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13258#issuecomment-220893879 **[Test build #59123 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59123/consoleFull)** for PR 13258 at commit

[GitHub] spark pull request: [SPARK-15472][SQL][Streaming] Add partitioned ...

2016-05-23 Thread lw-lin
GitHub user lw-lin opened a pull request: https://github.com/apache/spark/pull/13258 [SPARK-15472][SQL][Streaming] Add partitioned `csv`, `json`, `text` format support for FileStreamSink ## What changes were proposed in this pull request? This patch adds partitioned `csv`,