[GitHub] spark issue #15806: [SPARK-18345][STRUCTURED STREAMING] Structured Streaming...

2016-11-10 Thread oza
Github user oza commented on the issue: https://github.com/apache/spark/pull/15806 This was my mistake of configuration. After clearing the configuration about Hadoop, it works well. Closing this as not a problem. Thanks all for helping me, reviewing patch! --- If your project is

[GitHub] spark issue #15806: [SPARK-18345][STRUCTURED STREAMING] Structured Streaming...

2016-11-10 Thread oza
Github user oza commented on the issue: https://github.com/apache/spark/pull/15806 I'm sorry, but I had a hadoop configuration on my local: I noticed it on PR about SPARK-18345. I will check whether it happens after clearing configuration. --- If your project is set up for it, you

[GitHub] spark issue #15806: [SPARK-18345][STRUCTURED STREAMING] Structured Streaming...

2016-11-10 Thread oza
Github user oza commented on the issue: https://github.com/apache/spark/pull/15806 Updating patch based on kiszk's comment: https://github.com/apache/spark/pull/15806#discussion_r87393524 --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark issue #15806: [SPARK-18345][STRUCTURED STREAMING] Structured Streaming...

2016-11-10 Thread oza
Github user oza commented on the issue: https://github.com/apache/spark/pull/15806 @brkyvz @srowen could you check the latest PR? I added prefix "file:///" before the result of Utils.createTempDir, since Utils.createTempDir only creates local directory via java.io.File. --- If your

[GitHub] spark issue #15806: [SPARK-18345][STRUCTURED STREAMING] Structured Streaming...

2016-11-09 Thread oza
Github user oza commented on the issue: https://github.com/apache/spark/pull/15806 @brkyvz thanks for explanation, I will fix the line to work it on local mode without any breakage. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #15806: [SPARK-18345][STRUCTURED STREAMING] Structured Streaming...

2016-11-08 Thread brkyvz
Github user brkyvz commented on the issue: https://github.com/apache/spark/pull/15806 I think the change you should make should be for: https://github.com/apache/spark/pull/15806/files#diff-7dc261474784c6402f7020ffe7f61038R212 where you always append `file:///` otherwise, it

[GitHub] spark issue #15806: [SPARK-18345][STRUCTURED STREAMING] Structured Streaming...

2016-11-08 Thread oza
Github user oza commented on the issue: https://github.com/apache/spark/pull/15806 Now I understanding the behaviour. Based on this, I would like to suggest to add an option to disable checkpoint for the testing or quick start example. What do you think? --- If your project is set

[GitHub] spark issue #15806: [SPARK-18345][STRUCTURED STREAMING] Structured Streaming...

2016-11-08 Thread oza
Github user oza commented on the issue: https://github.com/apache/spark/pull/15806 @brkyvz Thanks for taking a look. The problem I faced is: without HDFS configuration, the [quick example](https://spark.apache.org/docs/latest/structured-streaming-programming-guide.html#quick-example)

[GitHub] spark issue #15806: [SPARK-18345][STRUCTURED STREAMING] Structured Streaming...

2016-11-07 Thread brkyvz
Github user brkyvz commented on the issue: https://github.com/apache/spark/pull/15806 Hi @oza, thank you for this patch, however I'm not sure if this patch fixes anything. What was your problem, what didn't work for you? --- If your project is set up for it, you can reply to this

[GitHub] spark issue #15806: [SPARK-18345][STRUCTURED STREAMING] Structured Streaming...

2016-11-07 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15806 cc @brkyvz --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #15806: [SPARK-18345][STRUCTURED STREAMING] Structured Streaming...

2016-11-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15806 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this