[GitHub] spark issue #15251: Fix two comments since Actor is not used anymore.

2016-09-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15251 **[Test build #3290 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3290/consoleFull)** for PR 15251 at commit

[GitHub] spark issue #15168: [SPARK-17612][SQL] Support `DESCRIBE table PARTITION` SQ...

2016-09-26 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15168 Hi, @hvanhovell . Could you review this PR again, please? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #15252: [SPARK-17677][SQL] Break WindowExec.scala into multiple ...

2016-09-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15252 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65945/ Test PASSed. ---

[GitHub] spark issue #15252: [SPARK-17677][SQL] Break WindowExec.scala into multiple ...

2016-09-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15252 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15252: [SPARK-17677][SQL] Break WindowExec.scala into multiple ...

2016-09-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15252 **[Test build #65945 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65945/consoleFull)** for PR 15252 at commit

[GitHub] spark issue #15242: [MINOR][PySpark][DOCS] Fix examples in PySpark documenta...

2016-09-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15242 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65947/ Test FAILed. ---

[GitHub] spark issue #15242: [MINOR][PySpark][DOCS] Fix examples in PySpark documenta...

2016-09-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15242 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15242: [MINOR][PySpark][DOCS] Fix examples in PySpark documenta...

2016-09-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15242 **[Test build #65947 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65947/consoleFull)** for PR 15242 at commit

[GitHub] spark issue #14897: [SPARK-17338][SQL] add global temp view

2016-09-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14897 **[Test build #65948 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65948/consoleFull)** for PR 14897 at commit

[GitHub] spark issue #15253: [SPARK-17678][REPL][Branch-1.6] Honor spark.replClassSer...

2016-09-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15253 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15253: [SPARK-17678][REPL][Branch-1.6] Honor spark.replClassSer...

2016-09-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15253 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65944/ Test PASSed. ---

[GitHub] spark issue #15253: [SPARK-17678][REPL][Branch-1.6] Honor spark.replClassSer...

2016-09-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15253 **[Test build #65944 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65944/consoleFull)** for PR 15253 at commit

[GitHub] spark pull request #15248: [SPARK-17671] Spark 2.0 history server summary pa...

2016-09-26 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15248#discussion_r80623063 --- Diff: core/src/main/scala/org/apache/spark/status/api/v1/ApplicationListResource.scala --- @@ -32,7 +32,14 @@ private[v1] class

[GitHub] spark pull request #15248: [SPARK-17671] Spark 2.0 history server summary pa...

2016-09-26 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15248#discussion_r80623021 --- Diff: core/src/main/scala/org/apache/spark/deploy/history/HistoryServer.scala --- @@ -178,6 +178,23 @@ class HistoryServer(

[GitHub] spark issue #15246: [MINOR][SQL] Use resource path for test_script.sh

2016-09-26 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15246 Hm, I see why this happens to work, because the file is not packaged inside a jar file. Normally that's what getResource is for, and if it were in a jar this wouldn't work. It's not a bad idea

[GitHub] spark issue #15252: [SPARK-17677][SQL] Break WindowExec.scala into multiple ...

2016-09-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15252 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65943/ Test PASSed. ---

[GitHub] spark issue #15252: [SPARK-17677][SQL] Break WindowExec.scala into multiple ...

2016-09-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15252 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15252: [SPARK-17677][SQL] Break WindowExec.scala into multiple ...

2016-09-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15252 **[Test build #65943 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65943/consoleFull)** for PR 15252 at commit

[GitHub] spark issue #15255: [SPARK-17680] [SQL] [TEST] Added a Testcase for Verifyin...

2016-09-26 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15255 ... Hit a bug in the write path... Need to fix it at first... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #15254: [SPARK-17679] [PYSPARK] remove unnecessary Py4J ListConv...

2016-09-26 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15254 cc @JoshRosen and @davies --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #15255: [SPARK-17680] [SQL] [TEST] Added a Testcase for Verifyin...

2016-09-26 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15255 Also need to add a test case for data source tables. Will do it later --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #15250: [SPARK-17676][CORE] FsHistoryProvider should ignore hidd...

2016-09-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15250 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65942/ Test PASSed. ---

[GitHub] spark issue #15250: [SPARK-17676][CORE] FsHistoryProvider should ignore hidd...

2016-09-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15250 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15250: [SPARK-17676][CORE] FsHistoryProvider should ignore hidd...

2016-09-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15250 **[Test build #65942 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65942/consoleFull)** for PR 15250 at commit

[GitHub] spark issue #15242: [MINOR][PySpark][DOCS] Fix examples in PySpark documenta...

2016-09-26 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15242 Let me update the PR description just in case. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #15242: [MINOR][PySpark][DOCS] Fix examples in PySpark documenta...

2016-09-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15242 **[Test build #65947 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65947/consoleFull)** for PR 15242 at commit

[GitHub] spark issue #15242: [MINOR][PySpark][DOCS] Fix examples in PySpark documenta...

2016-09-26 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15242 @srowen I just took a scan twice and I think they should be all. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #15254: [SPARK-17679] [PYSPARK] remove unnecessary Py4J ListConv...

2016-09-26 Thread lins05
Github user lins05 commented on the issue: https://github.com/apache/spark/pull/15254 I guess we can also remove another workaround [here](https://github.com/apache/spark/blob/v2.0.0/python/pyspark/rdd.py#L2320-L2328) ? --- If your project is set up for it, you can reply to this

[GitHub] spark issue #15255: [SPARK-17680] [SQL] [TEST] Added a Testcase for Verifyin...

2016-09-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15255 **[Test build #65946 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65946/consoleFull)** for PR 15255 at commit

[GitHub] spark pull request #15255: [SPARK-17680] [SQL] [TEST] Added a Testcase for V...

2016-09-26 Thread gatorsmile
GitHub user gatorsmile opened a pull request: https://github.com/apache/spark/pull/15255 [SPARK-17680] [SQL] [TEST] Added a Testcase for Verifying Unicode Character Support for Column Names and Comments ### What changes were proposed in this pull request? When the version of

[GitHub] spark issue #15090: [SPARK-17073] [SQL] generate column-level statistics

2016-09-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15090 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15090: [SPARK-17073] [SQL] generate column-level statistics

2016-09-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15090 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65941/ Test PASSed. ---

[GitHub] spark issue #15090: [SPARK-17073] [SQL] generate column-level statistics

2016-09-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15090 **[Test build #65941 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65941/consoleFull)** for PR 15090 at commit

[GitHub] spark issue #15254: [SPARK-17679] [PYSPARK] remove unnecessary Py4J ListConv...

2016-09-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15254 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #15254: [SPARK-17679] [PYSPARK] remove unnecessary Py4J ListConv...

2016-09-26 Thread JasonMWhite
Github user JasonMWhite commented on the issue: https://github.com/apache/spark/pull/15254 @davies you authored https://github.com/apache/spark/pull/5570 and reported the issue in Py4J https://github.com/bartdag/py4j/issues/160. I happened across this while spelunking through Py4J

[GitHub] spark pull request #15254: [SPARK-17679] [PYSPARK] remove unnecessary Py4J L...

2016-09-26 Thread JasonMWhite
GitHub user JasonMWhite opened a pull request: https://github.com/apache/spark/pull/15254 [SPARK-17679] [PYSPARK] remove unnecessary Py4J ListConverter patch ## What changes were proposed in this pull request? This PR removes a patch on ListConverter from

[GitHub] spark issue #15249: [SPARK-17675] [CORE] Expand Blacklist for TaskSets

2016-09-26 Thread kayousterhout
Github user kayousterhout commented on the issue: https://github.com/apache/spark/pull/15249 This is awesome to separate this out. I should have time to review this tomorrow and then hopefully we can (finally) merge this in the next few days! --- If your project is set up for it,

[GitHub] spark issue #15213: [SPARK-17644] [CORE] Do not add failedStages when abortS...

2016-09-26 Thread markhamstra
Github user markhamstra commented on the issue: https://github.com/apache/spark/pull/15213 @scwf I understand that you were trying to make the least invasive fix possible to deal with the problem. That's usually a good thing to do, but even when that kind of fix is getting to the

[GitHub] spark issue #13998: [SPARK-12177][Streaming][Kafka] limit api surface area

2016-09-26 Thread koeninger
Github user koeninger commented on the issue: https://github.com/apache/spark/pull/13998 I ran that test 100 times locally w/out error... you have any suggestions on repro? On Mon, Sep 26, 2016 at 6:40 PM, Cody Koeninger wrote: > Sure I'll

[GitHub] spark issue #14079: [SPARK-8425][CORE] New Blacklist Mechanism

2016-09-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14079 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14079: [SPARK-8425][CORE] New Blacklist Mechanism

2016-09-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14079 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65939/ Test PASSed. ---

[GitHub] spark issue #14079: [SPARK-8425][CORE] New Blacklist Mechanism

2016-09-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14079 **[Test build #65939 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65939/consoleFull)** for PR 14079 at commit

[GitHub] spark issue #15249: [SPARK-17675] [CORE] Expand Blacklist for TaskSets

2016-09-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15249 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65938/ Test PASSed. ---

[GitHub] spark issue #15249: [SPARK-17675] [CORE] Expand Blacklist for TaskSets

2016-09-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15249 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15249: [SPARK-17675] [CORE] Expand Blacklist for TaskSets

2016-09-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15249 **[Test build #65938 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65938/consoleFull)** for PR 15249 at commit

[GitHub] spark pull request #15102: [SPARK-17346][SQL] Add Kafka source for Structure...

2016-09-26 Thread koeninger
Github user koeninger commented on a diff in the pull request: https://github.com/apache/spark/pull/15102#discussion_r80617904 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSource.scala --- @@ -0,0 +1,344 @@ +/* + * Licensed to the

[GitHub] spark pull request #12618: [SPARK-14857] [SQL] Table/Database Name Validatio...

2016-09-26 Thread gatorsmile
Github user gatorsmile closed the pull request at: https://github.com/apache/spark/pull/12618 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark issue #12618: [SPARK-14857] [SQL] Table/Database Name Validation in Se...

2016-09-26 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/12618 The changes in this PR becomes completely out-of-dated. Will resubmit a new PR for it. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #15102: [SPARK-17346][SQL] Add Kafka source for Structured Strea...

2016-09-26 Thread koeninger
Github user koeninger commented on the issue: https://github.com/apache/spark/pull/15102 Ok, finished a line-by-line compare + comment. The biggest thing I'm having trouble reconciling is the stated emphasis on limiting user options in order to give guarantees, yet throwing

[GitHub] spark pull request #15102: [SPARK-17346][SQL] Add Kafka source for Structure...

2016-09-26 Thread koeninger
Github user koeninger commented on a diff in the pull request: https://github.com/apache/spark/pull/15102#discussion_r80617145 --- Diff: external/kafka-0-10-sql/pom.xml --- @@ -0,0 +1,82 @@ + + + +http://maven.apache.org/POM/4.0.0;

[GitHub] spark issue #15221: [SPARK-17648][CORE] TaskScheduler really needs offers to...

2016-09-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15221 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15221: [SPARK-17648][CORE] TaskScheduler really needs offers to...

2016-09-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15221 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65940/ Test FAILed. ---

[GitHub] spark issue #15221: [SPARK-17648][CORE] TaskScheduler really needs offers to...

2016-09-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15221 **[Test build #65940 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65940/consoleFull)** for PR 15221 at commit

[GitHub] spark pull request #15102: [SPARK-17346][SQL] Add Kafka source for Structure...

2016-09-26 Thread koeninger
Github user koeninger commented on a diff in the pull request: https://github.com/apache/spark/pull/15102#discussion_r80617036 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSourceRDD.scala --- @@ -0,0 +1,163 @@ +/* + * Licensed to the

[GitHub] spark pull request #15102: [SPARK-17346][SQL] Add Kafka source for Structure...

2016-09-26 Thread koeninger
Github user koeninger commented on a diff in the pull request: https://github.com/apache/spark/pull/15102#discussion_r80616878 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSourceRDD.scala --- @@ -0,0 +1,163 @@ +/* + * Licensed to the

[GitHub] spark issue #15252: [SPARK-17677][SQL] Break WindowExec.scala into multiple ...

2016-09-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15252 **[Test build #65945 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65945/consoleFull)** for PR 15252 at commit

[GitHub] spark issue #15213: [SPARK-17644] [CORE] Do not add failedStages when abortS...

2016-09-26 Thread scwf
Github user scwf commented on the issue: https://github.com/apache/spark/pull/15213 @markhamstra in my fix i just want to make the minor changes for the dagscheduer, and your fix is also ok to me, i can update this according your comment. Thanks:) /cc @zsxwing may also have

[GitHub] spark issue #15253: [SPARK-17678][REPL][Branch-1.6] Honor spark.replClassSer...

2016-09-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15253 **[Test build #65944 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65944/consoleFull)** for PR 15253 at commit

[GitHub] spark pull request #15253: [SPARK-17678][REPL][Branch-1.6] Honor spark.replC...

2016-09-26 Thread jerryshao
GitHub user jerryshao opened a pull request: https://github.com/apache/spark/pull/15253 [SPARK-17678][REPL][Branch-1.6] Honor spark.replClassServer.port in scala-2.11 repl ## What changes were proposed in this pull request? Spark 1.6 Scala-2.11 repl doesn't honor

[GitHub] spark pull request #15102: [SPARK-17346][SQL] Add Kafka source for Structure...

2016-09-26 Thread koeninger
Github user koeninger commented on a diff in the pull request: https://github.com/apache/spark/pull/15102#discussion_r80616386 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSourceRDD.scala --- @@ -0,0 +1,163 @@ +/* + * Licensed to the

[GitHub] spark pull request #15102: [SPARK-17346][SQL] Add Kafka source for Structure...

2016-09-26 Thread koeninger
Github user koeninger commented on a diff in the pull request: https://github.com/apache/spark/pull/15102#discussion_r80616098 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSourceRDD.scala --- @@ -0,0 +1,163 @@ +/* + * Licensed to the

[GitHub] spark pull request #15172: [SPARK-13331] AES support for over-the-wire encry...

2016-09-26 Thread cjjnjust
Github user cjjnjust commented on a diff in the pull request: https://github.com/apache/spark/pull/15172#discussion_r80615974 --- Diff: common/network-common/src/main/java/org/apache/spark/network/sasl/aes/SparkAesCipher.java --- @@ -0,0 +1,270 @@ +/* + * Licensed to the

[GitHub] spark issue #15251: Fix two comments since Actor is not used anymore.

2016-09-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15251 **[Test build #3290 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3290/consoleFull)** for PR 15251 at commit

[GitHub] spark issue #15251: Fix two comments since Actor is not used anymore.

2016-09-26 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15251 Jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #15102: [SPARK-17346][SQL] Add Kafka source for Structure...

2016-09-26 Thread koeninger
Github user koeninger commented on a diff in the pull request: https://github.com/apache/spark/pull/15102#discussion_r80615842 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSourceProvider.scala --- @@ -0,0 +1,263 @@ +/* + * Licensed

[GitHub] spark issue #15252: [SPARK-17677][SQL] Break WindowExec.scala into multiple ...

2016-09-26 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15252 cc @hvanhovell for review. This is mostly simple copy/paste. I did look over the warnings in IntelliJ and spacing issues. Also @yhuai and @hvanhovell - I noticed there was virtually 0 unit

[GitHub] spark issue #15252: [SPARK-17677][SQL] Break WindowExec.scala into multiple ...

2016-09-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15252 **[Test build #65943 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65943/consoleFull)** for PR 15252 at commit

[GitHub] spark pull request #15252: [SPARK-17677][SQL] Break WindowExec.scala into mu...

2016-09-26 Thread rxin
GitHub user rxin opened a pull request: https://github.com/apache/spark/pull/15252 [SPARK-17677][SQL] Break WindowExec.scala into multiple files ## What changes were proposed in this pull request? As of Spark 2.0, all the window function execution code are in WindowExec.scala.

[GitHub] spark pull request #15102: [SPARK-17346][SQL] Add Kafka source for Structure...

2016-09-26 Thread koeninger
Github user koeninger commented on a diff in the pull request: https://github.com/apache/spark/pull/15102#discussion_r80615307 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSourceProvider.scala --- @@ -0,0 +1,263 @@ +/* + * Licensed

[GitHub] spark pull request #15090: [SPARK-17073] [SQL] generate column-level statist...

2016-09-26 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/15090#discussion_r80615261 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/AnalyzeColumnCommand.scala --- @@ -0,0 +1,179 @@ +/* + * Licensed to

[GitHub] spark pull request #15102: [SPARK-17346][SQL] Add Kafka source for Structure...

2016-09-26 Thread koeninger
Github user koeninger commented on a diff in the pull request: https://github.com/apache/spark/pull/15102#discussion_r80614899 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSourceProvider.scala --- @@ -0,0 +1,263 @@ +/* + * Licensed

[GitHub] spark pull request #15102: [SPARK-17346][SQL] Add Kafka source for Structure...

2016-09-26 Thread koeninger
Github user koeninger commented on a diff in the pull request: https://github.com/apache/spark/pull/15102#discussion_r80614481 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSourceProvider.scala --- @@ -0,0 +1,263 @@ +/* + * Licensed

[GitHub] spark issue #15251: Comment fixing

2016-09-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15251 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #15243: Fixing comment since Actor is not used anymore.

2016-09-26 Thread danix800
Github user danix800 commented on the issue: https://github.com/apache/spark/pull/15243 Hi, @dongjoon-hyun . Fixed! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #15243: Fixing comment since Actor is not used anymore.

2016-09-26 Thread danix800
Github user danix800 commented on a diff in the pull request: https://github.com/apache/spark/pull/15243#discussion_r80614009 --- Diff: core/src/main/scala/org/apache/spark/deploy/worker/WorkerWatcher.scala --- @@ -21,7 +21,7 @@ import org.apache.spark.internal.Logging import

[GitHub] spark pull request #15251: Comment fixing

2016-09-26 Thread danix800
GitHub user danix800 opened a pull request: https://github.com/apache/spark/pull/15251 Comment fixing ## What changes were proposed in this pull request? Fix two comments since Actor is not used anymore. You can merge this pull request into a Git repository by running:

[GitHub] spark issue #15250: [SPARK-17676][CORE] FsHistoryProvider should ignore hidd...

2016-09-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15250 **[Test build #65942 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65942/consoleFull)** for PR 15250 at commit

[GitHub] spark pull request #15250: [SPARK-17676][CORE] FsHistoryProvider should igno...

2016-09-26 Thread squito
GitHub user squito opened a pull request: https://github.com/apache/spark/pull/15250 [SPARK-17676][CORE] FsHistoryProvider should ignore hidden files ## What changes were proposed in this pull request? FsHistoryProvider was writing a hidden file (to check the fs's clock).

[GitHub] spark pull request #15102: [SPARK-17346][SQL] Add Kafka source for Structure...

2016-09-26 Thread koeninger
Github user koeninger commented on a diff in the pull request: https://github.com/apache/spark/pull/15102#discussion_r80613358 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSourceProvider.scala --- @@ -0,0 +1,263 @@ +/* + * Licensed

[GitHub] spark pull request #15102: [SPARK-17346][SQL] Add Kafka source for Structure...

2016-09-26 Thread koeninger
Github user koeninger commented on a diff in the pull request: https://github.com/apache/spark/pull/15102#discussion_r80613155 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSourceProvider.scala --- @@ -0,0 +1,263 @@ +/* + * Licensed

[GitHub] spark pull request #15102: [SPARK-17346][SQL] Add Kafka source for Structure...

2016-09-26 Thread koeninger
Github user koeninger commented on a diff in the pull request: https://github.com/apache/spark/pull/15102#discussion_r80612809 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSource.scala --- @@ -0,0 +1,344 @@ +/* + * Licensed to the

[GitHub] spark pull request #15102: [SPARK-17346][SQL] Add Kafka source for Structure...

2016-09-26 Thread koeninger
Github user koeninger commented on a diff in the pull request: https://github.com/apache/spark/pull/15102#discussion_r80612619 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSource.scala --- @@ -0,0 +1,366 @@ +/* + * Licensed to the

[GitHub] spark issue #15090: [SPARK-17073] [SQL] generate column-level statistics

2016-09-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15090 **[Test build #65941 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65941/consoleFull)** for PR 15090 at commit

[GitHub] spark pull request #15102: [SPARK-17346][SQL] Add Kafka source for Structure...

2016-09-26 Thread koeninger
Github user koeninger commented on a diff in the pull request: https://github.com/apache/spark/pull/15102#discussion_r80612293 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSource.scala --- @@ -0,0 +1,366 @@ +/* + * Licensed to the

[GitHub] spark pull request #15102: [SPARK-17346][SQL] Add Kafka source for Structure...

2016-09-26 Thread koeninger
Github user koeninger commented on a diff in the pull request: https://github.com/apache/spark/pull/15102#discussion_r80611556 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSource.scala --- @@ -0,0 +1,366 @@ +/* + * Licensed to the

[GitHub] spark pull request #15102: [SPARK-17346][SQL] Add Kafka source for Structure...

2016-09-26 Thread koeninger
Github user koeninger commented on a diff in the pull request: https://github.com/apache/spark/pull/15102#discussion_r80611465 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSource.scala --- @@ -0,0 +1,366 @@ +/* + * Licensed to the

[GitHub] spark issue #15249: [SPARK-17675] [CORE] Expand Blacklist for TaskSets

2016-09-26 Thread djvulee
Github user djvulee commented on the issue: https://github.com/apache/spark/pull/15249 I would say this is a very important PR. As our experience, sometimes we just need to skip some nodes for the bad disks,the exist blacklist mechanism effects little. --- If your project is set

[GitHub] spark issue #15221: [SPARK-17648][CORE] TaskScheduler really needs offers to...

2016-09-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15221 **[Test build #65940 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65940/consoleFull)** for PR 15221 at commit

[GitHub] spark pull request #15102: [SPARK-17346][SQL] Add Kafka source for Structure...

2016-09-26 Thread koeninger
Github user koeninger commented on a diff in the pull request: https://github.com/apache/spark/pull/15102#discussion_r80610814 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSource.scala --- @@ -0,0 +1,366 @@ +/* + * Licensed to the

[GitHub] spark pull request #15102: [SPARK-17346][SQL] Add Kafka source for Structure...

2016-09-26 Thread koeninger
Github user koeninger commented on a diff in the pull request: https://github.com/apache/spark/pull/15102#discussion_r80610748 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSource.scala --- @@ -0,0 +1,366 @@ +/* + * Licensed to the

[GitHub] spark pull request #15102: [SPARK-17346][SQL] Add Kafka source for Structure...

2016-09-26 Thread koeninger
Github user koeninger commented on a diff in the pull request: https://github.com/apache/spark/pull/15102#discussion_r80610562 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSource.scala --- @@ -0,0 +1,366 @@ +/* + * Licensed to the

[GitHub] spark issue #15102: [SPARK-17346][SQL] Add Kafka source for Structured Strea...

2016-09-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15102 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65937/ Test FAILed. ---

[GitHub] spark issue #15102: [SPARK-17346][SQL] Add Kafka source for Structured Strea...

2016-09-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15102 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15102: [SPARK-17346][SQL] Add Kafka source for Structured Strea...

2016-09-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15102 **[Test build #65937 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65937/consoleFull)** for PR 15102 at commit

[GitHub] spark pull request #15102: [SPARK-17346][SQL] Add Kafka source for Structure...

2016-09-26 Thread koeninger
Github user koeninger commented on a diff in the pull request: https://github.com/apache/spark/pull/15102#discussion_r80610210 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSource.scala --- @@ -0,0 +1,366 @@ +/* + * Licensed to the

[GitHub] spark issue #14079: [SPARK-8425][CORE] New Blacklist Mechanism

2016-09-26 Thread squito
Github user squito commented on the issue: https://github.com/apache/spark/pull/14079 for anyone else who might be watching, I've carved out part of this change here: https://github.com/apache/spark/pull/15249 --- If your project is set up for it, you can reply to this email and

[GitHub] spark pull request #15102: [SPARK-17346][SQL] Add Kafka source for Structure...

2016-09-26 Thread koeninger
Github user koeninger commented on a diff in the pull request: https://github.com/apache/spark/pull/15102#discussion_r80609930 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSource.scala --- @@ -0,0 +1,366 @@ +/* + * Licensed to the

[GitHub] spark issue #15249: [SPARK-17675] [CORE] Expand Blacklist for TaskSets

2016-09-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15249 **[Test build #65938 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65938/consoleFull)** for PR 15249 at commit

[GitHub] spark issue #14079: [SPARK-8425][CORE] New Blacklist Mechanism

2016-09-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14079 **[Test build #65939 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65939/consoleFull)** for PR 14079 at commit

[GitHub] spark issue #15249: [SPARK-17675] [CORE] Expand Blacklist for TaskSets

2016-09-26 Thread squito
Github user squito commented on the issue: https://github.com/apache/spark/pull/15249 @kayousterhout after your suggestion to pull out a helper for blacklisting with a TAskSet, I thought it might make sense to actually pull out everythign related to TaskSets, so that we can make

  1   2   3   4   5   6   >