[GitHub] spark issue #10212: [SPARK-12221] add cpu time to metrics

2016-09-23 Thread jisookim0513
Github user jisookim0513 commented on the issue: https://github.com/apache/spark/pull/10212 @vanzin thanks a lot! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #15224: [SPARK-17650] malformed url's throw exceptions before br...

2016-09-23 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15224 Should we check more in addition to just mailformed urls? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #15222: [SPARK-15703][SCHEDULER][CORE][WEBUI] Make ListenerBus e...

2016-09-23 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/15222 Thanks! Merging to 2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #10212: [SPARK-12221] add cpu time to metrics

2016-09-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/10212 **[Test build #65834 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65834/consoleFull)** for PR 10212 at commit

[GitHub] spark issue #10212: [SPARK-12221] add cpu time to metrics

2016-09-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/10212 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #10212: [SPARK-12221] add cpu time to metrics

2016-09-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/10212 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65834/ Test PASSed. ---

[GitHub] spark issue #15196: [SPARK-17614] [SQL] sparkSession.read() .jdbc(***) use t...

2016-09-23 Thread sureshthalamati
Github user sureshthalamati commented on the issue: https://github.com/apache/spark/pull/15196 Just curious , Is overwrite of getSchemaQuery() for Posgres, and MySQL dialects required ? I thought default query works fine for My SQL, and Postgres also. --- If your project is

[GitHub] spark pull request #14659: [SPARK-16757] Set up Spark caller context to HDFS...

2016-09-23 Thread Sherry302
Github user Sherry302 commented on a diff in the pull request: https://github.com/apache/spark/pull/14659#discussion_r80323261 --- Diff: core/src/main/scala/org/apache/spark/scheduler/Task.scala --- @@ -54,7 +54,10 @@ private[spark] abstract class Task[T]( val partitionId:

[GitHub] spark issue #15220: [SPARK-17649][Core]Log how many Spark events got dropped...

2016-09-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15220 **[Test build #65836 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65836/consoleFull)** for PR 15220 at commit

[GitHub] spark issue #15223: [SPARKR][SPARK-17651] Set R package version number along...

2016-09-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15223 **[Test build #65849 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65849/consoleFull)** for PR 15223 at commit

[GitHub] spark issue #15222: [SPARK-15703][SCHEDULER][CORE][WEBUI] Make ListenerBus e...

2016-09-23 Thread yhuai
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/15222 lgtm --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #15222: [SPARK-15703][SCHEDULER][CORE][WEBUI] Make ListenerBus e...

2016-09-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15222 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #12601: [SPARK-14525][SQL] Make DataFrameWrite.save work for jdb...

2016-09-23 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/12601 @JustinPihony The document changes in Scala, JAVA and Python look good to me, but could you please also add the examples for both SQL and R? - The R API example for `write.jdbc` can be

[GitHub] spark issue #15223: [SPARKR][SPARK-17651] Set R package version number along...

2016-09-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15223 **[Test build #65844 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65844/consoleFull)** for PR 15223 at commit

[GitHub] spark issue #14808: [SPARK-17156][ML][EXAMPLE] Add multiclass logistic regre...

2016-09-23 Thread sethah
Github user sethah commented on the issue: https://github.com/apache/spark/pull/14808 I think we should close this. The new example and the user guide should be updated against [SPARK-17239](https://issues.apache.org/jira/browse/SPARK-17239). @jaceklaskowski If you'd still like to

[GitHub] spark issue #15224: [SPARK-17650] malformed url's throw exceptions before br...

2016-09-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15224 **[Test build #65854 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65854/consoleFull)** for PR 15224 at commit

[GitHub] spark issue #15220: [SPARK-17649][Core]Log how many Spark events got dropped...

2016-09-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15220 **[Test build #65847 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65847/consoleFull)** for PR 15220 at commit

[GitHub] spark issue #15220: [SPARK-17649][Core]Log how many Spark events got dropped...

2016-09-23 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/15220 Thanks! Merging to master / 2.0. I will submit a patch for 1.6. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark issue #15213: [SPARK-17644] [CORE] Do not add failedStages when abortS...

2016-09-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15213 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65853/ Test PASSed. ---

[GitHub] spark issue #15213: [SPARK-17644] [CORE] Do not add failedStages when abortS...

2016-09-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15213 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15213: [SPARK-17644] [CORE] Do not add failedStages when abortS...

2016-09-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15213 **[Test build #65853 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65853/consoleFull)** for PR 15213 at commit

[GitHub] spark issue #15218: [SPARK-17637][Scheduler]Packed scheduling for Spark task...

2016-09-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15218 **[Test build #65856 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65856/consoleFull)** for PR 15218 at commit

[GitHub] spark issue #15218: [SPARK-17637][Scheduler]Packed scheduling for Spark task...

2016-09-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15218 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15218: [SPARK-17637][Scheduler]Packed scheduling for Spark task...

2016-09-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15218 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65856/ Test PASSed. ---

[GitHub] spark pull request #15220: [SPARK-17649][Core]Log how many Spark events got ...

2016-09-23 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/15220#discussion_r80323077 --- Diff: core/src/main/scala/org/apache/spark/scheduler/LiveListenerBus.scala --- @@ -123,6 +129,23 @@ private[spark] class LiveListenerBus(val

[GitHub] spark issue #15223: [SPARKR] Set R package version number along with mvn

2016-09-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15223 **[Test build #65844 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65844/consoleFull)** for PR 15223 at commit

[GitHub] spark issue #15220: [SPARK-17649][Core]Log how many Spark events got dropped...

2016-09-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15220 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65836/ Test PASSed. ---

[GitHub] spark issue #15220: [SPARK-17649][Core]Log how many Spark events got dropped...

2016-09-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15220 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15224: [SPARK-17650] malformed url's throw exceptions before br...

2016-09-23 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15224 cc @zsxwing for review ... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #15089: [SPARK-15621] [SQL] Support spilling for Python UDF

2016-09-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15089 **[Test build #65850 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65850/consoleFull)** for PR 15089 at commit

[GitHub] spark pull request #15223: [SPARKR][SPARK-17651] Set R package version numbe...

2016-09-23 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15223 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15225: [SPARK-17652] Fix confusing exception message while rese...

2016-09-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15225 **[Test build #65852 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65852/consoleFull)** for PR 15225 at commit

[GitHub] spark issue #15190: [SPARK-17620][SQL] Determine Serde by hive.default.filef...

2016-09-23 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15190 @dilipbiswal Great! Thank you! LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #15224: [SPARK-17650] malformed url's throw exceptions before br...

2016-09-23 Thread brkyvz
Github user brkyvz commented on the issue: https://github.com/apache/spark/pull/15224 @zsxwing Thanks for the review. Addressed the nit. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #15213: [SPARK-17644] [CORE] Fix the race condition when DAGSche...

2016-09-23 Thread markhamstra
Github user markhamstra commented on the issue: https://github.com/apache/spark/pull/15213 This doesn't make sense to me. The DAGSchedulerEventProcessLoop runs on a single thread and processes a single event from its queue at a time. When the first CompletionEvent is run as

[GitHub] spark issue #15089: [SPARK-15621] [SQL] Support spilling for Python UDF

2016-09-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15089 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65848/ Test PASSed. ---

[GitHub] spark issue #15213: [SPARK-17644] [CORE] Fix the race condition when DAGSche...

2016-09-23 Thread markhamstra
Github user markhamstra commented on the issue: https://github.com/apache/spark/pull/15213 Ok, that makes better sense. The `disallowStageRetryForTest` case doesn't worry me too much since it is only used in tests. If we can fix this case, great; else if it remains possible

[GitHub] spark issue #15213: [SPARK-17644] [CORE] Fix the race condition when DAGSche...

2016-09-23 Thread scwf
Github user scwf commented on the issue: https://github.com/apache/spark/pull/15213 Thanks @zsxwing to explain this. @markhamstra the issue happens in the case of my PR description. It usually depends on muti-thread submitting jobs cases and the order of fetch failure, so i said

[GitHub] spark issue #15213: [SPARK-17644] [CORE] Fix the race condition when DAGSche...

2016-09-23 Thread markhamstra
Github user markhamstra commented on the issue: https://github.com/apache/spark/pull/15213 Right, but `abortStage` occurs elsewhere. "When abort stage" seems to imply that this fix is necessary for all usages of `abortStage` when the actual problem is not in `abortStage` but rather

[GitHub] spark issue #15218: [SPARK-17637][Scheduler]Packed scheduling for Spark task...

2016-09-23 Thread zhzhan
Github user zhzhan commented on the issue: https://github.com/apache/spark/pull/15218 @gatorsmile Thanks. #65832 is the latest one which does not have the same failure. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request #15226: [SPARK-17649][CORE] Log how many Spark events got...

2016-09-23 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/15226#discussion_r80347195 --- Diff: core/src/main/scala/org/apache/spark/util/AsynchronousListenerBus.scala --- @@ -117,6 +124,24 @@ private[spark] abstract class

[GitHub] spark issue #15220: [SPARK-17649][Core]Log how many Spark events got dropped...

2016-09-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15220 **[Test build #65851 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65851/consoleFull)** for PR 15220 at commit

[GitHub] spark issue #15220: [SPARK-17649][Core]Log how many Spark events got dropped...

2016-09-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15220 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65851/ Test PASSed. ---

[GitHub] spark pull request #12601: [SPARK-14525][SQL] Make DataFrameWrite.save work ...

2016-09-23 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/12601#discussion_r80350919 --- Diff: examples/src/main/java/org/apache/spark/examples/sql/JavaSQLDataSourceExample.java --- @@ -23,6 +23,8 @@ import java.util.List; //

[GitHub] spark pull request #15227: [SPARK-17655][SQL]Remove unused variables declara...

2016-09-23 Thread yaooqinn
GitHub user yaooqinn opened a pull request: https://github.com/apache/spark/pull/15227 [SPARK-17655][SQL]Remove unused variables declarations and definations in a WholeStageCodeGened stage ## What changes were proposed in this pull request? A WholeStageCodeGened stage with

[GitHub] spark pull request #15228: [SPARK-17654] [SQL] Propagate bucketing informati...

2016-09-23 Thread tejasapatil
GitHub user tejasapatil opened a pull request: https://github.com/apache/spark/pull/15228 [SPARK-17654] [SQL] Propagate bucketing information for Hive tables to / from Catalog ## What changes were proposed in this pull request? Currently Spark does not respect bucketing

[GitHub] spark issue #10212: [SPARK-12221] add cpu time to metrics

2016-09-23 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/10212 Merging to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #15223: Set R package version number along with mvn

2016-09-23 Thread shivaram
Github user shivaram commented on the issue: https://github.com/apache/spark/pull/15223 cc @rxin --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #15224: [SPARK-17650] malformed url's throw exceptions before br...

2016-09-23 Thread brkyvz
Github user brkyvz commented on the issue: https://github.com/apache/spark/pull/15224 cc @rxin --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #15219: [WIP][SPARK-14098][SQL] Generate Java code to build Cach...

2016-09-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15219 **[Test build #65838 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65838/consoleFull)** for PR 15219 at commit

[GitHub] spark issue #15219: [WIP][SPARK-14098][SQL] Generate Java code to build Cach...

2016-09-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15219 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15220: [SPARK-17649][Core]Log how many Spark events got dropped...

2016-09-23 Thread yhuai
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/15220 LGTM. Just left one comment to make the comment a little bit more clear. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #15222: [SPARK-15703][SCHEDULER][CORE][WEBUI] Make ListenerBus e...

2016-09-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15222 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65840/ Test PASSed. ---

[GitHub] spark pull request #15222: [SPARK-15703][SCHEDULER][CORE][WEBUI] Make Listen...

2016-09-23 Thread zsxwing
Github user zsxwing closed the pull request at: https://github.com/apache/spark/pull/15222 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #15225: [SPARK-17652] Fix confusing exception message whi...

2016-09-23 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/15225#discussion_r80337683 --- Diff: sql/core/src/main/java/org/apache/spark/sql/execution/vectorized/ColumnVector.java --- @@ -285,19 +285,19 @@ public void reserve(int

[GitHub] spark issue #15225: [SPARK-17652] Fix confusing exception message while rese...

2016-09-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15225 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65852/ Test FAILed. ---

[GitHub] spark pull request #15224: [SPARK-17650] malformed url's throw exceptions be...

2016-09-23 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/15224#discussion_r80337786 --- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala --- @@ -698,6 +698,28 @@ private[spark] object Utils extends Logging { }

[GitHub] spark issue #15220: [SPARK-17649][Core]Log how many Spark events got dropped...

2016-09-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15220 **[Test build #65843 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65843/consoleFull)** for PR 15220 at commit

[GitHub] spark issue #15220: [SPARK-17649][Core]Log how many Spark events got dropped...

2016-09-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15220 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15220: [SPARK-17649][Core]Log how many Spark events got dropped...

2016-09-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15220 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65843/ Test PASSed. ---

[GitHub] spark issue #15213: [SPARK-17644] [CORE] Fix the race condition when DAGSche...

2016-09-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15213 **[Test build #65853 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65853/consoleFull)** for PR 15213 at commit

[GitHub] spark issue #15220: [SPARK-17649][Core]Log how many Spark events got dropped...

2016-09-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15220 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65847/ Test PASSed. ---

[GitHub] spark issue #15220: [SPARK-17649][Core]Log how many Spark events got dropped...

2016-09-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15220 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15213: [SPARK-17644] [CORE] Fix the race condition when DAGSche...

2016-09-23 Thread scwf
Github user scwf commented on the issue: https://github.com/apache/spark/pull/15213 > actual problem is not in abortStage but rather in improper additions to failedStages correct, i think a more accurate description for this issue is "do not add `failedStages` when

[GitHub] spark pull request #15223: Set R package version number along with mvn

2016-09-23 Thread shivaram
GitHub user shivaram opened a pull request: https://github.com/apache/spark/pull/15223 Set R package version number along with mvn ## What changes were proposed in this pull request? This PR sets the R package version while tagging releases. Note that since R doesn't

[GitHub] spark issue #15218: [SPARK-17637][Scheduler]Packed scheduling for Spark task...

2016-09-23 Thread zhzhan
Github user zhzhan commented on the issue: https://github.com/apache/spark/pull/15218 retest please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #15218: [SPARK-17637][Scheduler]Packed scheduling for Spark task...

2016-09-23 Thread zhzhan
Github user zhzhan commented on the issue: https://github.com/apache/spark/pull/15218 Failed in DirectKafkaStreamSuite. It should has nothing to do with the patch. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request #15220: [SPARK-17649][Core]Log how many Spark events got ...

2016-09-23 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/15220#discussion_r80331963 --- Diff: core/src/main/scala/org/apache/spark/scheduler/LiveListenerBus.scala --- @@ -57,6 +57,12 @@ private[spark] class LiveListenerBus(val sparkContext:

[GitHub] spark issue #15222: [SPARK-15703][SCHEDULER][CORE][WEBUI] Make ListenerBus e...

2016-09-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15222 **[Test build #65840 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65840/consoleFull)** for PR 15222 at commit

[GitHub] spark issue #15168: [SPARK-17612][SQL] Support `DESCRIBE table PARTITION` SQ...

2016-09-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15168 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65841/ Test FAILed. ---

[GitHub] spark issue #15168: [SPARK-17612][SQL] Support `DESCRIBE table PARTITION` SQ...

2016-09-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15168 **[Test build #65841 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65841/consoleFull)** for PR 15168 at commit

[GitHub] spark issue #15168: [SPARK-17612][SQL] Support `DESCRIBE table PARTITION` SQ...

2016-09-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15168 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #12601: [SPARK-14525][SQL] Make DataFrameWrite.save work for jdb...

2016-09-23 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/12601 Not sure you already knew it. Just want to share the commands how to build the doc. ```Scala SKIP_API=1 jekyll build SKIP_API=1 jekyll serve ``` After the second

[GitHub] spark pull request #12601: [SPARK-14525][SQL] Make DataFrameWrite.save work ...

2016-09-23 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/12601#discussion_r80350458 --- Diff: examples/src/main/java/org/apache/spark/examples/sql/JavaSQLDataSourceExample.java --- @@ -23,6 +23,8 @@ import java.util.List; //

[GitHub] spark pull request #10212: [SPARK-12221] add cpu time to metrics

2016-09-23 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/10212 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15168: [SPARK-17612][SQL] Support `DESCRIBE table PARTITION` SQ...

2016-09-23 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15168 I also like this feature. The Hive-generated statistics for partitioned tables are stored in partition-level properties. See the PR: https://github.com/apache/spark/pull/15158 We

[GitHub] spark pull request #15224: [SPARK-17650] malformed url's throw exceptions be...

2016-09-23 Thread brkyvz
GitHub user brkyvz opened a pull request: https://github.com/apache/spark/pull/15224 [SPARK-17650] malformed url's throw exceptions before bricking Executors ## What changes were proposed in this pull request? When a malformed URL was sent to Executors through `sc.addJar`

[GitHub] spark issue #12601: [SPARK-14525][SQL] Make DataFrameWrite.save work for jdb...

2016-09-23 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/12601 Sure, will build the document in my local computer and review it soon. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request #15222: [SPARK-15703][SCHEDULER][CORE][WEBUI] Make Listen...

2016-09-23 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/15222#discussion_r80328167 --- Diff: core/src/main/scala/org/apache/spark/scheduler/LiveListenerBus.scala --- @@ -32,18 +33,24 @@ import org.apache.spark.util.Utils * has started

[GitHub] spark issue #15102: [SPARK-17346][SQL] Add Kafka source for Structured Strea...

2016-09-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15102 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65845/ Test FAILed. ---

[GitHub] spark issue #15102: [SPARK-17346][SQL] Add Kafka source for Structured Strea...

2016-09-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15102 **[Test build #65845 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65845/consoleFull)** for PR 15102 at commit

[GitHub] spark issue #15102: [SPARK-17346][SQL] Add Kafka source for Structured Strea...

2016-09-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15102 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15224: [SPARK-17650] malformed url's throw exceptions before br...

2016-09-23 Thread brkyvz
Github user brkyvz commented on the issue: https://github.com/apache/spark/pull/15224 Maybe we also need the blacklisting in case of failures? Maybe they provide a valid URL that doesn't exist, or is unreachable? --- If your project is set up for it, you can reply to this email and

[GitHub] spark issue #15168: [SPARK-17612][SQL] Support `DESCRIBE table PARTITION` SQ...

2016-09-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15168 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #15225: [SPARK-17652] Fix confusing exception message whi...

2016-09-23 Thread sameeragarwal
GitHub user sameeragarwal opened a pull request: https://github.com/apache/spark/pull/15225 [SPARK-17652] Fix confusing exception message while reserving capacity ## What changes were proposed in this pull request? This minor patch fixes a confusing exception message while

[GitHub] spark issue #15225: [SPARK-17652] Fix confusing exception message while rese...

2016-09-23 Thread sameeragarwal
Github user sameeragarwal commented on the issue: https://github.com/apache/spark/pull/15225 cc @yhuai --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #15168: [SPARK-17612][SQL] Support `DESCRIBE table PARTITION` SQ...

2016-09-23 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15168 Oh, my bad. The only failure is `describe.sql`. We can not use `SQLQueryTestSuite` since the last access time is always different. ``` describe.sql *** FAILED *** (272

[GitHub] spark issue #15089: [SPARK-15621] [SQL] Support spilling for Python UDF

2016-09-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15089 **[Test build #65850 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65850/consoleFull)** for PR 15089 at commit

[GitHub] spark issue #15218: [SPARK-17637][Scheduler]Packed scheduling for Spark task...

2016-09-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15218 **[Test build #65856 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65856/consoleFull)** for PR 15218 at commit

[GitHub] spark issue #15226: [SPARK-17649][CORE] Log how many Spark events got droppe...

2016-09-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15226 **[Test build #65855 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65855/consoleFull)** for PR 15226 at commit

[GitHub] spark pull request #15226: [SPARK-17649][CORE] Log how many Spark events got...

2016-09-23 Thread tejasapatil
Github user tejasapatil commented on a diff in the pull request: https://github.com/apache/spark/pull/15226#discussion_r80350179 --- Diff: core/src/main/scala/org/apache/spark/util/AsynchronousListenerBus.scala --- @@ -117,6 +124,24 @@ private[spark] abstract class

[GitHub] spark issue #15227: [SPARK-17655][SQL]Remove unused variables declarations a...

2016-09-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15227 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #15190: [SPARK-17620][SQL] Determine Serde by hive.default.filef...

2016-09-23 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15190 @dilipbiswal Could you please check whether your manual test case is included in the master branch? If not, can you add it? Thanks! --- If your project is set up for it, you can reply to this

[GitHub] spark issue #15219: [WIP][SPARK-14098][SQL] Generate Java code to build Cach...

2016-09-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15219 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65838/ Test FAILed. ---

[GitHub] spark issue #15224: [SPARK-17650] malformed url's throw exceptions before br...

2016-09-23 Thread brkyvz
Github user brkyvz commented on the issue: https://github.com/apache/spark/pull/15224 Other places check malformedURIs already (since we always pass around URIs). We can check if the endpoint exists and everything, but that seems a bit heavyweight. --- If your project is set up for

[GitHub] spark issue #15190: [SPARK-17620][SQL] Determine Serde by hive.default.filef...

2016-09-23 Thread dilipbiswal
Github user dilipbiswal commented on the issue: https://github.com/apache/spark/pull/15190 @gatorsmile We have test in SQLQuerySuite "CTAS without serde without location" where we check for default data source. I had actually added the following test before i saw the test in

[GitHub] spark issue #15220: [SPARK-17649][Core]Log how many Spark events got dropped...

2016-09-23 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15220 **[Test build #65851 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65851/consoleFull)** for PR 15220 at commit

[GitHub] spark issue #15200: Skip building R vignettes if Spark is not built

2016-09-23 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/15200 if it's part of the `-Psparkr` profile of the build it will be regenerated by default. If it's changed and not in .gitignore it should be flagged for commit.. --- If your project is set up

[GitHub] spark issue #15223: [SPARKR][SPARK-17651] Set R package version number along...

2016-09-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15223 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15223: [SPARKR][SPARK-17651] Set R package version number along...

2016-09-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15223 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65844/ Test PASSed. ---

  1   2   3   4   >