[GitHub] spark pull request #21793: [SPARK-24813][BUILD][FOLLOW-UP][HOTFIX] HiveExter...

2018-07-17 Thread srowen
GitHub user srowen opened a pull request: https://github.com/apache/spark/pull/21793 [SPARK-24813][BUILD][FOLLOW-UP][HOTFIX] HiveExternalCatalogVersionsSuite still flaky; fall back to Apache archive ## What changes were proposed in this pull request? Test

[GitHub] spark issue #21589: [SPARK-24591][CORE] Number of cores and executors in the...

2018-07-17 Thread MaxGekk
Github user MaxGekk commented on the issue: https://github.com/apache/spark/pull/21589 jenkins, retest this, please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #21729: [SPARK-24755][Core] Executor loss can cause task to not ...

2018-07-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21729 **[Test build #93176 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93176/testReport)** for PR 21729 at commit

[GitHub] spark issue #21794: [SPARK-24834][CORE] use java comparison for float and do...

2018-07-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21794 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21796: [SPARK-24833][K8S][WIP] Add host name aliases feature

2018-07-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21796 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21796: [SPARK-24833][K8S][WIP] Add host name aliases feature

2018-07-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21796 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21793: [SPARK-24813][BUILD][FOLLOW-UP][HOTFIX] HiveExternalCata...

2018-07-17 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/21793 As this is kind of a hotfix -- I think HiveExternalCatalogVersionsSuite has been failing and will continue to fail regularly because of the 503s -- and because I got a nod on the dev@ list -- I'd

[GitHub] spark issue #21788: [SPARK-24609][ML][DOC] PySpark/SparkR doc doesn't explai...

2018-07-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21788 **[Test build #93171 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93171/testReport)** for PR 21788 at commit

[GitHub] spark issue #21788: [SPARK-24609][ML][DOC] PySpark/SparkR doc doesn't explai...

2018-07-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21788 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93171/ Test PASSed. ---

[GitHub] spark issue #21542: [SPARK-24529][Build][test-maven] Add spotbugs into maven...

2018-07-17 Thread skonto
Github user skonto commented on the issue: https://github.com/apache/spark/pull/21542 I see errors when I build lcoally on my machine: ``` [ERROR] Failed to execute goal com.github.spotbugs:spotbugs-maven-plugin:3.1.3:spotbugs (spotbugs) on project

[GitHub] spark issue #21785: [SPARK-24529][BUILD][test-maven][FOLLOW-UP] Set spotbugs...

2018-07-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21785 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93161/ Test PASSed. ---

[GitHub] spark issue #21785: [SPARK-24529][BUILD][test-maven][FOLLOW-UP] Set spotbugs...

2018-07-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21785 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21542: [SPARK-24529][Build][test-maven] Add spotbugs into maven...

2018-07-17 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/21542 have you cleaned your environment? How exactly did you build Spark locally? --- - To unsubscribe, e-mail:

[GitHub] spark pull request #21795: [SPARK-24165][SQL][followup] Fixing conditional e...

2018-07-17 Thread cloud-fan
GitHub user cloud-fan opened a pull request: https://github.com/apache/spark/pull/21795 [SPARK-24165][SQL][followup] Fixing conditional expressions to handle nullability of nested types ## What changes were proposed in this pull request? This PR fixes a test case added in

[GitHub] spark issue #21352: [SPARK-24305][SQL][FOLLOWUP] Avoid serialization of priv...

2018-07-17 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/21352 thanks, merging to master! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #21793: [SPARK-24813][BUILD][FOLLOW-UP][HOTFIX] HiveExternalCata...

2018-07-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21793 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21793: [SPARK-24813][BUILD][FOLLOW-UP][HOTFIX] HiveExternalCata...

2018-07-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21793 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93173/ Test PASSed. ---

[GitHub] spark issue #21785: [SPARK-24529][BUILD][test-maven][FOLLOW-UP] Set spotbugs...

2018-07-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21785 **[Test build #93161 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93161/testReport)** for PR 21785 at commit

[GitHub] spark issue #21589: [SPARK-24591][CORE] Number of cores and executors in the...

2018-07-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21589 **[Test build #93174 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93174/testReport)** for PR 21589 at commit

[GitHub] spark issue #21794: [SPARK-24834][CORE] use java comparison for float and do...

2018-07-17 Thread bavardage
Github user bavardage commented on the issue: https://github.com/apache/spark/pull/21794 cc @JoshRosen who introduced this code originally, I think --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org

[GitHub] spark issue #21795: [SPARK-24165][SQL][followup] Fixing conditional expressi...

2018-07-17 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/21795 cc @mn-mikke @ueshin @viirya --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

[GitHub] spark pull request #20949: [SPARK-19018][SQL] Add support for custom encodin...

2018-07-17 Thread crafty-coder
Github user crafty-coder commented on a diff in the pull request: https://github.com/apache/spark/pull/20949#discussion_r203023263 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/csv/CSVSuite.scala --- @@ -512,6 +512,43 @@ class CSVSuite extends

[GitHub] spark issue #21794: [SPARK-24834][CORE] use java comparison for float and do...

2018-07-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21794 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21795: [SPARK-24165][SQL][followup] Fixing conditional expressi...

2018-07-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21795 **[Test build #93178 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93178/testReport)** for PR 21795 at commit

[GitHub] spark issue #21793: [SPARK-24813][BUILD][FOLLOW-UP][HOTFIX] HiveExternalCata...

2018-07-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21793 **[Test build #93173 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93173/testReport)** for PR 21793 at commit

[GitHub] spark issue #20949: [SPARK-19018][SQL] Add support for custom encoding on cs...

2018-07-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20949 **[Test build #93164 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93164/testReport)** for PR 20949 at commit

[GitHub] spark issue #21790: [SPARK-24544][SQL] Print actual failure cause when look ...

2018-07-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21790 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21790: [SPARK-24544][SQL] Print actual failure cause when look ...

2018-07-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21790 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93167/ Test FAILed. ---

[GitHub] spark issue #21785: [SPARK-24529][BUILD][test-maven][FOLLOW-UP] Set spotbugs...

2018-07-17 Thread wangyum
Github user wangyum commented on the issue: https://github.com/apache/spark/pull/21785 @kiszk What is your environment? My environment is: ``` Java HotSpot(TM) 64-Bit Server VM 1.8.0_151-b12 on Mac OS X 10.12.6 ``` ---

[GitHub] spark issue #21791: [SPARK-24832][SQL] Improve inputMetrics's bytesRead upda...

2018-07-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21791 **[Test build #93168 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93168/testReport)** for PR 21791 at commit

[GitHub] spark pull request #21795: [SPARK-24165][SQL][followup] Fixing conditional e...

2018-07-17 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/21795#discussion_r203057697 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DataFrameSuite.scala --- @@ -2336,46 +2336,40 @@ class DataFrameSuite extends QueryTest with

[GitHub] spark pull request #21795: [SPARK-24165][SQL][followup] Fixing conditional e...

2018-07-17 Thread mn-mikke
Github user mn-mikke commented on a diff in the pull request: https://github.com/apache/spark/pull/21795#discussion_r203064514 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DataFrameSuite.scala --- @@ -2336,46 +2336,40 @@ class DataFrameSuite extends QueryTest with

[GitHub] spark issue #19819: [SPARK-22606][Streaming]Add threadId to the CachedKafkaC...

2018-07-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19819 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark issue #19819: [SPARK-22606][Streaming]Add threadId to the CachedKafkaC...

2018-07-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19819 Build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

[GitHub] spark issue #21782: [SPARK-24816][SQL] SQL interface support repartitionByRa...

2018-07-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21782 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21782: [SPARK-24816][SQL] SQL interface support repartitionByRa...

2018-07-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21782 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93160/ Test PASSed. ---

[GitHub] spark issue #21791: [SPARK-24832][SQL] Improve inputMetrics's bytesRead upda...

2018-07-17 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/21791 Is it better to add a test to `InputOutputMetricsSuite`? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For

[GitHub] spark issue #21700: [SPARK-24717][SS] Split out max retain version of state ...

2018-07-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21700 **[Test build #93163 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93163/testReport)** for PR 21700 at commit

[GitHub] spark issue #21785: [SPARK-24529][BUILD][test-maven][FOLLOW-UP] Set spotbugs...

2018-07-17 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/21785 In my environment, `make-distribution.sh` works well without fork. ``` ... [INFO] [INFO] --- maven-source-plugin:3.0.1:jar-no-fork (create-source-jar) @ spark-assembly_2.11 ---

[GitHub] spark issue #21700: [SPARK-24717][SS] Split out max retain version of state ...

2018-07-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21700 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21700: [SPARK-24717][SS] Split out max retain version of state ...

2018-07-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21700 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93163/ Test PASSed. ---

[GitHub] spark pull request #21352: [SPARK-24305][SQL][FOLLOWUP] Avoid serialization ...

2018-07-17 Thread mn-mikke
Github user mn-mikke commented on a diff in the pull request: https://github.com/apache/spark/pull/21352#discussion_r203017442 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala --- @@ -737,21 +733,22 @@ case class

[GitHub] spark issue #21790: [SPARK-24544][SQL] Print actual failure cause when look ...

2018-07-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21790 **[Test build #93167 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93167/testReport)** for PR 21790 at commit

[GitHub] spark issue #21729: [SPARK-24755][Core] Executor loss can cause task to not ...

2018-07-17 Thread tgravescs
Github user tgravescs commented on the issue: https://github.com/apache/spark/pull/21729 test this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #21794: [SPARK-24834] use java comparison for float and double

2018-07-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21794 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #21794: [SPARK-24834] use java comparison for float and d...

2018-07-17 Thread bavardage
GitHub user bavardage opened a pull request: https://github.com/apache/spark/pull/21794 [SPARK-24834] use java comparison for float and double The methods in `Utils`, `nanSafeCompareDoubles` and `nanSafeCompareFloats` had the same semantics as java's `java.lang.Double.compare`

[GitHub] spark pull request #21352: [SPARK-24305][SQL][FOLLOWUP] Avoid serialization ...

2018-07-17 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/21352 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #19819: [SPARK-22606][Streaming]Add threadId to the CachedKafkaC...

2018-07-17 Thread gaborgsomogyi
Github user gaborgsomogyi commented on the issue: https://github.com/apache/spark/pull/19819 I think this can be closed as the problem solved. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For

[GitHub] spark issue #21793: [SPARK-24813][BUILD][FOLLOW-UP][HOTFIX] HiveExternalCata...

2018-07-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21793 **[Test build #93173 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93173/testReport)** for PR 21793 at commit

[GitHub] spark pull request #21789: [SPARK-24829][SQL]CAST AS FLOAT inconsistent with...

2018-07-17 Thread xuanyuanking
Github user xuanyuanking commented on a diff in the pull request: https://github.com/apache/spark/pull/21789#discussion_r203037295 --- Diff: sql/hive-thriftserver/src/test/scala/org/apache/spark/sql/hive/thriftserver/HiveThriftServer2Suites.scala --- @@ -766,6 +774,14 @@ class

[GitHub] spark issue #21791: [SPARK-24832][SQL] Improve inputMetrics's bytesRead upda...

2018-07-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21791 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93168/ Test PASSed. ---

[GitHub] spark issue #21791: [SPARK-24832][SQL] Improve inputMetrics's bytesRead upda...

2018-07-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21791 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21795: [SPARK-24165][SQL][followup] Fixing conditional expressi...

2018-07-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21795 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark issue #21795: [SPARK-24165][SQL][followup] Fixing conditional expressi...

2018-07-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21795 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #21352: [SPARK-24305][SQL][FOLLOWUP] Avoid serialization ...

2018-07-17 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/21352#discussion_r203058283 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala --- @@ -2109,7 +2107,7 @@ case class

[GitHub] spark issue #21796: [SPARK-24833][K8S][WIP] Add host name aliases feature

2018-07-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21796 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21788: [SPARK-24609][ML][DOC] PySpark/SparkR doc doesn't explai...

2018-07-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21788 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21785: [SPARK-24529][BUILD][test-maven][FOLLOW-UP] Set spotbugs...

2018-07-17 Thread skonto
Github user skonto commented on the issue: https://github.com/apache/spark/pull/21785 +1 I saw this with my build. I reported on the other PR. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For

[GitHub] spark issue #21793: [SPARK-24813][BUILD][FOLLOW-UP][HOTFIX] HiveExternalCata...

2018-07-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21793 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21793: [SPARK-24813][BUILD][FOLLOW-UP][HOTFIX] HiveExternalCata...

2018-07-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21793 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request #21352: [SPARK-24305][SQL][FOLLOWUP] Avoid serialization ...

2018-07-17 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/21352#discussion_r203013625 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala --- @@ -737,21 +733,22 @@ case class

[GitHub] spark issue #21352: [SPARK-24305][SQL][FOLLOWUP] Avoid serialization of priv...

2018-07-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21352 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21352: [SPARK-24305][SQL][FOLLOWUP] Avoid serialization of priv...

2018-07-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21352 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93165/ Test PASSed. ---

[GitHub] spark pull request #21635: [SPARK-24594][YARN] Introducing metrics for YARN

2018-07-17 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/21635#discussion_r20309 --- Diff: resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/ApplicationMasterSource.scala --- @@ -0,0 +1,49 @@ +/* + * Licensed

[GitHub] spark issue #21508: [SPARK-24488] [SQL] Fix issue when generator is aliased ...

2018-07-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21508 **[Test build #93177 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93177/testReport)** for PR 21508 at commit

[GitHub] spark pull request #21796: [SPARK-24833][K8S][WIP] Add host name aliases fea...

2018-07-17 Thread rvesse
GitHub user rvesse opened a pull request: https://github.com/apache/spark/pull/21796 [SPARK-24833][K8S][WIP] Add host name aliases feature ## What changes were proposed in this pull request? This adds a new feature to the driver and executor builders for K8S that allows

[GitHub] spark issue #21794: [SPARK-24834][CORE] use java comparison for float and do...

2018-07-17 Thread bavardage
Github user bavardage commented on the issue: https://github.com/apache/spark/pull/21794 There is a way in which the `nanSafeCompare*` methods do differ from java built-in, but that wasn't captured in the test cases (or in the suggestive naming of the method), namely the handling of

[GitHub] spark issue #21468: [SPARK-22151] : PYTHONPATH not picked up from the spark....

2018-07-17 Thread tgravescs
Github user tgravescs commented on the issue: https://github.com/apache/spark/pull/21468 +1 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #21537: [SPARK-24505][SQL] Convert strings in codegen to blocks:...

2018-07-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21537 **[Test build #93179 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93179/testReport)** for PR 21537 at commit

[GitHub] spark pull request #18903: [SPARK-21590][SS]Window start time should support...

2018-07-17 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/18903 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #21537: [SPARK-24505][SQL] Convert strings in codegen to blocks:...

2018-07-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21537 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark issue #21217: [SPARK-24151][SQL] Fix CURRENT_DATE, CURRENT_TIMESTAMP t...

2018-07-17 Thread jamesthomp
Github user jamesthomp commented on the issue: https://github.com/apache/spark/pull/21217 @HyukjinKwon - I have resolved the conflict with the docs changes. Please let me know if any additional changes are required. ---

[GitHub] spark issue #21758: [SPARK-24795][CORE] Implement barrier execution mode

2018-07-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21758 **[Test build #93180 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93180/testReport)** for PR 21758 at commit

[GitHub] spark issue #21758: [SPARK-24795][CORE] Implement barrier execution mode

2018-07-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21758 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93180/ Test FAILed. ---

[GitHub] spark issue #21758: [SPARK-24795][CORE] Implement barrier execution mode

2018-07-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21758 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21652: [SPARK-24551][K8S] Add integration tests for secrets

2018-07-17 Thread skonto
Github user skonto commented on the issue: https://github.com/apache/spark/pull/21652 @srowen pls review and merge. I updated the description with my local run and rebased. --- - To unsubscribe, e-mail:

[GitHub] spark issue #21652: [SPARK-24551][K8S] Add integration tests for secrets

2018-07-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21652 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/1058/ ---

[GitHub] spark pull request #21652: [SPARK-24551][K8S] Add integration tests for secr...

2018-07-17 Thread ifilonenko
Github user ifilonenko commented on a diff in the pull request: https://github.com/apache/spark/pull/21652#discussion_r203105805 --- Diff: resource-managers/kubernetes/integration-tests/src/test/scala/org/apache/spark/deploy/k8s/integrationtest/KubernetesSuite.scala --- @@ -29,25

[GitHub] spark issue #21488: SPARK-18057 Update structured streaming kafka from 0.10....

2018-07-17 Thread tedyu
Github user tedyu commented on the issue: https://github.com/apache/spark/pull/21488 @ijuma Sorry for the late response. 9 days ago I was in China where access to gmail is intermittent. --- - To unsubscribe,

[GitHub] spark issue #21488: SPARK-18057 Update structured streaming kafka from 0.10....

2018-07-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21488 **[Test build #93188 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93188/testReport)** for PR 21488 at commit

[GitHub] spark issue #21488: SPARK-18057 Update structured streaming kafka from 0.10....

2018-07-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21488 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21488: SPARK-18057 Update structured streaming kafka from 0.10....

2018-07-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21488 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark issue #21729: [SPARK-24755][Core] Executor loss can cause task to not ...

2018-07-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21729 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21729: [SPARK-24755][Core] Executor loss can cause task to not ...

2018-07-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21729 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93176/ Test PASSed. ---

[GitHub] spark pull request #21710: [SPARK-24207][R]add R API for PrefixSpan

2018-07-17 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/21710#discussion_r203148676 --- Diff: R/pkg/R/mllib_fpm.R --- @@ -154,3 +160,74 @@ setMethod("write.ml", signature(object = "FPGrowthModel", path = "character"),

[GitHub] spark pull request #21769: [SPARK-24805][SQL] Do not ignore avro files witho...

2018-07-17 Thread MaxGekk
Github user MaxGekk commented on a diff in the pull request: https://github.com/apache/spark/pull/21769#discussion_r203148694 --- Diff: external/avro/src/main/scala/org/apache/spark/sql/avro/AvroFileFormat.scala --- @@ -64,7 +64,7 @@ private[avro] class AvroFileFormat extends

[GitHub] spark issue #21720: [SPARK-24163][SPARK-24164][SQL] Support column list as t...

2018-07-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21720 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark issue #21639: [SPARK-24653][tests] Avoid cross-job pollution in TestUt...

2018-07-17 Thread squito
Github user squito commented on the issue: https://github.com/apache/spark/pull/21639 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #21488: SPARK-18057 Update structured streaming kafka from 0.10....

2018-07-17 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/21488 @tedyu We don't need to block on the release. I would expect the Kafka client is backward complicity. In addition, most of Spark users will not upgrade their Kafka at once after the new version

[GitHub] spark issue #21589: [SPARK-24591][CORE] Number of cores and executors in the...

2018-07-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21589 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93174/ Test PASSed. ---

[GitHub] spark issue #21589: [SPARK-24591][CORE] Number of cores and executors in the...

2018-07-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21589 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19194: [SPARK-20589] Allow limiting task concurrency per stage

2018-07-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19194 **[Test build #93187 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93187/testReport)** for PR 19194 at commit

[GitHub] spark issue #21719: [SPARK-24747][ML] Make Instrumentation class more flexib...

2018-07-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21719 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #21719: [SPARK-24747][ML] Make Instrumentation class more...

2018-07-17 Thread MrBago
Github user MrBago commented on a diff in the pull request: https://github.com/apache/spark/pull/21719#discussion_r203126526 --- Diff: mllib/src/main/scala/org/apache/spark/ml/util/Instrumentation.scala --- @@ -19,45 +19,60 @@ package org.apache.spark.ml.util import

[GitHub] spark issue #21719: [SPARK-24747][ML] Make Instrumentation class more flexib...

2018-07-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21719 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark issue #21488: SPARK-18057 Update structured streaming kafka from 0.10....

2018-07-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21488 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21582: [SPARK-24576][BUILD] Upgrade Apache ORC to 1.5.2

2018-07-17 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/21582 @dongjoon-hyun Could you submit a PR to use the latest Decimal64ColumnVector like what Hive does https://issues.apache.org/jira/browse/HIVE-19629 ? ---

[GitHub] spark pull request #21795: [SPARK-24165][SQL][followup] Fixing conditional e...

2018-07-17 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/21795#discussion_r203138528 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DataFrameSuite.scala --- @@ -2336,46 +2336,40 @@ class DataFrameSuite extends QueryTest with

[GitHub] spark issue #21652: [SPARK-24551][K8S] Add integration tests for secrets

2018-07-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21652 **[Test build #93194 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93194/testReport)** for PR 21652 at commit

[GitHub] spark issue #20838: [SPARK-23698] Resolve undefined names in Python 3

2018-07-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20838 **[Test build #93195 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93195/testReport)** for PR 20838 at commit

  1   2   3   4   5   6   7   >