[GitHub] spark pull request #16061: [SPARK-18278] [Scheduler] Support native submissi...

2016-11-30 Thread erikerlandson
Github user erikerlandson commented on a diff in the pull request: https://github.com/apache/spark/pull/16061#discussion_r90287638 --- Diff: kubernetes/README.md --- @@ -0,0 +1,21 @@ +# Pre-requisites +* maven, JDK and all other pre-requisites for building Spark. + +

[GitHub] spark issue #16082: [SPARK-18652] Include the example data and third-party l...

2016-11-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16082 **[Test build #69416 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69416/consoleFull)** for PR 16082 at commit [`ab51ae3`](https://github.com/apache/spark/commit/a

[GitHub] spark issue #16060: [SPARK-18220][SQL] read Hive orc table with varchar colu...

2016-11-30 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16060 Merging in master/branch-2.1. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wis

[GitHub] spark pull request #16009: [SPARK-18318][ML] ML, Graph 2.1 QA: API: New Scal...

2016-11-30 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/16009#discussion_r90287240 --- Diff: docs/ml-features.md --- @@ -1188,7 +1188,9 @@ categorical features. The number of bins is set by the `numBuckets` parameter. I that the number

[GitHub] spark issue #16080: [SPARK-18647][SQL] do not put provider in table properti...

2016-11-30 Thread mallman
Github user mallman commented on the issue: https://github.com/apache/spark/pull/16080 I built and tested this branch, and it resolves the issue I was having with reading Spark 2.1 tables in earlier versions of Spark. Thanks! --- If your project is set up for it, you can reply to thi

[GitHub] spark issue #15982: [SPARK-18546][core] Fix merging shuffle spills when usin...

2016-11-30 Thread squito
Github user squito commented on the issue: https://github.com/apache/spark/pull/15982 I think the comment on `#mergeSpillsWithFileStreams` needs to be updated slightly to include encryption, but other than that lgtm. --- If your project is set up for it, you can reply to this email a

[GitHub] spark issue #16082: [SPARK-18652] Include the example data and third-party l...

2016-11-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16082 **[Test build #69415 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69415/consoleFull)** for PR 16082 at commit [`9735e20`](https://github.com/apache/spark/commit/9

[GitHub] spark pull request #16080: [SPARK-18647][SQL] do not put provider in table p...

2016-11-30 Thread mallman
Github user mallman commented on a diff in the pull request: https://github.com/apache/spark/pull/16080#discussion_r90286503 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala --- @@ -232,17 +233,26 @@ private[spark] class HiveExternalCatalog(conf

[GitHub] spark issue #16070: [SPARK-18553][CORE][BRANCH-1.6] Fix leak of TaskSetManag...

2016-11-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16070 **[Test build #69414 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69414/consoleFull)** for PR 16070 at commit [`776269f`](https://github.com/apache/spark/commit/7

[GitHub] spark issue #16070: [SPARK-18553][CORE][BRANCH-1.6] Fix leak of TaskSetManag...

2016-11-30 Thread JoshRosen
Github user JoshRosen commented on the issue: https://github.com/apache/spark/pull/16070 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and w

[GitHub] spark issue #15910: [SPARK-18476][SPARKR][ML]:SparkR Logistic Regression sho...

2016-11-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15910 **[Test build #69413 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69413/consoleFull)** for PR 15910 at commit [`b1f7b23`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #16079: [SPARK-18645][Deploy] Fix spark-daemon.sh arguments erro...

2016-11-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16079 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16079: [SPARK-18645][Deploy] Fix spark-daemon.sh arguments erro...

2016-11-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16079 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69410/ Test PASSed. ---

[GitHub] spark issue #16079: [SPARK-18645][Deploy] Fix spark-daemon.sh arguments erro...

2016-11-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16079 **[Test build #69410 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69410/consoleFull)** for PR 16079 at commit [`9f67fd8`](https://github.com/apache/spark/commit/

[GitHub] spark issue #16082: [SPARK-18652] Include the data in pyspark package.

2016-11-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16082 **[Test build #69412 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69412/consoleFull)** for PR 16082 at commit [`43019db`](https://github.com/apache/spark/commit/4

[GitHub] spark pull request #16082: [SPARK-18652] Include the data in pyspark package...

2016-11-30 Thread lins05
GitHub user lins05 opened a pull request: https://github.com/apache/spark/pull/16082 [SPARK-18652] Include the data in pyspark package. ## What changes were proposed in this pull request? Since we already include the python examples in the pyspark package, we should include

[GitHub] spark pull request #16031: [SPARK-18606][HISTORYSERVER]remove useless elemen...

2016-11-30 Thread ajbozarth
Github user ajbozarth commented on a diff in the pull request: https://github.com/apache/spark/pull/16031#discussion_r90277233 --- Diff: core/src/main/resources/org/apache/spark/ui/static/historypage.js --- @@ -78,6 +78,12 @@ jQuery.extend( jQuery.fn.dataTableExt.oSort, {

[GitHub] spark issue #16077: [SPARK-18643][SPARKR] SparkR hangs at session start when...

2016-11-30 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/16077 install.spark() checks if SPARK_HOME is set or the Spark Jar can be found in the cache location. --- If your project is set up for it, you can reply to this email and have your reply appe

[GitHub] spark issue #15620: [SPARK-18091] [SQL] Deep if expressions cause Generated ...

2016-11-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15620 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15620: [SPARK-18091] [SQL] Deep if expressions cause Generated ...

2016-11-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15620 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69409/ Test PASSed. ---

[GitHub] spark issue #15620: [SPARK-18091] [SQL] Deep if expressions cause Generated ...

2016-11-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15620 **[Test build #69409 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69409/consoleFull)** for PR 15620 at commit [`fd0ab34`](https://github.com/apache/spark/commit/

[GitHub] spark issue #16079: [SPARK-18645][Deploy] Fix spark-daemon.sh arguments erro...

2016-11-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16079 **[Test build #69408 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69408/consoleFull)** for PR 16079 at commit [`563645f`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15736: [SPARK-18224] [CORE] Optimise PartitionedPairBuffer impl...

2016-11-30 Thread a-roberts
Github user a-roberts commented on the issue: https://github.com/apache/spark/pull/15736 Passed on your question to our JIT developers > The sense* of the test can have an impact of the VM interpreter performance, but that is not usually much of a component of actual throughpu

[GitHub] spark issue #15979: [SPARK-18251][SQL] the type of Dataset can't be Option o...

2016-11-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15979 **[Test build #69411 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69411/consoleFull)** for PR 15979 at commit [`876e5c7`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #16079: [SPARK-18645][Deploy] Fix spark-daemon.sh arguments erro...

2016-11-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16079 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69408/ Test PASSed. ---

[GitHub] spark issue #16079: [SPARK-18645][Deploy] Fix spark-daemon.sh arguments erro...

2016-11-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16079 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #16079: [SPARK-18645][Deploy] Fix spark-daemon.sh argumen...

2016-11-30 Thread wangyum
Github user wangyum commented on a diff in the pull request: https://github.com/apache/spark/pull/16079#discussion_r90250928 --- Diff: sbin/spark-daemon.sh --- @@ -176,11 +175,11 @@ run_command() { case "$mode" in (class) - execute_command nice -n "$SP

[GitHub] spark issue #16079: [SPARK-18645][Deploy] Fix spark-daemon.sh arguments erro...

2016-11-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16079 **[Test build #69410 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69410/consoleFull)** for PR 16079 at commit [`9f67fd8`](https://github.com/apache/spark/commit/9

[GitHub] spark pull request #16057: [SPARK-18624][SQL] Implicit cast complex types

2016-11-30 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/16057#discussion_r90250288 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/TypeCoercion.scala --- @@ -714,6 +714,17 @@ object TypeCoercion {

[GitHub] spark pull request #16079: [SPARK-18645][Deploy] Fix spark-daemon.sh argumen...

2016-11-30 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/16079#discussion_r90247203 --- Diff: sbin/spark-daemon.sh --- @@ -124,9 +124,8 @@ if [ "$SPARK_NICENESS" = "" ]; then fi execute_command() { - local command="$@"

[GitHub] spark pull request #16079: [SPARK-18645][Deploy] Fix spark-daemon.sh argumen...

2016-11-30 Thread wangyum
Github user wangyum commented on a diff in the pull request: https://github.com/apache/spark/pull/16079#discussion_r90244270 --- Diff: sbin/spark-daemon.sh --- @@ -124,9 +124,8 @@ if [ "$SPARK_NICENESS" = "" ]; then fi execute_command() { - local command="$@"

[GitHub] spark issue #16077: [SPARK-18643][SPARKR] SparkR hangs at session start when...

2016-11-30 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/16077 Is this means that it will install spark package each time when starting a new session in interactive mode? Thanks. --- If your project is set up for it, you can reply to this email and have you

[GitHub] spark pull request #16057: [SPARK-18624][SQL] Implicit cast complex types

2016-11-30 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/16057#discussion_r90243317 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/TypeCoercion.scala --- @@ -714,6 +714,17 @@ object TypeCoercion {

[GitHub] spark pull request #16057: [SPARK-18624][SQL] Implicit cast complex types

2016-11-30 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/16057#discussion_r90243278 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/TypeCoercion.scala --- @@ -714,6 +714,17 @@ object TypeCoercion {

[GitHub] spark issue #15991: [SPARK-17843][WEB UI] Indicate event logs pending for pr...

2016-11-30 Thread tgravescs
Github user tgravescs commented on the issue: https://github.com/apache/spark/pull/15991 since its just in the history server and pretty isolated seems ok. +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request #16057: [SPARK-18624][SQL] Implicit cast complex types

2016-11-30 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/16057#discussion_r90240521 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/TypeCoercion.scala --- @@ -714,6 +714,17 @@ object TypeCoercion {

[GitHub] spark issue #15620: [SPARK-18091] [SQL] Deep if expressions cause Generated ...

2016-11-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15620 **[Test build #69409 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69409/consoleFull)** for PR 15620 at commit [`fd0ab34`](https://github.com/apache/spark/commit/f

[GitHub] spark pull request #15910: [SPARK-18476][SPARKR][ML]:SparkR Logistic Regress...

2016-11-30 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/15910#discussion_r90215100 --- Diff: R/pkg/R/mllib.R --- @@ -769,11 +768,11 @@ setMethod("predict", signature(object = "KMeansModel"), #' # multinomial logistic regression

[GitHub] spark issue #15736: [SPARK-18224] [CORE] Optimise PartitionedPairBuffer impl...

2016-11-30 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15736 Hm why does the order matter - maybe helps branch prediction? I doubt we even know how the bytecode orders this let alone how it is JITted and whether it will gather branching info on this one branch

[GitHub] spark pull request #15620: [SPARK-18091] [SQL] Deep if expressions cause Gen...

2016-11-30 Thread kapilsingh5050
Github user kapilsingh5050 commented on a diff in the pull request: https://github.com/apache/spark/pull/15620#discussion_r90233749 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/conditionalExpressions.scala --- @@ -64,19 +64,72 @@ case class If(pr

[GitHub] spark pull request #15780: [SPARK-18284][SQL] Make ExpressionEncoder.seriali...

2016-11-30 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/15780#discussion_r90232704 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/ScalaReflection.scala --- @@ -590,7 +591,12 @@ object ScalaReflection extends ScalaReflec

[GitHub] spark pull request #15780: [SPARK-18284][SQL] Make ExpressionEncoder.seriali...

2016-11-30 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/15780#discussion_r90231949 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/ScalaReflection.scala --- @@ -590,7 +591,11 @@ object ScalaReflection extends ScalaReflec

[GitHub] spark issue #15736: [SPARK-18224] [CORE] Optimise PartitionedPairBuffer impl...

2016-11-30 Thread a-roberts
Github user a-roberts commented on the issue: https://github.com/apache/spark/pull/15736 I see, so doing the != comparison first which is likely to be true more of the time so we're not consistently failing this check then entering the else ``` def getComparator[K](keyCo

[GitHub] spark pull request #15620: [SPARK-18091] [SQL] Deep if expressions cause Gen...

2016-11-30 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/15620#discussion_r90231018 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/conditionalExpressions.scala --- @@ -64,19 +64,72 @@ case class If(predicate:

[GitHub] spark issue #16080: [SPARK-18647][SQL] do not put provider in table properti...

2016-11-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16080 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16080: [SPARK-18647][SQL] do not put provider in table properti...

2016-11-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16080 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69406/ Test PASSed. ---

[GitHub] spark issue #16079: [SPARK-18645][Deploy] Fix spark-daemon.sh arguments erro...

2016-11-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16079 **[Test build #69408 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69408/consoleFull)** for PR 16079 at commit [`563645f`](https://github.com/apache/spark/commit/5

[GitHub] spark pull request #15620: [SPARK-18091] [SQL] Deep if expressions cause Gen...

2016-11-30 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/15620#discussion_r90230044 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/conditionalExpressions.scala --- @@ -64,19 +64,72 @@ case class If(predicate:

[GitHub] spark issue #16080: [SPARK-18647][SQL] do not put provider in table properti...

2016-11-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16080 **[Test build #69406 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69406/consoleFull)** for PR 16080 at commit [`89f1625`](https://github.com/apache/spark/commit/

[GitHub] spark issue #16079: [SPARK-18645][Deploy] Fix spark-daemon.sh arguments erro...

2016-11-30 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/16079 Jenkins retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishe

[GitHub] spark issue #16081: [SPARK][EXAMPLE] Added missing semicolon in quick-start-...

2016-11-30 Thread manishatGit
Github user manishatGit commented on the issue: https://github.com/apache/spark/pull/16081 @srowen I scanned this page and Spark programming guide for other Java code examples, apart from Self-Contained Application on Quick-start-guide page, other code examples have no such problems.

[GitHub] spark issue #16079: [SPARK-18645][Deploy] Fix spark-daemon.sh arguments erro...

2016-11-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16079 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69404/ Test FAILed. ---

[GitHub] spark issue #16079: [SPARK-18645][Deploy] Fix spark-daemon.sh arguments erro...

2016-11-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16079 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16079: [SPARK-18645][Deploy] Fix spark-daemon.sh arguments erro...

2016-11-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16079 **[Test build #69404 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69404/consoleFull)** for PR 16079 at commit [`563645f`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #16057: [SPARK-18624][SQL] Implicit cast complex types

2016-11-30 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/16057#discussion_r90224278 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/TypeCoercion.scala --- @@ -714,6 +714,17 @@ object TypeCoercion {

[GitHub] spark issue #16081: [SPARK][EXAMPLE] Added missing semicolon in quick-start-...

2016-11-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16081 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69407/ Test PASSed. ---

[GitHub] spark issue #16081: [SPARK][EXAMPLE] Added missing semicolon in quick-start-...

2016-11-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16081 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16081: [SPARK][EXAMPLE] Added missing semicolon in quick-start-...

2016-11-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16081 **[Test build #69407 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69407/consoleFull)** for PR 16081 at commit [`6b01304`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15736: [SPARK-18224] [CORE] Optimise PartitionedPairBuffer impl...

2016-11-30 Thread mridulm
Github user mridulm commented on the issue: https://github.com/apache/spark/pull/15736 (Particularly) as the number of partitions increase, "if (a._1 != b._1)" might be better for bpt reasons. --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark issue #11974: [SPARK-14174][ML] Accelerate KMeans via Mini-Batch EM

2016-11-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11974 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69405/ Test PASSed. ---

[GitHub] spark issue #11974: [SPARK-14174][ML] Accelerate KMeans via Mini-Batch EM

2016-11-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11974 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #11974: [SPARK-14174][ML] Accelerate KMeans via Mini-Batch EM

2016-11-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11974 **[Test build #69405 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69405/consoleFull)** for PR 11974 at commit [`83b5b8e`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #16079: [SPARK-18645][Deploy] Fix spark-daemon.sh argumen...

2016-11-30 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/16079#discussion_r90221737 --- Diff: sbin/spark-daemon.sh --- @@ -176,11 +175,11 @@ run_command() { case "$mode" in (class) - execute_command nice -n "$SPA

[GitHub] spark pull request #16079: [SPARK-18645][Deploy] Fix spark-daemon.sh argumen...

2016-11-30 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/16079#discussion_r90221689 --- Diff: sbin/spark-daemon.sh --- @@ -124,9 +124,8 @@ if [ "$SPARK_NICENESS" = "" ]; then fi execute_command() { - local command="$@"

[GitHub] spark issue #16081: [SPARK][EXAMPLE] Added missing semicolon in quick-start-...

2016-11-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16081 **[Test build #69407 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69407/consoleFull)** for PR 16081 at commit [`6b01304`](https://github.com/apache/spark/commit/6

[GitHub] spark issue #16081: [SPARK][EXAMPLE] Added missing semicolon in quick-start-...

2016-11-30 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/16081 Jenkins test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #16081: [SPARK][EXAMPLE] Added missing semicolon in quick-start-...

2016-11-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16081 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request #16081: [SPARK][EXAMPLE] Added missing semicolon in quick...

2016-11-30 Thread manishatGit
GitHub user manishatGit opened a pull request: https://github.com/apache/spark/pull/16081 [SPARK][EXAMPLE] Added missing semicolon in quick-start-guide example ## What changes were proposed in this pull request? Added missing semicolon in quick-start-guide java example code

[GitHub] spark issue #15979: [SPARK-18251][SQL] the type of Dataset can't be Option o...

2016-11-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15979 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15979: [SPARK-18251][SQL] the type of Dataset can't be Option o...

2016-11-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15979 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69403/ Test FAILed. ---

[GitHub] spark issue #15979: [SPARK-18251][SQL] the type of Dataset can't be Option o...

2016-11-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15979 **[Test build #69403 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69403/consoleFull)** for PR 15979 at commit [`70dd650`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #16057: [SPARK-18624][SQL] Implicit cast complex types

2016-11-30 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/16057#discussion_r90219716 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/TypeCoercion.scala --- @@ -714,6 +714,17 @@ object TypeCoercion {

[GitHub] spark pull request #16057: [SPARK-18624][SQL] Implicit cast complex types

2016-11-30 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/16057#discussion_r90219640 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/TypeCoercion.scala --- @@ -714,6 +714,17 @@ object TypeCoercion {

[GitHub] spark pull request #15958: [SPARK-17932][SQL] Support SHOW TABLES EXTENDED L...

2016-11-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15958 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request #16067: [SPARK-17897] [SQL] Fixed IsNotNull Constraint In...

2016-11-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16067 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #16067: [SPARK-17897] [SQL] Fixed IsNotNull Constraint Inference...

2016-11-30 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/16067 thanks, merging to master/2.1! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled an

[GitHub] spark issue #16080: [SPARK-18647][SQL] do not put provider in table properti...

2016-11-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16080 **[Test build #69406 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69406/consoleFull)** for PR 16080 at commit [`89f1625`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #16080: [SPARK-18647][SQL] do not put provider in table properti...

2016-11-30 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/16080 cc @rxin @yhuai @mallman --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wis

[GitHub] spark pull request #16080: [SPARK-18647][SQL] do not put provider in table p...

2016-11-30 Thread cloud-fan
GitHub user cloud-fan opened a pull request: https://github.com/apache/spark/pull/16080 [SPARK-18647][SQL] do not put provider in table properties for Hive serde table ## What changes were proposed in this pull request? In Spark 2.1, we make Hive serde tables case-preservin

[GitHub] spark issue #16076: [SPARK-18324][ML][DOC] Update ML programming and migrati...

2016-11-30 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/16076 cc @jkbradley @MLnick @sethah --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled a

[GitHub] spark issue #11974: [SPARK-14174][ML] Accelerate KMeans via Mini-Batch EM

2016-11-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11974 **[Test build #69405 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69405/consoleFull)** for PR 11974 at commit [`83b5b8e`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #16037: [SPARK-18471][MLLIB] In LBFGS, avoid sending huge vector...

2016-11-30 Thread AnthonyTruchet
Github user AnthonyTruchet commented on the issue: https://github.com/apache/spark/pull/16037 @MLnick I have to add a transtyping denseGrad in the expression returned by seqOp from DenseVector to Vector. The only way I could find to do it with the API are: `Vectors.fromBreeze(denseGra

[GitHub] spark issue #11974: [SPARK-14174][ML] Accelerate KMeans via Mini-Batch EM

2016-11-30 Thread zhengruifeng
Github user zhengruifeng commented on the issue: https://github.com/apache/spark/pull/11974 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled an

[GitHub] spark issue #12896: [SPARK-14489][ML][PYSPARK] ALS unknown user/item predict...

2016-11-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12896 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69401/ Test PASSed. ---

[GitHub] spark issue #12896: [SPARK-14489][ML][PYSPARK] ALS unknown user/item predict...

2016-11-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12896 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #12896: [SPARK-14489][ML][PYSPARK] ALS unknown user/item predict...

2016-11-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/12896 **[Test build #69401 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69401/consoleFull)** for PR 12896 at commit [`a439899`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15987: [SPARK-17732][SPARK-18515][SQL] ALTER TABLE DROP PARTITI...

2016-11-30 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15987 Hi, @hvanhovell . Could you review this PR? This PR now is the new fix + the reverted commit. --- If your project is set up for it, you can reply to this email and have your reply appear o

[GitHub] spark pull request #15620: [SPARK-18091] [SQL] Deep if expressions cause Gen...

2016-11-30 Thread kapilsingh5050
Github user kapilsingh5050 commented on a diff in the pull request: https://github.com/apache/spark/pull/15620#discussion_r90211997 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/CodeGenerationSuite.scala --- @@ -97,6 +97,38 @@ class CodeGeneration

[GitHub] spark issue #15958: [SPARK-17932][SQL] Support SHOW TABLES EXTENDED LIKE 'id...

2016-11-30 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/15958 LGTM. Merging to master. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request #15620: [SPARK-18091] [SQL] Deep if expressions cause Gen...

2016-11-30 Thread kapilsingh5050
Github user kapilsingh5050 commented on a diff in the pull request: https://github.com/apache/spark/pull/15620#discussion_r90211519 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/conditionalExpressions.scala --- @@ -64,19 +64,72 @@ case class If(pr

[GitHub] spark pull request #15620: [SPARK-18091] [SQL] Deep if expressions cause Gen...

2016-11-30 Thread kapilsingh5050
Github user kapilsingh5050 commented on a diff in the pull request: https://github.com/apache/spark/pull/15620#discussion_r90211285 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/conditionalExpressions.scala --- @@ -64,19 +64,72 @@ case class If(pr

[GitHub] spark pull request #15620: [SPARK-18091] [SQL] Deep if expressions cause Gen...

2016-11-30 Thread kapilsingh5050
Github user kapilsingh5050 commented on a diff in the pull request: https://github.com/apache/spark/pull/15620#discussion_r90211169 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/conditionalExpressions.scala --- @@ -64,19 +64,72 @@ case class If(pr

[GitHub] spark issue #16067: [SPARK-17897] [SQL] Fixed IsNotNull Constraint Inference...

2016-11-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16067 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69396/ Test PASSed. ---

[GitHub] spark issue #16067: [SPARK-17897] [SQL] Fixed IsNotNull Constraint Inference...

2016-11-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16067 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16037: [SPARK-18471][MLLIB] In LBFGS, avoid sending huge vector...

2016-11-30 Thread AnthonyTruchet
Github user AnthonyTruchet commented on the issue: https://github.com/apache/spark/pull/16037 Hello @MLnick, Sorry that my push of a new version just crossed with your suggestion. I'll test you suggestion. Thanks to for having written it, I didn't get that Sean's hint

[GitHub] spark issue #16067: [SPARK-17897] [SQL] Fixed IsNotNull Constraint Inference...

2016-11-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16067 **[Test build #69396 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69396/consoleFull)** for PR 16067 at commit [`54c0dd1`](https://github.com/apache/spark/commit/

[GitHub] spark issue #11974: [SPARK-14174][ML] Accelerate KMeans via Mini-Batch EM

2016-11-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11974 **[Test build #69402 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69402/consoleFull)** for PR 11974 at commit [`c27f128`](https://github.com/apache/spark/commit/

[GitHub] spark issue #11974: [SPARK-14174][ML] Accelerate KMeans via Mini-Batch EM

2016-11-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11974 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69402/ Test FAILed. ---

[GitHub] spark issue #11974: [SPARK-14174][ML] Accelerate KMeans via Mini-Batch EM

2016-11-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11974 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15958: [SPARK-17932][SQL] Support SHOW TABLES EXTENDED LIKE 'id...

2016-11-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15958 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69395/ Test PASSed. ---

<    1   2   3   4   5   6   7   >