[GitHub] spark issue #18037: [SPARK-20814][mesos] Restore support for spark.executor....

Github user mgummelt commented on the issue: https://github.com/apache/spark/pull/18037 Was spark.executor.extraClassPath ever supported in Mesos? I see no code for it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark issue #18037: [SPARK-20814][mesos] Restore support for spark.executor....

Github user mgummelt commented on the issue: https://github.com/apache/spark/pull/18037 It looks like YARN just sets the generic java `CLASSPATH` env var. Maybe Mesos should do that too. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #18046: [SPARK-20749][SQL] Built-in SQL Function Support - all v...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18046 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77190/ Test FAILed. ---

[GitHub] spark issue #18046: [SPARK-20749][SQL] Built-in SQL Function Support - all v...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18046 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18037: [SPARK-20814][mesos] Restore support for spark.executor....

Github user vanzin commented on the issue: https://github.com/apache/spark/pull/18037 YARN does not run `spark-class`, Mesos does. And `spark-class` does not honor `CLASSPATH`, IIRC. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #18040: [SPARK-20815] [SPARKR] NullPointerException in RPackageU...

Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/18040 @jrshust would you have a chance to address a few minor comments? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #16609: [SPARK-8480] [CORE] [PYSPARK] [SPARKR] Add setName for D...

Github user michaelmior commented on the issue: https://github.com/apache/spark/pull/16609 Is there any way to create a name without caching the result? I'm parsing the Spark event logs to get some additional data about jobs and having names there is very helpful but I don't want to

[GitHub] spark issue #18023: [SPARK-12139] [SQL] REGEX Column Specification

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18023 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #18065: [SPARK-20844] Remove experimental from Structured...

GitHub user marmbrus opened a pull request: https://github.com/apache/spark/pull/18065 [SPARK-20844] Remove experimental from Structured Streaming APIs Now that Structured Streaming has been out for several Spark release and has large production use cases, the `Experimental` label

[GitHub] spark issue #18035: [MINOR][SPARKR][ML] Joint coefficients with intercept fo...

Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/18035 @yanboliang Appreciate discussing this matter with me, and it is important to sort this out now. Normally I wouldn't mind either way; but in this case I kinda feel strongly about not making

[GitHub] spark pull request #18046: [SPARK-20749][SQL] Built-in SQL Function Support ...

Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/18046#discussion_r117804345 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/FunctionRegistry.scala --- @@ -277,6 +277,8 @@ object FunctionRegistry {

[GitHub] spark pull request #18023: [SPARK-12139] [SQL] REGEX Column Specification

Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/18023#discussion_r117813681 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -1188,6 +1188,12 @@ class Dataset[T] private[sql]( def col(colName:

[GitHub] spark issue #18063: [SPARK-20842] [SQL] Upgrade to 1.2.2 for Hive Metastore ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18063 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77191/ Test PASSed. ---

[GitHub] spark pull request #18064: [SPARK-20213][SQL] Fix DataFrameWriter operations...

GitHub user cloud-fan opened a pull request: https://github.com/apache/spark/pull/18064 [SPARK-20213][SQL] Fix DataFrameWriter operations in SQL UI tab ## What changes were proposed in this pull request? Currently the `DataFrameWriter` operations have several problems:

[GitHub] spark issue #18037: [SPARK-20814][mesos] Restore support for spark.executor....

Github user vanzin commented on the issue: https://github.com/apache/spark/pull/18037 Neither standalone nor YARN use env variables to create the executor's classpath, so I guess that's why Mesos was missed. I'd rather Mesos stop using env variables too, but that's a bigger change,

[GitHub] spark pull request #17308: [SPARK-19968][SPARK-20737][SS] Use a cached insta...

Github user brkyvz commented on a diff in the pull request: https://github.com/apache/spark/pull/17308#discussion_r117804270 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/CachedKafkaProducer.scala --- @@ -18,34 +18,58 @@ package

[GitHub] spark issue #18047: [SPARK-20750][SQL] Built-in SQL Function Support - REPLA...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18047 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17981: [SPARK-15767][ML][SparkR] Decision Tree wrapper in Spark...

Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/17981 merged to master. thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #18047: [SPARK-20750][SQL] Built-in SQL Function Support - REPLA...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18047 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77187/ Test PASSed. ---

[GitHub] spark issue #18046: [SPARK-20749][SQL] Built-in SQL Function Support - all v...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18046 **[Test build #77190 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77190/testReport)** for PR 18046 at commit

[GitHub] spark pull request #17308: [SPARK-19968][SPARK-20737][SS] Use a cached insta...

Github user brkyvz commented on a diff in the pull request: https://github.com/apache/spark/pull/17308#discussion_r117805799 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/CachedKafkaProducer.scala --- @@ -18,34 +18,58 @@ package

[GitHub] spark issue #18046: [SPARK-20749][SQL] Built-in SQL Function Support - all v...

Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18046 Please run the following command to generate the result file: ``` SPARK_GENERATE_GOLDEN_FILES=1 build/sbt "sql/test-only *SQLQueryTestSuite" ``` --- If your project is set up for it,

[GitHub] spark issue #18063: [SPARK-20842] [SQL] Upgrade to 1.2.2 for Hive Metastore ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18063 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18051: [SPARK-18825][SPARKR][DOCS][WIP] Eliminate duplicate lin...

Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/18051 I see - I think this doesn't address doc build via `R CMD build pkg`? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request #17308: [SPARK-19968][SPARK-20737][SS] Use a cached insta...

Github user brkyvz commented on a diff in the pull request: https://github.com/apache/spark/pull/17308#discussion_r117803947 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/CachedKafkaProducer.scala --- @@ -18,34 +18,58 @@ package

[GitHub] spark issue #18051: [SPARK-18825][SPARKR][DOCS][WIP] Eliminate duplicate lin...

Github user zero323 commented on the issue: https://github.com/apache/spark/pull/18051 It doesn't, but `R CMD build pkg` doesn't generate html index. This happens somewhere in the `R CMD INSTALL` so even if we create custom build script (with `devtools`), it won't helps us here.

[GitHub] spark issue #18063: [SPARK-20842] [SQL] Upgrade to 1.2.2 for Hive Metastore ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18063 **[Test build #77191 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77191/testReport)** for PR 18063 at commit

[GitHub] spark issue #18023: [SPARK-12139] [SQL] REGEX Column Specification

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18023 **[Test build #77192 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77192/testReport)** for PR 18023 at commit

[GitHub] spark issue #18023: [SPARK-12139] [SQL] REGEX Column Specification

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18023 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77192/ Test PASSed. ---

[GitHub] spark issue #17993: [SPARK-20758][SQL] Add Constant propagation optimization

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17993 **[Test build #77193 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77193/testReport)** for PR 17993 at commit

[GitHub] spark issue #17993: [SPARK-20758][SQL] Add Constant propagation optimization

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17993 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77193/ Test FAILed. ---

[GitHub] spark issue #17993: [SPARK-20758][SQL] Add Constant propagation optimization

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17993 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18037: [SPARK-20814][mesos] Restore support for spark.executor....

Github user mgummelt commented on the issue: https://github.com/apache/spark/pull/18037 It looks like Standalone gets around this by constructing a raw `java` command instead of a `spark-class` command. Will YARN be using this new `SPARK_EXECUTOR_CLASSPATH` variable as well?

[GitHub] spark pull request #17308: [SPARK-19968][SPARK-20737][SS] Use a cached insta...

Github user brkyvz commented on a diff in the pull request: https://github.com/apache/spark/pull/17308#discussion_r117804651 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/CachedKafkaProducer.scala --- @@ -18,34 +18,58 @@ package

[GitHub] spark issue #16986: [SPARK-18891][SQL] Support for Scala Map collection type...

Github user michalsenkyr commented on the issue: https://github.com/apache/spark/pull/16986 That was because of my other PR that just got accepted. Just a matter of appending unit tests. I resolved the conflict from browser for now. Can rebase later if merge commits are not

[GitHub] spark issue #14971: [SPARK-17410] [SPARK-17284] Move Hive-generated Stats In...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14971 **[Test build #77196 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77196/testReport)** for PR 14971 at commit

[GitHub] spark issue #18037: [SPARK-20814][mesos] Restore support for spark.executor....

Github user vanzin commented on the issue: https://github.com/apache/spark/pull/18037 I'm gonna merge this to unblock 2.2; if there's a desire to clean up this code later, we can do it separately. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark issue #18064: [SPARK-20213][SQL] Fix DataFrameWriter operations in SQL...

Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/18064 cc @rdblue , I think this issue is important and we should probably fix it in 2.2, so I take over without the streaming changes to make this PR safer to merge. Also cc @zsxwing --- If

[GitHub] spark issue #18064: [SPARK-20213][SQL] Fix DataFrameWriter operations in SQL...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18064 **[Test build #77198 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77198/testReport)** for PR 18064 at commit

[GitHub] spark issue #18065: [SPARK-20844] Remove experimental from Structured Stream...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18065 **[Test build #77197 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77197/testReport)** for PR 18065 at commit

[GitHub] spark pull request #18023: [SPARK-12139] [SQL] REGEX Column Specification

Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18023#discussion_r117808657 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/AstBuilder.scala --- @@ -1230,25 +1230,37 @@ class AstBuilder(conf: SQLConf)

[GitHub] spark issue #16985: [SPARK-19122][SQL] Unnecessary shuffle+sort added if joi...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16985 **[Test build #77194 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77194/testReport)** for PR 16985 at commit

[GitHub] spark issue #17993: [SPARK-20758][SQL] Add Constant propagation optimization

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17993 **[Test build #77193 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77193/testReport)** for PR 17993 at commit

[GitHub] spark issue #18040: [SPARK-20815] [SPARKR] NullPointerException in RPackageU...

Github user jrshust commented on the issue: https://github.com/apache/spark/pull/18040 @felixcheung yep sorry will address today! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #18037: [SPARK-20814][mesos] Restore support for spark.ex...

Github user vanzin closed the pull request at: https://github.com/apache/spark/pull/18037 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16985: [SPARK-19122][SQL] Unnecessary shuffle+sort added if joi...

Github user tejasapatil commented on the issue: https://github.com/apache/spark/pull/16985 @cloud-fan : doesn't look like this PR is related to [SPARK-12704](https://issues.apache.org/jira/browse/SPARK-12704).. however, SPARK-12704 does seem related to another PR I was working on :

[GitHub] spark issue #18064: [SPARK-20213][SQL] Fix DataFrameWriter operations in SQL...

Github user rdblue commented on the issue: https://github.com/apache/spark/pull/18064 Agreed, sorry I haven't updated it. I was out most of last week. I'll get this fixed up as soon as I can. Thanks for all your help! --- If your project is set up for it, you can reply to this email

[GitHub] spark issue #18039: [SPARK-20751][SQL][FOLLOWUP] Add cot test in MathExpress...

Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18039 Thanks! Merging to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #18039: [SPARK-20751][SQL][FOLLOWUP] Add cot test in Math...

Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/18039 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #17633: [SPARK-20331][SQL] Enhanced Hive partition pruning predi...

Github user mallman commented on the issue: https://github.com/apache/spark/pull/17633 > You can add the test cases to VersionsSuite for verifying the behaviors of each Hive meta-store client version. @gatorsmile, I've refactored Hive version-specific testing to make it

[GitHub] spark pull request #16986: [SPARK-18891][SQL] Support for Scala Map collecti...

Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16986#discussion_r117835124 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects/objects.scala --- @@ -652,6 +653,299 @@ case class MapObjects

[GitHub] spark issue #16985: [SPARK-19122][SQL] Unnecessary shuffle+sort added if joi...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16985 **[Test build #77194 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77194/testReport)** for PR 16985 at commit

[GitHub] spark issue #15821: [SPARK-13534][PySpark] Using Apache Arrow to increase pe...

Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/15821 A quick update - I'm not sure why the pip tests failed, hopefully just a fluke with the worker. I'm waiting to retest until I can also update to Arrow 0.4, which includes a relevant bug fix

[GitHub] spark pull request #16986: [SPARK-18891][SQL] Support for Scala Map collecti...

Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16986#discussion_r117837287 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects/objects.scala --- @@ -652,6 +653,299 @@ case class MapObjects

[GitHub] spark issue #17966: [SPARK-20727] Skip tests that use Hadoop utils on CRAN W...

Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/17966 testing now - could you submit to https://win-builder.r-project.org? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request #16648: [SPARK-18016][SQL][CATALYST] Code Generation: Con...

Github user bdrillard commented on a diff in the pull request: https://github.com/apache/spark/pull/16648#discussion_r117842789 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/CodeGenerator.scala --- @@ -145,11 +145,85 @@ class

[GitHub] spark issue #17698: [SPARK-20403][SQL]Modify the instructions of some functi...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17698 **[Test build #77201 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77201/testReport)** for PR 17698 at commit

[GitHub] spark issue #18064: [SPARK-20213][SQL] Fix DataFrameWriter operations in SQL...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18064 **[Test build #77200 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77200/testReport)** for PR 18064 at commit

[GitHub] spark issue #16648: [SPARK-18016][SQL][CATALYST] Code Generation: Constant P...

Github user bdrillard commented on the issue: https://github.com/apache/spark/pull/16648 @kiszk We could do that, definitely. Changes in Feature 1 (splitting excess code among classes) are limited to the `CodeGeneration` class, and the few `Generate...` classes included with

[GitHub] spark issue #18065: [SPARK-20844] Remove experimental from Structured Stream...

Github user marmbrus commented on the issue: https://github.com/apache/spark/pull/18065 test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #18040: [SPARK-20815] [SPARKR] NullPointerException in RPackageU...

Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/18040 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #18064: [SPARK-20213][SQL] Fix DataFrameWriter operations in SQL...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18064 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77200/ Test FAILed. ---

[GitHub] spark issue #18064: [SPARK-20213][SQL] Fix DataFrameWriter operations in SQL...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18064 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18064: [SPARK-20213][SQL] Fix DataFrameWriter operations in SQL...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18064 **[Test build #77200 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77200/testReport)** for PR 18064 at commit

[GitHub] spark issue #18037: [SPARK-20814][mesos] Restore support for spark.executor....

Github user mgummelt commented on the issue: https://github.com/apache/spark/pull/18037 looking... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark pull request #17990: [YARN] [SPARK-20756] yarn-shuffle jar references ...

Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/17990 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #18063: [SPARK-20842] [SQL] Upgrade to 1.2.2 for Hive Met...

GitHub user gatorsmile opened a pull request: https://github.com/apache/spark/pull/18063 [SPARK-20842] [SQL] Upgrade to 1.2.2 for Hive Metastore Client 1.2 ### What changes were proposed in this pull request? Hive 1.2.2 release is available. Below is the list of bugs fixed in

[GitHub] spark issue #17993: [SPARK-20758][SQL] Add Constant propagation optimization

Github user tejasapatil commented on the issue: https://github.com/apache/spark/pull/17993 Jenkins test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #16985: [SPARK-19122][SQL] Unnecessary shuffle+sort added if joi...

Github user tejasapatil commented on the issue: https://github.com/apache/spark/pull/16985 Jenkins test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #18047: [SPARK-20750][SQL] Built-in SQL Function Support ...

Github user jiangxb1987 commented on a diff in the pull request: https://github.com/apache/spark/pull/18047#discussion_r117806348 --- Diff: conf/docker.properties.template --- @@ -15,6 +15,6 @@ # limitations under the License. #

[GitHub] spark issue #18040: [SPARK-20815] [SPARKR] NullPointerException in RPackageU...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18040 **[Test build #77195 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77195/testReport)** for PR 18040 at commit

[GitHub] spark pull request #17633: [SPARK-20331][SQL] Enhanced Hive partition prunin...

Github user mallman commented on a diff in the pull request: https://github.com/apache/spark/pull/17633#discussion_r117834494 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/client/HiveClientSuite.scala --- @@ -17,45 +17,656 @@ package

[GitHub] spark issue #18064: [SPARK-20213][SQL] Fix DataFrameWriter operations in SQL...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18064 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77198/ Test FAILed. ---

[GitHub] spark issue #18064: [SPARK-20213][SQL] Fix DataFrameWriter operations in SQL...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18064 **[Test build #77198 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77198/testReport)** for PR 18064 at commit

[GitHub] spark issue #18064: [SPARK-20213][SQL] Fix DataFrameWriter operations in SQL...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18064 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #16986: [SPARK-18891][SQL] Support for Scala Map collecti...

Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16986#discussion_r117837891 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects/objects.scala --- @@ -652,6 +653,299 @@ case class MapObjects

[GitHub] spark issue #14971: [SPARK-17410] [SPARK-17284] Move Hive-generated Stats In...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14971 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77196/ Test FAILed. ---

[GitHub] spark pull request #16986: [SPARK-18891][SQL] Support for Scala Map collecti...

Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16986#discussion_r117835808 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/ScalaReflection.scala --- @@ -333,31 +333,15 @@ object ScalaReflection extends

[GitHub] spark pull request #16986: [SPARK-18891][SQL] Support for Scala Map collecti...

Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16986#discussion_r117839368 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects/objects.scala --- @@ -652,6 +653,299 @@ case class MapObjects

[GitHub] spark issue #18040: [SPARK-20815] [SPARKR] NullPointerException in RPackageU...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18040 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18065: [SPARK-20844] Remove experimental from Structured Stream...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18065 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77197/ Test FAILed. ---

[GitHub] spark issue #17633: [SPARK-20331][SQL] Enhanced Hive partition pruning predi...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17633 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17698: [SPARK-20403][SQL]Modify the instructions of some functi...

Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/17698 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #18065: [SPARK-20844] Remove experimental from Structured Stream...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18065 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18040: [SPARK-20815] [SPARKR] NullPointerException in RPackageU...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18040 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77195/ Test FAILed. ---

[GitHub] spark issue #14971: [SPARK-17410] [SPARK-17284] Move Hive-generated Stats In...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14971 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #18047: [SPARK-20750][SQL] Built-in SQL Function Support ...

Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/18047#discussion_r117844677 --- Diff: conf/docker.properties.template --- @@ -15,6 +15,6 @@ # limitations under the License. # -spark.mesos.executor.docker.image:

[GitHub] spark issue #17990: [YARN] [SPARK-20756] yarn-shuffle jar references unshade...

Github user markgrover commented on the issue: https://github.com/apache/spark/pull/17990 Thanks On May 22, 2017 6:13 PM, "asfgit" wrote: > Closed #17990 via 3630911 >

[GitHub] spark issue #18065: [SPARK-20844] Remove experimental from Structured Stream...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18065 **[Test build #77203 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77203/testReport)** for PR 18065 at commit

[GitHub] spark issue #18040: [SPARK-20815] [SPARKR] NullPointerException in RPackageU...

Github user jrshust commented on the issue: https://github.com/apache/spark/pull/18040 Yeah I'm a bit confused the last build was fine and this one just had style changes. What are the next steps here? Is that a red herring or was it actually aborted? --- If your project is set up

[GitHub] spark issue #14971: [SPARK-17410] [SPARK-17284] Move Hive-generated Stats In...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14971 **[Test build #77204 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77204/testReport)** for PR 14971 at commit

[GitHub] spark issue #18063: [SPARK-20842] [SQL] Upgrade to 1.2.2 for Hive Metastore ...

Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/18063 +1, LGTM. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #14971: [SPARK-17410] [SPARK-17284] Move Hive-generated Stats In...

Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/14971 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #18040: [SPARK-20815] [SPARKR] NullPointerException in RPackageU...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18040 **[Test build #77205 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77205/testReport)** for PR 18040 at commit

[GitHub] spark issue #18051: [SPARK-18825][SPARKR][DOCS][WIP] Eliminate duplicate lin...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18051 **[Test build #77207 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77207/testReport)** for PR 18051 at commit

[GitHub] spark issue #18014: [SPARK-20783][SQL] Enhance ColumnVector to keep UnsafeAr...

Github user kiszk commented on the issue: https://github.com/apache/spark/pull/18014 @cloud-fan Could you please let us know your thoughts? Is it better to use binary type or to add simple logic for `UnsafeArrayData` and others in `ColumnVector`? --- If your project is set up

[GitHub] spark pull request #18019: [SPARK-20748][SQL] Add built-in SQL function CH[A...

Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/18019#discussion_r117835357 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala --- @@ -1268,6 +1268,51 @@ case class

[GitHub] spark issue #15821: [SPARK-13534][PySpark] Using Apache Arrow to increase pe...

Github user wesm commented on the issue: https://github.com/apache/spark/pull/15821 FYI for others: Arrow 0.3 and 0.4 are backwards/forwards compatible at the binary format. The 0.4 release contains bug fixes and new features in the Python bindings. The release vote is closing today,

[GitHub] spark pull request #16986: [SPARK-18891][SQL] Support for Scala Map collecti...

Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16986#discussion_r117837752 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects/objects.scala --- @@ -652,6 +653,299 @@ case class MapObjects

[GitHub] spark issue #17990: [YARN] [SPARK-20756] yarn-shuffle jar references unshade...

Github user markgrover commented on the issue: https://github.com/apache/spark/pull/17990 Thanks On May 22, 2017 6:13 PM, "asfgit" wrote: Closed #17990 via 3630911

  1   2   3   4   5   >