[GitHub] spark pull request #17954: [SPARK-20714] [SS] Fix match error when watermark...

2017-05-11 Thread tdas
GitHub user tdas opened a pull request: https://github.com/apache/spark/pull/17954 [SPARK-20714] [SS] Fix match error when watermark is set with timeout = no timeout / processing timeout ## What changes were proposed in this pull request? When watermark is set, and timeout

[GitHub] spark issue #17222: [SPARK-19439][PYSPARK][SQL] PySpark's registerJavaFuncti...

2017-05-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17222 **[Test build #76829 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76829/testReport)** for PR 17222 at commit [`84c1e5c`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #17938: [SPARK-20694][DOCS][SQL] Document DataFrameWriter partit...

2017-05-11 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/17938 @zero323 Could you also document SQL interface for creating bucket and partition tables in this PR? --- If your project is set up for it, you can reply to this email and have your reply appear o

[GitHub] spark issue #17925: [SPARK-20205][core] Make sure StageInfo is updated befor...

2017-05-11 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/17925 Test failure is because of SPARK-20666. All core tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #17906: [SPARK-20665][SQL]"Bround" and "Round" function return N...

2017-05-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17906 **[Test build #76832 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76832/testReport)** for PR 17906 at commit [`09712e1`](https://github.com/apache/spark/commit/09

[GitHub] spark issue #17906: [SPARK-20665][SQL]"Bround" and "Round" function return N...

2017-05-11 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/17906 Retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishe

[GitHub] spark issue #17906: [SPARK-20665][SQL]"Bround" and "Round" function return N...

2017-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17906 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17906: [SPARK-20665][SQL]"Bround" and "Round" function return N...

2017-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17906 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76820/ Test FAILed. ---

[GitHub] spark issue #17925: [SPARK-20205][core] Make sure StageInfo is updated befor...

2017-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17925 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17925: [SPARK-20205][core] Make sure StageInfo is updated befor...

2017-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17925 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76819/ Test FAILed. ---

[GitHub] spark issue #17925: [SPARK-20205][core] Make sure StageInfo is updated befor...

2017-05-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17925 **[Test build #76819 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76819/testReport)** for PR 17925 at commit [`f1ca990`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #17906: [SPARK-20665][SQL]"Bround" and "Round" function return N...

2017-05-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17906 **[Test build #76820 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76820/testReport)** for PR 17906 at commit [`09712e1`](https://github.com/apache/spark/commit/0

[GitHub] spark issue #17943: [SPARK-20682][SQL] Implement new ORC data source based o...

2017-05-11 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/17943 Hi, @cloud-fan and @viirya . Could you review new ORC data source (without ColumnarBatch part) again? --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark issue #17694: [SPARK-12717][PYSPARK] Resolving race condition with pys...

2017-05-11 Thread vundela
Github user vundela commented on the issue: https://github.com/apache/spark/pull/17694 ping @holdenk, checking if you have some time to review this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #17938: [SPARK-20694][DOCS][SQL] Document DataFrameWriter partit...

2017-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17938 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76831/ Test PASSed. ---

[GitHub] spark issue #17938: [SPARK-20694][DOCS][SQL] Document DataFrameWriter partit...

2017-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17938 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17938: [SPARK-20694][DOCS][SQL] Document DataFrameWriter partit...

2017-05-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17938 **[Test build #76831 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76831/testReport)** for PR 17938 at commit [`a7aff81`](https://github.com/apache/spark/commit/a

[GitHub] spark issue #17907: SPARK-7856 Principal components and variance using compu...

2017-05-11 Thread ghoto
Github user ghoto commented on the issue: https://github.com/apache/spark/pull/17907 I think I need sometime to run benchmarks. Originally the driver was set to 3GB, but since I was having this OutOfMemory in the driver I decided to give a try and increase the size. For other

[GitHub] spark issue #17938: [SPARK-20694][DOCS][SQL] Document DataFrameWriter partit...

2017-05-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17938 **[Test build #76831 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76831/testReport)** for PR 17938 at commit [`a7aff81`](https://github.com/apache/spark/commit/a7

[GitHub] spark issue #17938: [SPARK-20694][DOCS][SQL] Document DataFrameWriter partit...

2017-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17938 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76828/ Test PASSed. ---

[GitHub] spark issue #17938: [SPARK-20694][DOCS][SQL] Document DataFrameWriter partit...

2017-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17938 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17938: [SPARK-20694][DOCS][SQL] Document DataFrameWriter partit...

2017-05-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17938 **[Test build #76828 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76828/testReport)** for PR 17938 at commit [`cc1bfcf`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #17952: [SPARK-20705][WEB-UI]The sort function can not be used i...

2017-05-11 Thread ajbozarth
Github user ajbozarth commented on the issue: https://github.com/apache/spark/pull/17952 This seems to have been fixed in a later version of sorttable.js (https://github.com/stuartlangridge/sorttable/pull/9). If you could use that implementation instead I'd prefer the simpler change.

[GitHub] spark issue #17938: [SPARK-20694][DOCS][SQL] Document DataFrameWriter partit...

2017-05-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17938 **[Test build #76830 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76830/testReport)** for PR 17938 at commit [`606f1e3`](https://github.com/apache/spark/commit/6

[GitHub] spark issue #17938: [SPARK-20694][DOCS][SQL] Document DataFrameWriter partit...

2017-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17938 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76830/ Test FAILed. ---

[GitHub] spark issue #17938: [SPARK-20694][DOCS][SQL] Document DataFrameWriter partit...

2017-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17938 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17938: [SPARK-20694][DOCS][SQL] Document DataFrameWriter partit...

2017-05-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17938 **[Test build #76830 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76830/testReport)** for PR 17938 at commit [`606f1e3`](https://github.com/apache/spark/commit/60

[GitHub] spark issue #16648: [SPARK-18016][SQL][CATALYST] Code Generation: Constant P...

2017-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16648 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17222: [SPARK-19439][PYSPARK][SQL] PySpark's registerJavaFuncti...

2017-05-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17222 **[Test build #76829 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76829/testReport)** for PR 17222 at commit [`84c1e5c`](https://github.com/apache/spark/commit/84

[GitHub] spark issue #16648: [SPARK-18016][SQL][CATALYST] Code Generation: Constant P...

2017-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16648 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76822/ Test PASSed. ---

[GitHub] spark issue #16648: [SPARK-18016][SQL][CATALYST] Code Generation: Constant P...

2017-05-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16648 **[Test build #76822 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76822/testReport)** for PR 16648 at commit [`fa95364`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #17938: [SPARK-20694][DOCS][SQL] Document DataFrameWriter partit...

2017-05-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17938 **[Test build #76828 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76828/testReport)** for PR 17938 at commit [`cc1bfcf`](https://github.com/apache/spark/commit/cc

[GitHub] spark issue #17222: [SPARK-19439][PYSPARK][SQL] PySpark's registerJavaFuncti...

2017-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17222 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17222: [SPARK-19439][PYSPARK][SQL] PySpark's registerJavaFuncti...

2017-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17222 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76827/ Test FAILed. ---

[GitHub] spark issue #17222: [SPARK-19439][PYSPARK][SQL] PySpark's registerJavaFuncti...

2017-05-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17222 **[Test build #76827 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76827/testReport)** for PR 17222 at commit [`8c0ec9e`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #17222: [SPARK-19439][PYSPARK][SQL] PySpark's registerJavaFuncti...

2017-05-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17222 **[Test build #76827 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76827/testReport)** for PR 17222 at commit [`8c0ec9e`](https://github.com/apache/spark/commit/8c

[GitHub] spark issue #17940: [SPARK-20687][MLLIB] mllib.Matrices.fromBreeze may crash...

2017-05-11 Thread ghoto
Github user ghoto commented on the issue: https://github.com/apache/spark/pull/17940 Need to fix line in the test because it's too long. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this f

[GitHub] spark issue #17222: [SPARK-19439][PYSPARK][SQL] PySpark's registerJavaFuncti...

2017-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17222 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17222: [SPARK-19439][PYSPARK][SQL] PySpark's registerJavaFuncti...

2017-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17222 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76826/ Test FAILed. ---

[GitHub] spark issue #17222: [SPARK-19439][PYSPARK][SQL] PySpark's registerJavaFuncti...

2017-05-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17222 **[Test build #76826 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76826/testReport)** for PR 17222 at commit [`adbae6c`](https://github.com/apache/spark/commit/a

[GitHub] spark issue #17222: [SPARK-19439][PYSPARK][SQL] PySpark's registerJavaFuncti...

2017-05-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17222 **[Test build #76826 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76826/testReport)** for PR 17222 at commit [`adbae6c`](https://github.com/apache/spark/commit/ad

[GitHub] spark issue #17907: SPARK-7856 Principal components and variance using compu...

2017-05-11 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/17907 Hm, that sounds like a whole lot more memory being used than I'd imagine. How are you running the driver, and is it certainly the driver that runs out of memory? do you have timings for local vs dist

[GitHub] spark issue #17938: [SPARK-20694][DOCS][SQL] Document DataFrameWriter partit...

2017-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17938 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76825/ Test FAILed. ---

[GitHub] spark issue #17938: [SPARK-20694][DOCS][SQL] Document DataFrameWriter partit...

2017-05-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17938 **[Test build #76825 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76825/testReport)** for PR 17938 at commit [`7bf4bbc`](https://github.com/apache/spark/commit/7

[GitHub] spark issue #17938: [SPARK-20694][DOCS][SQL] Document DataFrameWriter partit...

2017-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17938 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17938: [SPARK-20694][DOCS][SQL] Document DataFrameWriter partit...

2017-05-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17938 **[Test build #76825 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76825/testReport)** for PR 17938 at commit [`7bf4bbc`](https://github.com/apache/spark/commit/7b

[GitHub] spark issue #17945: [SPARK-20704][SPARKR] change CRAN test to run single thr...

2017-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17945 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17945: [SPARK-20704][SPARKR] change CRAN test to run single thr...

2017-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17945 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76824/ Test PASSed. ---

[GitHub] spark issue #17945: [SPARK-20704][SPARKR] change CRAN test to run single thr...

2017-05-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17945 **[Test build #76824 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76824/testReport)** for PR 17945 at commit [`5aa7fd4`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #17945: [SPARK-20704][SPARKR] change CRAN test to run single thr...

2017-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17945 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76823/ Test PASSed. ---

[GitHub] spark issue #17945: [SPARK-20704][SPARKR] change CRAN test to run single thr...

2017-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17945 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17945: [SPARK-20704][SPARKR] change CRAN test to run single thr...

2017-05-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17945 **[Test build #76823 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76823/testReport)** for PR 17945 at commit [`21bea08`](https://github.com/apache/spark/commit/2

[GitHub] spark pull request #17938: [SPARK-20694][DOCS][SQL] Document DataFrameWriter...

2017-05-11 Thread zero323
Github user zero323 commented on a diff in the pull request: https://github.com/apache/spark/pull/17938#discussion_r116072807 --- Diff: docs/sql-programming-guide.md --- @@ -581,6 +581,46 @@ Starting from Spark 2.1, persistent datasource tables have per-partition metadat

[GitHub] spark issue #17945: [SPARK-20704][SPARKR] change CRAN test to run single thr...

2017-05-11 Thread shivaram
Github user shivaram commented on the issue: https://github.com/apache/spark/pull/17945 Ah that is a bummer. Lets hold off on that and use a new JIRA to discuss it. Rest of the changes LGTM pending jenkins, appveyor --- If your project is set up for it, you can reply to this email a

[GitHub] spark issue #17945: [SPARK-20704][SPARKR] change CRAN test to run single thr...

2017-05-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17945 **[Test build #76824 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76824/testReport)** for PR 17945 at commit [`5aa7fd4`](https://github.com/apache/spark/commit/5a

[GitHub] spark issue #17945: [SPARK-20704][SPARKR] change CRAN test to run single thr...

2017-05-11 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/17945 bummer, no one can install on windows then ``` Downloading GitHub repo felixcheung/spark@rchangesforpackage from URL https://api.github.com/repos/felixcheung/spark/zipball/rchangesfor

[GitHub] spark issue #17945: [SPARK-20704][SPARKR] change CRAN test to run single thr...

2017-05-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17945 **[Test build #76823 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76823/testReport)** for PR 17945 at commit [`21bea08`](https://github.com/apache/spark/commit/21

[GitHub] spark issue #17945: [SPARK-20704][SPARKR] change CRAN test to run single thr...

2017-05-11 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/17945 checked vignettes --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] spark issue #17945: [SPARK-20704][SPARKR] change CRAN test to run single thr...

2017-05-11 Thread shivaram
Github user shivaram commented on the issue: https://github.com/apache/spark/pull/17945 Can you also retest with devtools after the fix ? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #17945: [SPARK-20704][SPARKR] change CRAN test to run single thr...

2017-05-11 Thread shivaram
Github user shivaram commented on the issue: https://github.com/apache/spark/pull/17945 I think its a lowercase `t` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wi

[GitHub] spark pull request #17719: [SPARK-20431][SQL] Specify a schema by using a DD...

2017-05-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/17719 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request #17942: [SPARK-20702][Core]TaskContextImpl.markTaskComple...

2017-05-11 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/17942#discussion_r116063045 --- Diff: core/src/main/scala/org/apache/spark/scheduler/Task.scala --- @@ -115,26 +115,33 @@ private[spark] abstract class Task[T]( case t: T

[GitHub] spark issue #17719: [SPARK-20431][SQL] Specify a schema by using a DDL-forma...

2017-05-11 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/17719 Thanks! Merging to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and w

[GitHub] spark issue #17719: [SPARK-20431][SQL] Specify a schema by using a DDL-forma...

2017-05-11 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/17719 nvm. I will fix it later. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enable

[GitHub] spark pull request #17942: [SPARK-20702][Core]TaskContextImpl.markTaskComple...

2017-05-11 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/17942#discussion_r116062195 --- Diff: core/src/main/scala/org/apache/spark/util/taskListeners.scala --- @@ -55,14 +55,16 @@ class TaskCompletionListenerException( extends Runtime

[GitHub] spark issue #17719: [SPARK-20431][SQL] Specify a schema by using a DDL-forma...

2017-05-11 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/17719 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the fe

[GitHub] spark issue #17887: [SPARK-20399][SQL] Add a config to fallback string liter...

2017-05-11 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/17887 LGTM cc @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes s

[GitHub] spark issue #17945: [SPARK-20704][SPARKR] change CRAN test to run single thr...

2017-05-11 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/17945 hmm, I'm getting a warning? from R CMD check ``` Unknown, possibly mis-spelled, fields in DESCRIPTION: ‘OS_Type’ ``` --- If your project is set up for it, you can reply to

[GitHub] spark pull request #17887: [SPARK-20399][SQL] Add a config to fallback strin...

2017-05-11 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/17887#discussion_r116060915 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/regexpExpressions.scala --- @@ -144,7 +151,31 @@ case class Like(left: E

[GitHub] spark issue #15326: [SPARK-17759] [CORE] Avoid adding duplicate schedulables

2017-05-11 Thread erenavsarogullari
Github user erenavsarogullari commented on the issue: https://github.com/apache/spark/pull/15326 Hi @HyukjinKwon, thanks to follow this PR. I am busy for a while. Implementation is done and just last comments need to be addressed. I will address them as well asap. Thanks ;)

[GitHub] spark pull request #17917: [SPARK-20600][SS] KafkaRelation should be pretty ...

2017-05-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/17917 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request #17906: [SPARK-20665][SQL]"Bround" and "Round" function r...

2017-05-11 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/17906#discussion_r116059934 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/MathFunctionsSuite.scala --- @@ -231,6 +231,19 @@ class MathFunctionsSuite extends QueryTest with

[GitHub] spark pull request #17938: [SPARK-20694][DOCS][SQL] Document DataFrameWriter...

2017-05-11 Thread tejasapatil
Github user tejasapatil commented on a diff in the pull request: https://github.com/apache/spark/pull/17938#discussion_r116059777 --- Diff: docs/sql-programming-guide.md --- @@ -581,6 +581,46 @@ Starting from Spark 2.1, persistent datasource tables have per-partition metadat

[GitHub] spark issue #17917: [SPARK-20600][SS] KafkaRelation should be pretty printed...

2017-05-11 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/17917 LGTM. Merging to master and 2.2. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature en

[GitHub] spark issue #17906: [SPARK-20665][SQL]"Bround" and "Round" function return N...

2017-05-11 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/17906 Yeah. This is a right fix. I checked Hive and it behaves the same. ``` hive> SELECT round(3.1415925, 7), round(3.1415925, 8), round(3.1415925, 9), round(3.1415925, 10), round(3.14159

[GitHub] spark issue #17945: [SPARK-20704][SPARKR] change CRAN test to run single thr...

2017-05-11 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/17945 tested devtools install on Windows (even with OS_type unix) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does n

[GitHub] spark issue #17945: [SPARK-20704][SPARKR] change CRAN test to run single thr...

2017-05-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17945 **[Test build #76821 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76821/testReport)** for PR 17945 at commit [`a718645`](https://github.com/apache/spark/commit/a

[GitHub] spark issue #17945: [SPARK-20704][SPARKR] change CRAN test to run single thr...

2017-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17945 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17945: [SPARK-20704][SPARKR] change CRAN test to run single thr...

2017-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17945 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76821/ Test PASSed. ---

[GitHub] spark issue #17940: [SPARK-20687][MLLIB] mllib.Matrices.fromBreeze may crash...

2017-05-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17940 **[Test build #3710 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3710/testReport)** for PR 17940 at commit [`dbbd391`](https://github.com/apache/spark/commit/

[GitHub] spark issue #17940: [SPARK-20687][MLLIB] mllib.Matrices.fromBreeze may crash...

2017-05-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17940 **[Test build #3710 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3710/testReport)** for PR 17940 at commit [`dbbd391`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #17940: [SPARK-20687][MLLIB] mllib.Matrices.fromBreeze may crash...

2017-05-11 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/17940 CC @hhbyyh for https://github.com/apache/spark/pull/9520 Looks credible to me. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If y

[GitHub] spark issue #17940: [SPARK-20687][MLLIB] mllib.Matrices.fromBreeze may crash...

2017-05-11 Thread ghoto
Github user ghoto commented on the issue: https://github.com/apache/spark/pull/17940 Sorry about that. I added more context in the description and updated the title. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If you

[GitHub] spark issue #17644: [SPARK-17729] [SQL] Enable creating hive bucketed tables

2017-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17644 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76815/ Test PASSed. ---

[GitHub] spark issue #17644: [SPARK-17729] [SQL] Enable creating hive bucketed tables

2017-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17644 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #16648: [SPARK-18016][SQL][CATALYST] Code Generation: Constant P...

2017-05-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16648 **[Test build #76822 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76822/testReport)** for PR 16648 at commit [`fa95364`](https://github.com/apache/spark/commit/fa

[GitHub] spark issue #17644: [SPARK-17729] [SQL] Enable creating hive bucketed tables

2017-05-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17644 **[Test build #76815 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76815/testReport)** for PR 17644 at commit [`d01c721`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #17887: [SPARK-20399][SQL] Add a config to fallback string liter...

2017-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17887 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17887: [SPARK-20399][SQL] Add a config to fallback string liter...

2017-05-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17887 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76814/ Test PASSed. ---

[GitHub] spark issue #17887: [SPARK-20399][SQL] Add a config to fallback string liter...

2017-05-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17887 **[Test build #76814 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76814/testReport)** for PR 17887 at commit [`8ecb2ea`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #17945: [SPARK-20704][SPARKR] change CRAN test to run single thr...

2017-05-11 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/17945 yes, it's here https://github.com/apache/spark/pull/17945/files#diff-56790892076daac0bc43a9b38c0b1470R51 --- If your project is set up for it, you can reply to this email and have your reply a

[GitHub] spark issue #17907: SPARK-7856 Principal components and variance using compu...

2017-05-11 Thread ghoto
Github user ghoto commented on the issue: https://github.com/apache/spark/pull/17907 With classic Spark PCA, approx. 55Kx15K matrix and 10GB in driver I go out of memory. I chopped the matrix to be 55Kx3K and I can get the PCA. With the SVD distributed approach I could compute PCA wit

[GitHub] spark issue #17945: [SPARK-20704][SPARKR] change CRAN test to run single thr...

2017-05-11 Thread shivaram
Github user shivaram commented on the issue: https://github.com/apache/spark/pull/17945 Actually one more thing to do is to change the vignettes to use 1 core as well since they get rebuilt / checked during the CRAN check. --- If your project is set up for it, you can reply to this e

[GitHub] spark issue #17945: [SPARK-20704][SPARKR] change CRAN test to run single thr...

2017-05-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17945 **[Test build #76821 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76821/testReport)** for PR 17945 at commit [`a718645`](https://github.com/apache/spark/commit/a7

[GitHub] spark issue #17906: [SPARK-20665][SQL]"Bround" and "Round" function return N...

2017-05-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17906 **[Test build #76820 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76820/testReport)** for PR 17906 at commit [`09712e1`](https://github.com/apache/spark/commit/09

[GitHub] spark issue #14582: [SPARK-16997][SQL] Allow loading of JSON float values as...

2017-05-11 Thread lalinsky
Github user lalinsky commented on the issue: https://github.com/apache/spark/pull/14582 To me this looked like a simple change that would make Spark better, but I have closed the PR as requested. --- If your project is set up for it, you can reply to this email and have your reply ap

[GitHub] spark issue #17925: [SPARK-20205][core] Make sure StageInfo is updated befor...

2017-05-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17925 **[Test build #76819 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76819/testReport)** for PR 17925 at commit [`f1ca990`](https://github.com/apache/spark/commit/f1

[GitHub] spark issue #17906: [SPARK-20665][SQL]"Bround" and "Round" function return N...

2017-05-11 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/17906 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #17928: [SPARK-20311][SQL] Support aliases for table value funct...

2017-05-11 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/17928 Thanks! Merging to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and w

[GitHub] spark issue #17711: [SPARK-19951][SQL] Add string concatenate operator || to...

2017-05-11 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/17711 LGTM pending minor comment. We need to add an extra optimizer rule to combine the adjacent concatenate expressions. Thanks! --- If your project is set up for it, you can reply to this

<    1   2   3   4   5   6   7   >