[GitHub] spark pull request: [SPARK-15236][SQL][SPARK SHELL] Add spark-defa...

2016-05-13 Thread xwu0226
Github user xwu0226 commented on the pull request: https://github.com/apache/spark/pull/13088#issuecomment-219201641 @rxin I updated the code to use existing property `spark.sql.catalogImplementation` when checking whether we should switch to use in-memory or hive catalog. The

[GitHub] spark pull request: [SPARK-15320] [SQL] Spark-SQL Cli Ignores Para...

2016-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13111#issuecomment-219200482 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-15320] [SQL] Spark-SQL Cli Ignores Para...

2016-05-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13111#issuecomment-219200467 **[Test build #58601 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58601/consoleFull)** for PR 13111 at commit

[GitHub] spark pull request: [SPARK-15320] [SQL] Spark-SQL Cli Ignores Para...

2016-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13111#issuecomment-219200483 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-14906][ML] Copy linalg in PySpark to ne...

2016-05-13 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/13099#issuecomment-219200309 ping @mengxr --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-15320] [SQL] Spark-SQL Cli Ignores Para...

2016-05-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13111#issuecomment-219200094 **[Test build #58601 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58601/consoleFull)** for PR 13111 at commit

[GitHub] spark pull request: [SPARK-15320] [SQL] Spark-SQL Cli Ignores Para...

2016-05-13 Thread gatorsmile
GitHub user gatorsmile opened a pull request: https://github.com/apache/spark/pull/13111 [SPARK-15320] [SQL] Spark-SQL Cli Ignores Parameter hive.metastore.warehouse.dir What changes were proposed in this pull request? Although overriding `hive.metastore.warehouse.dir` in

[GitHub] spark pull request: Fix reading of partitioned format=text dataset...

2016-05-13 Thread HyukjinKwon
Github user HyukjinKwon commented on the pull request: https://github.com/apache/spark/pull/13104#issuecomment-219199027 (I think it might need a JIRA because it seems changing existing behaviour) --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: Fix bug where Array[Timestamp] cannot be encod...

2016-05-13 Thread smungee
Github user smungee commented on the pull request: https://github.com/apache/spark/pull/13108#issuecomment-219198990 @techaddict Added a test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Fix bug where Array[Timestamp] cannot be encod...

2016-05-13 Thread techaddict
Github user techaddict commented on the pull request: https://github.com/apache/spark/pull/13108#issuecomment-219198790 @smungee Can you please add tests for this ? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: Fix MapObjects.itemAccessorMethod to handle Ti...

2016-05-13 Thread smungee
Github user smungee commented on the pull request: https://github.com/apache/spark/pull/13108#issuecomment-219198553 The bug is quite easy to reproduce. In `ExpressionEncoderSuite`, if you add the following test case: ` encodeDecodeTest(Array(Timestamp.valueOf("2016-01-29

[GitHub] spark pull request: [SPARK-14978][PySpark] PySpark TrainValidation...

2016-05-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12767#issuecomment-219197282 **[Test build #58600 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58600/consoleFull)** for PR 12767 at commit

[GitHub] spark pull request: [SPARK-14978][PySpark] PySpark TrainValidation...

2016-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12767#issuecomment-219197287 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-14978][PySpark] PySpark TrainValidation...

2016-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12767#issuecomment-219197286 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-14978][PySpark] PySpark TrainValidation...

2016-05-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12767#issuecomment-219197017 **[Test build #58600 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58600/consoleFull)** for PR 12767 at commit

[GitHub] spark pull request: [SPARK-14978][PySpark] PySpark TrainValidation...

2016-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12767#issuecomment-219196442 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-14978][PySpark] PySpark TrainValidation...

2016-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12767#issuecomment-219196443 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-14978][PySpark] PySpark TrainValidation...

2016-05-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12767#issuecomment-219196440 **[Test build #58599 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58599/consoleFull)** for PR 12767 at commit

[GitHub] spark pull request: [SPARK-14978][PySpark] PySpark TrainValidation...

2016-05-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12767#issuecomment-219196409 **[Test build #58599 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58599/consoleFull)** for PR 12767 at commit

[GitHub] spark pull request: Problem select empty ORC table

2016-05-13 Thread HyukjinKwon
Github user HyukjinKwon commented on the pull request: https://github.com/apache/spark/pull/13103#issuecomment-219193377 For me, I would like to say this might better be closed if this PR does not propose code changes. I think It would be nicer if the bug report is in the JIRA. ---

[GitHub] spark pull request: Problem select empty ORC table

2016-05-13 Thread HyukjinKwon
Github user HyukjinKwon commented on the pull request: https://github.com/apache/spark/pull/13103#issuecomment-219193053 In https://cwiki.apache.org/confluence/display/SPARK/Contributing+to+Spark#ContributingtoSpark-ContributingBugReports , It seems not suggesting to create a PR

[GitHub] spark pull request: Fix MapObjects.itemAccessorMethod to handle Ti...

2016-05-13 Thread smungee
Github user smungee commented on the pull request: https://github.com/apache/spark/pull/13108#issuecomment-219192693 @HyukjinKwon I think the original author might have just forgotten to add the TimestampType to the match.. --- If your project is set up for it, you can reply to this

[GitHub] spark pull request: [SPARK-12042] Python API for mllib.stat.test.S...

2016-05-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11374#issuecomment-219192553 **[Test build #58598 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58598/consoleFull)** for PR 11374 at commit

[GitHub] spark pull request: [SPARK-12042] Python API for mllib.stat.test.S...

2016-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11374#issuecomment-219192556 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12042] Python API for mllib.stat.test.S...

2016-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11374#issuecomment-219192555 Build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-12042] Python API for mllib.stat.test.S...

2016-05-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11374#issuecomment-219192289 **[Test build #58598 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58598/consoleFull)** for PR 11374 at commit

[GitHub] spark pull request: [TRIVIAL] Add () to SparkSession's builder fun...

2016-05-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13086 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [TRIVIAL] Add () to SparkSession's builder fun...

2016-05-13 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/13086#issuecomment-219191756 Merging in master/2.0. Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: Problem select empty ORC table

2016-05-13 Thread pprado
Github user pprado commented on the pull request: https://github.com/apache/spark/pull/13103#issuecomment-219191363 Sorry, I tried to follow this document: https://cwiki.apache.org/confluence/display/SPARK/Contributing+to+Spark#ContributingtoSpark-ContributingBugReports

[GitHub] spark pull request: Fix MapObjects.itemAccessorMethod to handle Ti...

2016-05-13 Thread HyukjinKwon
Github user HyukjinKwon commented on the pull request: https://github.com/apache/spark/pull/13108#issuecomment-219191307 (I think it might needs a JIRA because it seems changing existing behaviour) --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-12469][CORE] Data Property accumulators...

2016-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11105#issuecomment-219191041 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12469][CORE] Data Property accumulators...

2016-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11105#issuecomment-219191037 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12469][CORE] Data Property accumulators...

2016-05-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11105#issuecomment-219190960 **[Test build #58595 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58595/consoleFull)** for PR 11105 at commit

[GitHub] spark pull request: [SPARK-13850] Force the sorter to Spill when n...

2016-05-13 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/13107#discussion_r63267469 --- Diff: core/src/main/java/org/apache/spark/util/collection/unsafe/sort/UnsafeExternalSorter.java --- @@ -143,6 +151,8 @@ private

[GitHub] spark pull request: Problem select empty ORC table

2016-05-13 Thread HyukjinKwon
Github user HyukjinKwon commented on the pull request: https://github.com/apache/spark/pull/13103#issuecomment-219188872 Because I guess this is a contribution to Spark and there is a guide for this. It seems there are a lot of things wrong with this PR (e.g. no JIRA). --- If your

[GitHub] spark pull request: [SPARK-13850] Force the sorter to Spill when n...

2016-05-13 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/13107#discussion_r6329 --- Diff: core/src/main/java/org/apache/spark/util/collection/unsafe/sort/UnsafeExternalSorter.java --- @@ -24,6 +24,8 @@ import java.util.Queue;

[GitHub] spark pull request: Problem select empty ORC table

2016-05-13 Thread pprado
Github user pprado commented on the pull request: https://github.com/apache/spark/pull/13103#issuecomment-219187681 Why? Em 13 de mai de 2016 9:08 PM, "Hyukjin Kwon" escreveu: > I think it would be good if you follow >

[GitHub] spark pull request: [SPARK-10372] [CORE] basic test framework for ...

2016-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8559#issuecomment-219186967 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: Problem select empty ORC table

2016-05-13 Thread HyukjinKwon
Github user HyukjinKwon commented on the pull request: https://github.com/apache/spark/pull/13103#issuecomment-219187010 I think it would be good if you follow https://cwiki.apache.org/confluence/display/SPARK/Spark+Code+Style+Guide. --- If your project is set up for it, you can

[GitHub] spark pull request: [SPARK-10372] [CORE] basic test framework for ...

2016-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8559#issuecomment-219186969 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10372] [CORE] basic test framework for ...

2016-05-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8559#issuecomment-219186887 **[Test build #58593 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58593/consoleFull)** for PR 8559 at commit

[GitHub] spark pull request: [SPARK-15318][ML][Example]:spark.ml Collaborat...

2016-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13110#issuecomment-219183105 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-15318][ML][Example]:spark.ml Collaborat...

2016-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13110#issuecomment-219183104 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-15318][ML][Example]:spark.ml Collaborat...

2016-05-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13110#issuecomment-219183057 **[Test build #58597 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58597/consoleFull)** for PR 13110 at commit

[GitHub] spark pull request: [SPARK-15319][SPARKR][DOCS] Fix SparkR doc lay...

2016-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13109#issuecomment-219182766 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-15319][SPARKR][DOCS] Fix SparkR doc lay...

2016-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13109#issuecomment-219182765 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-15319][SPARKR][DOCS] Fix SparkR doc lay...

2016-05-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13109#issuecomment-219182730 **[Test build #58596 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58596/consoleFull)** for PR 13109 at commit

[GitHub] spark pull request: [SPARK-15318][ML][Example]:spark.ml Collaborat...

2016-05-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13110#issuecomment-219182172 **[Test build #58597 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58597/consoleFull)** for PR 13110 at commit

[GitHub] spark pull request: [SPARK-15318][ML][Example]:spark.ml Collaborat...

2016-05-13 Thread wangmiao1981
GitHub user wangmiao1981 opened a pull request: https://github.com/apache/spark/pull/13110 [SPARK-15318][ML][Example]:spark.ml Collaborative Filtering example does not work in spark-shell ## What changes were proposed in this pull request? (Please fill in changes proposed

[GitHub] spark pull request: [SPARK-15319][SPARKR][DOCS] Fix SparkR doc lay...

2016-05-13 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/13109#issuecomment-219181759 LGTM. Thanks @felixcheung --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-15319][SPARKR][DOCS] Fix SparkR doc lay...

2016-05-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13109#issuecomment-219180940 **[Test build #58596 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58596/consoleFull)** for PR 13109 at commit

[GitHub] spark pull request: [SPARK-15319][SPARKR][DOCS] Fix SparkR doc lay...

2016-05-13 Thread felixcheung
Github user felixcheung commented on the pull request: https://github.com/apache/spark/pull/13109#issuecomment-219180908 @shivaram @sun-rui --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-15319][SPARKR][DOCS] Fix SparkR doc lay...

2016-05-13 Thread felixcheung
GitHub user felixcheung opened a pull request: https://github.com/apache/spark/pull/13109 [SPARK-15319][SPARKR][DOCS] Fix SparkR doc layout for corr and other DataFrame stats functions ## What changes were proposed in this pull request? Doc only changes. Please see

[GitHub] spark pull request: [SPARK-12469][CORE] Data Property accumulators...

2016-05-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11105#issuecomment-219180295 **[Test build #58595 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58595/consoleFull)** for PR 11105 at commit

[GitHub] spark pull request: [SPARK-15113][PySpark][ML] Add missing num fea...

2016-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12889#issuecomment-219179609 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-15113][PySpark][ML] Add missing num fea...

2016-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12889#issuecomment-219179607 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-15113][PySpark][ML] Add missing num fea...

2016-05-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12889#issuecomment-219179550 **[Test build #58594 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58594/consoleFull)** for PR 12889 at commit

[GitHub] spark pull request: [SPARK-15113][PySpark][ML] Add missing num fea...

2016-05-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12889#issuecomment-219177910 **[Test build #58594 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58594/consoleFull)** for PR 12889 at commit

[GitHub] spark pull request: Fix MapObjects.itemAccessorMethod to handle Ti...

2016-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13108#issuecomment-219177160 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: Fix MapObjects.itemAccessorMethod to handle Ti...

2016-05-13 Thread smungee
GitHub user smungee opened a pull request: https://github.com/apache/spark/pull/13108 Fix MapObjects.itemAccessorMethod to handle TimestampType ## What changes were proposed in this pull request? Fix `MapObjects.itemAccessorMethod` to handle `TimestampType`. Without this

[GitHub] spark pull request: [SPARK-10372] [CORE] basic test framework for ...

2016-05-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8559#issuecomment-219172799 **[Test build #58593 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58593/consoleFull)** for PR 8559 at commit

[GitHub] spark pull request: [SPARK-14476][SQL] Improve the physical plan v...

2016-05-13 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/12947#issuecomment-219168440 @clockfly It seems that this does not work with temporary tables, could you send an PR to fix that? --- If your project is set up for it, you can reply to this email

[GitHub] spark pull request: Fix reading of partitioned format=text dataset...

2016-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13104#issuecomment-219165088 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: Fix reading of partitioned format=text dataset...

2016-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13104#issuecomment-219165082 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: Fix reading of partitioned format=text dataset...

2016-05-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13104#issuecomment-219164866 **[Test build #58591 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58591/consoleFull)** for PR 13104 at commit

[GitHub] spark pull request: [SPARK-14878][SQL] Trim characters string func...

2016-05-13 Thread kevinyu98
Github user kevinyu98 commented on the pull request: https://github.com/apache/spark/pull/12646#issuecomment-219164845 retest it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-5210] Support group event log when app ...

2016-05-13 Thread satlal
Github user satlal commented on the pull request: https://github.com/apache/spark/pull/9246#issuecomment-219163186 @XuTingjun revisiting this thread. Since this patch seems to be abandoned, were you able to work around the large log files issue for long running streaming jobs? ---

[GitHub] spark pull request: [SPARK-10372] [CORE] basic test framework for ...

2016-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8559#issuecomment-219158034 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10372] [CORE] basic test framework for ...

2016-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8559#issuecomment-219158033 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10372] [CORE] basic test framework for ...

2016-05-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8559#issuecomment-219157811 **[Test build #58590 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58590/consoleFull)** for PR 8559 at commit

[GitHub] spark pull request: [SPARK-15311] [SQL] Disallow DML on Regular Ta...

2016-05-13 Thread gatorsmile
Github user gatorsmile commented on the pull request: https://github.com/apache/spark/pull/13093#issuecomment-219153156 @cloud-fan @yhuai @liancheng Could you please review this PR? Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark pull request: [SPARK-15316][PySpark][ML] Add linkPredictionC...

2016-05-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13106#issuecomment-219152856 **[Test build #58592 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58592/consoleFull)** for PR 13106 at commit

[GitHub] spark pull request: [SPARK-15316][PySpark][ML] Add linkPredictionC...

2016-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13106#issuecomment-219152958 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-15316][PySpark][ML] Add linkPredictionC...

2016-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13106#issuecomment-219152957 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13850] Force the sorter to Spill when n...

2016-05-13 Thread sitalkedia
Github user sitalkedia commented on the pull request: https://github.com/apache/spark/pull/13107#issuecomment-219152163 cc- @srowen, @JoshRosen --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-13850] Force the sorter to Spill when n...

2016-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13107#issuecomment-219151861 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13850] Force the sorter to Spill when n...

2016-05-13 Thread sitalkedia
GitHub user sitalkedia opened a pull request: https://github.com/apache/spark/pull/13107 [SPARK-13850] Force the sorter to Spill when number of elements in th… ## What changes were proposed in this pull request? Force the sorter to Spill when number of elements in the

[GitHub] spark pull request: [SPARK-15316][PySpark][ML] Add linkPredictionC...

2016-05-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13106#issuecomment-219150836 **[Test build #58592 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58592/consoleFull)** for PR 13106 at commit

[GitHub] spark pull request: [SPARK-14942][SQL][Streaming] Reduce delay bet...

2016-05-13 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/12725#discussion_r63246142 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamSuite.scala --- @@ -137,20 +137,88 @@ class StreamSuite extends StreamTest with

[GitHub] spark pull request: [SPARK-15316][PySpark][ML] Add linkPredictionC...

2016-05-13 Thread holdenk
GitHub user holdenk opened a pull request: https://github.com/apache/spark/pull/13106 [SPARK-15316][PySpark][ML] Add linkPredictionCol to GeneralizedLinearRegression ## What changes were proposed in this pull request? Add linkPredictionCol to GeneralizedLinearRegression

[GitHub] spark pull request: Fix reading of partitioned format=text dataset...

2016-05-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13104#issuecomment-219147522 **[Test build #58591 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58591/consoleFull)** for PR 13104 at commit

[GitHub] spark pull request: Fix reading of partitioned format=text dataset...

2016-05-13 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/13104#issuecomment-219146749 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-15075] [SQL] Cleanup dependencies betwe...

2016-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13102#issuecomment-219143546 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-15075] [SQL] Cleanup dependencies betwe...

2016-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13102#issuecomment-219143551 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-15075] [SQL] Cleanup dependencies betwe...

2016-05-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/13102#issuecomment-219143332 **[Test build #58589 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58589/consoleFull)** for PR 13102 at commit

[GitHub] spark pull request: [SPARK-11827] [SQL] Adding java.math.BigIntege...

2016-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10125#issuecomment-219141188 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11827] [SQL] Adding java.math.BigIntege...

2016-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10125#issuecomment-219141172 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11827] [SQL] Adding java.math.BigIntege...

2016-05-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10125#issuecomment-219140939 **[Test build #58588 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58588/consoleFull)** for PR 10125 at commit

[GitHub] spark pull request: [SPARK-15315][SQL] Adding error check to the C...

2016-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13105#issuecomment-219139730 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-15315][SQL] Adding error check to the C...

2016-05-13 Thread sureshthalamati
GitHub user sureshthalamati opened a pull request: https://github.com/apache/spark/pull/13105 [SPARK-15315][SQL] Adding error check to the CSV datasource writer for unsupported complex data types. ## What changes were proposed in this pull request? Adds error handling to

[GitHub] spark pull request: [SPARK-11827] [SQL] Adding java.math.BigIntege...

2016-05-13 Thread kevinyu98
Github user kevinyu98 commented on the pull request: https://github.com/apache/spark/pull/10125#issuecomment-219136788 I just run the ./dev/mima locally, it works, [info] Done packaging. [info] spark-examples: previous-artifact not set, not analyzing binary compatibility

[GitHub] spark pull request: [SPARK-11827] [SQL] Adding java.math.BigIntege...

2016-05-13 Thread kevinyu98
Github user kevinyu98 commented on the pull request: https://github.com/apache/spark/pull/10125#issuecomment-219136812 retest it please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-5929][PYSPARK] Context addPyPackage and...

2016-05-13 Thread buckhx
Github user buckhx commented on the pull request: https://github.com/apache/spark/pull/12398#issuecomment-219136325 changed addRequirementsFile to addPyRequirements which takes a list of requirement strings --- If your project is set up for it, you can reply to this email and have

[GitHub] spark pull request: [SPARK-10372] [CORE] basic test framework for ...

2016-05-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8559#issuecomment-219134254 **[Test build #58590 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58590/consoleFull)** for PR 8559 at commit

[GitHub] spark pull request: Fix reading of partitioned format=text dataset...

2016-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13104#issuecomment-219130685 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: Problem select empty ORC table

2016-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/13103#issuecomment-219130690 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: Fix reading of partitioned format=text dataset...

2016-05-13 Thread jurriaan
GitHub user jurriaan opened a pull request: https://github.com/apache/spark/pull/13104 Fix reading of partitioned format=text datasets I was using this in Spark 1.6.1 but it broke in Spark 2.0.0. It would be logical if you could also write those, but not entirely sure

[GitHub] spark pull request: Problem select empty ORC table

2016-05-13 Thread pprado
GitHub user pprado opened a pull request: https://github.com/apache/spark/pull/13103 Problem select empty ORC table ## Error when I selected empty ORC table > [pprado@hadoop-m ~]$ beeline -u jdbc:hive2:// WARNING: Use "yarn jar" to launch YARN applications.

[GitHub] spark pull request: [SPARK-15263][Core] Make shuffle service dir c...

2016-05-13 Thread tejasapatil
Github user tejasapatil commented on the pull request: https://github.com/apache/spark/pull/13042#issuecomment-219128637 There are no outstanding review comments left to address here. If everything looks good, can someone merge this PR ? Thanks !! --- If your project is set up for

[GitHub] spark pull request: [SPARK-15263][Core] Make shuffle service dir c...

2016-05-13 Thread tejasapatil
Github user tejasapatil commented on the pull request: https://github.com/apache/spark/pull/13042#issuecomment-219128249 @vanzin : I haven't gathered numbers with `Files.walkFileTree`. Based on its source code, it will have the same quirks wrt race conditions and speed. I believe

  1   2   3   4   >