[GitHub] spark issue #17467: [SPARK-20140][DStream] Remove hardcoded kinesis retry wa...

2017-03-29 Thread yssharma
Github user yssharma commented on the issue: https://github.com/apache/spark/pull/17467 @HyukjinKwon What should be the next steps for this PR. Are there any Spark-Kinesis experts who can review the patch ? --- If your project is set up for it, you can reply to this email and have

[GitHub] spark issue #17324: [SPARK-19969] [ML] Imputer doc and example

2017-03-29 Thread hhbyyh
Github user hhbyyh commented on the issue: https://github.com/apache/spark/pull/17324 The test was interrupted and need a retest. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #17450: [SPARK-20121][SQL] simplify NullPropagation with ...

2017-03-29 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/17450#discussion_r108843221 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala --- @@ -297,8 +297,8 @@ case class Lower(child:

[GitHub] spark pull request #17419: [SPARK-19634][ML] Multivariate summarizer - dataf...

2017-03-29 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/17419#discussion_r108840757 --- Diff: mllib/src/test/scala/org/apache/spark/ml/stat/SummarizerSuite.scala --- @@ -0,0 +1,399 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request #17419: [SPARK-19634][ML] Multivariate summarizer - dataf...

2017-03-29 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/17419#discussion_r108840709 --- Diff: mllib/src/test/scala/org/apache/spark/ml/stat/SummarizerSuite.scala --- @@ -0,0 +1,338 @@ +/* + * Licensed to the Apache Software

[GitHub] spark issue #17251: [SPARK-19910][SQL] `stack` should not reject NULL values...

2017-03-29 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/17251 Thank you so much! :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #17476: [SPARK-20151][SQL] Account for partition pruning in scan...

2017-03-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17476 **[Test build #75379 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75379/testReport)** for PR 17476 at commit

[GitHub] spark issue #17476: [SPARK-20151][SQL] Account for partition pruning in scan...

2017-03-29 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/17476 cc @ericl, @bogdanrdc, @adrian-ionescu, @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #17476: [SPARK-20151][SQL] Account for partition pruning ...

2017-03-29 Thread rxin
GitHub user rxin opened a pull request: https://github.com/apache/spark/pull/17476 [SPARK-20151][SQL] Account for partition pruning in scan metadataTime metrics ## What changes were proposed in this pull request? After SPARK-20136, we report metadata timing metrics in scan

[GitHub] spark pull request #17474: [Minor][SparkR]: Add run command comment in examp...

2017-03-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/17474 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #17474: [Minor][SparkR]: Add run command comment in examples

2017-03-29 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/17474 merged to master, thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #17251: [SPARK-19910][SQL] `stack` should not reject NULL values...

2017-03-29 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/17251 Will review it tonight. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #17419: [SPARK-19634][ML] Multivariate summarizer - dataf...

2017-03-29 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/17419#discussion_r108838518 --- Diff: mllib/src/main/scala/org/apache/spark/ml/stat/Summarizer.scala --- @@ -0,0 +1,746 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request #16019: [SPARK-18595] [SQL] Handling ignoreIfExists in Hi...

2017-03-29 Thread gatorsmile
Github user gatorsmile closed the pull request at: https://github.com/apache/spark/pull/16019 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark issue #17451: [SPARK-19866][ML][PySpark] Add local version of Word2Vec...

2017-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17451 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75378/ Test FAILed. ---

[GitHub] spark issue #17451: [SPARK-19866][ML][PySpark] Add local version of Word2Vec...

2017-03-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17451 **[Test build #75378 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75378/testReport)** for PR 17451 at commit

[GitHub] spark issue #17451: [SPARK-19866][ML][PySpark] Add local version of Word2Vec...

2017-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17451 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17451: [SPARK-19866][ML][PySpark] Add local version of Word2Vec...

2017-03-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17451 **[Test build #75378 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75378/testReport)** for PR 17451 at commit

[GitHub] spark pull request #17472: [SPARK-19999]: Fix for flakey tests due to java.n...

2017-03-29 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/17472#discussion_r108837689 --- Diff: common/unsafe/src/main/java/org/apache/spark/unsafe/Platform.java --- @@ -46,18 +46,22 @@ private static final boolean unaligned;

[GitHub] spark issue #17436: [SPARK-20101][SQL] Use OffHeapColumnVector when "spark.m...

2017-03-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17436 **[Test build #75377 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75377/testReport)** for PR 17436 at commit

[GitHub] spark pull request #17450: [SPARK-20121][SQL] simplify NullPropagation with ...

2017-03-29 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/17450#discussion_r108837093 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala --- @@ -297,8 +297,8 @@ case class Lower(child:

[GitHub] spark pull request #17475: [SPARK-20148] [SQL] Extend the file commit API to...

2017-03-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/17475 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #17475: [SPARK-20148] [SQL] Extend the file commit API to allow ...

2017-03-29 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/17475 Merging in master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark pull request #17469: [SPARK-20132][Docs] Add documentation for column ...

2017-03-29 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/17469#discussion_r108835449 --- Diff: python/pyspark/sql/column.py --- @@ -124,6 +124,35 @@ def _(self, other): return _ +like_doc = """ Return a Boolean

[GitHub] spark pull request #15821: [SPARK-13534][PySpark] Using Apache Arrow to incr...

2017-03-29 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/15821#discussion_r108835232 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -2747,6 +2747,17 @@ class Dataset[T] private[sql]( } }

[GitHub] spark pull request #15821: [SPARK-13534][PySpark] Using Apache Arrow to incr...

2017-03-29 Thread wesm
Github user wesm commented on a diff in the pull request: https://github.com/apache/spark/pull/15821#discussion_r108834631 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -2747,6 +2747,17 @@ class Dataset[T] private[sql]( } } +

[GitHub] spark pull request #15821: [SPARK-13534][PySpark] Using Apache Arrow to incr...

2017-03-29 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/15821#discussion_r108834618 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -2828,4 +2839,16 @@ class Dataset[T] private[sql](

[GitHub] spark issue #14617: [SPARK-17019][Core] Expose on-heap and off-heap memory u...

2017-03-29 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/14617 Hi @squito , would you please review the code again? Thanks a lot. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #17452: [SPARK-20123][build]$SPARK_HOME variable might have spac...

2017-03-29 Thread zuotingbing
Github user zuotingbing commented on the issue: https://github.com/apache/spark/pull/17452 OK,will do. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #15821: [SPARK-13534][PySpark] Using Apache Arrow to incr...

2017-03-29 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/15821#discussion_r108834139 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -2747,6 +2747,17 @@ class Dataset[T] private[sql]( } }

[GitHub] spark pull request #15821: [SPARK-13534][PySpark] Using Apache Arrow to incr...

2017-03-29 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/15821#discussion_r108833855 --- Diff: python/pyspark/sql/tests.py --- @@ -56,6 +56,15 @@ from pyspark.sql.utils import AnalysisException, ParseException, IllegalArgumentException

[GitHub] spark pull request #15821: [SPARK-13534][PySpark] Using Apache Arrow to incr...

2017-03-29 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/15821#discussion_r108833416 --- Diff: python/pyspark/sql/tests.py --- @@ -56,6 +56,15 @@ from pyspark.sql.utils import AnalysisException, ParseException, IllegalArgumentException

[GitHub] spark issue #17424: [SPARK-20089] [SQL] [TEST] Added DESC FUNCTION and DESC ...

2017-03-29 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/17424 I am not sure if it helps review by dumping the output of `DESC EXTENDED FUNCTION` to the test. We may not frequently change the output as I see. IMHO, It is hard to tell which is "correct" output

[GitHub] spark pull request #17415: [SPARK-19408][SQL] filter estimation on two colum...

2017-03-29 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/17415#discussion_r108830896 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/statsEstimation/FilterEstimationSuite.scala --- @@ -450,6 +467,69 @@ class

[GitHub] spark issue #16476: [SPARK-19084][SQL] Implement expression field

2017-03-29 Thread gczsjdy
Github user gczsjdy commented on the issue: https://github.com/apache/spark/pull/16476 @cloud-fan Do you have comment on this version? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #17475: [SPARK-20148] [SQL] Extend the file commit API to allow ...

2017-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17475 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17475: [SPARK-20148] [SQL] Extend the file commit API to allow ...

2017-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17475 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75374/ Test PASSed. ---

[GitHub] spark issue #17475: [SPARK-20148] [SQL] Extend the file commit API to allow ...

2017-03-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17475 **[Test build #75374 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75374/testReport)** for PR 17475 at commit

[GitHub] spark issue #15334: [SPARK-10367][SQL][WIP] Support Parquet logical type INT...

2017-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15334 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15334: [SPARK-10367][SQL][WIP] Support Parquet logical type INT...

2017-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15334 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75376/ Test PASSed. ---

[GitHub] spark issue #15334: [SPARK-10367][SQL][WIP] Support Parquet logical type INT...

2017-03-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15334 **[Test build #75376 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75376/testReport)** for PR 15334 at commit

[GitHub] spark pull request #17465: [SPARK-20136][SQL] Add num files and metadata ope...

2017-03-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/17465 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #17465: [SPARK-20136][SQL] Add num files and metadata operation ...

2017-03-29 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/17465 Let me merge this now. I will send a follow-up PR to take the logical planning time into account (otherwise in the vast majority of cases, i.e. pruned partitions, the metadata operation time will be

[GitHub] spark issue #17465: [SPARK-20136][SQL] Add num files and metadata operation ...

2017-03-29 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/17465 Merging in master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #17415: [SPARK-19408][SQL] filter estimation on two columns of s...

2017-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17415 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75375/ Test PASSed. ---

[GitHub] spark issue #17415: [SPARK-19408][SQL] filter estimation on two columns of s...

2017-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17415 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17415: [SPARK-19408][SQL] filter estimation on two columns of s...

2017-03-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17415 **[Test build #75375 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75375/testReport)** for PR 17415 at commit

[GitHub] spark pull request #17470: [SPARK-20146][SQL] fix comment missing issue for ...

2017-03-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/17470 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #17470: [SPARK-20146][SQL] fix comment missing issue for thrift ...

2017-03-29 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/17470 Merging in master. Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #17475: [SPARK-20148] [SQL] Extend the file commit API to allow ...

2017-03-29 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/17475 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark issue #17375: [SPARK-19019][PYTHON][BRANCH-1.6] Fix hijacked `collecti...

2017-03-29 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/17375 Yea, it might be less important but I guess still it is a valid backport. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #17375: [SPARK-19019][PYTHON][BRANCH-1.6] Fix hijacked `collecti...

2017-03-29 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/17375 tentative looks good, my only question is if someone wants to use Python 3.6 (first released December 2016) are they likely to want to use it with Spark 1.6 (first released January 2016)? --- If

[GitHub] spark pull request #17222: [SPARK-19439][PYSPARK][SQL] PySpark's registerJav...

2017-03-29 Thread zjffdu
GitHub user zjffdu reopened a pull request: https://github.com/apache/spark/pull/17222 [SPARK-19439][PYSPARK][SQL] PySpark's registerJavaFunction Should Support UDAFs ## What changes were proposed in this pull request? Support register Java UDAFs in PySpark so that user

[GitHub] spark pull request #17222: [SPARK-19439][PYSPARK][SQL] PySpark's registerJav...

2017-03-29 Thread zjffdu
Github user zjffdu closed the pull request at: https://github.com/apache/spark/pull/17222 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #17473: [SPARK-19088][SQL] Fix 2.10 build.

2017-03-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/17473 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #17473: [SPARK-19088][SQL] Fix 2.10 build.

2017-03-29 Thread ueshin
Github user ueshin commented on the issue: https://github.com/apache/spark/pull/17473 Merging to master! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #17473: [SPARK-19088][SQL] Fix 2.10 build.

2017-03-29 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/17473 LGTM, thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #17394: [SPARK-20067] [SQL] Unify and Clean Up Desc Commands Usi...

2017-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17394 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75370/ Test PASSed. ---

[GitHub] spark issue #17394: [SPARK-20067] [SQL] Unify and Clean Up Desc Commands Usi...

2017-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17394 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17394: [SPARK-20067] [SQL] Unify and Clean Up Desc Commands Usi...

2017-03-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17394 **[Test build #75370 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75370/testReport)** for PR 17394 at commit

[GitHub] spark issue #17473: [SPARK-19088][SQL] Fix 2.10 build.

2017-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17473 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75371/ Test PASSed. ---

[GitHub] spark issue #17473: [SPARK-19088][SQL] Fix 2.10 build.

2017-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17473 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17473: [SPARK-19088][SQL] Fix 2.10 build.

2017-03-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17473 **[Test build #75371 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75371/testReport)** for PR 17473 at commit

[GitHub] spark issue #15334: [SPARK-10367][SQL][WIP] Support Parquet logical type INT...

2017-03-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15334 **[Test build #75376 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75376/testReport)** for PR 15334 at commit

[GitHub] spark issue #17415: [SPARK-19408][SQL] filter estimation on two columns of s...

2017-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17415 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17415: [SPARK-19408][SQL] filter estimation on two columns of s...

2017-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17415 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75369/ Test PASSed. ---

[GitHub] spark issue #17415: [SPARK-19408][SQL] filter estimation on two columns of s...

2017-03-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17415 **[Test build #75369 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75369/testReport)** for PR 17415 at commit

[GitHub] spark issue #17415: [SPARK-19408][SQL] filter estimation on two columns of s...

2017-03-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17415 **[Test build #75375 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75375/testReport)** for PR 17415 at commit

[GitHub] spark issue #17475: [SPARK-20148] [SQL] Extend the file commit API to allow ...

2017-03-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17475 **[Test build #75374 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75374/testReport)** for PR 17475 at commit

[GitHub] spark issue #17417: [DOCS] Docs-only improvements

2017-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17417 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75368/ Test PASSed. ---

[GitHub] spark issue #17417: [DOCS] Docs-only improvements

2017-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17417 Build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request #17475: [SPARK-20148] [SQL] Extend the file commit API to...

2017-03-29 Thread ericl
GitHub user ericl opened a pull request: https://github.com/apache/spark/pull/17475 [SPARK-20148] [SQL] Extend the file commit API to allow subscribing to task commit messages ## What changes were proposed in this pull request? The internal FileCommitProtocol interface

[GitHub] spark issue #17417: [DOCS] Docs-only improvements

2017-03-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17417 **[Test build #75368 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75368/testReport)** for PR 17417 at commit

[GitHub] spark issue #17416: [SPARK-20075][CORE][WIP] Support classifier, packaging i...

2017-03-29 Thread BryanCutler
Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/17416 So is the problem that it downloads `stanford-corenlp-3.4.1-models.jar` but thinks it is `stanford-corenlp-3.4.1.jar`? It looks like it might be possible to add the classifier to

[GitHub] spark issue #17445: [SPARK-20115] [CORE] Fix DAGScheduler to recompute all t...

2017-03-29 Thread umehrot2
Github user umehrot2 commented on the issue: https://github.com/apache/spark/pull/17445 @kayousterhout Thanks for your response, and for that link. Well it does seem like #17088 addresses the same issue as this PR. However, I would like the you all to review this PR as well,

[GitHub] spark pull request #17415: [SPARK-19408][SQL] filter estimation on two colum...

2017-03-29 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/17415#discussion_r108810108 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/statsEstimation/FilterEstimation.scala --- @@ -550,8 +565,143 @@ case

[GitHub] spark pull request #17450: [SPARK-20121][SQL] simplify NullPropagation with ...

2017-03-29 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/17450#discussion_r108809796 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala --- @@ -297,8 +297,8 @@ case class Lower(child:

[GitHub] spark issue #17474: [Minor][SparkR]: Add run command comment in examples

2017-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17474 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75373/ Test PASSed. ---

[GitHub] spark issue #17474: [Minor][SparkR]: Add run command comment in examples

2017-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17474 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17474: [Minor][SparkR]: Add run command comment in examples

2017-03-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17474 **[Test build #75373 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75373/testReport)** for PR 17474 at commit

[GitHub] spark issue #15326: [SPARK-17759] [CORE] Avoid adding duplicate schedulables

2017-03-29 Thread erenavsarogullari
Github user erenavsarogullari commented on the issue: https://github.com/apache/spark/pull/15326 Jenkins test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #17474: [Minor][SparkR]: Add run command comment in examples

2017-03-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17474 **[Test build #75373 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75373/testReport)** for PR 17474 at commit

[GitHub] spark pull request #17474: [Minor][SparkR]: Add run command comment in examp...

2017-03-29 Thread wangmiao1981
GitHub user wangmiao1981 opened a pull request: https://github.com/apache/spark/pull/17474 [Minor][SparkR]: Add run command comment in examples ## What changes were proposed in this pull request? There are two examples in r folder missing the run commands. In this

[GitHub] spark issue #17472: [SPARK-19999]: Fix for flakey tests due to java.nio.Bits...

2017-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17472 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75372/ Test FAILed. ---

[GitHub] spark issue #17472: [SPARK-19999]: Fix for flakey tests due to java.nio.Bits...

2017-03-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17472 **[Test build #75372 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75372/testReport)** for PR 17472 at commit

[GitHub] spark issue #17472: [SPARK-19999]: Fix for flakey tests due to java.nio.Bits...

2017-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17472 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17472: [SPARK-19999]: Fix for flakey tests due to java.nio.Bits...

2017-03-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17472 **[Test build #75372 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75372/testReport)** for PR 17472 at commit

[GitHub] spark issue #17472: [SPARK-19999]: Fix for flakey tests due to java.nio.Bits...

2017-03-29 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/17472 Clear code comments can help code reading. : ) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #17472: [SPARK-19999]: Fix for flakey tests due to java.nio.Bits...

2017-03-29 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/17472 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark pull request #17472: [SPARK-19999]: Fix for flakey tests due to java.n...

2017-03-29 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/17472#discussion_r108802741 --- Diff: common/unsafe/src/main/java/org/apache/spark/unsafe/Platform.java --- @@ -46,18 +46,22 @@ private static final boolean unaligned;

[GitHub] spark pull request #17449: [SPARK-20120][SQL] spark-sql support silent mode

2017-03-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/17449 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #15009: [SPARK-17443][SPARK-11035] Stop Spark Application...

2017-03-29 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/15009#discussion_r108802255 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala --- @@ -735,7 +749,12 @@ object SparkSubmit extends CommandLineUtils { }

[GitHub] spark issue #17449: [SPARK-20120][SQL] spark-sql support silent mode

2017-03-29 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/17449 Thanks! Merging to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #15009: [SPARK-17443][SPARK-11035] Stop Spark Application...

2017-03-29 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/15009#discussion_r108801550 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala --- @@ -735,7 +749,12 @@ object SparkSubmit extends CommandLineUtils { }

[GitHub] spark issue #17415: [SPARK-19408][SQL] filter estimation on two columns of s...

2017-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17415 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75367/ Test PASSed. ---

[GitHub] spark issue #17415: [SPARK-19408][SQL] filter estimation on two columns of s...

2017-03-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17415 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17400: [SPARK-19981][SQL] Update output partitioning info. in P...

2017-03-29 Thread allengeorge
Github user allengeorge commented on the issue: https://github.com/apache/spark/pull/17400 I suggest the following code for `outputOrdering`: ``` override def outputOrdering: Seq[SortOrder] = child.outputOrdering.map { case s @ SortOrder(e, _) =>

[GitHub] spark issue #17415: [SPARK-19408][SQL] filter estimation on two columns of s...

2017-03-29 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17415 **[Test build #75367 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75367/testReport)** for PR 17415 at commit

[GitHub] spark issue #17472: [SPARK-19999]: Fix for flakey tests due to java.nio.Bits...

2017-03-29 Thread samelamin
Github user samelamin commented on the issue: https://github.com/apache/spark/pull/17472 @gatorsmile moved the comment per your suggestion, but to be honest if the comment is unclear surly the first thing someone will do is check that JIRA? --- If your project is set up for it, you

[GitHub] spark issue #16541: [SPARK-19088][SQL] Optimize sequence type deserializatio...

2017-03-29 Thread ueshin
Github user ueshin commented on the issue: https://github.com/apache/spark/pull/16541 I sent a pr #17473. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

  1   2   3   4   >