[GitHub] spark issue #14684: [SPARK-17105][CORE] App name will be random UUID while c...

2016-08-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14684 **[Test build #63914 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63914/consoleFull)** for PR 14684 at commit [`c05fc3e`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14688: [SPARK-17095] [Documentation] [Latex and Scala doc do no...

2016-08-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14688 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63920/ Test FAILed. ---

[GitHub] spark issue #14688: [SPARK-17095] [Documentation] [Latex and Scala doc do no...

2016-08-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14688 **[Test build #63920 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63920/consoleFull)** for PR 14688 at commit [`d50990c`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14688: [SPARK-17095] [Documentation] [Latex and Scala doc do no...

2016-08-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14688 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #14688: [SPARK-17095] [Documentation] [Latex and Scala do...

2016-08-17 Thread jagadeesanas2
GitHub user jagadeesanas2 opened a pull request: https://github.com/apache/spark/pull/14688 [SPARK-17095] [Documentation] [Latex and Scala doc do not play nicely] ## What changes were proposed in this pull request? In Latex, it is common to find "}}}" when closing several ex

[GitHub] spark issue #14688: [SPARK-17095] [Documentation] [Latex and Scala doc do no...

2016-08-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14688 **[Test build #63920 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63920/consoleFull)** for PR 14688 at commit [`d50990c`](https://github.com/apache/spark/commit/d

[GitHub] spark pull request #14620: [SPARK-17032][SQL] Add test cases for methods in ...

2016-08-17 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14620 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #14671: [SPARK-17091][SQL] ParquetFilters rewrite IN to OR of Eq

2016-08-17 Thread andreweduffy
Github user andreweduffy commented on the issue: https://github.com/apache/spark/pull/14671 Yeah benchmarking is definitely a great idea, as it is likely Spark will be better than Parquet at filtering individual records, but I'm still not quite understanding why this filter is any dif

[GitHub] spark issue #14687: [SPARK-17107][SQL] Remove redundant pushdown rule for Un...

2016-08-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14687 **[Test build #63919 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63919/consoleFull)** for PR 14687 at commit [`a4c015d`](https://github.com/apache/spark/commit/a

[GitHub] spark issue #14620: [SPARK-17032][SQL] Add test cases for methods in ParserU...

2016-08-17 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/14620 Merging to master. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and w

[GitHub] spark pull request #14687: [SPARK-17107][SQL] Remove redundant pushdown rule...

2016-08-17 Thread viirya
GitHub user viirya opened a pull request: https://github.com/apache/spark/pull/14687 [SPARK-17107][SQL] Remove redundant pushdown rule for Union ## What changes were proposed in this pull request? The `Optimizer` rules `PushThroughSetOperations` and `PushDownPredicate` have

[GitHub] spark issue #14620: [SPARK-17032][SQL] Add test cases for methods in ParserU...

2016-08-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14620 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63912/ Test PASSed. ---

[GitHub] spark issue #14620: [SPARK-17032][SQL] Add test cases for methods in ParserU...

2016-08-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14620 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #14676: [SPARK-16947][SQL] Support type coercion and fold...

2016-08-17 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/14676#discussion_r75110862 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/ResolveInlineTables.scala --- @@ -0,0 +1,109 @@ +/* + * Licensed to

[GitHub] spark issue #14620: [SPARK-17032][SQL] Add test cases for methods in ParserU...

2016-08-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14620 **[Test build #63912 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63912/consoleFull)** for PR 14620 at commit [`11bcb1d`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #14667: [SPARK-17087][MESOS] Documentation for Making Spa...

2016-08-17 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/14667#discussion_r75110761 --- Diff: docs/running-on-mesos.md --- @@ -207,6 +207,16 @@ The scheduler will start executors round-robin on the offers Mesos gives it, but there are no

[GitHub] spark pull request #14676: [SPARK-16947][SQL] Support type coercion and fold...

2016-08-17 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/14676#discussion_r75110610 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/ResolveInlineTables.scala --- @@ -0,0 +1,109 @@ +/* + * Licensed to

[GitHub] spark issue #14686: [SPARK-16253][SQL] make spark sql compatible with hive s...

2016-08-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14686 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request #14686: [SPARK-16253][SQL] make spark sql compatible with...

2016-08-17 Thread zenglinxi0615
GitHub user zenglinxi0615 opened a pull request: https://github.com/apache/spark/pull/14686 [SPARK-16253][SQL] make spark sql compatible with hive sql that using… ## What changes were proposed in this pull request? make spark sql compatible with hive sql that using python

[GitHub] spark pull request #14684: [SPARK-17105][CORE] App name will be random UUID ...

2016-08-17 Thread phalodi
Github user phalodi closed the pull request at: https://github.com/apache/spark/pull/14684 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is en

[GitHub] spark issue #14684: [SPARK-17105][CORE] App name will be random UUID while c...

2016-08-17 Thread phalodi
Github user phalodi commented on the issue: https://github.com/apache/spark/pull/14684 @srowen ok so i close this PR as you suggested. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fea

[GitHub] spark pull request #14685: [SPARK-17106][SQL] Simplify the SubqueryExpressio...

2016-08-17 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/14685#discussion_r75106052 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/subquery.scala --- @@ -56,30 +44,29 @@ trait ExecSubqueryExpression extends SubqueryExpre

[GitHub] spark issue #14279: [SPARK-16216][SQL][WIP] Read/write timestamps and dates ...

2016-08-17 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14279 I will take another look tomorrow. Please feel free to take a look further because it's almost complete I think. --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark issue #14279: [SPARK-16216][SQL] Read/write timestamps and dates in IS...

2016-08-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14279 **[Test build #63918 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63918/consoleFull)** for PR 14279 at commit [`4171a3c`](https://github.com/apache/spark/commit/4

[GitHub] spark issue #14279: [SPARK-16216][SQL] Write Timestamp and Date in ISO 8601 ...

2016-08-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14279 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14279: [SPARK-16216][SQL] Write Timestamp and Date in ISO 8601 ...

2016-08-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14279 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63917/ Test FAILed. ---

[GitHub] spark issue #14279: [SPARK-16216][SQL] Write Timestamp and Date in ISO 8601 ...

2016-08-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14279 **[Test build #63917 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63917/consoleFull)** for PR 14279 at commit [`c4900de`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14685: [SPARK-17106][SQL] Simplify the SubqueryExpression inter...

2016-08-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14685 **[Test build #63916 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63916/consoleFull)** for PR 14685 at commit [`d2bd26c`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #14279: [SPARK-16216][SQL] Write Timestamp and Date in ISO 8601 ...

2016-08-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14279 **[Test build #63917 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63917/consoleFull)** for PR 14279 at commit [`c4900de`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #14279: [SPARK-16216][SQL] Write Timestamp and Date in ISO 8601 ...

2016-08-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14279 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63915/ Test FAILed. ---

[GitHub] spark issue #14279: [SPARK-16216][SQL] Write Timestamp and Date in ISO 8601 ...

2016-08-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14279 **[Test build #63915 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63915/consoleFull)** for PR 14279 at commit [`8bcdd59`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14279: [SPARK-16216][SQL] Write Timestamp and Date in ISO 8601 ...

2016-08-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14279 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14685: [SPARK-17106][SQL] Simplify the SubqueryExpression inter...

2016-08-17 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/14685 cc @davies (we discussed this in PR https://github.com/apache/spark/pull/14548) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark issue #14279: [SPARK-16216][SQL] Write Timestamp and Date in ISO 8601 ...

2016-08-17 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14279 Let me please rebase as it is now different a lot. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request #14685: [SPARK-17106][SQL] Simplify the SubqueryExpressio...

2016-08-17 Thread hvanhovell
GitHub user hvanhovell opened a pull request: https://github.com/apache/spark/pull/14685 [SPARK-17106][SQL] Simplify the SubqueryExpression interface ## What changes were proposed in this pull request? The current subquery expression interface contains a little bit of technical

[GitHub] spark issue #14279: [SPARK-16216][SQL] Write Timestamp and Date in ISO 8601 ...

2016-08-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14279 **[Test build #63915 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63915/consoleFull)** for PR 14279 at commit [`8bcdd59`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #14684: [SPARK-17105][CORE] App name will be random UUID while c...

2016-08-17 Thread phalodi
Github user phalodi commented on the issue: https://github.com/apache/spark/pull/14684 @srowen Yes you are right but SPARK-16966 is only for spark session but while user creating the spark context then they must be give app name. i think for both spark session and spark context the be

[GitHub] spark issue #14684: [SPARK-17105][CORE] App name will be random UUID while c...

2016-08-17 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14684 This is a duplicate of SPARK-16966, pretty much. I don't think this behavior here should be changed. See the fix for SPARK-16966 and discussion for more about the intended behavior. --- If your pro

[GitHub] spark issue #14683: [SPARK-16968]Add additional options in jdbc when creatin...

2016-08-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14683 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14683: [SPARK-16968]Add additional options in jdbc when creatin...

2016-08-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14683 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63913/ Test PASSed. ---

[GitHub] spark issue #14683: [SPARK-16968]Add additional options in jdbc when creatin...

2016-08-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14683 **[Test build #63913 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63913/consoleFull)** for PR 14683 at commit [`8360c29`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14682: [SPARK-17104][SQL] LogicalRelation.newInstance should fo...

2016-08-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14682 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14682: [SPARK-17104][SQL] LogicalRelation.newInstance should fo...

2016-08-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14682 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63911/ Test PASSed. ---

[GitHub] spark issue #14682: [SPARK-17104][SQL] LogicalRelation.newInstance should fo...

2016-08-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14682 **[Test build #63911 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63911/consoleFull)** for PR 14682 at commit [`f9a8c76`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14684: [SPARK-17105][CORE] App name will be random UUID while c...

2016-08-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14684 **[Test build #63914 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63914/consoleFull)** for PR 14684 at commit [`c05fc3e`](https://github.com/apache/spark/commit/c

[GitHub] spark pull request #14684: [SPARK-17105][CORE] App name will be random UUID ...

2016-08-17 Thread phalodi
GitHub user phalodi opened a pull request: https://github.com/apache/spark/pull/14684 [SPARK-17105][CORE] App name will be random UUID while creating spark context if it will … ## What changes were proposed in this pull request? App name will be random UUID while creating

[GitHub] spark issue #14620: [SPARK-17032][SQL] Add test cases for methods in ParserU...

2016-08-17 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/14620 LGTM - pending Jenkins. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wish

[GitHub] spark issue #14683: [SPARK-16968]Add additional options in jdbc when creatin...

2016-08-17 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14683 Hm, this does not look up to date with master. The original changes were already merged, so I think this would just include your doc changes. Maybe squash your commits, rebase on master? --- If you

[GitHub] spark issue #14683: [SPARK-16968]Add additional options in jdbc when creatin...

2016-08-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14683 **[Test build #63913 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63913/consoleFull)** for PR 14683 at commit [`8360c29`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #14683: [SPARK-16968]Add additional options in jdbc when creatin...

2016-08-17 Thread GraceH
Github user GraceH commented on the issue: https://github.com/apache/spark/pull/14683 @srowen Here we go. please feel free to let me know your comments. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request #14683: [SPARK-16968]Add additional options in jdbc when ...

2016-08-17 Thread GraceH
GitHub user GraceH opened a pull request: https://github.com/apache/spark/pull/14683 [SPARK-16968]Add additional options in jdbc when creating a new table ## What changes were proposed in this pull request? (Please fill in changes proposed in this fix) In the PR, we just

[GitHub] spark issue #14671: [SPARK-17091][SQL] ParquetFilters rewrite IN to OR of Eq

2016-08-17 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14671 @andreweduffy @rxin Maybe I can go for the simple benchmark quickly (maybe within this weekend) and open a PR to disable Parquet row-by-row filtering if it makes sense and this can be the reason

[GitHub] spark issue #14620: [SPARK-17032][SQL] Add test cases for methods in ParserU...

2016-08-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14620 **[Test build #63912 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63912/consoleFull)** for PR 14620 at commit [`11bcb1d`](https://github.com/apache/spark/commit/1

[GitHub] spark issue #14559: [SPARK-16968]Add additional options in jdbc when creatin...

2016-08-17 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14559 @GraceH yeah you'll need a new PR. You can open it vs the same JIRA since these are fairly tightly related. --- If your project is set up for it, you can reply to this email and have your reply appe

[GitHub] spark issue #14650: [SPARK-17062][MESOS] add conf option to mesos dispatcher

2016-08-17 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14650 Seems OK to me, to the limits of my understanding, and given the logic of https://github.com/apache/spark/pull/14650#issuecomment-240057336 --- If your project is set up for it, you can reply to thi

[GitHub] spark pull request #14667: [SPARK-17087][MESOS] Documentation for Making Spa...

2016-08-17 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14667#discussion_r75097036 --- Diff: docs/running-on-mesos.md --- @@ -207,6 +207,16 @@ The scheduler will start executors round-robin on the offers Mesos gives it, but there are no

[GitHub] spark pull request #14643: [SPARK-17057][ML] ProbabilisticClassifierModels' ...

2016-08-17 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14643#discussion_r75096884 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/ProbabilisticClassifier.scala --- @@ -201,11 +201,18 @@ abstract class ProbabilisticClassif

[GitHub] spark issue #14671: [SPARK-17091][SQL] ParquetFilters rewrite IN to OR of Eq

2016-08-17 Thread andreweduffy
Github user andreweduffy commented on the issue: https://github.com/apache/spark/pull/14671 That is true, but currently all filters are being pushed down to row-by-row anyway when not using the vectorized reader, so I'm unclear why the IN filter is special --- If your project is set

[GitHub] spark issue #14559: [SPARK-16968]Add additional options in jdbc when creatin...

2016-08-17 Thread GraceH
Github user GraceH commented on the issue: https://github.com/apache/spark/pull/14559 Hi @srowen @rxin , sorry for late response. I have added the document part. https://github.com/GraceH/spark/commit/8360c2911b70aa628f8edba593e3764d3b07ca55 Shall I raise a new PR? --- If your pr

[GitHub] spark issue #14659: [SPARK-16757] Set up Spark caller context to HDFS

2016-08-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14659 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63910/ Test FAILed. ---

[GitHub] spark issue #14659: [SPARK-16757] Set up Spark caller context to HDFS

2016-08-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14659 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14659: [SPARK-16757] Set up Spark caller context to HDFS

2016-08-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14659 **[Test build #63910 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63910/consoleFull)** for PR 14659 at commit [`ec6833d`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13950: [SPARK-15487] [Web UI] Spark Master UI to reverse proxy ...

2016-08-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13950 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63909/ Test PASSed. ---

[GitHub] spark issue #13950: [SPARK-15487] [Web UI] Spark Master UI to reverse proxy ...

2016-08-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13950 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14671: [SPARK-17091][SQL] ParquetFilters rewrite IN to OR of Eq

2016-08-17 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14671 I mean, maybe we should disable the row-by-row one in Parquet with a proper benchmark first before handling `In` here. --- If your project is set up for it, you can reply to this email and have

[GitHub] spark issue #13950: [SPARK-15487] [Web UI] Spark Master UI to reverse proxy ...

2016-08-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13950 **[Test build #63909 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63909/consoleFull)** for PR 13950 at commit [`624af2e`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14671: [SPARK-17091][SQL] ParquetFilters rewrite IN to OR of Eq

2016-08-17 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14671 Yea, that is all true. Actually, it would be okay just not to pass the filter [here](https://github.com/apache/spark/blob/abff92bfdc7d4c9d2308794f0350561fe0ceb4dd/sql/core/src/main/scala/org/apa

[GitHub] spark issue #13950: [SPARK-15487] [Web UI] Spark Master UI to reverse proxy ...

2016-08-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13950 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13950: [SPARK-15487] [Web UI] Spark Master UI to reverse proxy ...

2016-08-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13950 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63907/ Test PASSed. ---

[GitHub] spark issue #13950: [SPARK-15487] [Web UI] Spark Master UI to reverse proxy ...

2016-08-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13950 **[Test build #63907 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63907/consoleFull)** for PR 13950 at commit [`035478d`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #14671: [SPARK-17091][SQL] ParquetFilters rewrite IN to O...

2016-08-17 Thread andreweduffy
Github user andreweduffy commented on a diff in the pull request: https://github.com/apache/spark/pull/14671#discussion_r75092317 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetFilterSuite.scala --- @@ -369,7 +369,7 @@ class ParquetFilt

[GitHub] spark issue #14671: [SPARK-17091][SQL] ParquetFilters rewrite IN to OR of Eq

2016-08-17 Thread andreweduffy
Github user andreweduffy commented on the issue: https://github.com/apache/spark/pull/14671 Thanks for the comments guys! Had to search through some code, but I think I understand the current state of things. Correct me if I'm wrong, but it seems that record-by-record filtering only o

[GitHub] spark pull request #14620: [SPARK-17032][SQL] Add test cases for methods in ...

2016-08-17 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/14620#discussion_r75091055 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/parser/ParserUtilsSuite.scala --- @@ -61,5 +102,88 @@ class ParserUtilsSuite extends

[GitHub] spark issue #14279: [SPARK-16216][SQL] Write Timestamp and Date in ISO 8601 ...

2016-08-17 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14279 Sure, thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #14524: [SPARK-16832] [ML] [WIP] CrossValidator and TrainValidat...

2016-08-17 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14524 OK, this sounds like it could be a good change. I'd like to ask @jkbradley again in case there was a strong reason I'm missing to fix the seed by default. Also CC @davies if possible to consider the

[GitHub] spark issue #14679: [SPARK-17102][SQL] bypass UserDefinedGenerator for json ...

2016-08-17 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/14679 Now I have put the stacktrace in the JIRA, sorry for that. I didn't look into this, seems like the behavior of scala reflection methods is different between scala 2.10 and 2.11. Anyway the

[GitHub] spark issue #14555: [SPARK-16965][MLLIB][PYSPARK] Fix bound checking for Spa...

2016-08-17 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14555 That's a good point, it's public now. I think I agree with you then, it's fairly important to retain the validation there. It would also be inconsistent to move it back, yes, because I see the other

[GitHub] spark issue #14682: [SPARK-17104][SQL] LogicalRelation.newInstance should fo...

2016-08-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14682 **[Test build #63911 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63911/consoleFull)** for PR 14682 at commit [`f9a8c76`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #14562: [SPARK-16973][SQL] remove the buffer offsets in Imperati...

2016-08-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14562 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63908/ Test FAILed. ---

[GitHub] spark issue #14562: [SPARK-16973][SQL] remove the buffer offsets in Imperati...

2016-08-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14562 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14562: [SPARK-16973][SQL] remove the buffer offsets in Imperati...

2016-08-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14562 **[Test build #63908 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63908/consoleFull)** for PR 14562 at commit [`5c8f324`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #14682: [SPARK-17104][SQL] LogicalRelation.newInstance sh...

2016-08-17 Thread viirya
GitHub user viirya opened a pull request: https://github.com/apache/spark/pull/14682 [SPARK-17104][SQL] LogicalRelation.newInstance should follow the semantics of MultiInstanceRelation ## What changes were proposed in this pull request? Currently `LogicalRelation.newInstanc

[GitHub] spark issue #14562: [SPARK-16973][SQL] remove the buffer offsets in Imperati...

2016-08-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14562 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14562: [SPARK-16973][SQL] remove the buffer offsets in Imperati...

2016-08-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14562 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63906/ Test FAILed. ---

[GitHub] spark issue #14562: [SPARK-16973][SQL] remove the buffer offsets in Imperati...

2016-08-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14562 **[Test build #63906 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63906/consoleFull)** for PR 14562 at commit [`e50aece`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14679: [SPARK-17102][SQL] bypass UserDefinedGenerator for json ...

2016-08-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14679 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14679: [SPARK-17102][SQL] bypass UserDefinedGenerator for json ...

2016-08-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14679 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63902/ Test PASSed. ---

[GitHub] spark issue #14576: [SPARK-16391][SQL] Support partial aggregation for reduc...

2016-08-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14576 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14679: [SPARK-17102][SQL] bypass UserDefinedGenerator for json ...

2016-08-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14679 **[Test build #63902 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63902/consoleFull)** for PR 14679 at commit [`c04084d`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14576: [SPARK-16391][SQL] Support partial aggregation for reduc...

2016-08-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14576 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63903/ Test PASSed. ---

[GitHub] spark issue #14576: [SPARK-16391][SQL] Support partial aggregation for reduc...

2016-08-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14576 **[Test build #63903 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63903/consoleFull)** for PR 14576 at commit [`1b57b74`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14551: [SPARK-16961][CORE] Fixed off-by-one error that biased r...

2016-08-17 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14551 I'd expect the Gaussians to move as a result of this change. I think it's fair to simply modify the test to match the current output in this case. --- If your project is set up for it, you can repl

[GitHub] spark pull request #14674: [SPARK-17002][CORE]: Document that spark.ssl.prot...

2016-08-17 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14674#discussion_r75082040 --- Diff: core/src/main/scala/org/apache/spark/SecurityManager.scala --- @@ -282,7 +282,9 @@ private[spark] class SecurityManager(sparkConf: SparkConf)

[GitHub] spark issue #14680: [SPARK-17101][SQL] Provide format identifier for TextFil...

2016-08-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14680 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14680: [SPARK-17101][SQL] Provide format identifier for TextFil...

2016-08-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14680 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63904/ Test FAILed. ---

[GitHub] spark issue #14681: [SPARK-17038][Streaming] fix metrics retrieval source of...

2016-08-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14681 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14680: [SPARK-17101][SQL] Provide format identifier for TextFil...

2016-08-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14680 **[Test build #63904 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63904/consoleFull)** for PR 14680 at commit [`133e5de`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14681: [SPARK-17038][Streaming] fix metrics retrieval source of...

2016-08-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14681 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63905/ Test PASSed. ---

[GitHub] spark issue #14681: [SPARK-17038][Streaming] fix metrics retrieval source of...

2016-08-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14681 **[Test build #63905 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63905/consoleFull)** for PR 14681 at commit [`ccd211f`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14659: [SPARK-16757] Set up Spark caller context to HDFS

2016-08-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14659 **[Test build #63910 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63910/consoleFull)** for PR 14659 at commit [`ec6833d`](https://github.com/apache/spark/commit/e

<    2   3   4   5   6   7   8   >