[GitHub] spark pull request: [SPARK-5095] [Mesos] Support launching multipl...

2016-02-01 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/10993#issuecomment-178173549 Also, follow-up question: have you tested this with cluster mode and/or with dynamic allocation? --- If your project is set up for it, you can reply to this email a

[GitHub] spark pull request: [SPARK-11780][SQL] Add catalyst type aliases b...

2016-02-01 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/10915#issuecomment-178172474 Can you close this PR now? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not hav

[GitHub] spark pull request: [ML][MINOR] Invalid MulticlassClassification r...

2016-02-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/10996 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-10605][SQL] Add structs to collect_list...

2016-02-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11004#issuecomment-178169642 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-10605][SQL] Add structs to collect_list...

2016-02-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11004#issuecomment-178169641 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12299][CORE][WIP] Remove history servin...

2016-02-01 Thread BryanCutler
Github user BryanCutler commented on the pull request: https://github.com/apache/spark/pull/10991#issuecomment-178169443 cc @andrewor14, @squito for thoughts on above --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If you

[GitHub] spark pull request: [SPARK-12790][CORE] Remove HistoryServer old m...

2016-02-01 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/10860#issuecomment-178169396 I see, that seems unnecessary. We deleted all the code path that would parse the format so it's pretty much impossible for it to be picked up right? --- If your pro

[GitHub] spark pull request: [ML][MINOR] Invalid MulticlassClassification r...

2016-02-01 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/10996#issuecomment-178169426 LGTM. Merged into master. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does no

[GitHub] spark pull request: [SPARK-12951] [SQL] support spilling in genera...

2016-02-01 Thread nongli
Github user nongli commented on the pull request: https://github.com/apache/spark/pull/10998#issuecomment-178169324 Can you include the generated code? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-10605][SQL] Add structs to collect_list...

2016-02-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11004#issuecomment-178169233 **[Test build #50493 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50493/consoleFull)** for PR 11004 at commit [`326a213`](https://g

[GitHub] spark pull request: [SPARK-12992][SQL]: Update parquet reader to s...

2016-02-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10908#issuecomment-178168455 **[Test build #50499 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50499/consoleFull)** for PR 10908 at commit [`2ea2d54`](https://gi

[GitHub] spark pull request: [SPARK-11780][SQL] Add catalyst type aliases b...

2016-02-01 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/10915#issuecomment-178167383 Thanks, merged to branch-1.6. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-12951] [SQL] support spilling in genera...

2016-02-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10998#issuecomment-178167283 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12951] [SQL] support spilling in genera...

2016-02-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10998#issuecomment-178167285 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12790][CORE] Remove HistoryServer old m...

2016-02-01 Thread felixcheung
Github user felixcheung commented on the pull request: https://github.com/apache/spark/pull/10860#issuecomment-178166829 sure - that was just to make sure it doesn't get picked up, as a negative test. I can purge all of that since it seems both you and @vanzin have the same feedback?

[GitHub] spark pull request: [SPARK-12951] [SQL] support spilling in genera...

2016-02-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10998#issuecomment-178166922 **[Test build #50494 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50494/consoleFull)** for PR 10998 at commit [`02f2a25`](https://g

[GitHub] spark pull request: [SPARK-12790][CORE] Remove HistoryServer old m...

2016-02-01 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/10860#issuecomment-178166468 @felixcheung this looks great! I'm excited about how many lines of code we're deleting in this patch. I had one question about the tests but this is good to go other

[GitHub] spark pull request: [SPARK-12790][CORE] Remove HistoryServer old m...

2016-02-01 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/10860#discussion_r51472679 --- Diff: .rat-excludes --- @@ -63,14 +63,15 @@ logs .*dependency-reduced-pom.xml known_translations json_expectation -local-14229817592

[GitHub] spark pull request: [Docs] Fix the jar location of datanucleus in ...

2016-02-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/10901 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-12790][CORE] Remove HistoryServer old m...

2016-02-01 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/10860#discussion_r51472337 --- Diff: core/src/test/resources/spark-events/local-1425081759268/EVENT_LOG_1 --- @@ -0,0 +1,88 @@ +{"Event":"SparkListenerBlockManagerAdded","Block

[GitHub] spark pull request: [SPARK-13113][Core] Remove unnecessary bit ope...

2016-02-01 Thread holdenk
Github user holdenk commented on the pull request: https://github.com/apache/spark/pull/11002#issuecomment-178160294 This change looks good to me, maybe @JoshRosen who was the last to touch that line can take a look? --- If your project is set up for it, you can reply to this email a

[GitHub] spark pull request: [SPARK-12790][CORE] Remove HistoryServer old m...

2016-02-01 Thread felixcheung
Github user felixcheung commented on the pull request: https://github.com/apache/spark/pull/10860#issuecomment-178159771 Could we merge this please? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [Docs] Fix the jar location of datanucleus in ...

2016-02-01 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/10901#issuecomment-178163321 Merging to master and 1.6 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-12330] [MESOS] Fix mesos coarse mode cl...

2016-02-01 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/10319#issuecomment-178162846 @drcrallen This looks great, thanks for fixing the issue. I left a few minor comments. Once you fix them I'll merge this. --- If your project is set up for it, you

[GitHub] spark pull request: [SPARK-12330] [MESOS] Fix mesos coarse mode cl...

2016-02-01 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/10319#discussion_r51471696 --- Diff: docs/running-on-mesos.md --- @@ -387,6 +387,13 @@ See the [configuration page](configuration.html) for information on Spark config

[GitHub] spark pull request: [SPARK-12705] [SPARK-10777] [SQL] Analyzer Rul...

2016-02-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/10678 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-12705] [SPARK-10777] [SQL] Analyzer Rul...

2016-02-01 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/10678#issuecomment-178161088 LGTM, thanks for adding a bunch of tests! Merging to master. --- If your project is set up for it, you can reply to this email and have your reply appear on G

[GitHub] spark pull request: [SPARK-12330] [MESOS] Fix mesos coarse mode cl...

2016-02-01 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/10319#discussion_r51471308 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/CoarseMesosSchedulerBackend.scala --- @@ -364,7 +379,27 @@ private[spark] class Co

[GitHub] spark pull request: [SPARK-12330] [MESOS] Fix mesos coarse mode cl...

2016-02-01 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/10319#discussion_r51470918 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/CoarseMesosSchedulerBackend.scala --- @@ -364,7 +379,27 @@ private[spark] class Co

[GitHub] spark pull request: [SPARK-12330] [MESOS] Fix mesos coarse mode cl...

2016-02-01 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/10319#discussion_r51470974 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/CoarseMesosSchedulerBackend.scala --- @@ -364,7 +379,27 @@ private[spark] class Co

[GitHub] spark pull request: [SPARK-12478][SQL] Bugfix: Dataset fields of p...

2016-02-01 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/10431#issuecomment-178158109 Yeah, since its labeled experimental, I'd like to fix as many Dataset bugs as we can for 1.6.1. --- If your project is set up for it, you can reply to this email and

[GitHub] spark pull request: [SPARK-12330] [MESOS] Fix mesos coarse mode cl...

2016-02-01 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/10319#discussion_r51470346 --- Diff: docs/running-on-mesos.md --- @@ -387,6 +387,13 @@ See the [configuration page](configuration.html) for information on Spark config

[GitHub] spark pull request: [SPARK-12330] [MESOS] Fix mesos coarse mode cl...

2016-02-01 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/10319#discussion_r51470296 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/CoarseMesosSchedulerBackend.scala --- @@ -60,6 +62,12 @@ private[spark] class Coar

[GitHub] spark pull request: [SPARK-6166] Limit number of concurrent outbou...

2016-02-01 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/10838#issuecomment-178153656 Hm, I think `block` is also not `accurate`. Never mind, just update the title should be enough. --- If your project is set up for it, you can reply to this email and h

[GitHub] spark pull request: [SPARK-10820][SQL] Support for the continuous ...

2016-02-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11006#issuecomment-178151805 **[Test build #50498 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50498/consoleFull)** for PR 11006 at commit [`7147b3f`](https://gi

[GitHub] spark pull request: [SPARK-10820][SQL] Support for the continuous ...

2016-02-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11006#issuecomment-178146931 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-5095] [Mesos] Support launching multipl...

2016-02-01 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/10993#issuecomment-178151143 Looks like this is failing real tests --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-6166] Limit number of concurrent outbou...

2016-02-01 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/10838#issuecomment-178150124 > @zsxwing Other than the PR title - I think everything else says inflight in code/documentation. Did you see anything to the contrary ? I mean changing `reques

[GitHub] spark pull request: [SPARK-12989] [SQL] Delaying Alias Cleanup aft...

2016-02-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/10963 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-12798] [SQL] generated BroadcastHashJoi...

2016-02-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10989#issuecomment-178147379 **[Test build #2486 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2486/consoleFull)** for PR 10989 at commit [`c1c0588`](https://g

[GitHub] spark pull request: [SPARK-10820][SQL] Support for the continuous ...

2016-02-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11006#issuecomment-178146926 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-10820][SQL] Support for the continuous ...

2016-02-01 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/11006#issuecomment-178144361 test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fea

[GitHub] spark pull request: [SPARK-10820][SQL] Support for the continuous ...

2016-02-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11006#issuecomment-178143406 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-10820][SQL] Support for the continuous ...

2016-02-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11006#issuecomment-178143411 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-7889] [CORE] HistoryServer to refresh c...

2016-02-01 Thread squito
Github user squito commented on the pull request: https://github.com/apache/spark/pull/6935#issuecomment-178142661 hi @steveloughran sorry for another really long delay on my end. mostly this looks fine, there are some style nits and a couple of comments that need updating. I also l

[GitHub] spark pull request: [SPARK-6166] Limit number of concurrent outbou...

2016-02-01 Thread mridulm
Github user mridulm commented on the pull request: https://github.com/apache/spark/pull/10838#issuecomment-178141964 @zsxwing Other than the PR title - I think everything else says inflight in code/documentation. Did you see anything to the contrary ? --- If your project is set up fo

[GitHub] spark pull request: [SPARK-12989] [SQL] Delaying Alias Cleanup aft...

2016-02-01 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/10963#issuecomment-178139377 Thanks, merging to master and 1.6. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-7889] [CORE] HistoryServer to refresh c...

2016-02-01 Thread squito
Github user squito commented on the pull request: https://github.com/apache/spark/pull/6935#issuecomment-178139026 jenkins, add to whitelist --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark pull request: [Spark-12732][ML] bug fix in linear regression...

2016-02-01 Thread iyounus
Github user iyounus commented on the pull request: https://github.com/apache/spark/pull/10702#issuecomment-178134675 For the case (3), I'm assuming that the label and features are not standardized. So, in that case, the solution exists. Here is my perspective on this. The nor

[GitHub] spark pull request: [SPARK-12798] [SQL] generated BroadcastHashJoi...

2016-02-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10989#issuecomment-178133351 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12798] [SQL] generated BroadcastHashJoi...

2016-02-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10989#issuecomment-178133344 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-10820][SQL] Support for the continuous ...

2016-02-01 Thread marmbrus
GitHub user marmbrus opened a pull request: https://github.com/apache/spark/pull/11006 [SPARK-10820][SQL] Support for the continuous execution of structured queries This is a follow up to 9aadcffabd226557174f3ff566927f873c71672e that extends Spark SQL to allow users to _repeatedly_

[GitHub] spark pull request: [SPARK-6847][Core][Streaming]Fix stack overflo...

2016-02-01 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/10934#issuecomment-178132065 I did not merge this into 1.6 or before because of 2 reasons: - It doesn't merge cleanly, and more importantly - This changes internal semantics and it's not t

[GitHub] spark pull request: [SPARK-6847][Core][Streaming]Fix stack overflo...

2016-02-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/10934 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-6847][Core][Streaming]Fix stack overflo...

2016-02-01 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/10934#issuecomment-178130645 Merged into master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have thi

[GitHub] spark pull request: [SPARK-6847][Core][Streaming]Fix stack overflo...

2016-02-01 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/10934#discussion_r51463360 --- Diff: streaming/src/test/scala/org/apache/spark/streaming/CheckpointSuite.scala --- @@ -821,6 +821,75 @@ class CheckpointSuite extends TestSuiteBase w

[GitHub] spark pull request: [SPARK-6166] Limit number of concurrent outbou...

2016-02-01 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/10838#issuecomment-178129985 @tgravescs in general, this patch doesn't limit number of concurrent outbound connections. Instead, it just limits number of in flight blocks. Could you update the titl

[GitHub] spark pull request: [SPARK-12951] [SQL] support spilling in genera...

2016-02-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10998#issuecomment-178128143 **[Test build #50494 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50494/consoleFull)** for PR 10998 at commit [`02f2a25`](https://gi

[GitHub] spark pull request: [SPARK-12992][SQL]: Update parquet reader to s...

2016-02-01 Thread nongli
Github user nongli commented on a diff in the pull request: https://github.com/apache/spark/pull/10908#discussion_r51462376 --- Diff: sql/core/src/main/java/org/apache/spark/sql/execution/datasources/parquet/VectorizedPlainValuesReader.java --- @@ -52,15 +55,49 @@ public void skip

[GitHub] spark pull request: [SPARK-12992][SQL]: Update parquet reader to s...

2016-02-01 Thread nongli
Github user nongli commented on a diff in the pull request: https://github.com/apache/spark/pull/10908#discussion_r51462281 --- Diff: sql/core/src/main/java/org/apache/spark/sql/execution/datasources/parquet/VectorizedRleValuesReader.java --- @@ -180,6 +188,152 @@ public void read

[GitHub] spark pull request: [SPARK-12506][SPARK-12126][SQL]use CatalystSca...

2016-02-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11005#issuecomment-178126949 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your p

[GitHub] spark pull request: [SPARK-12506][SPARK-12126][SQL]use CatalystSca...

2016-02-01 Thread huaxingao
GitHub user huaxingao opened a pull request: https://github.com/apache/spark/pull/11005 [SPARK-12506][SPARK-12126][SQL]use CatalystScan for JDBCRelation As suggested https://issues.apache.org/jira/browse/SPARK-9182?focusedCommentId=15031526&page=com.atlassian.jira.plugin.system.issue

[GitHub] spark pull request: [SPARK-12798] [SQL] generated BroadcastHashJoi...

2016-02-01 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/10989#discussion_r51461171 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/BufferedRowIterator.java --- @@ -31,22 +33,20 @@ * TODO: replaced it by batched column

[GitHub] spark pull request: [SPARK-12506][SQL]push down WHERE clause arith...

2016-02-01 Thread huaxingao
Github user huaxingao commented on the pull request: https://github.com/apache/spark/pull/10750#issuecomment-178119526 @viirya @HyukjinKwon @rxin Thank you all very much for your comments. I will change JDBCRelation to implement CatalystScan, and then directly access Catalyst ex

[GitHub] spark pull request: [SPARK-12506][SQL]push down WHERE clause arith...

2016-02-01 Thread huaxingao
Github user huaxingao closed the pull request at: https://github.com/apache/spark/pull/10750 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-12478][SQL] Bugfix: Dataset fields of p...

2016-02-01 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/10431#issuecomment-178118573 @marmbrus Should we backport this to branch-1.6? I missed @yhuai's comment above and haven't done it yet. --- If your project is set up for it, you can reply to this

[GitHub] spark pull request: [SPARK-12966][SQL] ArrayType(DecimalType) supp...

2016-02-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10928#issuecomment-178118188 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12966][SQL] ArrayType(DecimalType) supp...

2016-02-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10928#issuecomment-178118185 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12966][SQL] ArrayType(DecimalType) supp...

2016-02-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10928#issuecomment-178117669 **[Test build #50492 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50492/consoleFull)** for PR 10928 at commit [`4934ad3`](https://g

[GitHub] spark pull request: [SPARK-10605][SQL] Add structs to collect_list...

2016-02-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11004#issuecomment-178112452 **[Test build #50493 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50493/consoleFull)** for PR 11004 at commit [`326a213`](https://gi

[GitHub] spark pull request: [SPARK-10605][SQL] Add structs to collect_list...

2016-02-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11004#issuecomment-178097238 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-10605][SQL] Add structs to collect_list...

2016-02-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11004#issuecomment-178097245 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-10605][SQL] Add structs to collect_list...

2016-02-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11004#issuecomment-178096904 **[Test build #50490 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50490/consoleFull)** for PR 11004 at commit [`8247d8e`](https://g

[GitHub] spark pull request: [SPARK-7889] [CORE] HistoryServer to refresh c...

2016-02-01 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/6935#discussion_r51451496 --- Diff: core/src/main/scala/org/apache/spark/deploy/history/ApplicationCache.scala --- @@ -0,0 +1,667 @@ +/* + * Licensed to the Apache Software Foun

[GitHub] spark pull request: [SPARK-7889] [CORE] HistoryServer to refresh c...

2016-02-01 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/6935#discussion_r51451010 --- Diff: core/src/test/scala/org/apache/spark/deploy/history/HistoryServerSuite.scala --- @@ -282,6 +297,197 @@ class HistoryServerSuite extends SparkFunSuite

[GitHub] spark pull request: [SPARK-7889] [CORE] HistoryServer to refresh c...

2016-02-01 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/6935#discussion_r51450652 --- Diff: core/src/test/scala/org/apache/spark/deploy/history/HistoryServerSuite.scala --- @@ -21,16 +21,29 @@ import java.net.{HttpURLConnection, URL} im

[GitHub] spark pull request: [SPARK-7889] [CORE] HistoryServer to refresh c...

2016-02-01 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/6935#discussion_r51450618 --- Diff: core/src/test/scala/org/apache/spark/deploy/history/HistoryServerSuite.scala --- @@ -44,7 +57,7 @@ import org.apache.spark.util.ResetSystemProperties

[GitHub] spark pull request: [SPARK-7889] [CORE] HistoryServer to refresh c...

2016-02-01 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/6935#discussion_r51450584 --- Diff: core/src/test/scala/org/apache/spark/deploy/history/HistoryServerSuite.scala --- @@ -21,16 +21,29 @@ import java.net.{HttpURLConnection, URL} im

[GitHub] spark pull request: [SPARK-7889] [CORE] HistoryServer to refresh c...

2016-02-01 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/6935#discussion_r51449903 --- Diff: core/src/test/scala/org/apache/spark/deploy/history/ApplicationCacheSuite.scala --- @@ -0,0 +1,484 @@ +/* + * Licensed to the Apache Softwar

[GitHub] spark pull request: [SPARK-7889] [CORE] HistoryServer to refresh c...

2016-02-01 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/6935#discussion_r51447527 --- Diff: core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala --- @@ -666,6 +804,40 @@ private[history] class FsHistoryProvider(conf:

[GitHub] spark pull request: [SPARK-7889] [CORE] HistoryServer to refresh c...

2016-02-01 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/6935#discussion_r51447480 --- Diff: core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala --- @@ -666,6 +804,40 @@ private[history] class FsHistoryProvider(conf:

[GitHub] spark pull request: [SPARK-7889] [CORE] HistoryServer to refresh c...

2016-02-01 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/6935#discussion_r51447272 --- Diff: core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala --- @@ -613,13 +739,23 @@ private[history] class FsHistoryProvider(conf:

[GitHub] spark pull request: [SPARK-7889] [CORE] HistoryServer to refresh c...

2016-02-01 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/6935#discussion_r51446839 --- Diff: core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala --- @@ -386,24 +437,49 @@ private[history] class FsHistoryProvider(conf:

[GitHub] spark pull request: [SPARK-7889] [CORE] HistoryServer to refresh c...

2016-02-01 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/6935#discussion_r51446687 --- Diff: core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala --- @@ -42,6 +42,35 @@ import org.apache.spark.util.{Clock, SystemClock,

[GitHub] spark pull request: [SPARK-7889] [CORE] HistoryServer to refresh c...

2016-02-01 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/6935#discussion_r51445356 --- Diff: core/src/main/scala/org/apache/spark/deploy/history/ApplicationCache.scala --- @@ -0,0 +1,658 @@ +/* + * Licensed to the Apache Software Foun

[GitHub] spark pull request: [SPARK-7889] [CORE] HistoryServer to refresh c...

2016-02-01 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/6935#discussion_r51444707 --- Diff: core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala --- @@ -430,8 +517,55 @@ private[history] class FsHistoryProvider(conf:

[GitHub] spark pull request: [SPARK-7889] [CORE] HistoryServer to refresh c...

2016-02-01 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/6935#discussion_r51444027 --- Diff: core/src/main/scala/org/apache/spark/deploy/history/ApplicationCache.scala --- @@ -0,0 +1,667 @@ +/* + * Licensed to the Apache Software Foun

[GitHub] spark pull request: [SPARK-12966][SQL] ArrayType(DecimalType) supp...

2016-02-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10928#issuecomment-178062076 **[Test build #50492 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50492/consoleFull)** for PR 10928 at commit [`4934ad3`](https://gi

[GitHub] spark pull request: [SPARK-12966][SQL] ArrayType(DecimalType) supp...

2016-02-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10928#issuecomment-178061786 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12966][SQL] ArrayType(DecimalType) supp...

2016-02-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10928#issuecomment-178061788 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-10605][SQL] Add structs to collect_list...

2016-02-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11004#issuecomment-178056994 **[Test build #50490 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50490/consoleFull)** for PR 11004 at commit [`8247d8e`](https://gi

[GitHub] spark pull request: [SPARK-12966][SQL] ArrayType(DecimalType) supp...

2016-02-01 Thread blbradley
Github user blbradley commented on the pull request: https://github.com/apache/spark/pull/10928#issuecomment-178055015 Moved the enum column to `c14` to keep real and double arrays next to each other. --- If your project is set up for it, you can reply to this email and have your rep

[GitHub] spark pull request: [SPARK-10605][SQL] Add structs to collect_list...

2016-02-01 Thread hvanhovell
GitHub user hvanhovell opened a pull request: https://github.com/apache/spark/pull/11004 [SPARK-10605][SQL] Add structs to collect_list/collect_set We currently use the Hive implementations for the ```collect_list```/```collect_set``` aggregate functions. This has a few major drawb

[GitHub] spark pull request: [SPARK-10963] [Streaming] [Kafka] make KafkaCl...

2016-02-01 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/9007#issuecomment-178009731 @tdas I'd like to merge unless you object. I also find this a useful developer API. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-10963] [Streaming] [Kafka] make KafkaCl...

2016-02-01 Thread koeninger
Github user koeninger commented on the pull request: https://github.com/apache/spark/pull/9007#issuecomment-178008540 @tdas @srowen Can we either get this merged, or officially close off the possibility of merging it? People are still raising specific issues on a fairly regu

[GitHub] spark pull request: [SPARK-12950][Core] Remove unnecessary bit ope...

2016-02-01 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11002#issuecomment-177996778 **[Test build #50489 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50489/consoleFull)** for PR 11002 at commit [`4b846dd`](https://g

[GitHub] spark pull request: [SPARK-12950][Core] Remove unnecessary bit ope...

2016-02-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11002#issuecomment-177997036 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12950][Core] Remove unnecessary bit ope...

2016-02-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11002#issuecomment-177997035 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12982][SQL] Add table name validation i...

2016-02-01 Thread jayadevanmurali
Github user jayadevanmurali commented on the pull request: https://github.com/apache/spark/pull/10983#issuecomment-177969053 @hvanhovell, Yea I tried to merge my branch (https://github.com/jayadevanmurali/spark/tree/branch-0.1-SPARK-SPARK-12982) with apache spark master. But I cant se

[GitHub] spark pull request: [SPARK-13065] [Streaming] streaming-twitter pa...

2016-02-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11003#issuecomment-177968286 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your p

<    1   2   3   4   5   6   7   >