[GitHub] spark issue #17005: [SPARK-14659][ML] RFormula supports setting base level b...

2017-02-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17005 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73182/ Test FAILed. ---

[GitHub] spark issue #17005: [SPARK-14659][ML] RFormula supports setting base level b...

2017-02-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17005 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17005: [SPARK-14659][ML] RFormula supports setting base level b...

2017-02-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17005 **[Test build #73182 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73182/testReport)** for PR 17005 at commit

[GitHub] spark issue #17005: [SPARK-14659][ML] RFormula supports setting base level b...

2017-02-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17005 **[Test build #73182 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73182/testReport)** for PR 17005 at commit

[GitHub] spark issue #17005: [SPARK-14659][ML] RFormula supports setting base level b...

2017-02-20 Thread actuaryzhang
Github user actuaryzhang commented on the issue: https://github.com/apache/spark/pull/17005 @srowen @jkbradley @felixcheung @sethah @yanboliang One question is: is it better to move the `HasStringOrderType` trait to the shared params? This is only used by StringIndexer and

[GitHub] spark pull request #17005: [SPARK-14659][ML] RFormula supports setting base ...

2017-02-20 Thread actuaryzhang
GitHub user actuaryzhang opened a pull request: https://github.com/apache/spark/pull/17005 [SPARK-14659][ML] RFormula supports setting base level both by frequency and alphabetically ## What changes were proposed in this pull request? Current RFormula drops the least frequent

[GitHub] spark issue #17000: [SPARK-18946][ML] sliceAggregate which is a new aggregat...

2017-02-20 Thread hhbyyh
Github user hhbyyh commented on the issue: https://github.com/apache/spark/pull/17000 Hi @ZunwenYou Do you know what's the reason that treeAggregate failed when feature dimension reach 20 million? I think this potentially can help with the 2G disk shuffle spill limit. (to be

[GitHub] spark pull request #16910: [SPARK-19575][SQL]Reading from or writing to a hi...

2017-02-20 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16910#discussion_r102077850 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/HiveTableScanExec.scala --- @@ -139,6 +140,13 @@ case class HiveTableScanExec(

[GitHub] spark pull request #16910: [SPARK-19575][SQL]Reading from or writing to a hi...

2017-02-20 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16910#discussion_r102076358 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveDDLSuite.scala --- @@ -1494,4 +1495,149 @@ class HiveDDLSuite }

[GitHub] spark pull request #16910: [SPARK-19575][SQL]Reading from or writing to a hi...

2017-02-20 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16910#discussion_r102076327 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveDDLSuite.scala --- @@ -1494,4 +1495,149 @@ class HiveDDLSuite }

[GitHub] spark pull request #16910: [SPARK-19575][SQL]Reading from or writing to a hi...

2017-02-20 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16910#discussion_r102076290 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveDDLSuite.scala --- @@ -1494,4 +1495,149 @@ class HiveDDLSuite }

[GitHub] spark pull request #16910: [SPARK-19575][SQL]Reading from or writing to a hi...

2017-02-20 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16910#discussion_r102076227 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveDDLSuite.scala --- @@ -1494,4 +1495,149 @@ class HiveDDLSuite }

[GitHub] spark issue #16905: [SPARK-19567][CORE][SCHEDULER] Support some Schedulable ...

2017-02-20 Thread erenavsarogullari
Github user erenavsarogullari commented on the issue: https://github.com/apache/spark/pull/16905 Hi @markhamstra, Do you have chance to review this PR and my latest comment? Thanks in advance ;) --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark issue #16996: [SPARK-19664][SQL]put hive.metastore.warehouse.dir in ha...

2017-02-20 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16996 Why we need to overwrite its original value? I thought we will not use that value any more. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #16996: [SPARK-19664][SQL]put hive.metastore.warehouse.dir in ha...

2017-02-20 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16996 In your PR title, `verwrite ` -> `overwrite ` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #16996: [SPARK-19664][SQL]put hive.metastore.warehouse.di...

2017-02-20 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16996#discussion_r102074108 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/internal/SharedState.scala --- @@ -61,6 +62,12 @@ private[sql] class SharedState(val

[GitHub] spark issue #16998: [SPARK-19665][SQL][WIP] Improve constraint propagation

2017-02-20 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16998 > Another issue is we actually don't need the additional constraints at most of time. For example, if there is a constraint "a > b", and "a" is aliased to "c" and "d". When we use this

[GitHub] spark issue #16966: [SPARK-18409][ML]LSH approxNearestNeighbors should use a...

2017-02-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16966 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73177/ Test PASSed. ---

[GitHub] spark issue #16966: [SPARK-18409][ML]LSH approxNearestNeighbors should use a...

2017-02-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16966 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16966: [SPARK-18409][ML]LSH approxNearestNeighbors should use a...

2017-02-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16966 **[Test build #73177 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73177/testReport)** for PR 16966 at commit

[GitHub] spark issue #15415: [SPARK-14503][ML] spark.ml API for FPGrowth

2017-02-20 Thread hhbyyh
Github user hhbyyh commented on the issue: https://github.com/apache/spark/pull/15415 @jkbradley Sent an update to refine the transform code and address the comments. Regarding to the behavior changing concern, I think different partition strategy will only affect the

[GitHub] spark issue #16928: [SPARK-18699][SQL] Put malformed tokens into a new field...

2017-02-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16928 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73175/ Test PASSed. ---

[GitHub] spark issue #16928: [SPARK-18699][SQL] Put malformed tokens into a new field...

2017-02-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16928 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16928: [SPARK-18699][SQL] Put malformed tokens into a new field...

2017-02-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16928 **[Test build #73175 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73175/testReport)** for PR 16928 at commit

[GitHub] spark issue #17002: [SPARK-19669][SQL] Open up visibility for sharedState, s...

2017-02-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17002 **[Test build #73181 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73181/testReport)** for PR 17002 at commit

[GitHub] spark issue #17002: [SPARK-19669][SQL] Open up visibility for sharedState, s...

2017-02-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17002 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73181/ Test FAILed. ---

[GitHub] spark issue #17002: [SPARK-19669][SQL] Open up visibility for sharedState, s...

2017-02-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17002 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17002: [SPARK-19669][SQL] Open up visibility for sharedState, s...

2017-02-20 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/17002 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #17002: [SPARK-19669][SQL] Open up visibility for sharedState, s...

2017-02-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17002 **[Test build #73181 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73181/testReport)** for PR 17002 at commit

[GitHub] spark pull request #17002: [SPARK-19669][SQL] Open up visibility for sharedS...

2017-02-20 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/17002#discussion_r102070142 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/SparkSession.scala --- @@ -95,16 +95,26 @@ class SparkSession private( /** * State

[GitHub] spark issue #17000: [SPARK-18946][ML] sliceAggregate which is a new aggregat...

2017-02-20 Thread MLnick
Github user MLnick commented on the issue: https://github.com/apache/spark/pull/17000 Just to be clear - this is essentially just splitting an array up into smaller chunks so that overall communication is more efficient? It would be good to look at why Spark is not doing a good job

[GitHub] spark pull request #17002: [SPARK-19669][SQL] Open up visibility for sharedS...

2017-02-20 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/17002#discussion_r102069532 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/SparkSession.scala --- @@ -95,16 +95,26 @@ class SparkSession private( /** * State

[GitHub] spark issue #17004: [SPARK-19670] [SQL] [TEST] Enable Bucketed Table Reading...

2017-02-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17004 **[Test build #73180 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73180/testReport)** for PR 17004 at commit

[GitHub] spark pull request #17004: [SPARK-19670] [SQL] [TEST] Enable Bucketed Table ...

2017-02-20 Thread gatorsmile
GitHub user gatorsmile opened a pull request: https://github.com/apache/spark/pull/17004 [SPARK-19670] [SQL] [TEST] Enable Bucketed Table Reading and Writing Testing Without Hive Support ### What changes were proposed in this pull request? Bucketed table reading and writing

[GitHub] spark issue #16726: [SPARK-19390][SQL] Replace the unnecessary usages of hiv...

2017-02-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16726 **[Test build #73179 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73179/testReport)** for PR 16726 at commit

[GitHub] spark pull request #15125: [SPARK-5484][GraphX] Periodically do checkpoint i...

2017-02-20 Thread dding3
Github user dding3 commented on a diff in the pull request: https://github.com/apache/spark/pull/15125#discussion_r102067500 --- Diff: docs/graphx-programming-guide.md --- @@ -708,7 +708,9 @@ messages remaining. > messaging function. These constraints allow additional

[GitHub] spark issue #16726: [SPARK-19390][SQL] Replace the unnecessary usages of hiv...

2017-02-20 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16726 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #17003: [SPARK-19646][BUILD][HOTFIX] Fix compile error from cher...

2017-02-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17003 **[Test build #73178 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73178/testReport)** for PR 17003 at commit

[GitHub] spark pull request #17003: [SPARK-19646][BUILD][HOTFIX] Fix compile error fr...

2017-02-20 Thread srowen
GitHub user srowen opened a pull request: https://github.com/apache/spark/pull/17003 [SPARK-19646][BUILD][HOTFIX] Fix compile error from cherry-pick of SPARK-19646 into branch 2.1 ## What changes were proposed in this pull request? Fix compile error from cherry-pick of

[GitHub] spark pull request #15125: [SPARK-5484][GraphX] Periodically do checkpoint i...

2017-02-20 Thread dding3
Github user dding3 commented on a diff in the pull request: https://github.com/apache/spark/pull/15125#discussion_r102065803 --- Diff: graphx/src/main/scala/org/apache/spark/graphx/Pregel.scala --- @@ -154,7 +169,9 @@ object Pregel extends Logging { // count the

[GitHub] spark pull request #16966: [SPARK-18409][ML]LSH approxNearestNeighbors shoul...

2017-02-20 Thread Yunni
Github user Yunni commented on a diff in the pull request: https://github.com/apache/spark/pull/16966#discussion_r102065786 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/LSH.scala --- @@ -147,6 +148,15 @@ private[ml] abstract class LSHModel[T <: LSHModel[T]]

[GitHub] spark issue #16928: [SPARK-18699][SQL] Put malformed tokens into a new field...

2017-02-20 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/16928 @HyukjinKwon The current patch has a bit different behaviour between csv and json cases when `_corrupt_record` has types other than `StringType`; in json cases, it hits `requirement failed` and, in

[GitHub] spark issue #17002: [SPARK-19669][SQL] Open up visibility for sharedState, s...

2017-02-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17002 **[Test build #73176 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73176/testReport)** for PR 17002 at commit

[GitHub] spark issue #16966: [SPARK-18409][ML]LSH approxNearestNeighbors should use a...

2017-02-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16966 **[Test build #73177 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73177/testReport)** for PR 16966 at commit

[GitHub] spark pull request #17002: [SPARK-19669][SQL] Open up visibility for sharedS...

2017-02-20 Thread rxin
GitHub user rxin opened a pull request: https://github.com/apache/spark/pull/17002 [SPARK-19669][SQL] Open up visibility for sharedState, sessionState, and a few other functions ## What changes were proposed in this pull request? To ease debugging, most of Spark SQL internals

[GitHub] spark issue #16998: [SPARK-19665][SQL][WIP] Improve constraint propagation

2017-02-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16998 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16998: [SPARK-19665][SQL][WIP] Improve constraint propagation

2017-02-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16998 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73174/ Test PASSed. ---

[GitHub] spark issue #16998: [SPARK-19665][SQL][WIP] Improve constraint propagation

2017-02-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16998 **[Test build #73174 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73174/testReport)** for PR 16998 at commit

[GitHub] spark issue #16974: [SPARK-19646][CORE][STREAMING] binaryRecords replicates ...

2017-02-20 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/16974 Oops, pick was clean into 2.1 but it actually resulted in an error:

[GitHub] spark issue #16974: [SPARK-19646][CORE][STREAMING] binaryRecords replicates ...

2017-02-20 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/16974 Merged to master/2.1/2.0 as it's a reasonably important bug --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request #16994: [SPARK-15453] [SQL] [Follow-up] FileSourceScanExe...

2017-02-20 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16994 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #16974: [SPARK-19646][CORE][STREAMING] binaryRecords repl...

2017-02-20 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16974 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16994: [SPARK-15453] [SQL] [Follow-up] FileSourceScanExec to ex...

2017-02-20 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16994 Thanks! Merging to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #16928: [SPARK-18699][SQL] Put malformed tokens into a new field...

2017-02-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16928 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73173/ Test PASSed. ---

[GitHub] spark issue #16928: [SPARK-18699][SQL] Put malformed tokens into a new field...

2017-02-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16928 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16928: [SPARK-18699][SQL] Put malformed tokens into a new field...

2017-02-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16928 **[Test build #73173 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73173/testReport)** for PR 16928 at commit

[GitHub] spark issue #15125: [SPARK-5484][GraphX] Periodically do checkpoint in Prege...

2017-02-20 Thread mallman
Github user mallman commented on the issue: https://github.com/apache/spark/pull/15125 @dding3, thank you for your continued patience and dedication to this PR, despite the continued change requests. We are getting closer to a merge. --- If your project is set up for it, you can

[GitHub] spark pull request #15125: [SPARK-5484][GraphX] Periodically do checkpoint i...

2017-02-20 Thread mallman
Github user mallman commented on a diff in the pull request: https://github.com/apache/spark/pull/15125#discussion_r102057156 --- Diff: docs/graphx-programming-guide.md --- @@ -708,7 +708,9 @@ messages remaining. > messaging function. These constraints allow additional

[GitHub] spark pull request #15125: [SPARK-5484][GraphX] Periodically do checkpoint i...

2017-02-20 Thread mallman
Github user mallman commented on a diff in the pull request: https://github.com/apache/spark/pull/15125#discussion_r102056438 --- Diff: docs/graphx-programming-guide.md --- @@ -708,7 +708,9 @@ messages remaining. > messaging function. These constraints allow additional

[GitHub] spark issue #16928: [SPARK-18699][SQL] Put malformed tokens into a new field...

2017-02-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16928 **[Test build #73175 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73175/testReport)** for PR 16928 at commit

[GitHub] spark pull request #15125: [SPARK-5484][GraphX] Periodically do checkpoint i...

2017-02-20 Thread mallman
Github user mallman commented on a diff in the pull request: https://github.com/apache/spark/pull/15125#discussion_r102053462 --- Diff: graphx/src/main/scala/org/apache/spark/graphx/Pregel.scala --- @@ -154,7 +169,9 @@ object Pregel extends Logging { // count the

[GitHub] spark issue #16928: [SPARK-18699][SQL] Put malformed tokens into a new field...

2017-02-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16928 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73172/ Test FAILed. ---

[GitHub] spark issue #16928: [SPARK-18699][SQL] Put malformed tokens into a new field...

2017-02-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16928 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16928: [SPARK-18699][SQL] Put malformed tokens into a new field...

2017-02-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16928 **[Test build #73172 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73172/testReport)** for PR 16928 at commit

[GitHub] spark issue #16626: [SPARK-19261][SQL] Alter add columns for Hive serde and ...

2017-02-20 Thread xwu0226
Github user xwu0226 commented on the issue: https://github.com/apache/spark/pull/16626 @gatorsmile Thanks for your comments! I will update the code. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark issue #17001: [SPARK-19667][SQL][WIP]create table with hiveenabled in ...

2017-02-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17001 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17001: [SPARK-19667][SQL][WIP]create table with hiveenabled in ...

2017-02-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17001 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73171/ Test FAILed. ---

[GitHub] spark issue #17001: [SPARK-19667][SQL][WIP]create table with hiveenabled in ...

2017-02-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17001 **[Test build #73171 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73171/testReport)** for PR 17001 at commit

[GitHub] spark issue #16998: [SPARK-19665][SQL][WIP] Improve constraint propagation

2017-02-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16998 **[Test build #73174 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73174/testReport)** for PR 16998 at commit

[GitHub] spark issue #16928: [SPARK-18699][SQL] Put malformed tokens into a new field...

2017-02-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16928 **[Test build #73173 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73173/testReport)** for PR 16928 at commit

[GitHub] spark issue #17001: [SPARK-19667][SQL][WIP]create table with hiveenabled in ...

2017-02-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17001 **[Test build #73171 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73171/testReport)** for PR 17001 at commit

[GitHub] spark issue #16928: [SPARK-18699][SQL] Put malformed tokens into a new field...

2017-02-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16928 **[Test build #73172 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73172/testReport)** for PR 16928 at commit

[GitHub] spark issue #16610: [SPARK-19254][SQL] Support Seq, Map, and Struct in funct...

2017-02-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16610 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #17001: [SPARK-19667][SQL][WIP]create table with hiveenab...

2017-02-20 Thread windpiger
GitHub user windpiger opened a pull request: https://github.com/apache/spark/pull/17001 [SPARK-19667][SQL][WIP]create table with hiveenabled in default database se warehouse path instead of the location of default database ## What changes were proposed in this pull request?

[GitHub] spark issue #16610: [SPARK-19254][SQL] Support Seq, Map, and Struct in funct...

2017-02-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16610 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73165/ Test PASSed. ---

[GitHub] spark issue #16610: [SPARK-19254][SQL] Support Seq, Map, and Struct in funct...

2017-02-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16610 **[Test build #73165 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73165/testReport)** for PR 16610 at commit

[GitHub] spark issue #16928: [SPARK-18699][SQL] Put malformed tokens into a new field...

2017-02-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16928 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16928: [SPARK-18699][SQL] Put malformed tokens into a new field...

2017-02-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16928 **[Test build #73170 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73170/testReport)** for PR 16928 at commit

[GitHub] spark issue #16928: [SPARK-18699][SQL] Put malformed tokens into a new field...

2017-02-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16928 **[Test build #73170 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73170/testReport)** for PR 16928 at commit

[GitHub] spark issue #16928: [SPARK-18699][SQL] Put malformed tokens into a new field...

2017-02-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16928 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73170/ Test FAILed. ---

[GitHub] spark issue #17000: [SPARK-18946][ML] sliceAggregate which is a new aggregat...

2017-02-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17000 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #17000: [SPARK-18946][ML] sliceAggregate which is a new a...

2017-02-20 Thread ZunwenYou
GitHub user ZunwenYou opened a pull request: https://github.com/apache/spark/pull/17000 [SPARK-18946][ML] sliceAggregate which is a new aggregate operator for high-dimensional data In many machine learning cases, driver has to aggregate high-dimensional vectors/arrays from

[GitHub] spark issue #16987: [SPARK-19633][SS] FileSource read from FileSink

2017-02-20 Thread lw-lin
Github user lw-lin commented on the issue: https://github.com/apache/spark/pull/16987 @marmbrus @zsxwing would you take a look at this? thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #16928: [SPARK-18699][SQL] Put malformed tokens into a new field...

2017-02-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16928 **[Test build #73169 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73169/testReport)** for PR 16928 at commit

[GitHub] spark issue #16928: [SPARK-18699][SQL] Put malformed tokens into a new field...

2017-02-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16928 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16928: [SPARK-18699][SQL] Put malformed tokens into a new field...

2017-02-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16928 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73169/ Test FAILed. ---

[GitHub] spark issue #16928: [SPARK-18699][SQL] Put malformed tokens into a new field...

2017-02-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16928 **[Test build #73169 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73169/testReport)** for PR 16928 at commit

[GitHub] spark pull request #16928: [SPARK-18699][SQL] Put malformed tokens into a ne...

2017-02-20 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/16928#discussion_r102029272 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/CSVOptions.scala --- @@ -95,6 +104,9 @@ private[csv] class CSVOptions(

[GitHub] spark issue #16928: [SPARK-18699][SQL] Put malformed tokens into a new field...

2017-02-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16928 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16928: [SPARK-18699][SQL] Put malformed tokens into a new field...

2017-02-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16928 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73168/ Test FAILed. ---

[GitHub] spark issue #16928: [SPARK-18699][SQL] Put malformed tokens into a new field...

2017-02-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16928 **[Test build #73168 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73168/testReport)** for PR 16928 at commit

[GitHub] spark issue #16928: [SPARK-18699][SQL] Put malformed tokens into a new field...

2017-02-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16928 **[Test build #73168 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73168/testReport)** for PR 16928 at commit

[GitHub] spark issue #16928: [SPARK-18699][SQL] Put malformed tokens into a new field...

2017-02-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16928 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73167/ Test FAILed. ---

[GitHub] spark issue #16928: [SPARK-18699][SQL] Put malformed tokens into a new field...

2017-02-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16928 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16928: [SPARK-18699][SQL] Put malformed tokens into a new field...

2017-02-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16928 **[Test build #73167 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73167/testReport)** for PR 16928 at commit

[GitHub] spark issue #16928: [SPARK-18699][SQL] Put malformed tokens into a new field...

2017-02-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16928 **[Test build #73167 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73167/testReport)** for PR 16928 at commit

[GitHub] spark issue #16998: [SPARK-19665][SQL][WIP] Improve constraint propagation

2017-02-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16998 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73163/ Test FAILed. ---

[GitHub] spark issue #16998: [SPARK-19665][SQL][WIP] Improve constraint propagation

2017-02-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16998 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16998: [SPARK-19665][SQL][WIP] Improve constraint propagation

2017-02-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16998 **[Test build #73163 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73163/testReport)** for PR 16998 at commit

[GitHub] spark issue #16995: [SPARK-19340][SQL] CSV file will result in an exception ...

2017-02-20 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16995 @lxsmnv, could you check if this is a more general problem? I suspect it is not a CSV specific issue. --- If your project is set up for it, you can reply to this email and have your reply

<    1   2   3   4   >