[GitHub] spark issue #11601: [SPARK-13568] [ML] Create feature transformer to impute ...

2017-02-21 Thread hhbyyh
Github user hhbyyh commented on the issue: https://github.com/apache/spark/pull/11601 Sent an update to add multi-column support. Let me know if this is not what you have in mind. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark issue #11601: [SPARK-13568] [ML] Create feature transformer to impute ...

2017-02-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11601 **[Test build #73268 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73268/testReport)** for PR 11601 at commit

[GitHub] spark issue #16832: [WIP][SPARK-19490][SQL] ignore case sensitivity when fil...

2017-02-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16832 **[Test build #73267 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73267/testReport)** for PR 16832 at commit

[GitHub] spark issue #17001: [SPARK-19667][SQL]create table with hiveenabled in defau...

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17001 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17001: [SPARK-19667][SQL]create table with hiveenabled in defau...

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17001 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73263/ Test FAILed. ---

[GitHub] spark issue #17001: [SPARK-19667][SQL]create table with hiveenabled in defau...

2017-02-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17001 **[Test build #73263 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73263/testReport)** for PR 17001 at commit

[GitHub] spark pull request #16594: [SPARK-17078] [SQL] Show stats when explain

2017-02-21 Thread wzhfy
Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/16594#discussion_r102399167 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/Statistics.scala --- @@ -54,11 +57,29 @@ case class Statistics(

[GitHub] spark pull request #16594: [SPARK-17078] [SQL] Show stats when explain

2017-02-21 Thread wzhfy
Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/16594#discussion_r102398658 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSqlParser.scala --- @@ -282,7 +282,8 @@ class SparkSqlAstBuilder(conf: SQLConf) extends

[GitHub] spark pull request #16594: [SPARK-17078] [SQL] Show stats when explain

2017-02-21 Thread wzhfy
Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/16594#discussion_r102398371 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/Statistics.scala --- @@ -54,11 +57,29 @@ case class Statistics(

[GitHub] spark issue #16476: [SPARK-19084][SQL] Implement expression field

2017-02-21 Thread gczsjdy
Github user gczsjdy commented on the issue: https://github.com/apache/spark/pull/16476 @cloud-fan Could you please help me review this PR? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #16691: [SPARK-19349][DStreams]improve resource ready check to a...

2017-02-21 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/16691 I don't like copying codes from Spark core. Maybe let's still keep using a dummy Spark job. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark issue #16936: [SPARK-19605][DStream] Fail it if existing resource is n...

2017-02-21 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/16936 I agreed with @srowen. Streaming should not need to know the details about the mode, and when someone changes other modules, they won't know these codes inside streaming. I would like to see a

[GitHub] spark issue #17017: [SPARK-19682][SparkR] Issue warning (or error) when subs...

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17017 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17017: [SPARK-19682][SparkR] Issue warning (or error) when subs...

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17017 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73264/ Test PASSed. ---

[GitHub] spark issue #17017: [SPARK-19682][SparkR] Issue warning (or error) when subs...

2017-02-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17017 **[Test build #73264 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73264/testReport)** for PR 17017 at commit

[GitHub] spark pull request #16714: [SPARK-16333][Core] Enable EventLoggingListener t...

2017-02-21 Thread jasonmoore2k
Github user jasonmoore2k commented on a diff in the pull request: https://github.com/apache/spark/pull/16714#discussion_r102396498 --- Diff: core/src/main/scala/org/apache/spark/util/JsonProtocol.scala --- @@ -62,18 +62,21 @@ private[spark] object JsonProtocol { * JSON

[GitHub] spark issue #17001: [SPARK-19667][SQL]create table with hiveenabled in defau...

2017-02-21 Thread windpiger
Github user windpiger commented on the issue: https://github.com/apache/spark/pull/17001 great, I will take a look at it~ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request #16714: [SPARK-16333][Core] Enable EventLoggingListener t...

2017-02-21 Thread jasonmoore2k
Github user jasonmoore2k commented on a diff in the pull request: https://github.com/apache/spark/pull/16714#discussion_r102395516 --- Diff: core/src/main/scala/org/apache/spark/util/JsonProtocol.scala --- @@ -97,61 +100,80 @@ private[spark] object JsonProtocol { case

[GitHub] spark issue #17012: [SPARK-19677][SS] Renaming a file atop an existing one s...

2017-02-21 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/17012 The fix looks good to me. But the test doesn't test anything. Right? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request #16910: [SPARK-19575][SQL]Reading from or writing to a hi...

2017-02-21 Thread windpiger
Github user windpiger commented on a diff in the pull request: https://github.com/apache/spark/pull/16910#discussion_r102395323 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveDDLSuite.scala --- @@ -1494,4 +1495,148 @@ class HiveDDLSuite }

[GitHub] spark issue #16714: [SPARK-16333][Core] Enable EventLoggingListener to log l...

2017-02-21 Thread jasonmoore2k
Github user jasonmoore2k commented on the issue: https://github.com/apache/spark/pull/16714 Would some of the other recent contributors to this area (e.g. @zsxwing or @JoshRosen) be able to comment on any use for these internal accumulables / block status updates, and whether they

[GitHub] spark pull request #16910: [SPARK-19575][SQL]Reading from or writing to a hi...

2017-02-21 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16910#discussion_r102395141 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveDDLSuite.scala --- @@ -1494,4 +1495,148 @@ class HiveDDLSuite }

[GitHub] spark issue #17001: [SPARK-19667][SQL]create table with hiveenabled in defau...

2017-02-21 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/17001 Personally, I think we should improve the test case. Instead of doing it in HiveDDLSuite, we can do it in HiveSparkSubmitSuite.scala. Basically, when using the same metastore, you just need to

[GitHub] spark issue #16910: [SPARK-19575][SQL]Reading from or writing to a hive serd...

2017-02-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16910 **[Test build #73266 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73266/testReport)** for PR 16910 at commit

[GitHub] spark issue #16158: [SPARK-18724][ML] Add TuningSummary for TrainValidationS...

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16158 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #16910: [SPARK-19575][SQL]Reading from or writing to a hi...

2017-02-21 Thread windpiger
Github user windpiger commented on a diff in the pull request: https://github.com/apache/spark/pull/16910#discussion_r102394591 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveDDLSuite.scala --- @@ -1494,4 +1495,148 @@ class HiveDDLSuite }

[GitHub] spark pull request #16970: [SPARK-19497][SS]Implement streaming deduplicatio...

2017-02-21 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/16970#discussion_r102394580 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/statefulOperators.scala --- @@ -321,3 +327,66 @@ case class

[GitHub] spark issue #16158: [SPARK-18724][ML] Add TuningSummary for TrainValidationS...

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16158 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73262/ Test PASSed. ---

[GitHub] spark issue #16158: [SPARK-18724][ML] Add TuningSummary for TrainValidationS...

2017-02-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16158 **[Test build #73262 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73262/testReport)** for PR 16158 at commit

[GitHub] spark issue #16970: [SPARK-19497][SS]Implement streaming deduplication

2017-02-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16970 **[Test build #73265 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73265/testReport)** for PR 16970 at commit

[GitHub] spark pull request #16970: [SPARK-19497][SS]Implement streaming deduplicatio...

2017-02-21 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/16970#discussion_r102394378 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -1996,7 +1996,7 @@ class Dataset[T] private[sql]( def

[GitHub] spark issue #17017: [SPARK-19682][SparkR] Issue warning (or error) when subs...

2017-02-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17017 **[Test build #73264 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73264/testReport)** for PR 17017 at commit

[GitHub] spark issue #17017: [SPARK-19682][SparkR] Issue warning (or error) when subs...

2017-02-21 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/17017 That's one weird test failure. Looks good --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #16980: [SPARK-19617][SS]fix structured streaming restart bug

2017-02-21 Thread uncleGen
Github user uncleGen commented on the issue: https://github.com/apache/spark/pull/16980 The JIRA ID is not SPARK-19645? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #17017: [SPARK-19682][SparkR] Issue warning (or error) when subs...

2017-02-21 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/17017 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request #16910: [SPARK-19575][SQL]Reading from or writing to a hi...

2017-02-21 Thread windpiger
Github user windpiger commented on a diff in the pull request: https://github.com/apache/spark/pull/16910#discussion_r102393239 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/TableReader.scala --- @@ -114,22 +114,30 @@ class HadoopTableReader( val tablePath =

[GitHub] spark issue #16980: [SPARK-19617][SS]fix structured streaming restart bug

2017-02-21 Thread uncleGen
Github user uncleGen commented on the issue: https://github.com/apache/spark/pull/16980 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #17001: [SPARK-19667][SQL]create table with hiveenabled i...

2017-02-21 Thread windpiger
Github user windpiger commented on a diff in the pull request: https://github.com/apache/spark/pull/17001#discussion_r102392451 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveClientImpl.scala --- @@ -311,11 +313,12 @@ private[hive] class HiveClientImpl(

[GitHub] spark issue #17001: [SPARK-19667][SQL]create table with hiveenabled in defau...

2017-02-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17001 **[Test build #73263 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73263/testReport)** for PR 17001 at commit

[GitHub] spark issue #16910: [SPARK-19575][SQL]Reading from or writing to a hive serd...

2017-02-21 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16910 LGTM except a few minor comments. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #16970: [SPARK-19497][SS]Implement streaming deduplicatio...

2017-02-21 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/16970#discussion_r102391414 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -1996,7 +1996,7 @@ class Dataset[T] private[sql]( def

[GitHub] spark pull request #16910: [SPARK-19575][SQL]Reading from or writing to a hi...

2017-02-21 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16910#discussion_r102390808 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveDDLSuite.scala --- @@ -1494,4 +1495,148 @@ class HiveDDLSuite }

[GitHub] spark issue #17023: [SPARK-19695][SQL] Throw an exception if a `columnNameOf...

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17023 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17023: [SPARK-19695][SQL] Throw an exception if a `columnNameOf...

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17023 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73259/ Test PASSed. ---

[GitHub] spark issue #17001: [SPARK-19667][SQL]create table with hiveenabled in defau...

2017-02-21 Thread windpiger
Github user windpiger commented on the issue: https://github.com/apache/spark/pull/17001 [HIVE-1537](https://issues.apache.org/jira/browse/HIVE-1537) related jira

[GitHub] spark issue #17023: [SPARK-19695][SQL] Throw an exception if a `columnNameOf...

2017-02-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17023 **[Test build #73259 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73259/testReport)** for PR 17023 at commit

[GitHub] spark issue #17013: [SPARK-19666][SQL] Skip a property without getter in Jav...

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17013 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17013: [SPARK-19666][SQL] Skip a property without getter in Jav...

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17013 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73258/ Test PASSed. ---

[GitHub] spark issue #17013: [SPARK-19666][SQL] Skip a property without getter in Jav...

2017-02-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17013 **[Test build #73258 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73258/testReport)** for PR 17013 at commit

[GitHub] spark pull request #16972: [SPARK-19556][CORE][WIP] Broadcast data is not en...

2017-02-21 Thread uncleGen
Github user uncleGen commented on a diff in the pull request: https://github.com/apache/spark/pull/16972#discussion_r102390214 --- Diff: core/src/main/scala/org/apache/spark/storage/DiskStore.scala --- @@ -73,17 +81,52 @@ private[spark] class DiskStore(conf: SparkConf,

[GitHub] spark pull request #16910: [SPARK-19575][SQL]Reading from or writing to a hi...

2017-02-21 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16910#discussion_r102390174 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveDDLSuite.scala --- @@ -1494,4 +1495,148 @@ class HiveDDLSuite }

[GitHub] spark pull request #16910: [SPARK-19575][SQL]Reading from or writing to a hi...

2017-02-21 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16910#discussion_r102389966 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveDDLSuite.scala --- @@ -1494,4 +1495,148 @@ class HiveDDLSuite }

[GitHub] spark pull request #16910: [SPARK-19575][SQL]Reading from or writing to a hi...

2017-02-21 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16910#discussion_r102389843 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/TableReader.scala --- @@ -114,22 +114,30 @@ class HadoopTableReader( val tablePath

[GitHub] spark issue #17013: [SPARK-19666][SQL] Skip a property without getter in Jav...

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17013 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17013: [SPARK-19666][SQL] Skip a property without getter in Jav...

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17013 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73256/ Test PASSed. ---

[GitHub] spark issue #17013: [SPARK-19666][SQL] Skip a property without getter in Jav...

2017-02-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17013 **[Test build #73256 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73256/testReport)** for PR 17013 at commit

[GitHub] spark issue #16158: [SPARK-18724][ML] Add TuningSummary for TrainValidationS...

2017-02-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16158 **[Test build #73262 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73262/testReport)** for PR 16158 at commit

[GitHub] spark issue #17014: [SPARK-18608][ML][WIP] Fix double-caching in ML algorith...

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17014 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73253/ Test PASSed. ---

[GitHub] spark issue #17014: [SPARK-18608][ML][WIP] Fix double-caching in ML algorith...

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17014 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17014: [SPARK-18608][ML][WIP] Fix double-caching in ML algorith...

2017-02-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17014 **[Test build #73253 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73253/testReport)** for PR 17014 at commit

[GitHub] spark issue #17001: [SPARK-19667][SQL]create table with hiveenabled in defau...

2017-02-21 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/17001 > In Hive2.0.0, it is allowed to create a table in default database which shared between clusters Are you able to find the specific Hive JIRA for this? --- If your project is set up

[GitHub] spark pull request #17001: [SPARK-19667][SQL]create table with hiveenabled i...

2017-02-21 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/17001#discussion_r102387112 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveClientImpl.scala --- @@ -311,11 +313,12 @@ private[hive] class HiveClientImpl(

[GitHub] spark issue #17013: [SPARK-19666][SQL] Skip a property without getter in Jav...

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17013 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17013: [SPARK-19666][SQL] Skip a property without getter in Jav...

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17013 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73257/ Test FAILed. ---

[GitHub] spark issue #17013: [SPARK-19666][SQL] Skip a property without getter in Jav...

2017-02-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17013 **[Test build #73257 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73257/testReport)** for PR 17013 at commit

[GitHub] spark issue #17024: [SPARK-19525][CORE] Compressing checkpoints.

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17024 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #17024: [SPARK-19525][CORE] Compressing checkpoints.

2017-02-21 Thread aramesh117
GitHub user aramesh117 opened a pull request: https://github.com/apache/spark/pull/17024 [SPARK-19525][CORE] Compressing checkpoints. Spark's performance improves greatly if we enable compression of checkpoints. ## What changes were proposed in this pull request?

[GitHub] spark issue #16938: [SPARK-19583][SQL]CTAS for data source table with a crea...

2017-02-21 Thread windpiger
Github user windpiger commented on the issue: https://github.com/apache/spark/pull/16938 @cloud-fan situation 2. CREATE TABLE ...(PARTITIONED BY ...) LOCATION path AS SELECT ... is different for `path exists`, which is this PR going to resolve. It is ok to make it consist

[GitHub] spark issue #17020: [SPARK-19693][SQL] Make the SET mapreduce.job.reduces au...

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17020 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17001: [SPARK-19667][SQL]create table with hiveenabled in defau...

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17001 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17001: [SPARK-19667][SQL]create table with hiveenabled in defau...

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17001 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73261/ Test FAILed. ---

[GitHub] spark issue #17020: [SPARK-19693][SQL] Make the SET mapreduce.job.reduces au...

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17020 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73254/ Test PASSed. ---

[GitHub] spark issue #17001: [SPARK-19667][SQL]create table with hiveenabled in defau...

2017-02-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17001 **[Test build #73261 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73261/testReport)** for PR 17001 at commit

[GitHub] spark issue #17020: [SPARK-19693][SQL] Make the SET mapreduce.job.reduces au...

2017-02-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17020 **[Test build #73254 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73254/testReport)** for PR 17020 at commit

[GitHub] spark pull request #17022: Aqp 271

2017-02-21 Thread ahshahid
Github user ahshahid closed the pull request at: https://github.com/apache/spark/pull/17022 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #17001: [SPARK-19667][SQL]create table with hiveenabled in defau...

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17001 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73260/ Test FAILed. ---

[GitHub] spark issue #17001: [SPARK-19667][SQL]create table with hiveenabled in defau...

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17001 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17001: [SPARK-19667][SQL]create table with hiveenabled in defau...

2017-02-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17001 **[Test build #73260 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73260/testReport)** for PR 17001 at commit

[GitHub] spark issue #16938: [SPARK-19583][SQL]CTAS for data source table with a crea...

2017-02-21 Thread windpiger
Github user windpiger commented on the issue: https://github.com/apache/spark/pull/16938 @tejasapatil * throw exception is the result of the test, It is really happened in current spark master branch * Hive CTAS not support for partition table

[GitHub] spark issue #17022: Aqp 271

2017-02-21 Thread ahshahid
Github user ahshahid commented on the issue: https://github.com/apache/spark/pull/17022 Sorry I used the wrong base to generate pull request. I will close this. I will later push an appropriate branch, as the bug does exist in master On 21 Feb 2017 21:00, "Hyukjin Kwon"

[GitHub] spark issue #17001: [SPARK-19667][SQL]create table with hiveenabled in defau...

2017-02-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17001 **[Test build #73261 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73261/testReport)** for PR 17001 at commit

[GitHub] spark issue #16910: [SPARK-19575][SQL]Reading from or writing to a hive serd...

2017-02-21 Thread windpiger
Github user windpiger commented on the issue: https://github.com/apache/spark/pull/16910 @gatorsmile I have fixed the review above~ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #16996: [SPARK-19664][SQL]put hive.metastore.warehouse.dir in ha...

2017-02-21 Thread windpiger
Github user windpiger commented on the issue: https://github.com/apache/spark/pull/16996 @yhuai could you help to review this? thanks~ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #17022: Aqp 271

2017-02-21 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/17022 @ahshahid, it seems mistakenly open. Could you close this please? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #17001: [SPARK-19667][SQL]create table with hiveenabled in defau...

2017-02-21 Thread windpiger
Github user windpiger commented on the issue: https://github.com/apache/spark/pull/17001 Agreed, I process the logic in create/get database in HiveClientImpl --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #17001: [SPARK-19667][SQL]create table with hiveenabled in defau...

2017-02-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17001 **[Test build #73260 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73260/testReport)** for PR 17001 at commit

[GitHub] spark issue #12436: [SPARK-14649][CORE] DagScheduler should not run duplicat...

2017-02-21 Thread jisookim0513
Github user jisookim0513 commented on the issue: https://github.com/apache/spark/pull/12436 @sitalkedia have you had a chance to work on this issue and open a new PR? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark issue #17021: [SPARK-19694][ML] Add missing 'setTopicDistributionCol' ...

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17021 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17021: [SPARK-19694][ML] Add missing 'setTopicDistributionCol' ...

2017-02-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17021 **[Test build #73255 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73255/testReport)** for PR 17021 at commit

[GitHub] spark issue #17021: [SPARK-19694][ML] Add missing 'setTopicDistributionCol' ...

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17021 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73255/ Test PASSed. ---

[GitHub] spark issue #16744: [SPARK-19405][STREAMING] Support for cross-account Kines...

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16744 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73248/ Test PASSed. ---

[GitHub] spark issue #16744: [SPARK-19405][STREAMING] Support for cross-account Kines...

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16744 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16744: [SPARK-19405][STREAMING] Support for cross-account Kines...

2017-02-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16744 **[Test build #73248 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73248/testReport)** for PR 16744 at commit

[GitHub] spark issue #16928: [SPARK-18699][SQL] Put malformed tokens into a new field...

2017-02-21 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/16928 @HyukjinKwon @cloud-fan okay, all tests passed. Also, I made a pr to fix the json behaviour #17023. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #16928: [SPARK-18699][SQL] Put malformed tokens into a new field...

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16928 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16928: [SPARK-18699][SQL] Put malformed tokens into a new field...

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16928 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73251/ Test PASSed. ---

[GitHub] spark issue #16928: [SPARK-18699][SQL] Put malformed tokens into a new field...

2017-02-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16928 **[Test build #73251 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73251/testReport)** for PR 16928 at commit

[GitHub] spark pull request #16970: [SPARK-19497][SS]Implement streaming deduplicatio...

2017-02-21 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/16970#discussion_r102381390 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -1996,7 +1996,7 @@ class Dataset[T] private[sql]( def

[GitHub] spark issue #17023: [SPARK-19695][SQL] Throw an exception if a `columnNameOf...

2017-02-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17023 **[Test build #73259 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73259/testReport)** for PR 17023 at commit

[GitHub] spark issue #17022: Aqp 271

2017-02-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17022 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

  1   2   3   4   5   6   >