Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14014
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14014
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61811/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14014
**[Test build #61811 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61811/consoleFull)**
for PR 14014 at commit
Github user gurvindersingh commented on a diff in the pull request:
https://github.com/apache/spark/pull/13950#discussion_r69678617
--- Diff: core/src/main/scala/org/apache/spark/ui/JettyUtils.scala ---
@@ -186,6 +188,67 @@ private[spark] object JettyUtils extends Logging {
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/13990#discussion_r69678507
--- Diff:
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/ComplexTypeSuite.scala
---
@@ -246,4 +246,17 @@ class
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14004
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14004
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61807/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14004
**[Test build #61807 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61807/consoleFull)**
for PR 14004 at commit
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/13990#discussion_r69678271
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala
---
@@ -393,3 +393,64 @@ case class
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14045
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61814/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14045
**[Test build #61814 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61814/consoleFull)**
for PR 14045 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14045
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user rxin commented on the issue:
https://github.com/apache/spark/pull/14063
Can you verify the output after the all the follow-up commits?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13509
**[Test build #3166 has
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3166/consoleFull)**
for PR 13509 at commit
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/13990#discussion_r69677978
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala
---
@@ -393,3 +393,64 @@ case class
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/13990#discussion_r69677596
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala
---
@@ -393,3 +393,64 @@ case class
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14045
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61813/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14045
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14045
**[Test build #61813 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61813/consoleFull)**
for PR 14045 at commit
Github user rxin commented on a diff in the pull request:
https://github.com/apache/spark/pull/13494#discussion_r69677532
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/OptimizeMetadataOnlySuite.scala
---
@@ -0,0 +1,95 @@
+/*
+ * Licensed to the Apache
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14053
**[Test build #61820 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61820/consoleFull)**
for PR 14053 at commit
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/13990
Sure, @rxin .
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so,
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/14004
If then, I will reposition that.
Do you mean `making a new java file containing not-really-UTF8String`
function?
---
If your project is set up for it, you can reply to this email and
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/14004
Oh, @cloud-fan .
Is there some misunderstanding?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13990
**[Test build #61819 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61819/consoleFull)**
for PR 13990 at commit
Github user tnachen commented on a diff in the pull request:
https://github.com/apache/spark/pull/13950#discussion_r69676891
--- Diff: core/src/main/scala/org/apache/spark/ui/JettyUtils.scala ---
@@ -186,6 +188,67 @@ private[spark] object JettyUtils extends Logging {
Github user tnachen commented on a diff in the pull request:
https://github.com/apache/spark/pull/13950#discussion_r69676869
--- Diff: docs/configuration.md ---
@@ -598,6 +598,20 @@ Apart from these, the following properties are also
available, and may be useful
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/14004
Now, the PR became more concise. Thank you for decision, @cloud-fan .
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user techaddict commented on a diff in the pull request:
https://github.com/apache/spark/pull/13990#discussion_r69676815
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala
---
@@ -393,3 +393,71 @@ case class
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/13926
@cloud-fan `CreateDataSourceTableAsSelectCommand` creates a DataFrame at
first, and then create a data source table. The order is different from
`CreateHiveTableAsSelectCommand`. If we hit any
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/14060
It's my pleasure. Thank you for reviewing, @MukulSoul and @rxin .
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/13494#discussion_r69676774
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/OptimizeMetadataOnlySuite.scala
---
@@ -0,0 +1,95 @@
+/*
+ * Licensed to the
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14004
**[Test build #61818 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61818/consoleFull)**
for PR 14004 at commit
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/14004#discussion_r6967
--- Diff:
common/unsafe/src/main/java/org/apache/spark/unsafe/types/UTF8String.java ---
@@ -801,6 +804,49 @@ public static UTF8String concatWs(UTF8String
Github user rxin commented on the issue:
https://github.com/apache/spark/pull/14054
hm it does seem to me this should be an option in the data source itself.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user rxin commented on the issue:
https://github.com/apache/spark/pull/14059
LGTM except the minor comment.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14004
**[Test build #61816 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61816/consoleFull)**
for PR 14004 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13708
**[Test build #61817 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61817/consoleFull)**
for PR 13708 at commit
Github user rxin commented on a diff in the pull request:
https://github.com/apache/spark/pull/14059#discussion_r69676444
--- Diff: docs/running-on-mesos.md ---
@@ -180,30 +180,47 @@ Note that jars or python files that are passed to
spark-submit should be URIs re
#
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13990
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61806/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13494
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61805/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13990
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13494
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13990
**[Test build #61806 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61806/consoleFull)**
for PR 13990 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13494
**[Test build #61805 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61805/consoleFull)**
for PR 13494 at commit
Github user rxin commented on a diff in the pull request:
https://github.com/apache/spark/pull/13494#discussion_r69676173
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/OptimizeMetadataOnly.scala
---
@@ -0,0 +1,133 @@
+/*
+ * Licensed to the Apache
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13990
**[Test build #61815 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61815/consoleFull)**
for PR 13990 at commit
Github user rxin commented on the issue:
https://github.com/apache/spark/pull/14060
Merging in master.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or
Github user rxin commented on the issue:
https://github.com/apache/spark/pull/13990
cc @dongjoon-hyun can you help review this
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user rxin commented on a diff in the pull request:
https://github.com/apache/spark/pull/13990#discussion_r69676026
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala
---
@@ -393,3 +393,71 @@ case class
Github user rxin commented on a diff in the pull request:
https://github.com/apache/spark/pull/13990#discussion_r69676018
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala
---
@@ -393,3 +393,71 @@ case class
Github user rxin commented on a diff in the pull request:
https://github.com/apache/spark/pull/13990#discussion_r69676002
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala
---
@@ -393,3 +393,71 @@ case class
Github user techaddict commented on a diff in the pull request:
https://github.com/apache/spark/pull/13990#discussion_r69675997
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala
---
@@ -393,3 +393,71 @@ case class
Github user rxin commented on a diff in the pull request:
https://github.com/apache/spark/pull/13494#discussion_r69675862
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/OptimizeMetadataOnlySuite.scala
---
@@ -0,0 +1,95 @@
+/*
+ * Licensed to the Apache
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14045
**[Test build #61814 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61814/consoleFull)**
for PR 14045 at commit
Github user rxin commented on a diff in the pull request:
https://github.com/apache/spark/pull/13494#discussion_r69675796
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/OptimizeMetadataOnlySuite.scala
---
@@ -0,0 +1,95 @@
+/*
+ * Licensed to the Apache
Github user rxin commented on a diff in the pull request:
https://github.com/apache/spark/pull/13494#discussion_r69675767
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/OptimizeMetadataOnlySuite.scala
---
@@ -0,0 +1,95 @@
+/*
+ * Licensed to the Apache
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/13990#discussion_r69675764
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala
---
@@ -393,3 +393,71 @@ case class
Github user rxin commented on a diff in the pull request:
https://github.com/apache/spark/pull/13494#discussion_r69675675
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/OptimizeMetadataOnlySuite.scala
---
@@ -0,0 +1,95 @@
+/*
+ * Licensed to the Apache
Github user rxin commented on a diff in the pull request:
https://github.com/apache/spark/pull/13494#discussion_r69675663
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/OptimizeMetadataOnlySuite.scala
---
@@ -0,0 +1,95 @@
+/*
+ * Licensed to the Apache
Github user rxin commented on a diff in the pull request:
https://github.com/apache/spark/pull/13494#discussion_r69675655
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/OptimizeMetadataOnlySuite.scala
---
@@ -0,0 +1,95 @@
+/*
+ * Licensed to the Apache
Github user rxin commented on a diff in the pull request:
https://github.com/apache/spark/pull/13494#discussion_r69675558
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/OptimizeMetadataOnly.scala
---
@@ -0,0 +1,133 @@
+/*
+ * Licensed to the Apache
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/13926
does CreateDataSourceTableAsSelectCommand has this problem?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does
Github user rxin commented on a diff in the pull request:
https://github.com/apache/spark/pull/13494#discussion_r69675543
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/OptimizeMetadataOnly.scala
---
@@ -0,0 +1,133 @@
+/*
+ * Licensed to the Apache
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/14004#discussion_r69675532
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/regexpExpressions.scala
---
@@ -198,6 +200,35 @@ case class
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14063
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/61810/
Test PASSed.
---
Github user MukulSoul commented on the issue:
https://github.com/apache/spark/pull/14060
@dongjoon-hyun : Thanks for taking the case. It looks good.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/14004#discussion_r69675519
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/regexpExpressions.scala
---
@@ -198,6 +200,35 @@ case class
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14063
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/14035
@mengxr, @yanboliang, Could you review this?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14063
**[Test build #61810 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61810/consoleFull)**
for PR 14063 at commit
Github user techaddict commented on a diff in the pull request:
https://github.com/apache/spark/pull/13990#discussion_r69675457
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala
---
@@ -393,3 +393,71 @@ case class
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14045
**[Test build #61813 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61813/consoleFull)**
for PR 14045 at commit
Github user techaddict commented on a diff in the pull request:
https://github.com/apache/spark/pull/13990#discussion_r69675325
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala
---
@@ -393,3 +393,71 @@ case class
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/13494#discussion_r69675141
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/OptimizeMetadataOnly.scala
---
@@ -0,0 +1,133 @@
+/*
+ * Licensed to the Apache
Github user liancheng commented on a diff in the pull request:
https://github.com/apache/spark/pull/14014#discussion_r69675124
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetRowConverter.scala
---
@@ -482,13 +482,106 @@
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/13990#discussion_r69675090
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala
---
@@ -393,3 +393,71 @@ case class
Github user rxin commented on a diff in the pull request:
https://github.com/apache/spark/pull/13494#discussion_r69675086
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/OptimizeMetadataOnly.scala
---
@@ -0,0 +1,133 @@
+/*
+ * Licensed to the Apache
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/14004#discussion_r69674992
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/regexpExpressions.scala
---
@@ -198,6 +200,35 @@ case class
Github user rxin commented on a diff in the pull request:
https://github.com/apache/spark/pull/13494#discussion_r69674974
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/OptimizeMetadataOnly.scala
---
@@ -0,0 +1,133 @@
+/*
+ * Licensed to the Apache
Github user rxin commented on a diff in the pull request:
https://github.com/apache/spark/pull/13494#discussion_r69674988
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/OptimizeMetadataOnly.scala
---
@@ -0,0 +1,133 @@
+/*
+ * Licensed to the Apache
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/14004#discussion_r69674949
--- Diff:
common/unsafe/src/main/java/org/apache/spark/unsafe/types/UTF8String.java ---
@@ -801,6 +804,49 @@ public static UTF8String
Github user rxin commented on a diff in the pull request:
https://github.com/apache/spark/pull/13494#discussion_r69674955
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/OptimizeMetadataOnly.scala
---
@@ -0,0 +1,133 @@
+/*
+ * Licensed to the Apache
Github user rxin commented on a diff in the pull request:
https://github.com/apache/spark/pull/13494#discussion_r69674923
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/OptimizeMetadataOnly.scala
---
@@ -0,0 +1,133 @@
+/*
+ * Licensed to the Apache
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/14004#discussion_r69674859
--- Diff:
common/unsafe/src/main/java/org/apache/spark/unsafe/types/UTF8String.java ---
@@ -801,6 +804,49 @@ public static UTF8String concatWs(UTF8String
Github user rxin commented on the issue:
https://github.com/apache/spark/pull/14036
OK I think it's fine to add it in SQL for compatibility but I wouldn't add
functions in the DataFrame API for that.
---
If your project is set up for it, you can reply to this email and have your
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14014
**[Test build #61811 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61811/consoleFull)**
for PR 14014 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14013
**[Test build #61812 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61812/consoleFull)**
for PR 14013 at commit
Github user rxin commented on a diff in the pull request:
https://github.com/apache/spark/pull/13494#discussion_r69674624
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/OptimizeMetadataOnly.scala
---
@@ -0,0 +1,133 @@
+/*
+ * Licensed to the Apache
Github user rxin commented on a diff in the pull request:
https://github.com/apache/spark/pull/13494#discussion_r69674487
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/OptimizeMetadataOnly.scala
---
@@ -0,0 +1,133 @@
+/*
+ * Licensed to the Apache
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/13890
it's a pretty good optimization! should we also apply it to `LocalRelation`?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If
Github user rxin commented on a diff in the pull request:
https://github.com/apache/spark/pull/13494#discussion_r69674388
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/OptimizeMetadataOnly.scala
---
@@ -0,0 +1,133 @@
+/*
+ * Licensed to the Apache
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/13890#discussion_r69674281
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/ExistingRDD.scala ---
@@ -74,13 +74,71 @@ object RDDConversions {
}
}
Github user rxin commented on a diff in the pull request:
https://github.com/apache/spark/pull/13494#discussion_r69674280
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/OptimizeMetadataOnly.scala
---
@@ -0,0 +1,133 @@
+/*
+ * Licensed to the Apache
Github user rxin commented on a diff in the pull request:
https://github.com/apache/spark/pull/13494#discussion_r69674209
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/OptimizeMetadataOnly.scala
---
@@ -0,0 +1,133 @@
+/*
+ * Licensed to the Apache
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/13890#discussion_r69674173
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/ExistingRDD.scala ---
@@ -74,13 +74,71 @@ object RDDConversions {
}
}
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/13873
I tried to do this before, but couldn't find much value of it. Current the
schema of encoder is passed in as parameter, not retrieved from the serializer
expression. What do you think?
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14063
**[Test build #61810 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/61810/consoleFull)**
for PR 14063 at commit
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/14053#discussion_r69673940
--- Diff:
sql/hive/src/test/scala/org/apache/spark/sql/hive/parquetSuites.scala ---
@@ -716,6 +717,39 @@ class ParquetSourceSuite extends
Github user rxin commented on the issue:
https://github.com/apache/spark/pull/13494
@lianhuiwang please update the pull request description to include the
actual cases that are supported in this pull request.
---
If your project is set up for it, you can reply to this email and
1 - 100 of 613 matches
Mail list logo
