GitHub user QuentinAmbard opened a pull request:
https://github.com/apache/spark/pull/21917
[SPARK-24720][STREAMING-KAFKA] add option to align ranges with offset
having records to support kafka transaction
## What changes were proposed in this pull request?
This fix adds
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21917
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user xuanyuanking commented on a diff in the pull request:
https://github.com/apache/spark/pull/21893#discussion_r206188190
--- Diff:
sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/MultiFormatTableSuite.scala
---
@@ -0,0 +1,514 @@
+/*
+ * Licensed to
Github user xuanyuanking commented on a diff in the pull request:
https://github.com/apache/spark/pull/21893#discussion_r206182473
--- Diff:
sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/MultiFormatTableSuite.scala
---
@@ -0,0 +1,514 @@
+/*
+ * Licensed to
Github user xuanyuanking commented on a diff in the pull request:
https://github.com/apache/spark/pull/21893#discussion_r206188295
--- Diff:
sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/MultiFormatTableSuite.scala
---
@@ -0,0 +1,514 @@
+/*
+ * Licensed to
Github user xuanyuanking commented on a diff in the pull request:
https://github.com/apache/spark/pull/21893#discussion_r206190334
--- Diff:
sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/MultiFormatTableSuite.scala
---
@@ -0,0 +1,514 @@
+/*
+ * Licensed to
Github user xuanyuanking commented on a diff in the pull request:
https://github.com/apache/spark/pull/21893#discussion_r206184350
--- Diff:
sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/MultiFormatTableSuite.scala
---
@@ -0,0 +1,514 @@
+/*
+ * Licensed to
Github user holdensmagicalunicorn commented on the issue:
https://github.com/apache/spark/pull/21918
@jiangxb1987, thanks! I am a bot who has found some folks who might be able
to help with the review:@mateiz, @rxin and @kayousterhout
---
GitHub user jiangxb1987 opened a pull request:
https://github.com/apache/spark/pull/21918
[SPARK-24821][Core] Fail fast when submitted job compute on a subset of all
the partitions for a barrier stage
## What changes were proposed in this pull request?
Check on
Github user krisgeus commented on a diff in the pull request:
https://github.com/apache/spark/pull/21893#discussion_r206228870
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/ParserUtils.scala
---
@@ -96,6 +96,9 @@ object ParserUtils {
}
Github user arunmahadevan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21721#discussion_r206241038
--- Diff:
sql/core/src/main/java/org/apache/spark/sql/sources/v2/writer/streaming/SupportsCustomWriterMetrics.java
---
@@ -0,0 +1,45 @@
+/*
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21896
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93781/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21896
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user holdensmagicalunicorn commented on the issue:
https://github.com/apache/spark/pull/21920
@HyukjinKwon, thanks! I am a bot who has found some folks who might be able
to help with the review:@shivaram
---
GitHub user HyukjinKwon opened a pull request:
https://github.com/apache/spark/pull/21920
[SPARK-24956][BUILD][FOLLOWUP] Upgrade Maven version to 3.5.4 for AppVeyor
as well
## What changes were proposed in this pull request?
Maven version was upgraded and AppVeyor should
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21921
**[Test build #93796 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93796/testReport)**
for PR 21921 at commit
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/21921
cc @rdblue @rxin @gatorsmile @gengliangwang
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
GitHub user cloud-fan opened a pull request:
https://github.com/apache/spark/pull/21921
[SPARK-24971][SQL] remove SupportsDeprecatedScanRow
## What changes were proposed in this pull request?
This is a follow up of https://github.com/apache/spark/pull/21118 .
In
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21921
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21199
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21199
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93797/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21199
**[Test build #93797 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93797/testReport)**
for PR 21199 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21910
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19832
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19832
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93777/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21910
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93779/
Test PASSed.
---
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/21914
LGTM, merging to master!
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user mauropalsgraaf commented on a diff in the pull request:
https://github.com/apache/spark/pull/21807#discussion_r206142897
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/CheckAnalysis.scala
---
@@ -68,9 +68,18 @@ trait CheckAnalysis extends
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/21834
Thanks! Merged to master.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21916
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user xuanyuanking commented on a diff in the pull request:
https://github.com/apache/spark/pull/21893#discussion_r206188012
--- Diff:
sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/MultiFormatTableSuite.scala
---
@@ -0,0 +1,514 @@
+/*
+ * Licensed to
Github user xuanyuanking commented on a diff in the pull request:
https://github.com/apache/spark/pull/21893#discussion_r206184183
--- Diff:
sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/MultiFormatTableSuite.scala
---
@@ -0,0 +1,514 @@
+/*
+ * Licensed to
Github user xuanyuanking commented on a diff in the pull request:
https://github.com/apache/spark/pull/21893#discussion_r206188650
--- Diff:
sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/MultiFormatTableSuite.scala
---
@@ -0,0 +1,514 @@
+/*
+ * Licensed to
Github user xuanyuanking commented on a diff in the pull request:
https://github.com/apache/spark/pull/21893#discussion_r206178526
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/ParserUtils.scala
---
@@ -96,6 +96,9 @@ object ParserUtils {
}
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/21893
A single partitioned table with different file formats, like Parquet, ORC
and csv?
---
-
To unsubscribe, e-mail:
Github user mn-mikke commented on a diff in the pull request:
https://github.com/apache/spark/pull/21103#discussion_r206228544
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala
---
@@ -3651,14 +3651,9 @@ case class
Github user krisgeus commented on the issue:
https://github.com/apache/spark/pull/21893
@gatorsmile That's why this PR makes sure that in the case of differing
formats we use the HiveTableScanExec path and not the FileSourceScanExec
---
Github user kiszk commented on the issue:
https://github.com/apache/spark/pull/21920
@HyukjinKwon thank you
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user krisgeus commented on a diff in the pull request:
https://github.com/apache/spark/pull/21893#discussion_r206229791
--- Diff:
sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/MultiFormatTableSuite.scala
---
@@ -0,0 +1,514 @@
+/*
+ * Licensed to the
Github user krisgeus commented on a diff in the pull request:
https://github.com/apache/spark/pull/21893#discussion_r206229739
--- Diff:
sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/MultiFormatTableSuite.scala
---
@@ -0,0 +1,514 @@
+/*
+ * Licensed to the
Github user krisgeus commented on a diff in the pull request:
https://github.com/apache/spark/pull/21893#discussion_r206229680
--- Diff:
sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/MultiFormatTableSuite.scala
---
@@ -0,0 +1,514 @@
+/*
+ * Licensed to the
Github user krisgeus commented on a diff in the pull request:
https://github.com/apache/spark/pull/21893#discussion_r206229532
--- Diff:
sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/MultiFormatTableSuite.scala
---
@@ -0,0 +1,514 @@
+/*
+ * Licensed to the
Github user krisgeus commented on a diff in the pull request:
https://github.com/apache/spark/pull/21893#discussion_r206229611
--- Diff:
sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/MultiFormatTableSuite.scala
---
@@ -0,0 +1,514 @@
+/*
+ * Licensed to the
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21922
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21918
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21918
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user krisgeus commented on a diff in the pull request:
https://github.com/apache/spark/pull/21893#discussion_r206229212
--- Diff:
sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/MultiFormatTableSuite.scala
---
@@ -0,0 +1,514 @@
+/*
+ * Licensed to the
Github user krisgeus commented on a diff in the pull request:
https://github.com/apache/spark/pull/21893#discussion_r206229493
--- Diff:
sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/MultiFormatTableSuite.scala
---
@@ -0,0 +1,514 @@
+/*
+ * Licensed to the
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21896
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21896
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user arunmahadevan commented on the issue:
https://github.com/apache/spark/pull/21721
@HeartSaVioR thanks for taking time to review. Addressed the comments, can
you take a look again?
Regarding the mixin interface, would like to take feedback from others.
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21721
**[Test build #93793 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93793/testReport)**
for PR 21721 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21721
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93793/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21721
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21902
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93782/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21199
**[Test build #93797 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93797/testReport)**
for PR 21199 at commit
Github user holdensmagicalunicorn commented on the issue:
https://github.com/apache/spark/pull/21922
@gatorsmile, thanks! I am a bot who has found some folks who might be able
to help with the review:@rxin, @cloud-fan and @hvanhovell
---
GitHub user gatorsmile opened a pull request:
https://github.com/apache/spark/pull/21922
[WIP] Add an ANSI SQL parser mode
## What changes were proposed in this pull request?
This WIP is just to show how to add a SQLConf in the parser module.
## How was this patch
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/21922
cc @dilipbiswal @dongjoon-hyun
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21902
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93790/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21912
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21912
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93786/
Test PASSed.
---
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/21488
https://github.com/apache/kafka/releases KAFKA 2.0.0 release is publicly
available. We can finish it before the code freeze?
---
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/1
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/21834
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
GitHub user rezasafi opened a pull request:
https://github.com/apache/spark/pull/21916
[SPARK-24958][WIP] Report executors' process tree total memory information
to heartbeat signals
This is work in progress for SPARK-24958 and this PR is opened on top of
the PR for SPARK-23429:
Github user holdensmagicalunicorn commented on the issue:
https://github.com/apache/spark/pull/21916
@rezasafi, thanks! I am a bot who has found some folks who might be able to
help with the review:@JoshRosen, @vanzin and @pwendell
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21917
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21917
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/21913
cc @zsxwing
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/21881
Test case?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user krisgeus commented on the issue:
https://github.com/apache/spark/pull/21893
@xuanyuanking Thanks for another round of review comments. Addressed them
in the 4th commit. Hope it is ok now.
---
-
To
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/21893#discussion_r206234291
--- Diff:
sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveClientImpl.scala
---
@@ -437,6 +437,8 @@ private[hive] class HiveClientImpl(
Github user krisgeus commented on a diff in the pull request:
https://github.com/apache/spark/pull/21893#discussion_r206236120
--- Diff:
sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveClientImpl.scala
---
@@ -437,6 +437,8 @@ private[hive] class HiveClientImpl(
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/21893
I do not think we will provide this support. This will complicate the whole
design and implementation, and the benefit is limited.
I left two comments about your code. Maybe you can
Github user arunmahadevan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21721#discussion_r206237610
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/ProgressReporter.scala
---
@@ -143,18 +150,50 @@ trait ProgressReporter
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21721
**[Test build #93793 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93793/testReport)**
for PR 21721 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21902
**[Test build #93782 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93782/testReport)**
for PR 21902 at commit
Github user rxin commented on the issue:
https://github.com/apache/spark/pull/21922
what are the actual changes?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21916
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21916
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user holdensmagicalunicorn commented on the issue:
https://github.com/apache/spark/pull/21917
@QuentinAmbard, thanks! I am a bot who has found some folks who might be
able to help with the review:@tdas, @zsxwing and @koeninger
---
Github user xuanyuanking commented on a diff in the pull request:
https://github.com/apache/spark/pull/21881#discussion_r206203835
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala ---
@@ -337,7 +337,11 @@ case class LoadDataCommand(
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21918
**[Test build #93792 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93792/testReport)**
for PR 21918 at commit
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/21898
cc @mengxr @cloud-fan @rxin
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21919
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user holdensmagicalunicorn commented on the issue:
https://github.com/apache/spark/pull/21919
@vackosar, thanks! I am a bot who has found some folks who might be able to
help with the review:@tdas, @gatorsmile and @cloud-fan
---
GitHub user vackosar opened a pull request:
https://github.com/apache/spark/pull/21919
[SPARK-24933][SS] Report numOutputRows in SinkProgress via WrittenComâ¦
## What changes were proposed in this pull request?
SinkProgress should report similar properties like
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21919
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/21893
The current design of file source reading and writing does not support
this.
---
-
To unsubscribe, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21896
**[Test build #93781 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93781/testReport)**
for PR 21896 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21902
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21920
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21920
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21920
**[Test build #93795 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93795/testReport)**
for PR 21920 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21912
**[Test build #93786 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93786/testReport)**
for PR 21912 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21902
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user krisgeus commented on the issue:
https://github.com/apache/spark/pull/21893
@gatorsmile Yes indeed. A singel partitioned table having multiple
partitions.
Each partition can have it own file format like parquet, orc, avro etc.
In our case new data comes in in AVRO
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/21893#discussion_r206235932
--- Diff:
sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveStrategies.scala ---
@@ -182,7 +182,9 @@ case class RelationConversions(
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/21896
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
1 - 100 of 553 matches
Mail list logo
