StefanXiepj commented on a change in pull request #30785:
URL: https://github.com/apache/spark/pull/30785#discussion_r544121403
##########
File path:
sql/hive/src/test/scala/org/apache/spark/sql/hive/orc/HiveOrcSourceSuite.scala
##########
@@ -153,4 +153,18 @@ class HiveOrcSourceSuite extends OrcSuite with
TestHiveSingleton {
}
}
}
+
+ test("SPARK-33755: Allow creating orc table when row format separator is
defined") {
+ withTable("row_format_orc") {
+ sql(
+ s"""CREATE TABLE row_format_orc(
+ | intField INT,
+ | stringField STRING
+ |)
+ |ROW FORMAT DELIMITED FIELDS TERMINATED BY '002'
Review comment:
We have many tasks which are running on hive and slowly, so we want to
migrate it from hive to spark. I think other companies want to this too. If we
support ignore this exception by set
spark.sql.orc.skipRowFormatDelimitedError=true , we can migrate hive task and
user do not need to modify his sql script.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
