HyukjinKwon commented on a change in pull request #33362:
URL: https://github.com/apache/spark/pull/33362#discussion_r670317869
##########
File path: docs/sql-ref-syntax-qry-select-transform.md
##########
@@ -24,6 +24,14 @@ license: |
The `TRANSFORM` clause is used to specify a Hive-style transform query
specification
to transform the inputs by running a user-specified command or script.
+Currently, Spark's script transform support two modes:
Review comment:
```suggestion
Spark's script transform supports two modes:
```
##########
File path: docs/sql-ref-syntax-qry-select-transform.md
##########
@@ -24,6 +24,14 @@ license: |
The `TRANSFORM` clause is used to specify a Hive-style transform query
specification
to transform the inputs by running a user-specified command or script.
+Currently, Spark's script transform support two modes:
+
+ 1. Without Hive: Spark scripts transform can run without `-Phive` or
`SparkSession.builder.enableHiveSupport()`.
Review comment:
```suggestion
1. Without Hive: Spark script transform can run without `-Phive` or
`SparkSession.builder.enableHiveSupport()`.
```
##########
File path: docs/sql-ref-syntax-qry-select-transform.md
##########
@@ -24,6 +24,14 @@ license: |
The `TRANSFORM` clause is used to specify a Hive-style transform query
specification
to transform the inputs by running a user-specified command or script.
+Currently, Spark's script transform support two modes:
+
+ 1. Without Hive: Spark scripts transform can run without `-Phive` or
`SparkSession.builder.enableHiveSupport()`.
+ In this case, now spark only use script transform with
`ROW FORMAT DELIMITED` and treat all value passed
Review comment:
```suggestion
In this case, now spark only use script transform with
`ROW FORMAT DELIMITED` and treat all values passed
```
##########
File path: docs/sql-ref-syntax-qry-select-transform.md
##########
@@ -24,6 +24,14 @@ license: |
The `TRANSFORM` clause is used to specify a Hive-style transform query
specification
to transform the inputs by running a user-specified command or script.
+Currently, Spark's script transform support two modes:
+
+ 1. Without Hive: Spark scripts transform can run without `-Phive` or
`SparkSession.builder.enableHiveSupport()`.
+ In this case, now spark only use script transform with
`ROW FORMAT DELIMITED` and treat all value passed
+ to script as a string.
Review comment:
```suggestion
to the script as strings.
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
