Github user BryanCutler commented on a diff in the pull request:
https://github.com/apache/spark/pull/21427#discussion_r196243235
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ---
@@ -1161,6 +1161,16 @@ object SQLConf {
.booleanConf
.createWithDefault(true)
+ val PANDAS_GROUPED_MAP_ASSIGN_COLUMNS_BY_POSITION =
+
buildConf("spark.sql.execution.pandas.groupedMap.assignColumnsByPosition")
+ .internal()
+ .doc("When true, a grouped map Pandas UDF will assign columns from
the returned " +
+ "Pandas DataFrame based on position, regardless of column label
type. When false, " +
+ "columns will be looked up by name if labeled with a string and
fallback to use" +
--- End diff --
This can also be marked as deprecated right?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
