[
https://issues.apache.org/jira/browse/SPARK-43889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17727717#comment-17727717
]
Beishao Cao commented on SPARK-43889:
-------------------------------------
Submit a pr about this https://github.com/apache/spark/pull/41393
> Add check to see if column name is legal for __dir__
> ----------------------------------------------------
>
> Key: SPARK-43889
> URL: https://issues.apache.org/jira/browse/SPARK-43889
> Project: Spark
> Issue Type: Bug
> Components: PySpark
> Affects Versions: 3.5.0
> Reporter: Beishao Cao
> Priority: Major
>
> In SPARK-43270, we add a support for the autocomplete suggest for {{df.|}} ,
> which also suggest column_name for dataframe.
> However, we found out later that some dataframe can have column which has
> illegal variable name (e.g: name?1, name 1, 2name etc.) These variable name
> should be filtered out and this will be consistent with pandas behavior now
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
