Beishao Cao created SPARK-43889:
-----------------------------------
Summary: Add check to see if column name is legal for __dir__
Key: SPARK-43889
URL: https://issues.apache.org/jira/browse/SPARK-43889
Project: Spark
Issue Type: Bug
Components: PySpark
Affects Versions: 3.5.0
Reporter: Beishao Cao
In SPARK-43270, we add a support for the autocomplete suggest for {{df.|}} ,
which also suggest column_name for dataframe.
However, we found out later that some dataframe can have column which has
illegal variable name (e.g: name?1, name 1, 2name etc.) These variable name
should be filtered out and this will be consistent with pandas behavior now
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
