[
https://issues.apache.org/jira/browse/SPARK-43892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Beishao Cao updated SPARK-43892:
--------------------------------
Description:
We don't have a keys method for pyspark dataframe, even though we support
df['column name']
And when we want to get a suggestion for {{{}df[|]{}}}, we can't get anything.
So this could be an improvement for autocomplete engine that uses {{keys()}} to
generate autocomplete suggestions (e.g. IPython kernel, Databricks Notebooks)
will suggest column names on the completion df[|]
However, for those using IPython, they don't check keys, it only support pandas
& numpy & dict type. So we need to add _ipython_key_completions_ to our object
to make it work.
was:
We don't have a keys method for pyspark dataframe, even though we support
df['column name']
And when we want to get a suggestion for {{{}df[|]{}}}, we can't get anything.
So this could be an improvement for autocomplete engine that uses {{keys()}} to
generate autocomplete suggestions (e.g. IPython kernel, Databricks Notebooks)
will suggest column names on the completion df[|]
> Add support for df[|] suggest column
> ------------------------------------
>
> Key: SPARK-43892
> URL: https://issues.apache.org/jira/browse/SPARK-43892
> Project: Spark
> Issue Type: Improvement
> Components: PySpark
> Affects Versions: 3.5.0
> Reporter: Beishao Cao
> Priority: Major
>
> We don't have a keys method for pyspark dataframe, even though we support
> df['column name']
> And when we want to get a suggestion for {{{}df[|]{}}}, we can't get
> anything. So this could be an improvement for autocomplete engine that uses
> {{keys()}} to generate autocomplete suggestions (e.g. IPython kernel,
> Databricks Notebooks) will suggest column names on the completion df[|]
> However, for those using IPython, they don't check keys, it only support
> pandas & numpy & dict type. So we need to add _ipython_key_completions_ to
> our object to make it work.
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
