Maciej Szymkiewicz created SPARK-37668:
------------------------------------------
Summary: 'Index' object has no attribute 'levels'
Key: SPARK-37668
URL: https://issues.apache.org/jira/browse/SPARK-37668
Project: Spark
Issue Type: Bug
Components: PySpark
Affects Versions: 3.3.0
Reporter: Maciej Szymkiewicz
[This piece of
code|https://github.com/apache/spark/blob/6e45b04db48008fa033b09df983d3bd1c4f790ea/python/pyspark/pandas/frame.py#L3991-L3993]
in {{pyspark.pandas.frame}} is going to fail on runtime, when
{{is_name_like_tuple}} evaluates to {{True}}
{code:python}
if is_name_like_tuple(column):
if len(column) != len(self.columns.levels):
{code}
with
{code}
'Index' object has no attribute 'levels'
{code}
To be honest, I am not sure what is intended behavior (initially, I suspected
that we should have
{code:python}
if len(column) != self.columns.nlevels
{code}
but {{nlevels}} is hard-coded to one, and wouldn't be consistent with Pandas at
all.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
