[
https://issues.apache.org/jira/browse/BEAM-12541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brian Hulette updated BEAM-12541:
---------------------------------
Description:
A new doctest was added in 1.3.0 that verifies fillna with a DataFrame value:
{code}
df = pd.DataFrame([[np.nan, 2, np.nan, 0],
[3, 4, np.nan, 1],
[np.nan, np.nan, np.nan, 5],
[np.nan, 3, np.nan, 4]],
columns=list("ABCD"))
df2 = pd.DataFrame(np.zeros((4, 4)), columns=list("ABCE"))
df.fillna(df2)
A B C D
0 0.0 2.0 0.0 0
1 3.0 4.0 0.0 1
2 0.0 0.0 0.0 5
3 0.0 3.0 0.0 4
{code}
Unfortunately, we fail this test. The root cause is that we don't require Index
partitioning when fillna is called with a DataFrame/Series value.
was:
A new doctest was added in 1.3.0 that verifies fillna with a DataFrame value:
{code}
df2 = pd.DataFrame(np.zeros((4, 4)), columns=list("ABCE"))
df.fillna(df2)
A B C D
0 0.0 2.0 0.0 0
1 3.0 4.0 0.0 1
2 0.0 0.0 0.0 5
3 0.0 3.0 0.0 4
{code}
Unfortunately, we fail this test. The root cause is that we don't require Index
partitioning when fillna is called with a DataFrame/Series value.
> fillna(value=DataFrame/Series) does not correctly fill values
> -------------------------------------------------------------
>
> Key: BEAM-12541
> URL: https://issues.apache.org/jira/browse/BEAM-12541
> Project: Beam
> Issue Type: Bug
> Components: dsl-dataframe
> Reporter: Brian Hulette
> Assignee: Brian Hulette
> Priority: P2
> Fix For: 2.32.0
>
>
> A new doctest was added in 1.3.0 that verifies fillna with a DataFrame value:
> {code}
> df = pd.DataFrame([[np.nan, 2, np.nan, 0],
> [3, 4, np.nan, 1],
> [np.nan, np.nan, np.nan, 5],
> [np.nan, 3, np.nan, 4]],
> columns=list("ABCD"))
> df2 = pd.DataFrame(np.zeros((4, 4)), columns=list("ABCE"))
> df.fillna(df2)
> A B C D
> 0 0.0 2.0 0.0 0
> 1 3.0 4.0 0.0 1
> 2 0.0 0.0 0.0 5
> 3 0.0 3.0 0.0 4
> {code}
> Unfortunately, we fail this test. The root cause is that we don't require
> Index partitioning when fillna is called with a DataFrame/Series value.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
