[jira] [Updated] (SPARK-48100) [SQL][XML] Fix issues in skipping nested structure fields not selected in schema
[ https://issues.apache.org/jira/browse/SPARK-48100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shujing Yang updated SPARK-48100: - Description: Previously, the XML parser can't skip nested structure data fields effectively when they were not selected in the schema. For instance, in the below example, `df.select("struct2").collect()` returns `Seq(null)` as `struct1` wasn't effectively skipped. This PR fixes this issue. {code:java} 1 2 {code} was: Previously, the XML parser can't skip nested structure data fields when they were not selected in the schema. For instance, in the below example, `df.select("struct2").collect()` returns `Seq(null)` as `struct1` wasn't effectively skipped. This PR fixes this issue. {code:java} 1 2 {code} > [SQL][XML] Fix issues in skipping nested structure fields not selected in > schema > > > Key: SPARK-48100 > URL: https://issues.apache.org/jira/browse/SPARK-48100 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 4.0.0 >Reporter: Shujing Yang >Priority: Major > Labels: pull-request-available > > Previously, the XML parser can't skip nested structure data fields > effectively when they were not selected in the schema. For instance, in the > below example, `df.select("struct2").collect()` returns `Seq(null)` as > `struct1` wasn't effectively skipped. This PR fixes this issue. > {code:java} > > > 1 > > > 2 > > {code} > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-48100) [SQL][XML] Fix issues in skipping nested structure fields not selected in schema
[ https://issues.apache.org/jira/browse/SPARK-48100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48100: --- Labels: pull-request-available (was: ) > [SQL][XML] Fix issues in skipping nested structure fields not selected in > schema > > > Key: SPARK-48100 > URL: https://issues.apache.org/jira/browse/SPARK-48100 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 4.0.0 >Reporter: Shujing Yang >Priority: Major > Labels: pull-request-available > > Previously, the XML parser can't skip nested structure data fields when they > were not selected in the schema. For instance, in the below example, > `df.select("struct2").collect()` returns `Seq(null)` as `struct1` wasn't > effectively skipped. This PR fixes this issue. > {code:java} > > > 1 > > > 2 > > {code} > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-48100) [SQL][XML] Fix issues in skipping nested structure fields not selected in schema
[ https://issues.apache.org/jira/browse/SPARK-48100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shujing Yang updated SPARK-48100: - Summary: [SQL][XML] Fix issues in skipping nested structure fields not selected in schema (was: [SQL][XML] Fix projection issue when there's a nested struct) > [SQL][XML] Fix issues in skipping nested structure fields not selected in > schema > > > Key: SPARK-48100 > URL: https://issues.apache.org/jira/browse/SPARK-48100 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 4.0.0 >Reporter: Shujing Yang >Priority: Major > > Previously, the XML parser can't skip nested structure data fields when they > were not selected in the schema. For instance, in the below example, > `df.select("struct2").collect()` returns `Seq(null)` as `struct1` wasn't > effectively skipped. This PR fixes this issue. > {code:java} > > > 1 > > > 2 > > {code} > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org