[
https://issues.apache.org/jira/browse/HADOOP-18856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dipayan Dev updated HADOOP-18856:
---------------------------------
Summary: Spark saveAsTable/insertInto with location GCS bucket root causes
NPE (was: Spark saveAsTable with location GCS bucket's root cause NPE)
> Spark saveAsTable/insertInto with location GCS bucket root causes NPE
> ---------------------------------------------------------------------
>
> Key: HADOOP-18856
> URL: https://issues.apache.org/jira/browse/HADOOP-18856
> Project: Hadoop Common
> Issue Type: Bug
> Components: common
> Affects Versions: 3.3.3
> Reporter: Dipayan Dev
> Priority: Minor
>
>
> {noformat}
> scala> import org.apache.hadoop.fs.Path
> import org.apache.hadoop.fs.Path
> scala> val path: Path = new Path("gs://test_dd123/")
> path: org.apache.hadoop.fs.Path = gs://test_dd123/
> scala> path.suffix("/num=123")
> java.lang.NullPointerException
> at org.apache.hadoop.fs.Path.<init>(Path.java:150)
> at org.apache.hadoop.fs.Path.<init>(Path.java:129)
> at org.apache.hadoop.fs.Path.suffix(Path.java:450){noformat}
>
> Path.suffix throughs NPE when writing into GS buckets root.
>
> In our Organisation, we are using GCS bucket root location to point to our
> Hive table. Dataproc's latest 2.1 uses *Hadoop* *3.3.3* and this needs to be
> fixed in 3.3.3.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
