[
https://issues.apache.org/jira/browse/HADOOP-18856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dipayan Dev updated HADOOP-18856:
---------------------------------
Description:
{noformat}
scala> import org.apache.hadoop.fs.Path
import org.apache.hadoop.fs.Path
scala> val path: Path = new Path("gs://test_dd123/")
path: org.apache.hadoop.fs.Path = gs://test_dd123/
scala> path.suffix("/num=123")
java.lang.NullPointerException
at org.apache.hadoop.fs.Path.<init>(Path.java:150)
at org.apache.hadoop.fs.Path.<init>(Path.java:129)
at org.apache.hadoop.fs.Path.suffix(Path.java:450){noformat}
Path.suffix through NPE when writing into GS buckets root.
In our Organisation, we are using GCS bucket root location to point to our Hive
table. Dataproc's latest 2.1 uses *Hadoop* *3.3.3* and this needs to be fixed
in 3.3.3.
was:
{noformat}
scala> import org.apache.hadoop.fs.Path
import org.apache.hadoop.fs.Path
scala> val path: Path = new Path("gs://test_dd123/")
path: org.apache.hadoop.fs.Path = gs://test_dd123/
scala> path.suffix("/num=123")
java.lang.NullPointerException
at org.apache.hadoop.fs.Path.<init>(Path.java:150)
at org.apache.hadoop.fs.Path.<init>(Path.java:129)
at org.apache.hadoop.fs.Path.suffix(Path.java:450){noformat}
Path.suffix through NPE when writing into GS buckets root.
In our Organisation, we are using GCS bucket root location to point to our Hive
table. Dataproc's latest 2.1 uses Hadoop 3.3.3 and this needs to be fixed in
3.3.3.
> Spark saveAsTable with location GCS bucket's root cause NPE
> -----------------------------------------------------------
>
> Key: HADOOP-18856
> URL: https://issues.apache.org/jira/browse/HADOOP-18856
> Project: Hadoop Common
> Issue Type: Bug
> Components: common
> Affects Versions: 3.3.3
> Reporter: Dipayan Dev
> Priority: Minor
>
>
> {noformat}
> scala> import org.apache.hadoop.fs.Path
> import org.apache.hadoop.fs.Path
> scala> val path: Path = new Path("gs://test_dd123/")
> path: org.apache.hadoop.fs.Path = gs://test_dd123/
> scala> path.suffix("/num=123")
> java.lang.NullPointerException
> at org.apache.hadoop.fs.Path.<init>(Path.java:150)
> at org.apache.hadoop.fs.Path.<init>(Path.java:129)
> at org.apache.hadoop.fs.Path.suffix(Path.java:450){noformat}
>
> Path.suffix through NPE when writing into GS buckets root.
>
> In our Organisation, we are using GCS bucket root location to point to our
> Hive table. Dataproc's latest 2.1 uses *Hadoop* *3.3.3* and this needs to be
> fixed in 3.3.3.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
