Github user avulanov commented on the issue:
https://github.com/apache/spark/pull/13868
@srowen It seems that the issue is with the new version of `warehousePath`.
It did string replace `user.dir` in the path in the original 2.0.
`warehousePath` was simplified in master due to new `getConf` that does the
replace. The new 2.0
https://github.com/apache/spark/commit/719ac5f37ccf32c34c70524b8cf9a2699c71a353
at your link has old `getConf` and new `warehousePath`. In particular, the
following occurs:
```
scala> val x = new Path("${system:x.d}")
java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative
path i
n absolute URI: ${system:x.d%7D
```
There are at least two ways to fix this: either use `warehousePath` with
string replace or new version(s) of `getConf`. The former seems simpler:
```
def warehousePath: String = {
new Path(getConf(WAREHOUSE_PATH).replace("${system:user.dir}",
System.getProperty("user.dir"))).toString
}
```
It was in one of my commits
https://github.com/apache/spark/pull/13868/commits/fb12118c4a692e4f4ec14cbc2754abac7059aab2
until I bumped into
https://github.com/apache/spark/commit/75a06aa256aa256c112555609a93c1e1dbb1cb4b
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
