GitHub user avulanov opened a pull request:
https://github.com/apache/spark/pull/14600
[SPARK-15899] [SQL] Fix the construction of the file path with hadoop Path
for Spark 2.0
This PR contains the adaptation of
https://github.com/apache/spark/pull/13868 for Spark 2.0
## What changes were proposed in this pull request?
Fix the construction of the file path in `SQLConf.scala` and unit tests
that rely on this: `SQLConfSuite` and `DDLSuite`. Previous way of construction
caused the creation of incorrect path on Windows.
## How was this patch tested?
Run unit tests on Windows
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/avulanov/spark SPARK-15899-file-2.0
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/14600.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #14600
----
commit ade65f55a4bec12b8a9058c5cee069ea0cc40ed5
Author: avulanov <[email protected]>
Date: 2016-06-23T03:07:19Z
Fix the construction of the file scheme
commit 878859f0b26af8323fb3136e9f510271e754f84b
Author: avulanov <[email protected]>
Date: 2016-06-23T18:03:37Z
Fix SQLConf test
commit 2530e1f7dadc2c0abaac4632cd7f50a1835858d1
Author: avulanov <[email protected]>
Date: 2016-06-25T01:36:05Z
Fix DDLSuite path construction and path equality tests
commit f9ea448f5701e02dbb196810fba31c9245f51829
Author: avulanov <[email protected]>
Date: 2016-06-25T02:07:30Z
SQLConf path construction with hadoop Path
commit f2642c4aade1873ea250767d73f34aab07754188
Author: avulanov <[email protected]>
Date: 2016-06-28T02:05:47Z
Path construction with makeQualifiedPath from SessionCatalog
commit 110a99a439ac8856a47722b95ff6158ea8b6de54
Author: avulanov <[email protected]>
Date: 2016-06-28T02:16:51Z
Fix scalastyle comment in test
commit 772952b32967106a2c094ef0da1e5945efec99c9
Author: avulanov <[email protected]>
Date: 2016-08-03T10:26:48Z
Remove toUri
commit b4543240802587fe9f2f1f7c62dda76e2d1f4374
Author: avulanov <[email protected]>
Date: 2016-08-03T12:16:48Z
Rebase
commit dc2fa3b76fdb9dd8a8ec4df7866bd4694b35cec7
Author: avulanov <[email protected]>
Date: 2016-08-04T09:09:56Z
Resolve conflicts for: Addressing reviewers comments. Escape Windows path
in create table string
commit 6f385079c30a31aeebbb8d44603be203b2a51044
Author: avulanov <[email protected]>
Date: 2016-08-09T08:56:11Z
Resolve conflicts for: Addressing reviewers comments
commit 2f4566ce8b93e9cc3da40cd70bedae2e93c2c147
Author: avulanov <[email protected]>
Date: 2016-08-11T09:27:07Z
Fix warehousePath for 2.0
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]