mattcasters opened a new pull request, #7575:
URL: https://github.com/apache/hop/pull/7575
Fixes #7567
## Summary
Add Apache Commons VFS support for **Databricks Unity Catalog Volumes** and
**Workspace** files via the workspace **Files API**, with named connection
metadata (MinIO-style).
### Functionality
- **Databricks VFS Connection** metadata (`FILE_STORAGE`): name = URI
scheme; references **Databricks Connection** for host + PAT; optional **root
path** so `scheme:///input` maps to `{root}/input`
- VFS provider: list / read / write / mkdir / rename (copy+delete) / delete
directories (recursive without invalid `?recursive` query param)
- **`RestDatabricksFilesClient`**: shared Files API client; Jobs client
delegates Volume/Workspace upload paths
- WireMock unit tests for client and FileObject ops
- Docs: VFS + metadata pages; Hop-side only — not for Native Spark Dataset
I/O / bulk data landings
- **Move Files**: log full exception stack on move failures (helps diagnose
VFS errors)
### Out of scope / notes
- Classic DBFS VFS not exposed (deploy still has DBFS fallback for
non-Volume paths)
- Files API is single-stream HTTP — not intended as a bulk object-store
client for Spark big data
## Test plan
- [x] `./mvnw -pl plugins/tech/databricks test`
- [x] Manual: named VFS + root path; create folders; copy file; move file;
delete empty folders
- [ ] CI on this PR
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
