This is an automated email from the ASF dual-hosted git repository.
snlee pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/pinot.git
The following commit(s) were added to refs/heads/master by this push:
new b50c58fcd3 Fix the issue with ADLSGen2 connector when writing a file
(#10230)
b50c58fcd3 is described below
commit b50c58fcd388519572a4863857fe385d2ee63f00
Author: Seunghyun Lee <[email protected]>
AuthorDate: Sun Feb 5 17:39:41 2023 -0800
Fix the issue with ADLSGen2 connector when writing a file (#10230)
412 error has been introduced after the client version bump.
This is because the behavior change from the ADLSGen2 client.
For more context, please check:
https://github.com/Azure/azure-sdk-for-java/issues/31248
---
.../main/java/org/apache/pinot/plugin/filesystem/ADLSGen2PinotFS.java | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git
a/pinot-plugins/pinot-file-system/pinot-adls/src/main/java/org/apache/pinot/plugin/filesystem/ADLSGen2PinotFS.java
b/pinot-plugins/pinot-file-system/pinot-adls/src/main/java/org/apache/pinot/plugin/filesystem/ADLSGen2PinotFS.java
index ceed39af67..8a13265d42 100644
---
a/pinot-plugins/pinot-file-system/pinot-adls/src/main/java/org/apache/pinot/plugin/filesystem/ADLSGen2PinotFS.java
+++
b/pinot-plugins/pinot-file-system/pinot-adls/src/main/java/org/apache/pinot/plugin/filesystem/ADLSGen2PinotFS.java
@@ -657,7 +657,7 @@ public class ADLSGen2PinotFS extends BasePinotFS {
totalBytesRead += bytesRead;
}
// Call flush on ADLS Gen 2
- fileClient.flush(totalBytesRead);
+ fileClient.flush(totalBytesRead, true);
return true;
} catch (DataLakeStorageException | NoSuchAlgorithmException e) {
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
