GitHub user BaurzhanSakhariev edited a discussion: What format should I use for the last-modified property in list response when using scheme = azblob?
Hi, thanks for providing a convenient way to access data! Have a question about specific API. I have working implementation for read/write from Azure Blob Storage using java_binding. I tried to create a lightweight test by using [stub http server](https://github.com/crate/crate/blob/master/plugins/es-repository-azure/src/test/java/org/elasticsearch/repositories/azure/AzureHttpHandler.java). Read/write work fine, but when I try to use `list` API, i get an error `parse datetime from rfc2822 failed` After checking code, I think I'm hitting last modified date extraction https://github.com/apache/opendal/blob/main/core/src/services/azblob/lister.rs#L99 I tried to add `<Last-Modified>some date in rfc2822 format</LastModified>` to the `List Blobs` part of the stub server and I can confirm that it does react on changes in that property but I never managed to get it working. Experiments so far: - `input contains invalid characters` error if I provide dummy string (just to test that list API is sensitive to this property) - `Connection reset by peer (os error 54)` if I provide some valid date, say, `Mon, 12 Aug 2024 11:16:46 UT` - OpenDAL passes `x-ms-date` header, I thought that maybe `list` expects `modified date` in the response to be the same with passed header? I tried using `exchange.getRequestHeaders().get("X-ms-date").get(0)` as LastModified but still getting `os error 54.` It's probably similar to https://github.com/apache/opendal/pull/3478. What format should I use for Last-Modified property? Is there any specific requirement other than be rfc2822 complaint? Thanks! GitHub link: https://github.com/apache/opendal/discussions/4998 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
