[GitHub] [jclouds] gaul commented on pull request #130: JCLOUDS-1587 - S3 Blobstore: Support Bucket Configuration Options - Versioning, Lifecycle, Encryption

[via GitHub]

gaul commented on PR #130:
URL: https://github.com/apache/jclouds/pull/130#issuecomment-1399747736

   Please re-open if this is still relevant.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscr...@jclouds.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [jclouds] gaul closed pull request #130: JCLOUDS-1587 - S3 Blobstore: Support Bucket Configuration Options - Versioning, Lifecycle, Encryption

[via GitHub]

gaul closed pull request #130: JCLOUDS-1587 - S3 Blobstore: Support Bucket 
Configuration Options - Versioning, Lifecycle, Encryption
URL: https://github.com/apache/jclouds/pull/130


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscr...@jclouds.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [jclouds] gaul closed pull request #142: Adding access key auth support for openstack V3

[via GitHub]

gaul closed pull request #142: Adding access key auth support for openstack V3
URL: https://github.com/apache/jclouds/pull/142


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscr...@jclouds.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [jclouds] gaul commented on pull request #142: Adding access key auth support for openstack V3

[via GitHub]

gaul commented on PR #142:
URL: https://github.com/apache/jclouds/pull/142#issuecomment-1399747692

   Please re-open if this is still relevant.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscr...@jclouds.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Build failed in Jenkins: JClouds » jclouds-with-credentials » jclouds-google-compute-engine-live-tests #126

[Apache Jenkins Server]

See 


Changes:


--
Started by timer
Running as SYSTEM
No JDK named ?JDK 1.8 (latest)? found
[EnvInject] - Loading node environment variables.
Building remotely on builds23 (ubuntu) in workspace 

No JDK named ?JDK 1.8 (latest)? found
ERROR: A Maven installation needs to be available for this project to be 
built.Either your server has no Maven installations defined, or the requested 
Maven version does not exist.
No JDK named ?JDK 1.8 (latest)? found
No JDK named ?JDK 1.8 (latest)? found

[GitHub] [jclouds] gaul commented on pull request #164: JCLOUDS-1371: Optimize filesystem delimiter

[via GitHub]

gaul commented on PR #164:
URL: https://github.com/apache/jclouds/pull/164#issuecomment-1399439582

   @timuralp Maybe interesting to you.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscr...@jclouds.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [jclouds] gaul opened a new pull request, #164: JCLOUDS-1371: Optimize filesystem delimiter

[via GitHub]

gaul opened a new pull request, #164:
URL: https://github.com/apache/jclouds/pull/164

   `populateBlobKeysInContainer` will no longer recurse when the delimiter 
matches "/".  This makes listing deep hierarchies with a delimiter faster.  
Note that the general `LocalBlobStore` handling is still required for the 
general cases.  This requires removing a bogus test case.  References 
gaul/s3proxy#473.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscr...@jclouds.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[jira] [Commented] (JCLOUDS-1488) Filesystem list call with prefix is slow in large containers

[ASF subversion and git services (Jira)]

[ 
https://issues.apache.org/jira/browse/JCLOUDS-1488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17679526#comment-17679526
 ] 

ASF subversion and git services commented on JCLOUDS-1488:
--

Commit e478dd5452d70a5ea2082337b05ad91f331f0eb6 in jclouds's branch 
refs/heads/master from Andrew Gaul
[ https://gitbox.apache.org/repos/asf?p=jclouds.git;h=e478dd5452 ]

JCLOUDS-1371: JCLOUDS-1488: optimize fs prefix

This reduces the number of stat calls required when prefix is deep in the
filesystem hierarchy.  Further optimizations to delimiter are possible.
References gaul/s3proxy#473.


> Filesystem list call with prefix is slow in large containers
> 
>
> Key: JCLOUDS-1488
> URL: https://issues.apache.org/jira/browse/JCLOUDS-1488
> Project: jclouds
>  Issue Type: Bug
>  Components: jclouds-blobstore
>Affects Versions: 2.1.1
> Environment: Java version: java version "1.8.0_131"
> Operating system: Fedora 27 x86_64
>Reporter: Lari Sinisalo
>Assignee: Andrew Gaul
>Priority: Major
>  Labels: filesystem
> Fix For: 2.2.0, 2.1.2
>
> Attachments: JCLOUDS1488.java
>
>
> When the filesystem blobstore is used, running the following code takes very 
> long if there are a lot of files in the container:
> {code:java}
>     ListContainerOptions options = new ListContainerOptions();
>     options.prefix("test-container-subdirectory/");
>     Set results =
>   blobStore.list("test-container",options);
> {code}
> See the attached Java source file [^JCLOUDS1488.java] for the full code.
> On my system, running the attached Java code takes over 10 seconds to list a 
> single file if there are 500,000 files in the container outside that prefix.
> Output from the attached code:
> {code:java}
> Number of blobs listed: 1
> First listed blob: test-container-subdirectory/file-to-list
> Time it took to list the blobs: 13256 ms
> {code}
> A more general version of this problem was reported previously in 
> JCLOUDS-1371.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

[jira] [Commented] (JCLOUDS-1371) LocalBlobStore.list enumerates entire container

[ASF subversion and git services (Jira)]

[ 
https://issues.apache.org/jira/browse/JCLOUDS-1371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17679525#comment-17679525
 ] 

ASF subversion and git services commented on JCLOUDS-1371:
--

Commit e478dd5452d70a5ea2082337b05ad91f331f0eb6 in jclouds's branch 
refs/heads/master from Andrew Gaul
[ https://gitbox.apache.org/repos/asf?p=jclouds.git;h=e478dd5452 ]

JCLOUDS-1371: JCLOUDS-1488: optimize fs prefix

This reduces the number of stat calls required when prefix is deep in the
filesystem hierarchy.  Further optimizations to delimiter are possible.
References gaul/s3proxy#473.


> LocalBlobStore.list enumerates entire container
> ---
>
> Key: JCLOUDS-1371
> URL: https://issues.apache.org/jira/browse/JCLOUDS-1371
> Project: jclouds
>  Issue Type: Improvement
>  Components: jclouds-blobstore
>Affects Versions: 2.0.3
>Reporter: Andrew Gaul
>Priority: Major
>  Labels: filesystem
>  Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> {{LocalBlobStore.list}} with the filesystem blobstore enumerates the entire 
> container even when prefix and delimiter set.  The File API does not provide 
> a way to list a subset of files except for those within a specific directory 
> and the underlying filesystem makes no guarantees about enumeration order.  
> We can still optimize the case where prefix is set and delimiter is /.  
> Reference:
> https://lists.apache.org/thread.html/72e8a101d8a8f99b6f728336633db2cecae1dc443e4c5b195eee8f0d@%3Cuser.jclouds.apache.org%3E



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

[GitHub] [jclouds] gaul merged pull request #161: JCLOUDS-1371: JCLOUDS-1488: optimize fs prefix

[via GitHub]

gaul merged PR #161:
URL: https://github.com/apache/jclouds/pull/161


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscr...@jclouds.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org