Hi Ken,
The limit you hit is a hard limit on the amount of search results that
will be returned by a Artifactory's queries via Jackrabbit, since large
result sets can consume a large amount of system resources.
Currently, the REST API searcher which allows limitless search results
is the "Created or modified in range" searcher. It's details can be
viewed in the REST API wiki
<http://wiki.jfrog.org/confluence/display/RTF/Artifactory%27s+REST+API>
page, under "Searches" -> "Get All Artifacts Created in Date Range".
I have also created a JIRA issue for allowing limitless search results
from all searchers: RTFACT-2920
<http://issues.jfrog.org/jira/browse/RTFACT-2920>.
Noam
Pacileo, Ken wrote:
Hi Noam,
I tried your suggestions without any luck. Looking back at the results
from yesterday I found I was only getting artifacts listed from three
of the five local repos, not all the local repos. This is what I saw:
Permissions: All browser requests show a non_authenticated_user in the
request log. This makes sense according to your statement that REST
commands executed from a browser are made anonymously:
20100304165310|1953|REQUEST|xx.xxx.xx.xx|non_authenticated_user|GET|/api/search/artifact|HTTP/1.1|200|0
I tried the browser requests with both anonymous access disabled and
enabled (initially anonymous access was disabled with encrypted
passwords required, LDAP auth enabled and various permission targets
restricting access). With anonymous access enabled, encrypted
passwords supported and all permission targets giving the anonymous
user read access to the local repos and the sole remote repo, the
request returns a list of 501 artifacts from three of the five local
repos. No artifacts were listed from the other local repos or the
remote repo. Disabling read access to the local repos and rerunning
the request returns a list of 44 artifacts from the remote repo.
Searching the UI for Group Id of '*' from the remote repo displays 400
matches. The remote repo is to central (http://repo1.maven.org/maven2).
There are three permission targets that tune access to five local
repos depending on the type of user. If only TargetA is set to give
the anonymous user read access to three local repos, the request
returns a list of 501 artifacts from those three repos. There are 842
artifacts in those three repos.
Removing the anonymous user's read access from TargetA and applying it
to TargetB that assigns perms for four local repos returns a different
list of artifacts but the number of entries in the list from
TargetB is the same as the list from TargetA - 501. Is there is a
limit to the number of entries returned by a REST request? If so, is
there another method that can be used to obtain a complete catalog of
everything stored in Artifactory, local repos and remote caches?
Regards,
--Ken
------------------------------------------------------------------------
*From:* Noam Y. Tenne [mailto:[email protected]]
*Sent:* Thursday, March 04, 2010 3:16 AM
*To:* [email protected]
*Subject:* Re: [Artifactory-users] Retrieving a complete listing of
artifacts via REST
Hi Ken
There is no reason for artifacts to be filtered by repository (when no
repository is specified in the query) and I can't seem to reproduce
the issue you describe.
There are a couple of things you can check in order to troubleshoot
the problem:
* Permissions: When normally executing REST commands (from a
browser, for example), the request is made anonymously. It is
possible that the "missing" artifacts are filtered for
permission reasons.
You can view the the history of HTTP requests made to
Artifactory via the request.log file
($ARTIFACTORY_HOME/logs/request.log) to see the name of the user
that performed the request.
* Do the "missing" artifacts appear when searching for them via
the UI Artifact search?
If the sections described above behave as expected, could you please
provide us with specific details like the name of the repository
cache, the name of the artifact, the query, etc'?
HTH,
Noam
Pacileo, Ken wrote:
Hi,
I'm testing some of the Search REST commands from
(_http://wiki.jfrog.org/confluence/display/RTF/Artifactory%27s+REST+API_)
to get a complete list of all artifacts stored in Artifactory. The
basic artifact search works (api/search/artifact?name=*) but only
lists artifacts stored in the local repos. Is there an option I can
use to include the remote repo caches as well?
Regards,
--Ken
Ken Pacileo
Continuous Integration Service
Solutions Development & Delvry
UnitedHealth Group -- IT
W 303-410-7386
M 860-908-4307
This e-mail, including attachments, may include confidential and/or
proprietary information, and may be used only by the person or entity
to which it is addressed. If the reader of this e-mail is not the intended
recipient or his or her authorized agent, the reader is hereby notified
that any dissemination, distribution or copying of this e-mail is
prohibited. If you have received this e-mail in error, please notify the
sender by replying to this message and delete this e-mail immediately.
------------------------------------------------------------------------
------------------------------------------------------------------------------
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
------------------------------------------------------------------------
_______________________________________________
Artifactory-users mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/artifactory-users
This e-mail, including attachments, may include confidential and/or
proprietary information, and may be used only by the person or entity
to which it is addressed. If the reader of this e-mail is not the intended
recipient or his or her authorized agent, the reader is hereby notified
that any dissemination, distribution or copying of this e-mail is
prohibited. If you have received this e-mail in error, please notify the
sender by replying to this message and delete this e-mail immediately.
------------------------------------------------------------------------
------------------------------------------------------------------------------
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
------------------------------------------------------------------------
_______________________________________________
Artifactory-users mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/artifactory-users
------------------------------------------------------------------------------
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
_______________________________________________
Artifactory-users mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/artifactory-users
