[
https://jira.duraspace.org/browse/DS-1059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mark H. Wood updated DS-1059:
-----------------------------
Attachment: StatisticsImporter.patch
> Statistics utilities should be filters
> --------------------------------------
>
> Key: DS-1059
> URL: https://jira.duraspace.org/browse/DS-1059
> Project: DSpace
> Issue Type: New Feature
> Components: Solr
> Reporter: Mark H. Wood
> Assignee: Mark H. Wood
> Fix For: post-1.8.0
>
> Attachments: ApacheLogRobotsProcessor.patch,
> ClassicDSpaceLogConverter.patch, StatisticsImporter.patch
>
>
> Log files on large, busy sites may be enormous. This can make it difficult
> to find enough storage when (re)loading statistical cases from logs. Very
> large files also are very likely to be compressed by the sysadmin to save
> storage, which means they have to be decompressed before feeding them to the
> utilities, requiring even more temporary storage.
> One should be able to operate these utilities in a pipeline so that
> intermediate storage is eliminated. That is, they should be able to operate
> as filters: read standard input, write standard output.
> Attached patches (as they come) will add this *optional* behavior. If -i or
> -o switches are not given, or are given the value "-" or "", this means
> respectively standard input or standard output. Any other values will work
> as before: the value names a file.
> One can then do things like 'bunzip2 < logs/gigundo.log | bin/dspace
> stats-log-converter | bin/dspace stats-log-importer' without any additional
> storage required beyond what Solr will use.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://jira.duraspace.org/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
------------------------------------------------------------------------------
The demand for IT networking professionals continues to grow, and the
demand for specialized networking skills is growing even more rapidly.
Take a complimentary Learning@Cisco Self-Assessment and learn
about Cisco certifications, training, and career opportunities.
http://p.sf.net/sfu/cisco-dev2dev
_______________________________________________
Dspace-devel mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/dspace-devel
