[
https://jira.duraspace.org/browse/DS-1059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mark H. Wood updated DS-1059:
-----------------------------
Status: Open (was: Received)
> Statistics utilities should be filters
> --------------------------------------
>
> Key: DS-1059
> URL: https://jira.duraspace.org/browse/DS-1059
> Project: DSpace
> Issue Type: New Feature
> Components: Solr
> Reporter: Mark H. Wood
> Assignee: Mark H. Wood
> Fix For: 3.0
>
> Attachments: ApacheLogRobotsProcessor.patch,
> ClassicDSpaceLogConverter.patch, StatisticsImporter.patch
>
>
> Log files on large, busy sites may be enormous. This can make it difficult
> to find enough storage when (re)loading statistical cases from logs. Very
> large files also are very likely to be compressed by the sysadmin to save
> storage, which means they have to be decompressed before feeding them to the
> utilities, requiring even more temporary storage.
> One should be able to operate these utilities in a pipeline so that
> intermediate storage is eliminated. That is, they should be able to operate
> as filters: read standard input, write standard output.
> Attached patches (as they come) will add this *optional* behavior. If -i or
> -o switches are not given, or are given the value "-" or "", this means
> respectively standard input or standard output. Any other values will work
> as before: the value names a file.
> One can then do things like 'bunzip2 < logs/gigundo.log | bin/dspace
> stats-log-converter | bin/dspace stats-log-importer' without any additional
> storage required beyond what Solr will use.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://jira.duraspace.org/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Dspace-devel mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/dspace-devel
