Hello, the impact of this issue seems to be severe in our case: Please have a look at this item:
<http://stadtteilgeschichten.net/handle/2339/5620?show=full> compared to any other item in our DSpace, such as: <http://stadtteilgeschichten.net/handle/2339/5621?show=full> Obviously, we have lost most of the metadata for the first item during insertion in our database! Even required fields got lost like dc.contributor.author or dc.type. This means that the item will not be indexed, not be shown e.g. while browsing by type or when using faceted search. Obviously with this little metadata, it will also hardly be visible when searching by Google. So far I have lowered drastically the cycle of thumbnail generation, but honestly, this is solution is neither sufficient nor satisfactory. I think whether I should close login to avoid partial input altogether. But as I have no idea as of how to fix the issue, it is also a tough decision to spoil our users timetable, especially, when they have promised to fulfill a certain amount of work until the end of the year. My postgresql logfile looks like this: 2014-12-02 04:00:10 CET LOG: unexpected EOF on client connection 2014-12-02 08:00:05 CET LOG: unexpected EOF on client connection 2014-12-02 08:00:05 CET LOG: unexpected EOF on client connection 2014-12-02 08:01:15 CET LOG: unexpected EOF on client connection 2014-12-02 08:01:15 CET LOG: unexpected EOF on client connection 2014-12-02 10:00:09 CET LOG: unexpected EOF on client connection 2014-12-02 10:00:09 CET LOG: unexpected EOF on client connection 2014-12-02 10:00:11 CET LOG: unexpected EOF on client connection 2014-12-02 10:00:11 CET LOG: unexpected EOF on client connection 2014-12-02 10:01:14 CET LOG: unexpected EOF on client connection 2014-12-02 10:01:14 CET LOG: unexpected EOF on client connection 2014-12-02 12:00:05 CET LOG: unexpected EOF on client connection 2014-12-02 12:00:05 CET LOG: unexpected EOF on client connection 2014-12-02 12:01:13 CET LOG: unexpected EOF on client connection 2014-12-02 12:01:13 CET LOG: unexpected EOF on client connection Four entries every even hour means that I have two interruptions in database connection for each run of filter-media and itemcounter. Six such events at ten o'clock are caused by a third batch running at that time, generate-sitemaps, while update-discovery-index at four o'clock causes a single interruption. I dont know exactly when this has started. I dont look to these logs routinely and removal of old logs follows default rules. I can see now that it was at least the case since September, but nobody ever noticed any malfunction. Although my postgresql is in standard configuration running autovacuum regularly, I did a manual vacuum full and a reindex database and reindex system for the dspace database yesterday. These jobs finished fast without problems. The snippet of the logfile above was recorded after this maintainance. Please suggest on appropriate measures. Thanks, Christian Am 01.12.2014 um 14:23 schrieb Christian Völker <[email protected]>: > Hello, > > has this issue ever been solved? > > I encounter it here with DSpace 1.8.3 and Postgres 9.1 > > Thanks, Christian > > > Am 31.01.2012 um 15:59 schrieb Tim Donohue <[email protected]>: > >> Rui, >> >> Sorry, I haven't gotten any further with this issue. >> >> Does anyone else on this list have any ideas here? Anyone else >> encountering this issue on either 1.7.x or 1.8.x, or find a way to >> resolve it? >> >> - Tim >> >> On 1/31/2012 6:28 AM, Rui Ramos wrote: >>> Tim Hi, >>> >>> Have you manage to solve this issue ? >>> I have the same problem and from the logs it seams the Database resets >>> the connection. >>> >>> Dspace - 1.7.2 >>> PostgreSQL- 8.4.9 >>> >>> Any ideias ? >>> >>> On Fri, 2011-12-09 at 10:58 -0600, Tim Donohue wrote: >>>> Actually, looking at these error messages a bit more closely, this may >>>> be entirely unrelated. It could be an XMLUI specific issue, rather than >>>> a database layer issue that you are seeing. >>>> >>>> - Tim >>>> >>>> On 12/9/2011 10:54 AM, Tim Donohue wrote: >>>>> Hi Mark, >>>>> >>>>> Unfortunately, I don't have an answer for you. But, digging around I >>>>> noticed a similar oddity on demo.dspace.org. On demo.dspace.org we're >>>>> getting some similar sorts of SocketException errors (though"broken >>>>> pipe" rather than"socket closed") in the dspace.log files, but these >>>>> are from the XMLUI. >>>>> >>>>> demo.dspace.org is currently running: >>>>> * DSpace 1.8.0 >>>>> * PostgreSQL 8.4.2 >>>>> * Tomcat 6.0.29 >>>>> * Java 1.6.0_24 >>>>> >>>>> The error on demo.dspace.org is a"ClientAbortException: >>>>> java.net.SocketException: Broken pipe" (in XMLUI), which is caused by an >>>>> underlying"java.net.SocketException: Broken pipe". Not the same error, >>>>> but eerily similar. The XMLUI seems to handle it in stride, but it does >>>>> cause frequent lines like this to appear in the logs: >>>>> >>>>> 2011-12-09 10:51:48,663 ERROR >>>>> org.dspace.app.xmlui.cocoon.DSpaceCocoonServletFilter @ Serious Error >>>>> Occurred Processing Request! >>>>> >>>>> In the PostgreSQL logs I see some occasional"unexpected EOF on client >>>>> connection" errors, but the times don't seem to match up with the >>>>> SocketExceptions above. >>>>> >>>>> I'm also seeing these same logged issues on my local development box, >>>>> now that I look closer. Again, I cannot verify this is 100% related to >>>>> your same issue, but it does look a bit similar. >>>>> >>>>> An example of a full error stack trace from the dspace logs is attached. >>>>> >>>>> Sorry I don't have more help to add. Just wanted to send along what I've >>>>> noticed that seems a bit similar. So far, I haven't noticed this same >>>>> issue with the packager -- but, admittedly I'm using 1.8.0 (which did >>>>> include some changes/bug fixes to the packager, though I'm not sure that >>>>> any were related to this issue). >>>>> >>>>> - Tim >>>>> >>>>> On 12/9/2011 10:18 AM, Mark H. Wood wrote: >>>>>> I'm trying to script a daily incremental dump using the packager. >>>>>> Sometimes it completes, but most often it throws"PSQLException: An I/O >>>>>> error occurred while sending to the backend" caused by >>>>>> "java.net.SocketException: Socket closed". About the same time >>>>>> PostgreSQL logs"unexpected EOF on client connection" and tears down >>>>>> its session. I turned logging way up on both ends but saw nothing >>>>>> unusual on the DSpace side and only the unexpected EOF on the Pg side. >>>>>> >>>>>> Digging through the Pg log, I see lots of these unexpected EOFs. >>>>>> Apparently the webapp is getting this too but takes it in stride. >>>>>> Commandline app.s seem to be less fortunate. >>>>>> >>>>>> I captured a packet trace while running my script and can see that the >>>>>> client is chugging along, making requests and getting responses, then >>>>>> suddenly the client sends a TCP FIN, ACK packet and that's the end of >>>>>> that. No Pg shutdown message was sent, so far as I can tell, and >>>>>> that's why Pg says"unexpected EOF". After fairly rapid exchanges >>>>>> there's a pause of about 0.8 seconds between the previous packet >>>>>> (client ACKing the server's last response) and the FIN. >>>>>> >>>>>> The Pg backend is v9.0.5. This DSpace instance is v1.7.2. OS is >>>>>> Gentoo Linux x86 with all current userspace updates and kernel >>>>>> 2.6.39. JRE is Oracle (Sun) 1.6.0_29-b11. Ideas for debugging this? >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> ------------------------------------------------------------------------------ >>>>>> >>>>>> Cloud Services Checklist: Pricing and Packaging Optimization >>>>>> This white paper is intended to serve as a reference, checklist and >>>>>> point of >>>>>> discussion for anyone considering optimizing the pricing and packaging >>>>>> model >>>>>> of a cloud services business. Read Now! >>>>>> http://www.accelacomm.com/jaw/sfnl/114/51491232/ >>>>>> >>>>>> >>>>>> >>>>>> _______________________________________________ >>>>>> DSpace-tech mailing list >>>>>> [email protected] >>>>>> <mailto:[email protected]> >>>>>> https://lists.sourceforge.net/lists/listinfo/dspace-tech >>>> >>>> ------------------------------------------------------------------------------ >>>> Cloud Services Checklist: Pricing and Packaging Optimization >>>> This white paper is intended to serve as a reference, checklist and point >>>> of >>>> discussion for anyone considering optimizing the pricing and packaging >>>> model >>>> of a cloud services business. Read Now! >>>> http://www.accelacomm.com/jaw/sfnl/114/51491232/ >>>> _______________________________________________ >>>> DSpace-tech mailing list >>>> [email protected] >>>> <mailto:[email protected]> >>>> https://lists.sourceforge.net/lists/listinfo/dspace-tech >>>> >>> >> >> ------------------------------------------------------------------------------ >> Keep Your Developer Skills Current with LearnDevNow! >> The most comprehensive online learning library for Microsoft developers >> is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, >> Metro Style Apps, more. Free future releases when you subscribe now! >> http://p.sf.net/sfu/learndevnow-d2d >> _______________________________________________ >> DSpace-tech mailing list >> [email protected] >> https://lists.sourceforge.net/lists/listinfo/dspace-tech > > > > ------------------------------------------------------------------------------ > Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server > from Actuate! Instantly Supercharge Your Business Reports and Dashboards > with Interactivity, Sharing, Native Excel Exports, App Integration & more > Get technology previously reserved for billion-dollar corporations, FREE > http://pubads.g.doubleclick.net/gampad/clk?id=157005751&iu=/4140/ostg.clktrk > _______________________________________________ > DSpace-tech mailing list > [email protected] > https://lists.sourceforge.net/lists/listinfo/dspace-tech > List Etiquette: > https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette ------------------------------------------------------------------------------ Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server from Actuate! Instantly Supercharge Your Business Reports and Dashboards with Interactivity, Sharing, Native Excel Exports, App Integration & more Get technology previously reserved for billion-dollar corporations, FREE http://pubads.g.doubleclick.net/gampad/clk?id=157005751&iu=/4140/ostg.clktrk _______________________________________________ DSpace-tech mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
