Re: [dspace-tech] oai import errors
Dear Paul, I have seen done an import with the -v option (vebose). /dspace/bin/dspace oai import -c -v So I have seen which was the handle of the item before the system has gone in error (for example 1040303/230). Then in handle table I have found the item with the handle following the previous one. (for example 1040303/231) So have removed this and reinserted again and now the system works. Thanks for you suggestion Best regards Massimiliano Il giorno venerdì 1 novembre 2019 14:53:08 UTC+1, Paul Münch ha scritto: > > Hello, > > there seems to be an UTF-8 error at one item. > > > Caused by: java.io.CharConversionException: Invalid UTF-8 character > > 0x at char #7968757, byte #7974911) > > Maybe it helps debugging to log the imported item. > > cf. > > https://groups.google.com/d/msgid/dspace-tech/91087dc0-c393-4af9-854b-9dde1d7be1b2%40googlegroups.com?utm_medium=email_source=footer > > > Kind regards, > > Paul Münch > > Am 29.10.2019 um 14:37 schrieb Massimiliano CILURZO: > > Dear All, > > We have a Dspace 6.3 and tried to configure the oai harvesting. > >But after doing |[dspace]/bin/dspace oai|| ||import -c| > > |the system says:| > > |* > > Using full import. > > Full import > > 1000 items prepared so far... > > 1000 items imported so far... > > 2000 items prepared so far... > > 2000 items imported so far... > > Total: 2875 items > > org.dspace.xoai.solr.exceptions.DSpaceSolrIndexerException: IOException > > occured when talking to server at: http://localhost:8080/solr/oai > > at org.dspace.xoai.app.XOAI.index(XOAI.java:310) > > at org.dspace.xoai.app.XOAI.indexAll(XOAI.java:226) > > at org.dspace.xoai.app.XOAI.index(XOAI.java:133) > > at org.dspace.xoai.app.XOAI.main(XOAI.java:578) > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > > at > > > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > > > at > > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > > > > at java.lang.reflect.Method.invoke(Method.java:498) > > at > > > org.dspace.app.launcher.ScriptLauncher.runOneCommand(ScriptLauncher.java:229) > > > at > > org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:81) > > Caused by: org.apache.solr.client.solrj.SolrServerException: IOException > > occured when talking to server at: http://localhost:8080/solr/oai > > at > > > org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:566) > > > > at > > > org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:210) > > > > at > > > org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:206) > > > > at > > > org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:124) > > > > at > org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:68) > > at > org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:54) > > at org.dspace.xoai.app.XOAI.index(XOAI.java:304) > > ... 9 more > > Caused by: org.apache.http.client.ClientProtocolException > > at > > > org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:886) > > > > at > > > org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82) > > > > at > > > org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107) > > > > at > > > org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55) > > > > at > > > org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:448) > > > > ... 15 more > > Caused by: org.apache.http.client.NonRepeatableRequestException: Cannot > > retry request with a non-repeatable request entity. The cause lists the > > reason the original request failed. > > at > > > org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:659) > > > > at > > > org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487) > > > > at > > > org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882) > > > > ... 19 more > > Caused by: java.net.SocketException: Connection reset > > at > > java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:115) > > at > java.net.SocketOutputStream.write(SocketOutputStream.java:155) > > at > > > org.apache.http.impl.io.AbstractSessionOutputBuffer.write(AbstractSessionOutputBuffer.java:181) > > > > at > > > org.apache.http.impl.io.ChunkedOutputStream.flushCacheWithAppend(ChunkedOutputStream.java:124) > > > > at > > >
Re: [dspace-tech] oai import errors
Dear Paul, I have tried this solution but it doesn't work. Do you have some suggestions? Thanks Best regards Massimiliano Il giorno venerdì 1 novembre 2019 14:53:08 UTC+1, Paul Münch ha scritto: > > Hello, > > there seems to be an UTF-8 error at one item. > > > Caused by: java.io.CharConversionException: Invalid UTF-8 character > > 0x at char #7968757, byte #7974911) > > Maybe it helps debugging to log the imported item. > > cf. > > https://groups.google.com/d/msgid/dspace-tech/91087dc0-c393-4af9-854b-9dde1d7be1b2%40googlegroups.com?utm_medium=email_source=footer > > > Kind regards, > > Paul Münch > > Am 29.10.2019 um 14:37 schrieb Massimiliano CILURZO: > > Dear All, > > We have a Dspace 6.3 and tried to configure the oai harvesting. > >But after doing |[dspace]/bin/dspace oai|| ||import -c| > > |the system says:| > > |* > > Using full import. > > Full import > > 1000 items prepared so far... > > 1000 items imported so far... > > 2000 items prepared so far... > > 2000 items imported so far... > > Total: 2875 items > > org.dspace.xoai.solr.exceptions.DSpaceSolrIndexerException: IOException > > occured when talking to server at: http://localhost:8080/solr/oai > > at org.dspace.xoai.app.XOAI.index(XOAI.java:310) > > at org.dspace.xoai.app.XOAI.indexAll(XOAI.java:226) > > at org.dspace.xoai.app.XOAI.index(XOAI.java:133) > > at org.dspace.xoai.app.XOAI.main(XOAI.java:578) > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > > at > > > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > > > at > > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > > > > at java.lang.reflect.Method.invoke(Method.java:498) > > at > > > org.dspace.app.launcher.ScriptLauncher.runOneCommand(ScriptLauncher.java:229) > > > at > > org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:81) > > Caused by: org.apache.solr.client.solrj.SolrServerException: IOException > > occured when talking to server at: http://localhost:8080/solr/oai > > at > > > org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:566) > > > > at > > > org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:210) > > > > at > > > org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:206) > > > > at > > > org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:124) > > > > at > org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:68) > > at > org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:54) > > at org.dspace.xoai.app.XOAI.index(XOAI.java:304) > > ... 9 more > > Caused by: org.apache.http.client.ClientProtocolException > > at > > > org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:886) > > > > at > > > org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82) > > > > at > > > org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107) > > > > at > > > org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55) > > > > at > > > org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:448) > > > > ... 15 more > > Caused by: org.apache.http.client.NonRepeatableRequestException: Cannot > > retry request with a non-repeatable request entity. The cause lists the > > reason the original request failed. > > at > > > org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:659) > > > > at > > > org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487) > > > > at > > > org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882) > > > > ... 19 more > > Caused by: java.net.SocketException: Connection reset > > at > > java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:115) > > at > java.net.SocketOutputStream.write(SocketOutputStream.java:155) > > at > > > org.apache.http.impl.io.AbstractSessionOutputBuffer.write(AbstractSessionOutputBuffer.java:181) > > > > at > > > org.apache.http.impl.io.ChunkedOutputStream.flushCacheWithAppend(ChunkedOutputStream.java:124) > > > > at > > > org.apache.http.impl.io.ChunkedOutputStream.write(ChunkedOutputStream.java:181) > > > > at > > > org.apache.http.entity.InputStreamEntity.writeTo(InputStreamEntity.java:136) > > > at > > > org.apache.http.entity.HttpEntityWrapper.writeTo(HttpEntityWrapper.java:96) > > at > > >
Re: [dspace-tech] oai import errors
Hello, there seems to be an UTF-8 error at one item. > Caused by: java.io.CharConversionException: Invalid UTF-8 character > 0x at char #7968757, byte #7974911) Maybe it helps debugging to log the imported item. cf. https://groups.google.com/d/msgid/dspace-tech/91087dc0-c393-4af9-854b-9dde1d7be1b2%40googlegroups.com?utm_medium=email_source=footer Kind regards, Paul Münch Am 29.10.2019 um 14:37 schrieb Massimiliano CILURZO: > Dear All, > We have a Dspace 6.3 and tried to configure the oai harvesting. > But after doing |[dspace]/bin/dspace oai|| ||import -c| > |the system says:| > |* > Using full import. > Full import > 1000 items prepared so far... > 1000 items imported so far... > 2000 items prepared so far... > 2000 items imported so far... > Total: 2875 items > org.dspace.xoai.solr.exceptions.DSpaceSolrIndexerException: IOException > occured when talking to server at: http://localhost:8080/solr/oai > at org.dspace.xoai.app.XOAI.index(XOAI.java:310) > at org.dspace.xoai.app.XOAI.indexAll(XOAI.java:226) > at org.dspace.xoai.app.XOAI.index(XOAI.java:133) > at org.dspace.xoai.app.XOAI.main(XOAI.java:578) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at > org.dspace.app.launcher.ScriptLauncher.runOneCommand(ScriptLauncher.java:229) > at > org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:81) > Caused by: org.apache.solr.client.solrj.SolrServerException: IOException > occured when talking to server at: http://localhost:8080/solr/oai > at > org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:566) > at > org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:210) > at > org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:206) > at > org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:124) > at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:68) > at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:54) > at org.dspace.xoai.app.XOAI.index(XOAI.java:304) > ... 9 more > Caused by: org.apache.http.client.ClientProtocolException > at > org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:886) > at > org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82) > at > org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107) > at > org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55) > at > org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:448) > ... 15 more > Caused by: org.apache.http.client.NonRepeatableRequestException: Cannot > retry request with a non-repeatable request entity. The cause lists the > reason the original request failed. > at > org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:659) > at > org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487) > at > org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882) > ... 19 more > Caused by: java.net.SocketException: Connection reset > at > java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:115) > at java.net.SocketOutputStream.write(SocketOutputStream.java:155) > at > org.apache.http.impl.io.AbstractSessionOutputBuffer.write(AbstractSessionOutputBuffer.java:181) > at > org.apache.http.impl.io.ChunkedOutputStream.flushCacheWithAppend(ChunkedOutputStream.java:124) > at > org.apache.http.impl.io.ChunkedOutputStream.write(ChunkedOutputStream.java:181) > at > org.apache.http.entity.InputStreamEntity.writeTo(InputStreamEntity.java:136) > at > org.apache.http.entity.HttpEntityWrapper.writeTo(HttpEntityWrapper.java:96) > at > org.apache.http.impl.client.EntityEnclosingRequestWrapper$EntityWrapper.writeTo(EntityEnclosingRequestWrapper.java:112) > at > org.apache.http.impl.entity.EntitySerializer.serialize(EntitySerializer.java:117) > at > org.apache.http.impl.AbstractHttpClientConnection.sendRequestEntity(AbstractHttpClientConnection.java:265) > at > org.apache.http.impl.conn.ManagedClientConnectionImpl.sendRequestEntity(ManagedClientConnectionImpl.java:203) > at > org.apache.http.protocol.HttpRequestExecutor.doSendRequest(HttpRequestExecutor.java:237) > at > org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:122) > at >
