Re: [dspace-tech] Issue with database migration 6.3 to 7.4
Hi Jacob I had a similar problem with a database I was trying to import: many /N invalid commands. I gave my user superuser privileges and was able to import the dump without those errors. Sean On Thu, 26 Jan 2023 at 23:06, Cameron, Jacob wrote: > Hi Everyone, > > I exported my DSpace 6.3 database, imported it on the new server running > 7.4. There were thousands of invalid command /N that showed up during the > import and lots of other ERROR: relation "xxx" does not exist. > > I did try running dspace database migrate ignored afterwards and was given > some errors. > > I checked the DSpace log and there was some messaged about being unable to > find the bean by name or database but that may have been when I deleted my > old database before recreating the new one to import to. > > Any thoughts or suggestions would be welcome. I've seen a few suggestions > out there and I've tried them, but I haven't had any luck. > > C:\DSpace\bin>dspace database migrate ignored > Using DSpace installation in: C:\DSpace > > Database URL: jdbc:postgresql://localhost:5432/dspace > Migrating database to latest version AND running previously "Ignored" > migrations... (Check logs for details) > Migration exception: > java.sql.SQLException: Flyway migration error occurred > at > org.dspace.storage.rdbms.DatabaseUtils.updateDatabase(DatabaseUtils.java:785) > at > org.dspace.storage.rdbms.DatabaseUtils.updateDatabase(DatabaseUtils.java:672) > at > org.dspace.storage.rdbms.DatabaseUtils.main(DatabaseUtils.java:195) > at > java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native > Method) > at > java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.base/java.lang.reflect.Method.invoke(Method.java:566) > at > org.dspace.app.launcher.ScriptLauncher.runOneCommand(ScriptLauncher.java:277) > at > org.dspace.app.launcher.ScriptLauncher.handleScript(ScriptLauncher.java:133) > at > org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:98) > Caused by: > org.flywaydb.core.internal.command.DbMigrate$FlywayMigrateException: > Migration > V5.7_2017.04.11__DS-3563_Index_metadatavalue_resource_type_id_column.sql > failed > > - > SQL State : 42703 > Error Code : 0 > Message: ERROR: column "resource_type_id" does not exist > Location : > org/dspace/storage/rdbms/sqlmigration/postgres/V5.7_2017.04.11__DS-3563_Index_metadatavalue_resource_type_id_column.sql > (C:\DSpace\file:\C:\DSpace\lib\dspace-api-7.4.jar!\org\dspace\storage\rdbms\sqlmigration\postgres\V5.7_2017.04.11__DS-3563_Index_metadatavalue_resource_type_id_column.sql) > Line : 16 > Statement : CREATE INDEX metadatavalue_resource_type_id_idx ON > metadatavalue (resource_type_id) > > at > org.flywaydb.core.internal.command.DbMigrate.doMigrateGroup(DbMigrate.java:385) > at > org.flywaydb.core.internal.command.DbMigrate.lambda$applyMigrations$1(DbMigrate.java:275) > at > org.flywaydb.core.internal.jdbc.TransactionalExecutionTemplate.execute(TransactionalExecutionTemplate.java:55) > at > org.flywaydb.core.internal.command.DbMigrate.applyMigrations(DbMigrate.java:274) > at > org.flywaydb.core.internal.command.DbMigrate.migrateGroup(DbMigrate.java:247) > at > org.flywaydb.core.internal.command.DbMigrate.lambda$migrateAll$0(DbMigrate.java:141) > at > org.flywaydb.core.internal.database.postgresql.PostgreSQLAdvisoryLockTemplate.execute(PostgreSQLAdvisoryLockTemplate.java:69) > at > org.flywaydb.core.internal.database.postgresql.PostgreSQLConnection.lock(PostgreSQLConnection.java:99) > at > org.flywaydb.core.internal.schemahistory.JdbcTableSchemaHistory.lock(JdbcTableSchemaHistory.java:139) > at > org.flywaydb.core.internal.command.DbMigrate.migrateAll(DbMigrate.java:141) > at > org.flywaydb.core.internal.command.DbMigrate.migrate(DbMigrate.java:98) > at org.flywaydb.core.Flyway$1.execute(Flyway.java:173) > at org.flywaydb.core.Flyway$1.execute(Flyway.java:124) > at > org.flywaydb.core.FlywayExecutor.execute(FlywayExecutor.java:214) > at org.flywaydb.core.Flyway.migrate(Flyway.java:124) > at > org.dspace.storage.rdbms.DatabaseUtils.updateDatabase(DatabaseUtils.java:772) > ... 9 more > Caused by: org.flywaydb.core.internal.sqlscript.FlywaySqlScriptException: > Migration > V5.7_2017.04.11__DS-3563_Index_metadatavalue_resource_type_id_column.sql > failed > > - > SQL State : 42703 > Error Code : 0 > Message: ERROR: column "resource_type_id" does not exist > Location : >
Re: [dspace-tech] Re: Problem Disseminating DSpace SITE
Hello Tim,I would like to thank you for your support as it worked after I added a value into a Null field under the epersongroup name table.Thank you so much, Problem solved!Regards,SaadSent from my iPhoneOn 26 Jan 2023, at 6:39 PM, Saad Itani wrote:Dear Tim,Thank you for reaching me in the support of the problem, will check and report back if we have a Null eperson group table.Regards,SaadSent from my iPhoneOn 26 Jan 2023, at 6:11 PM, 'Tim Donohue' via DSpace Technical Support wrote:Hi,Based on the initial error "stacktrace" it looks like the error begins here:https://github.com/DSpace/DSpace/blob/dspace-6.4/dspace-api/src/main/java/org/dspace/content/packager/PackageUtils.java#L822The error results in a NullPointerException which seems to imply that the "groupName" it encounters is either empty string or null (missing). Maybe somehow your database has a Group that has *no name*? That shouldn't be possible in DSpace, but it almost sounds like what has occurred here.To see if you have a nameless Group, you'd want to look in your "epersongroup" database table to see if there's an entry in there with a null or empty "name" column. If you find one, you can give it a name (even just call it "unnamed" or something) and try the export again.If you have other questions, let us know on this list.TimOn Thursday, January 26, 2023 at 7:49:11 AM UTC-6 itani...@gmail.com wrote:[UPDATE]Changing the type to METS example /data/bin/dspace packager -d -a -t METS -e dspace@xx -i 10938/0 /data/BACKUP/aip-backup/dspace-aip.zipworked!any idea why AIP is not working?On Wednesday, January 25, 2023 at 4:14:12 PM UTC+2 Saad Itani wrote:Dears we recently updated DSPACE from 5.x to 6.4 and the site is up and running smoothly, however I am stuck in a problem regarding export of AIP.Info:DSpace version: 6.4If I run this command, I get the following error:/data/bin/dspace packager -d -a -t AIP -e dsp...@xx.com -i 10938/0 dspace-aip.zipWarning at xsl:stylesheet on line 14 column 35 Unrecognized version 1.1: treated as 1.0Disseminating DSpace SITE [ hdl=10938/0 ] to dspace-aip.zipAlso disseminating all child objects (recursive mode)..This may take a while, please check your logs for ongoing status while we process each package.Exception: Failed to export Roles via packager (see wrapped error message for more details)org.dspace.content.crosswalk.CrosswalkInternalException: Failed to export Roles via packager (see wrapped error message for more details) at org.dspace.content.crosswalk.RoleCrosswalk.disseminateElement(RoleCrosswalk.java:236) at org.dspace.content.packager.AbstractMETSDisseminator.crosswalkToMetsElement(AbstractMETSDisseminator.java:1356) at org.dspace.content.packager.AbstractMETSDisseminator.makeMdSec(AbstractMETSDisseminator.java:626) at org.dspace.content.packager.AbstractMETSDisseminator.addToAmdSec(AbstractMETSDisseminator.java:739) at org.dspace.content.packager.AbstractMETSDisseminator.addAmdSec(AbstractMETSDisseminator.java:765) at org.dspace.content.packager.AbstractMETSDisseminator.makeManifest(AbstractMETSDisseminator.java:862) at org.dspace.content.packager.AbstractMETSDisseminator.writeZipPackage(AbstractMETSDisseminator.java:334) at org.dspace.content.packager.AbstractMETSDisseminator.disseminate(AbstractMETSDisseminator.java:271) at org.dspace.content.packager.DSpaceAIPDisseminator.disseminate(DSpaceAIPDisseminator.java:165) at org.dspace.content.packager.AbstractPackageDisseminator.disseminateAll(AbstractPackageDisseminator.java:102) at org.dspace.app.packager.Packager.disseminate(Packager.java:642) at org.dspace.app.packager.Packager.main(Packager.java:461) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.dspace.app.launcher.ScriptLauncher.runOneCommand(ScriptLauncher.java:229) at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:81)Caused by: org.dspace.content.packager.PackageException: java.lang.NullPointerException, Reason: java.lang.NullPointerException at org.dspace.content.packager.RoleDisseminator.writeToStream(RoleDisseminator.java:255) at org.dspace.content.packager.RoleDisseminator.disseminate(RoleDisseminator.java:106) at org.dspace.content.crosswalk.RoleCrosswalk.disseminateElement(RoleCrosswalk.java:205) ... 17 moreCaused by: java.lang.NullPointerException at java.util.regex.Matcher.getTextLength(Matcher.java:1283) at java.util.regex.Matcher.reset(Matcher.java:309) at java.util.regex.Matcher.(Matcher.java:229) at java.util.regex.Pattern.matcher(Pattern.java:1093) at
[dspace-tech] Issue with database migration 6.3 to 7.4
Hi Everyone, I exported my DSpace 6.3 database, imported it on the new server running 7.4. There were thousands of invalid command /N that showed up during the import and lots of other ERROR: relation "xxx" does not exist. I did try running dspace database migrate ignored afterwards and was given some errors. I checked the DSpace log and there was some messaged about being unable to find the bean by name or database but that may have been when I deleted my old database before recreating the new one to import to. Any thoughts or suggestions would be welcome. I've seen a few suggestions out there and I've tried them, but I haven't had any luck. C:\DSpace\bin>dspace database migrate ignored Using DSpace installation in: C:\DSpace Database URL: jdbc:postgresql://localhost:5432/dspace Migrating database to latest version AND running previously "Ignored" migrations... (Check logs for details) Migration exception: java.sql.SQLException: Flyway migration error occurred at org.dspace.storage.rdbms.DatabaseUtils.updateDatabase(DatabaseUtils.java:785) at org.dspace.storage.rdbms.DatabaseUtils.updateDatabase(DatabaseUtils.java:672) at org.dspace.storage.rdbms.DatabaseUtils.main(DatabaseUtils.java:195) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:566) at org.dspace.app.launcher.ScriptLauncher.runOneCommand(ScriptLauncher.java:277) at org.dspace.app.launcher.ScriptLauncher.handleScript(ScriptLauncher.java:133) at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:98) Caused by: org.flywaydb.core.internal.command.DbMigrate$FlywayMigrateException: Migration V5.7_2017.04.11__DS-3563_Index_metadatavalue_resource_type_id_column.sql failed - SQL State : 42703 Error Code : 0 Message: ERROR: column "resource_type_id" does not exist Location : org/dspace/storage/rdbms/sqlmigration/postgres/V5.7_2017.04.11__DS-3563_Index_metadatavalue_resource_type_id_column.sql (C:\DSpace\file:\C:\DSpace\lib\dspace-api-7.4.jar!\org\dspace\storage\rdbms\sqlmigration\postgres\V5.7_2017.04.11__DS-3563_Index_metadatavalue_resource_type_id_column.sql) Line : 16 Statement : CREATE INDEX metadatavalue_resource_type_id_idx ON metadatavalue (resource_type_id) at org.flywaydb.core.internal.command.DbMigrate.doMigrateGroup(DbMigrate.java:385) at org.flywaydb.core.internal.command.DbMigrate.lambda$applyMigrations$1(DbMigrate.java:275) at org.flywaydb.core.internal.jdbc.TransactionalExecutionTemplate.execute(TransactionalExecutionTemplate.java:55) at org.flywaydb.core.internal.command.DbMigrate.applyMigrations(DbMigrate.java:274) at org.flywaydb.core.internal.command.DbMigrate.migrateGroup(DbMigrate.java:247) at org.flywaydb.core.internal.command.DbMigrate.lambda$migrateAll$0(DbMigrate.java:141) at org.flywaydb.core.internal.database.postgresql.PostgreSQLAdvisoryLockTemplate.execute(PostgreSQLAdvisoryLockTemplate.java:69) at org.flywaydb.core.internal.database.postgresql.PostgreSQLConnection.lock(PostgreSQLConnection.java:99) at org.flywaydb.core.internal.schemahistory.JdbcTableSchemaHistory.lock(JdbcTableSchemaHistory.java:139) at org.flywaydb.core.internal.command.DbMigrate.migrateAll(DbMigrate.java:141) at org.flywaydb.core.internal.command.DbMigrate.migrate(DbMigrate.java:98) at org.flywaydb.core.Flyway$1.execute(Flyway.java:173) at org.flywaydb.core.Flyway$1.execute(Flyway.java:124) at org.flywaydb.core.FlywayExecutor.execute(FlywayExecutor.java:214) at org.flywaydb.core.Flyway.migrate(Flyway.java:124) at org.dspace.storage.rdbms.DatabaseUtils.updateDatabase(DatabaseUtils.java:772) ... 9 more Caused by: org.flywaydb.core.internal.sqlscript.FlywaySqlScriptException: Migration V5.7_2017.04.11__DS-3563_Index_metadatavalue_resource_type_id_column.sql failed - SQL State : 42703 Error Code : 0 Message: ERROR: column "resource_type_id" does not exist Location : org/dspace/storage/rdbms/sqlmigration/postgres/V5.7_2017.04.11__DS-3563_Index_metadatavalue_resource_type_id_column.sql (C:\DSpace\file:\C:\DSpace\lib\dspace-api-7.4.jar!\org\dspace\storage\rdbms\sqlmigration\postgres\V5.7_2017.04.11__DS-3563_Index_metadatavalue_resource_type_id_column.sql) Line : 16 Statement : CREATE INDEX metadatavalue_resource_type_id_idx ON metadatavalue (resource_type_id) at
Re: [dspace-tech] Re: Problem Disseminating DSpace SITE
Hi Saad, maybe you got unfinished registrations. We did run into a similar problem when we tried a complete AIP type AIP In/Export (in 5.x) just fort testing it. You can check this with a database query: select * from eperson where password is null; You can choose not to export passwords with the option -o passwords=false Hope this helps Claudia Am 26.01.2023 um 14:49 schrieb Saad Itani: [UPDATE] Changing the type to METS example /data/bin/dspace packager -d -a -t METS -e dspace@xx -i 10938/0 /data/BACKUP/aip-backup/dspace-aip.zip worked! any idea why AIP is not working? On Wednesday, January 25, 2023 at 4:14:12 PM UTC+2 Saad Itani wrote: Dears we recently updated DSPACE from 5.x to 6.4 and the site is up and running smoothly, however I am stuck in a problem regarding export of AIP. Info: DSpace version: 6.4 If I run this command, I get the following error: /data/bin/dspace packager -d -a -t AIP -e dsp...@xx.com -i 10938/0 dspace-aip.zip Warning at xsl:stylesheet on line 14 column 35 Unrecognized version 1.1: treated as 1.0 Disseminating DSpace SITE [ hdl=10938/0 ] to dspace-aip.zip Also disseminating all child objects (recursive mode).. This may take a while, please check your logs for ongoing status while we process each package. Exception: Failed to export Roles via packager (see wrapped error message for more details) org.dspace.content.crosswalk.CrosswalkInternalException: Failed to export Roles via packager (see wrapped error message for more details) at org.dspace.content.crosswalk.RoleCrosswalk.disseminateElement(RoleCrosswalk.java:236) at org.dspace.content.packager.AbstractMETSDisseminator.crosswalkToMetsElement(AbstractMETSDisseminator.java:1356) at org.dspace.content.packager.AbstractMETSDisseminator.makeMdSec(AbstractMETSDisseminator.java:626) at org.dspace.content.packager.AbstractMETSDisseminator.addToAmdSec(AbstractMETSDisseminator.java:739) at org.dspace.content.packager.AbstractMETSDisseminator.addAmdSec(AbstractMETSDisseminator.java:765) at org.dspace.content.packager.AbstractMETSDisseminator.makeManifest(AbstractMETSDisseminator.java:862) at org.dspace.content.packager.AbstractMETSDisseminator.writeZipPackage(AbstractMETSDisseminator.java:334) at org.dspace.content.packager.AbstractMETSDisseminator.disseminate(AbstractMETSDisseminator.java:271) at org.dspace.content.packager.DSpaceAIPDisseminator.disseminate(DSpaceAIPDisseminator.java:165) at org.dspace.content.packager.AbstractPackageDisseminator.disseminateAll(AbstractPackageDisseminator.java:102) at org.dspace.app.packager.Packager.disseminate(Packager.java:642) at org.dspace.app.packager.Packager.main(Packager.java:461) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.dspace.app.launcher.ScriptLauncher.runOneCommand(ScriptLauncher.java:229) at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:81) Caused by: org.dspace.content.packager.PackageException: java.lang.NullPointerException, Reason: java.lang.NullPointerException at org.dspace.content.packager.RoleDisseminator.writeToStream(RoleDisseminator.java:255) at org.dspace.content.packager.RoleDisseminator.disseminate(RoleDisseminator.java:106) at org.dspace.content.crosswalk.RoleCrosswalk.disseminateElement(RoleCrosswalk.java:205) ... 17 more Caused by: java.lang.NullPointerException at java.util.regex.Matcher.getTextLength(Matcher.java:1283) at java.util.regex.Matcher.reset(Matcher.java:309) at java.util.regex.Matcher.(Matcher.java:229) at java.util.regex.Pattern.matcher(Pattern.java:1093) at org.dspace.content.packager.PackageUtils.translateGroupNameForExport(PackageUtils.java:822) at org.dspace.content.packager.RoleDisseminator.writeGroup(RoleDisseminator.java:307) at org.dspace.content.packager.RoleDisseminator.writeToStream(RoleDisseminator.java:229) ... 19 more [DSPACE LOG SHOW] 2023-01-25 15:36:53,696 WARN net.sf.ehcache.CacheManager @ Creating a new instance of CacheManager using the diskStorePath "/tmp" which is already used by an existing CacheManager. The source of the configuration was net.sf.ehcache.config.generator.ConfigurationSource$URLConfigurationSource@3794ff96. The diskStore path for this
[dspace-tech] Re: DB Schema / Data model for Dspace 7
Hi, As you correctly noted, the latest schema diagram we have is for DSpace 6: https://wiki.lyrasis.org/display/DSDOC7x/Storage+Layer This diagram is "semi-accurate" for DSpace 7, as v7 uses the same general table structure as v6... with a few new tables added to v7 to specifically support Configurable Entities & other new features in v7. Unfortunately, we've not had a volunteer to help us regenerate that fancy diagram in the documentation (the previous v6 diagram was created with a paid tool). If anyone is interested in helping generate a pretty diagram for v7, we'd appreciate volunteers. In the meantime, there are many free database tools which can generate an interactive ERD (Entity Relationship Diagram) if you just point it at your database. One I've used in the past is pgAdmin 4 (https://www.pgadmin.org/docs/pgadmin4/6.18/erd_tool.html). To get a dynamically built diagram for DSpace 7, you could point pgAdmin 4 against a DSpace 7 (Postgres) database, and use its built in ERD Tool. The advantage to this is that you no longer are dealing with a static image file, the diagram is interactive & you can easily zoom in to get as much detail on each table as you wish. Tim On Wednesday, January 25, 2023 at 5:30:28 AM UTC-6 jorge...@gmail.com wrote: > Hi. > Could I please get the db schema/ data model for Dspace 7 ? > > Why ? > > We are a large institution with various departments and are required to > provide quarterly updates per departments. To this end we run SQL queries > against the database. > We have preset queries which we used in Dspace 4 , which , with a press of > a button spew out the required information. > These queries/selects obviously no longer work after our migration to > dspace 7. > To assist in the "correction" of the queries I was asked to provide the > schema ... the relationships between the tables in the actual database and > what they hold. > > I did attempt to find this on my own , but on the wiki the closest I found > was dspace 6 schema . > Are they the same ? > > -- All messages to this mailing list should adhere to the Code of Conduct: https://www.lyrasis.org/about/Pages/Code-of-Conduct.aspx --- You received this message because you are subscribed to the Google Groups "DSpace Technical Support" group. To unsubscribe from this group and stop receiving emails from it, send an email to dspace-tech+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/dspace-tech/43e9ad2e-99e4-4234-8241-c3d95518b810n%40googlegroups.com.
Re: [dspace-tech] Re: Problem Disseminating DSpace SITE
Dear Tim,Thank you for reaching me in the support of the problem, will check and report back if we have a Null eperson group table.Regards,SaadSent from my iPhoneOn 26 Jan 2023, at 6:11 PM, 'Tim Donohue' via DSpace Technical Support wrote:Hi,Based on the initial error "stacktrace" it looks like the error begins here:https://github.com/DSpace/DSpace/blob/dspace-6.4/dspace-api/src/main/java/org/dspace/content/packager/PackageUtils.java#L822The error results in a NullPointerException which seems to imply that the "groupName" it encounters is either empty string or null (missing). Maybe somehow your database has a Group that has *no name*? That shouldn't be possible in DSpace, but it almost sounds like what has occurred here.To see if you have a nameless Group, you'd want to look in your "epersongroup" database table to see if there's an entry in there with a null or empty "name" column. If you find one, you can give it a name (even just call it "unnamed" or something) and try the export again.If you have other questions, let us know on this list.TimOn Thursday, January 26, 2023 at 7:49:11 AM UTC-6 itani...@gmail.com wrote:[UPDATE]Changing the type to METS example /data/bin/dspace packager -d -a -t METS -e dspace@xx -i 10938/0 /data/BACKUP/aip-backup/dspace-aip.zipworked!any idea why AIP is not working?On Wednesday, January 25, 2023 at 4:14:12 PM UTC+2 Saad Itani wrote:Dears we recently updated DSPACE from 5.x to 6.4 and the site is up and running smoothly, however I am stuck in a problem regarding export of AIP.Info:DSpace version: 6.4If I run this command, I get the following error:/data/bin/dspace packager -d -a -t AIP -e dsp...@xx.com -i 10938/0 dspace-aip.zipWarning at xsl:stylesheet on line 14 column 35 Unrecognized version 1.1: treated as 1.0Disseminating DSpace SITE [ hdl=10938/0 ] to dspace-aip.zipAlso disseminating all child objects (recursive mode)..This may take a while, please check your logs for ongoing status while we process each package.Exception: Failed to export Roles via packager (see wrapped error message for more details)org.dspace.content.crosswalk.CrosswalkInternalException: Failed to export Roles via packager (see wrapped error message for more details) at org.dspace.content.crosswalk.RoleCrosswalk.disseminateElement(RoleCrosswalk.java:236) at org.dspace.content.packager.AbstractMETSDisseminator.crosswalkToMetsElement(AbstractMETSDisseminator.java:1356) at org.dspace.content.packager.AbstractMETSDisseminator.makeMdSec(AbstractMETSDisseminator.java:626) at org.dspace.content.packager.AbstractMETSDisseminator.addToAmdSec(AbstractMETSDisseminator.java:739) at org.dspace.content.packager.AbstractMETSDisseminator.addAmdSec(AbstractMETSDisseminator.java:765) at org.dspace.content.packager.AbstractMETSDisseminator.makeManifest(AbstractMETSDisseminator.java:862) at org.dspace.content.packager.AbstractMETSDisseminator.writeZipPackage(AbstractMETSDisseminator.java:334) at org.dspace.content.packager.AbstractMETSDisseminator.disseminate(AbstractMETSDisseminator.java:271) at org.dspace.content.packager.DSpaceAIPDisseminator.disseminate(DSpaceAIPDisseminator.java:165) at org.dspace.content.packager.AbstractPackageDisseminator.disseminateAll(AbstractPackageDisseminator.java:102) at org.dspace.app.packager.Packager.disseminate(Packager.java:642) at org.dspace.app.packager.Packager.main(Packager.java:461) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.dspace.app.launcher.ScriptLauncher.runOneCommand(ScriptLauncher.java:229) at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:81)Caused by: org.dspace.content.packager.PackageException: java.lang.NullPointerException, Reason: java.lang.NullPointerException at org.dspace.content.packager.RoleDisseminator.writeToStream(RoleDisseminator.java:255) at org.dspace.content.packager.RoleDisseminator.disseminate(RoleDisseminator.java:106) at org.dspace.content.crosswalk.RoleCrosswalk.disseminateElement(RoleCrosswalk.java:205) ... 17 moreCaused by: java.lang.NullPointerException at java.util.regex.Matcher.getTextLength(Matcher.java:1283) at java.util.regex.Matcher.reset(Matcher.java:309) at java.util.regex.Matcher.(Matcher.java:229) at java.util.regex.Pattern.matcher(Pattern.java:1093) at org.dspace.content.packager.PackageUtils.translateGroupNameForExport(PackageUtils.java:822) at org.dspace.content.packager.RoleDisseminator.writeGroup(RoleDisseminator.java:307) at org.dspace.content.packager.RoleDisseminator.writeToStream(RoleDisseminator.java:229) ... 19 more[DSPACE LOG SHOW]2023-01-25
[dspace-tech] Re: Problem Disseminating DSpace SITE
Hi, Based on the initial error "stacktrace" it looks like the error begins here: https://github.com/DSpace/DSpace/blob/dspace-6.4/dspace-api/src/main/java/org/dspace/content/packager/PackageUtils.java#L822 The error results in a NullPointerException which seems to imply that the "groupName" it encounters is either empty string or null (missing). Maybe somehow your database has a Group that has *no name*? That shouldn't be possible in DSpace, but it almost sounds like what has occurred here. To see if you have a nameless Group, you'd want to look in your "epersongroup" database table to see if there's an entry in there with a null or empty "name" column. If you find one, you can give it a name (even just call it "unnamed" or something) and try the export again. If you have other questions, let us know on this list. Tim On Thursday, January 26, 2023 at 7:49:11 AM UTC-6 itani...@gmail.com wrote: > [UPDATE] > Changing the type to METS example /data/bin/dspace packager -d -a -t METS > -e dspace@xx -i 10938/0 /data/BACKUP/aip-backup/dspace-aip.zip > > worked! > > any idea why AIP is not working? > > On Wednesday, January 25, 2023 at 4:14:12 PM UTC+2 Saad Itani wrote: > >> Dears we recently updated DSPACE from 5.x to 6.4 and the site is up and >> running smoothly, however I am stuck in a problem regarding export of AIP. >> >> Info: >> DSpace version: 6.4 >> >> If I run this command, I get the following error: >> >> /data/bin/dspace packager -d -a -t AIP -e dsp...@xx.com -i 10938/0 >> dspace-aip.zip >> >> Warning at xsl:stylesheet on line 14 column 35 >> Unrecognized version 1.1: treated as 1.0 >> >> Disseminating DSpace SITE [ hdl=10938/0 ] to dspace-aip.zip >> >> Also disseminating all child objects (recursive mode).. >> This may take a while, please check your logs for ongoing status while we >> process each package. >> Exception: Failed to export Roles via packager (see wrapped error message >> for more details) >> org.dspace.content.crosswalk.CrosswalkInternalException: Failed to export >> Roles via packager (see wrapped error message for more details) >> at >> org.dspace.content.crosswalk.RoleCrosswalk.disseminateElement(RoleCrosswalk.java:236) >> at >> org.dspace.content.packager.AbstractMETSDisseminator.crosswalkToMetsElement(AbstractMETSDisseminator.java:1356) >> at >> org.dspace.content.packager.AbstractMETSDisseminator.makeMdSec(AbstractMETSDisseminator.java:626) >> at >> org.dspace.content.packager.AbstractMETSDisseminator.addToAmdSec(AbstractMETSDisseminator.java:739) >> at >> org.dspace.content.packager.AbstractMETSDisseminator.addAmdSec(AbstractMETSDisseminator.java:765) >> at >> org.dspace.content.packager.AbstractMETSDisseminator.makeManifest(AbstractMETSDisseminator.java:862) >> at >> org.dspace.content.packager.AbstractMETSDisseminator.writeZipPackage(AbstractMETSDisseminator.java:334) >> at >> org.dspace.content.packager.AbstractMETSDisseminator.disseminate(AbstractMETSDisseminator.java:271) >> at >> org.dspace.content.packager.DSpaceAIPDisseminator.disseminate(DSpaceAIPDisseminator.java:165) >> at >> org.dspace.content.packager.AbstractPackageDisseminator.disseminateAll(AbstractPackageDisseminator.java:102) >> at org.dspace.app.packager.Packager.disseminate(Packager.java:642) >> at org.dspace.app.packager.Packager.main(Packager.java:461) >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> at >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) >> at >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> at java.lang.reflect.Method.invoke(Method.java:498) >> at >> org.dspace.app.launcher.ScriptLauncher.runOneCommand(ScriptLauncher.java:229) >> at >> org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:81) >> Caused by: org.dspace.content.packager.PackageException: >> java.lang.NullPointerException, Reason: java.lang.NullPointerException >> at >> org.dspace.content.packager.RoleDisseminator.writeToStream(RoleDisseminator.java:255) >> at >> org.dspace.content.packager.RoleDisseminator.disseminate(RoleDisseminator.java:106) >> at >> org.dspace.content.crosswalk.RoleCrosswalk.disseminateElement(RoleCrosswalk.java:205) >> ... 17 more >> Caused by: java.lang.NullPointerException >> at java.util.regex.Matcher.getTextLength(Matcher.java:1283) >> at java.util.regex.Matcher.reset(Matcher.java:309) >> at java.util.regex.Matcher.(Matcher.java:229) >> at java.util.regex.Pattern.matcher(Pattern.java:1093) >> at >> org.dspace.content.packager.PackageUtils.translateGroupNameForExport(PackageUtils.java:822) >> at >> org.dspace.content.packager.RoleDisseminator.writeGroup(RoleDisseminator.java:307) >> at >>
[dspace-tech] Re: Problem Disseminating DSpace SITE
[UPDATE] Changing the type to METS example /data/bin/dspace packager -d -a -t METS -e dspace@xx -i 10938/0 /data/BACKUP/aip-backup/dspace-aip.zip worked! any idea why AIP is not working? On Wednesday, January 25, 2023 at 4:14:12 PM UTC+2 Saad Itani wrote: > Dears we recently updated DSPACE from 5.x to 6.4 and the site is up and > running smoothly, however I am stuck in a problem regarding export of AIP. > > Info: > DSpace version: 6.4 > > If I run this command, I get the following error: > > /data/bin/dspace packager -d -a -t AIP -e dsp...@xx.com -i 10938/0 > dspace-aip.zip > > Warning at xsl:stylesheet on line 14 column 35 > Unrecognized version 1.1: treated as 1.0 > > Disseminating DSpace SITE [ hdl=10938/0 ] to dspace-aip.zip > > Also disseminating all child objects (recursive mode).. > This may take a while, please check your logs for ongoing status while we > process each package. > Exception: Failed to export Roles via packager (see wrapped error message > for more details) > org.dspace.content.crosswalk.CrosswalkInternalException: Failed to export > Roles via packager (see wrapped error message for more details) > at > org.dspace.content.crosswalk.RoleCrosswalk.disseminateElement(RoleCrosswalk.java:236) > at > org.dspace.content.packager.AbstractMETSDisseminator.crosswalkToMetsElement(AbstractMETSDisseminator.java:1356) > at > org.dspace.content.packager.AbstractMETSDisseminator.makeMdSec(AbstractMETSDisseminator.java:626) > at > org.dspace.content.packager.AbstractMETSDisseminator.addToAmdSec(AbstractMETSDisseminator.java:739) > at > org.dspace.content.packager.AbstractMETSDisseminator.addAmdSec(AbstractMETSDisseminator.java:765) > at > org.dspace.content.packager.AbstractMETSDisseminator.makeManifest(AbstractMETSDisseminator.java:862) > at > org.dspace.content.packager.AbstractMETSDisseminator.writeZipPackage(AbstractMETSDisseminator.java:334) > at > org.dspace.content.packager.AbstractMETSDisseminator.disseminate(AbstractMETSDisseminator.java:271) > at > org.dspace.content.packager.DSpaceAIPDisseminator.disseminate(DSpaceAIPDisseminator.java:165) > at > org.dspace.content.packager.AbstractPackageDisseminator.disseminateAll(AbstractPackageDisseminator.java:102) > at org.dspace.app.packager.Packager.disseminate(Packager.java:642) > at org.dspace.app.packager.Packager.main(Packager.java:461) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at > org.dspace.app.launcher.ScriptLauncher.runOneCommand(ScriptLauncher.java:229) > at > org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:81) > Caused by: org.dspace.content.packager.PackageException: > java.lang.NullPointerException, Reason: java.lang.NullPointerException > at > org.dspace.content.packager.RoleDisseminator.writeToStream(RoleDisseminator.java:255) > at > org.dspace.content.packager.RoleDisseminator.disseminate(RoleDisseminator.java:106) > at > org.dspace.content.crosswalk.RoleCrosswalk.disseminateElement(RoleCrosswalk.java:205) > ... 17 more > Caused by: java.lang.NullPointerException > at java.util.regex.Matcher.getTextLength(Matcher.java:1283) > at java.util.regex.Matcher.reset(Matcher.java:309) > at java.util.regex.Matcher.(Matcher.java:229) > at java.util.regex.Pattern.matcher(Pattern.java:1093) > at > org.dspace.content.packager.PackageUtils.translateGroupNameForExport(PackageUtils.java:822) > at > org.dspace.content.packager.RoleDisseminator.writeGroup(RoleDisseminator.java:307) > at > org.dspace.content.packager.RoleDisseminator.writeToStream(RoleDisseminator.java:229) > ... 19 more > > [DSPACE LOG SHOW] > 2023-01-25 15:36:53,696 WARN net.sf.ehcache.CacheManager @ Creating a new > instance of CacheManager using the diskStorePath "/tmp" which is already > used by an existing CacheManager. > The source of the configuration was > net.sf.ehcache.config.generator.ConfigurationSource$URLConfigurationSource@3794ff96. > The diskStore path for this CacheManager will be set to > /tmp/ehcache_auto_created_1674653813695. > To avoid this warning consider using the CacheManager factory methods to > create a singleton CacheManager or specifying a separate ehcache > configuration (ehcache.xml) for each CacheManager instance. > 2023-01-25 15:36:55,808 WARN org.dspace.content.packager.PackageUtils @ > DSpace Object (ID='128', type ='3') no longer exists -- translating > COLLECTION_128_DEFAULT_READ to ORPHANED_3_GROUP_128_DEFAULT_READ. > 2023-01-25 15:36:55,809 WARN org.dspace.content.packager.PackageUtils @ >
