[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Katrin Fischer changed: What|Removed |Added CC||pablo.bian...@gmail.com --- Comment #139 from Katrin Fischer --- *** Bug 15192 has been marked as a duplicate of this bug. *** -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Fridolin SOMERS changed: What|Removed |Added Blocks||21908 Referenced Bugs: https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=21908 [Bug 21908] Add biblio_metadata to rebuild_zebra.pl tables -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Jonathan Druart changed: What|Removed |Added Blocks||19638 Referenced Bugs: https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=19638 [Bug 19638] False positives for 'Update SQL' button -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Fridolin SOMERS changed: What|Removed |Added Blocks||19583 Referenced Bugs: https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=19583 [Bug 19583] Report updater triggers on auth_header.marcxml -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Fridolin SOMERS changed: What|Removed |Added Blocks||19724 Referenced Bugs: https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=19724 [Bug 19724] Add timestamp to biblio_metadata and deletedbiblio_metadata -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Jonathan Druart changed: What|Removed |Added Blocks||19332 Referenced Bugs: https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=19332 [Bug 19332] Basket grouping PDF and CSV exports empty -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Dobrica Pavlinusic changed: What|Removed |Added See Also||https://bugs.koha-community ||.org/bugzilla3/show_bug.cgi ||?id=19332 -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Kyle M Hall changed: What|Removed |Added Text to go in the|This development moves |This development moves release notes|marcxml out of the |marcxml out of the |biblioitems and |biblioitems and |deletedbiblioitems tables |deletedbiblioitems tables |and moves it to two new |and moves it to two new |tables: biblio_metadata and |tables: biblio_metadata and |deletedbiblio_metadata. SQL |deletedbiblio_metadata. SQL |queries on the marcxml data |queries using the |will get a performance |biblioitems table but not |boost. Storing the marcxml |the marcxml column will get |in a specific table will|a performance boost. |allow us to store several |Storing the marcxml in a |metadata formats (USMARC, |specific table will allow |MARCXML, MIJ, etc.).|us to store several |ATTENTION: all reports that |metadata formats (USMARC, |use ExtractValue to |MARCXML, MIJ, etc.). |retrieve MARC tags from |ATTENTION: all reports that |biblioitems.marcxml need to |use ExtractValue to |be updated/rewritten. |retrieve MARC tags from ||biblioitems.marcxml need to ||be updated/rewritten. -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Jonathan Druart changed: What|Removed |Added Blocks||18284 --- Comment #138 from Jonathan Druart --- (In reply to Olli-Antti Kivilahti from comment #137) > Followup Bug 18265 is ready to be SO'd. I have opened and submitted a patch on bug 18284 to deal with the move of the biblio metadata and the data lost. Referenced Bugs: https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=18284 [Bug 18284] Biblio metadata are not moved to the deleted table when a biblio is deleted -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 --- Comment #137 from Olli-Antti Kivilahti --- Followup Bug 18265 is ready to be SO'd. Regardless of the bugs found, I think this change is welcome. I hope we get the fixes in asap. http://quoteinvestigator.com/2014/12/16/no-mistakes/ -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 --- Comment #136 from Olli-Antti Kivilahti --- Just noticed while doing DB changes, that biblio_metadata is linked to the biblio table instead of the biblioitems-table! This will be fixed in the followup. >Try to be around when we ask for feedbacks and tests, *before* things are >pushed. >I am sure it would be more useful for everybody. >I cannot count how many times I have asked for help on this one. Unfortunately that is not possible at the moment. I can only bark later. -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 --- Comment #135 from Jonathan Druart --- (In reply to Olli-Antti Kivilahti from comment #134) > I don't want to beat a dead horse, but can't resist: Try to be around when we ask for feedbacks and tests, *before* things are pushed. I am sure it would be more useful for everybody. I cannot count how many times I have asked for help on this one. > The search is arguably slow. > I wonder how the performance inspiration server (10 min search time) is > configured? "This is a test DB, not optimized, but we were surprised by the results." http://lists.koha-community.org/pipermail/koha-devel/2016-July/042821.html -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Olli-Antti Kivilahti changed: What|Removed |Added Blocks||18265 Referenced Bugs: https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=18265 [Bug 18265] Followup to Buuug 17196. deletedbiblio_metadata is not used. biblioitemnumber was forgot. -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Olli-Antti Kivilahti changed: What|Removed |Added CC||olli-antti.kivila...@jns.fi --- Comment #134 from Olli-Antti Kivilahti --- I don't want to beat a dead horse, but can't resist: > There are several goals to do it: > - Performance > As Paul Poulain wrote, a simple query like > SELECT publicationyear, count(publicationyear) FROM biblioitems GROUP BY > publicationyear; > takes more than 10min on a DB with more than 1M bibliographic records > but only 3sec (!) on the same DB without the biblioitems.marcxml field All our test environments: MariaDB [koha]> SELECT COUNT(*) FROM biblioitems; +--+ | COUNT(*) | +--+ | 1424537 | +--+ 1 row in set (0.34 sec) On Ubuntu14.04 MariaDB using a normal 10k HDD with Intel Xeon 3GHz: innodb_buffer_pool_size = 128MB MariaDB [koha]> SELECT publicationyear, count(publicationyear) FROM biblioitems GROUP BY publicationyear; +-++ | publicationyear | count(publicationyear) | +-++ | NULL| 0 | +-++ 1 row in set (39.64 sec) The search is arguably slow. I wonder how the performance inspiration server (10 min search time) is configured? On Ubuntu14.04 MariaDB using RAID-1 SSD with Intel Xeon 3GHz 32GB RAM innodb_buffer_pool_size = 24G (Percona autoconfigurer) MariaDB [koha]> SELECT publicationyear, count(publicationyear) FROM biblioitems GROUP BY publicationyear; +-++ | publicationyear | count(publicationyear) | +-++ | NULL| 0 | +-++ 1 row in set (5.56 sec) RAM and SSDs are really cheap nowadays. See also Bug 18265 -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 --- Comment #133 from Katrin Fischer --- This won't get ported back to 16.11.x as it is an enhancement. -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 --- Comment #132 from Jonathan Druart --- I am willing to change the names of these fields if you have a good suggestion. It's the beginning of the end of MARC, so I think I can spend 10 min to rename the fields. (In reply to David Cook from comment #130) > I don't know. I'm guessing all the work's actually be done on this one > anyway, so I'm probably too late with these comments. Indeed, I asked for feedbacks on these patches for the last 6 months... But better late than never, isn't it? -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 --- Comment #131 from Zeno Tajoli --- Hi, > +CREATE TABLE biblio_metadata ( > +`id` INT(11) NOT NULL AUTO_INCREMENT, > +`biblionumber` INT(11) NOT NULL, > +`format` VARCHAR(16) NOT NULL, > +`marcflavour` VARCHAR(16) NOT NULL, in fact I think it is a case of not perfect selection of names. 'format' = 'physical_format' [ISO2709, XML, JSON, etc.] 'marcflavour' = 'logical_format' [MARC21, UNIMARC, Dublin Core, etc.] -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 --- Comment #130 from David Cook --- Comment on attachment 58927 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58927 Bug 17196: DB Changes Review of attachment 58927: --> (https://bugs.koha-community.org/bugzilla3/page.cgi?id=splinter.html&bug=17196&attachment=58927) - ::: installer/data/mysql/kohastructure.sql @@ +3926,5 @@ > + > +CREATE TABLE biblio_metadata ( > +`id` INT(11) NOT NULL AUTO_INCREMENT, > +`biblionumber` INT(11) NOT NULL, > +`format` VARCHAR(16) NOT NULL, I know this has already been pushed, but maybe the RM could add some comments to this SQL? In the comments, I think format was "USMARC, MARCXML, MiJ"? I'd maybe add a comment saying something like "ISO2709, XML, JSON", although maybe I'm misunderstanding how the field will actually be used... @@ +3927,5 @@ > +CREATE TABLE biblio_metadata ( > +`id` INT(11) NOT NULL AUTO_INCREMENT, > +`biblionumber` INT(11) NOT NULL, > +`format` VARCHAR(16) NOT NULL, > +`marcflavour` VARCHAR(16) NOT NULL, It seems unfortunate that we're using marcflavour here after divorcing this table from MARC in every other way. Although I don't know how else we'd do this. Both UNIMARC and USMARC share the same MARCXML schema, and if we can have non-XML data, we couldn't use "schema" instad of "marcflavour". Although if it were Dublin Core, you'd want to be able to specify that schema I reckon. Maybe a person could cheat and use a format of XML and a schema of UNIMARC or USMARC, and you'd use the actual MARCXML schema for both but you'd know you're dealing with one standard or the other. I don't know. I'm guessing all the work's actually be done on this one anyway, so I'm probably too late with these comments. -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Katrin Fischer changed: What|Removed |Added Resolution|--- |FIXED CC||katrin.fisc...@bsz-bw.de Status|Pushed to Master|RESOLVED Text to go in the|This develop moves marcxml |This development moves release notes|out of the biblioitems |marcxml out of the |table and inserts it inside |biblioitems and |two new tables: |deletedbiblioitems tables |biblio_metadata and |and moves it to two new |deletedbiblio_metadata. SQL |tables: biblio_metadata and |query on table biblioitems |deletedbiblio_metadata. SQL |will boost on performance. |queries on the marcxml data |Storing the marcxml in a|will get a performance |specific table would allow |boost. Storing the marcxml |use to store several kind |in a specific table will |of metadata (USMARC,|allow us to store several |MARCXML, MIJ, etc.) and |metadata formats (USMARC, |different formats |MARCXML, MIJ, etc.). |(marcflavour). |ATTENTION: all reports that |ATTENTION: |use ExtractValue to |all reports that use XPATH |retrieve MARC tags from |to retrive MARC tags from |biblioitems.marcxml need to |biblioitems.marcxml need to |be updated/rewritten. |be updated/rewritten| --- Comment #129 from Katrin Fischer --- This won't get ported back to 16.11.x as it is an enhancement. -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Jonathan Druart changed: What|Removed |Added Blocks||17898 Referenced Bugs: https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17898 [Bug 17898] Add a way to automatically convert SQL reports -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Kyle M Hall changed: What|Removed |Added CC||k...@bywatersolutions.com Status|Passed QA |Pushed to Master --- Comment #128 from Kyle M Hall --- Pushed to master for 17.05, thanks Jonathan, Nick, Marcel! -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Marcel de Rooy changed: What|Removed |Added QA Contact|testo...@bugs.koha-communit |m.de.r...@rijksmuseum.nl |y.org | Patch complexity|--- |Medium patch -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 --- Comment #127 from Marcel de Rooy --- (In reply to Josef Moravec from comment #126) > (In reply to Marcel de Rooy from comment #125) > > Last comments: > > > > > Changes in Koha/OAI/Server/ListRecords.pm is planned on bug 15108. > > Failed QA several weeks ago. The author did not respond until now. > > > > Ere Maijala is primerly working on VuFind development, so probably we could > try to contact them by e-mail directly to ask if he is plannig to work a bit > on this OAI enhancement. Josef, If you know him, could you please ask him for rebase and feedback. Thanks -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 --- Comment #126 from Josef Moravec --- (In reply to Marcel de Rooy from comment #125) > Last comments: > > > Changes in Koha/OAI/Server/ListRecords.pm is planned on bug 15108. > Failed QA several weeks ago. The author did not respond until now. > Ere Maijala is primerly working on VuFind development, so probably we could try to contact them by e-mail directly to ask if he is plannig to work a bit on this OAI enhancement. -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Marcel de Rooy changed: What|Removed |Added Status|Signed Off |Passed QA --- Comment #125 from Marcel de Rooy --- Last comments: > Changes in Koha/OAI/Server/ListRecords.pm is planned on bug 15108. Failed QA several weeks ago. The author did not respond until now. [OK] t/db_dependent/Holds/DisallowHoldIfItemsAvailable.t [OK] t/db_dependent/Holds/HoldFulfillmentPolicy.t [OK] t/db_dependent/Holds/HoldItemtypeLimit.t [OK} t/db_dependent/HoldsQueue.t [OK] t/db_dependent/UsageStats.t [OK] t/db_dependent/Members/GetAllIssues.t [OK] t/db_dependent/Items.t [OK] t/ImportBatch.t [OK] t/db_dependent/OAI/Server.t [OK] t/db_dependent/Record/Record.t [OK] t/db_dependent/Record.t [OK] t/db_dependent/Search.t [OK] t/db_dependent/Acquisition/GetOrdersByBiblionumber.t [OK] t/db_dependent/Acquisition/TransferOrder.t misc/migration_tools/koha-svc.pl: Did not verify it this still works. koha-svc.pl http://koha-dev:8080/cgi-bin/koha/svc svc-user svc-password $biblionumber [bib-42.xml] Did not check REST API. Well finally, we know about Reports. Should we still warn somewhere about that ? -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 --- Comment #123 from Marcel de Rooy --- Created attachment 58946 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58946&action=edit Bug 17196: [QA Follow-up] Adjust some text on marcxml No code changes here, just text. Signed-off-by: Marcel de Rooy -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 --- Comment #124 from Marcel de Rooy --- Created attachment 58947 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58947&action=edit Bug 17196: [QA Follow-up] Additional fix on acqui/basketgroup acqui/basketgroup calls GetOrders and expects marcxml in the results. Fixing it by an additional call of GetXmlBiblio. Signed-off-by: Marcel de Rooy -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Marcel de Rooy changed: What|Removed |Added Attachment #58939|0 |1 is obsolete|| --- Comment #122 from Marcel de Rooy --- Created attachment 58943 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58943&action=edit Bug 17196: Remove occurrence of marcxml in columns.def Also remove a wrong ref to the marc column Signed-off-by: Marcel de Rooy -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 --- Comment #121 from Jonathan Druart --- Created attachment 58939 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58939&action=edit Bug 17196: Remove occurrence of marcxml in columns.def Also remove a wrong ref to the marc column -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 --- Comment #120 from Marcel de Rooy --- dmin -> admin -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 --- Comment #119 from Marcel de Rooy --- > C4/Items.pm: changes aimed for catalogue/itemsearch.pl, but I am not sure if > they are needed. Does item search actually looks into the xml? Seems not. > New report?? So that is wrong. You can do it via dmin/items_search_fields.pl. Works fine. -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 --- Comment #118 from Jonathan Druart --- (In reply to Jonathan Druart from comment #117) > > C4/Items.pm: changes aimed for catalogue/itemsearch.pl, but I am not sure if > > they are needed. Does item search actually looks into the xml? Seems not. > > New report?? > > I don't think so, it uses it. See C4::Items::_SearchItems_build_where_fragment -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 --- Comment #117 from Jonathan Druart --- (In reply to Marcel de Rooy from comment #116) > Some preliminary findings: > > opac/opac-readingrecord.pl: Calling GetXmlBiblio seems useless here. > Probably should be GetMarcBiblio. GetMarcBiblio does much more stuffs than GetXmlBiblio. Since we just want the metadata it's better like that. > opac-search.pl: map { (C4::Context->config('zebra_bib_index_mode') eq > 'dom')? $_->{marcxml}: $_->{marc}; } This marc reference should not have > been there anymore? Nope, the column does no longer exist. > C4/Items.pm: changes aimed for catalogue/itemsearch.pl, but I am not sure if > they are needed. Does item search actually looks into the xml? Seems not. > New report?? I don't think so, it uses it. -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 --- Comment #116 from Marcel de Rooy --- Some preliminary findings: opac/opac-readingrecord.pl: Calling GetXmlBiblio seems useless here. Probably should be GetMarcBiblio. opac-search.pl: map { (C4::Context->config('zebra_bib_index_mode') eq 'dom')? $_->{marcxml}: $_->{marc}; } This marc reference should not have been there anymore? C4/Items.pm: changes aimed for catalogue/itemsearch.pl, but I am not sure if they are needed. Does item search actually looks into the xml? Seems not. New report?? -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Marcel de Rooy changed: What|Removed |Added Attachment #58517|0 |1 is obsolete|| -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 --- Comment #115 from Marcel de Rooy --- Still working on it little bit, but looks good. Please wait.. -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 --- Comment #111 from Marcel de Rooy --- Created attachment 58935 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58935&action=edit Bug 17196: [QA Follow-up] Correct POD in ILSDI/Services.pm QA tools complains about: Apparent command =cut not preceded by blank line. Trivial fix. Signed-off-by: Marcel de Rooy -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 --- Comment #112 from Marcel de Rooy --- Created attachment 58936 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58936&action=edit Bug 17196: [QA Follow-up] DBIx schema changes Signed-off-by: Marcel de Rooy -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Marcel de Rooy changed: What|Removed |Added Attachment #58516|0 |1 is obsolete|| --- Comment #109 from Marcel de Rooy --- Created attachment 58933 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58933&action=edit Bug 17196: Fix delete_records_via_leader.pl Signed-off-by: Nick Clemens Signed-off-by: Marcel de Rooy -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 --- Comment #113 from Marcel de Rooy --- Created attachment 58937 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58937&action=edit Bug 17196: [QA Follow-up] Wrong module in Record.t Should be the singular version instead of the plural one. Signed-off-by: Marcel de Rooy -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Marcel de Rooy changed: What|Removed |Added Attachment #58514|0 |1 is obsolete|| --- Comment #108 from Marcel de Rooy --- Created attachment 58932 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58932&action=edit Bug 17196: Update POD of sanitise_records.pl Signed-off-by: Josef Moravec Signed-off-by: Zeno Tajoli Signed-off-by: Nick Clemens Signed-off-by: Marcel de Rooy -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 --- Comment #114 from Marcel de Rooy --- Created attachment 58938 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58938&action=edit Bug 17196: [QA Follow-up] Missing unique key in kohastructure See the atomic update. Signed-off-by: Marcel de Rooy Tested on command line. -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 --- Comment #110 from Marcel de Rooy --- Created attachment 58934 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58934&action=edit Bug 17196 - (QA Followup) Use items from Koha::Biblio Signed-off-by: Nick Clemens Signed-off-by: Marcel de Rooy Amended: Using items from Koha::Biblio seems better :) -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Marcel de Rooy changed: What|Removed |Added Attachment #58513|0 |1 is obsolete|| --- Comment #107 from Marcel de Rooy --- Created attachment 58931 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58931&action=edit Bug 17196: Fix build_oai_sets.pl The wrong value was retrieved. Signed-off-by: Josef Moravec Signed-off-by: Zeno Tajoli Signed-off-by: Nick Clemens Signed-off-by: Marcel de Rooy -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Marcel de Rooy changed: What|Removed |Added Attachment #58511|0 |1 is obsolete|| --- Comment #105 from Marcel de Rooy --- Created attachment 58929 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58929&action=edit Bug 17196: Fix - Update metadata on update Signed-off-by: Mason James Signed-off-by: Josef Moravec Signed-off-by: Zeno Tajoli Signed-off-by: Nick Clemens Signed-off-by: Marcel de Rooy -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Marcel de Rooy changed: What|Removed |Added Attachment #58512|0 |1 is obsolete|| --- Comment #106 from Marcel de Rooy --- Created attachment 58930 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58930&action=edit Bug 17196: follow-up for bug 17088 If bug 17088 is pushed first, we will need this patch. Signed-off-by: Josef Moravec Signed-off-by: Zeno Tajoli Signed-off-by: Nick Clemens Signed-off-by: Marcel de Rooy -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Marcel de Rooy changed: What|Removed |Added Attachment #58510|0 |1 is obsolete|| --- Comment #104 from Marcel de Rooy --- Created attachment 58928 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58928&action=edit Bug 17196: Simplify tests for the different marc flavours centralize the way MARC field are set. Signed-off-by: Mason James Signed-off-by: Josef Moravec Signed-off-by: Zeno Tajoli Signed-off-by: Nick Clemens Signed-off-by: Marcel de Rooy -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Marcel de Rooy changed: What|Removed |Added Attachment #58507|0 |1 is obsolete|| --- Comment #101 from Marcel de Rooy --- Created attachment 58925 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58925&action=edit Bug 17196: Update misc/maintenance/sanitize_records.pl Test plan: Use the sanitize_records.pl maintenance script with the --auto-search option Signed-off-by: Mason James Signed-off-by: Josef Moravec Signed-off-by: Zeno Tajoli Signed-off-by: Nick Clemens Signed-off-by: Marcel de Rooy -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Marcel de Rooy changed: What|Removed |Added Attachment #58509|0 |1 is obsolete|| --- Comment #103 from Marcel de Rooy --- Created attachment 58927 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58927&action=edit Bug 17196: DB Changes Remove biblioitems.marcxml and deletedbiblioitems.marcxml and adds 2 table biblio_metadata and deletedbiblio_metadata Signed-off-by: Mason James Signed-off-by: Josef Moravec Signed-off-by: Zeno Tajoli Signed-off-by: Nick Clemens Signed-off-by: Marcel de Rooy -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Marcel de Rooy changed: What|Removed |Added Attachment #58508|0 |1 is obsolete|| --- Comment #102 from Marcel de Rooy --- Created attachment 58926 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58926&action=edit Bug 17196: Update switch_marc21_series_info.pl Not sure if this script is still used, could someone confirm? Test plan: If you know how to test it, please do Signed-off-by: Mason James Signed-off-by: Josef Moravec Signed-off-by: Zeno Tajoli Signed-off-by: Nick Clemens Signed-off-by: Marcel de Rooy -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Marcel de Rooy changed: What|Removed |Added Attachment #58505|0 |1 is obsolete|| --- Comment #99 from Marcel de Rooy --- Created attachment 58923 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58923&action=edit Bug 17196: Move marcxml out of the biblioitems table Two discussions on koha-devel lead to the same conclusion: biblioitems.marcxml should be moved out this table - biblio and biblioitems http://lists.koha-community.org/pipermail/koha-devel/2013-April/039239.html - biblioitems.marcxml & biblioitems.marc / HUGE performance issue ! http://lists.koha-community.org/pipermail/koha-devel/2016-July/042821.html There are several goals to do it: - Performance As Paul Poulain wrote, a simple query like SELECT publicationyear, count(publicationyear) FROM biblioitems GROUP BY publicationyear; takes more than 10min on a DB with more than 1M bibliographic records but only 3sec (!) on the same DB without the biblioitems.marcxml field Note that priori to this patch set, the biblioitems.marcxml was not retrieved systematically, but was, at least, in C4::Acquisition::GetOrdersByBiblionumber and C4::Acquisition::GetOrders - Flexibility Storing the marcxml in a specific table would allow use to store several kind of metadata (USMARC, MARCXML, MIJ, etc.) and different formats (marcflavour) - Clean code It would be a first step toward Koha::MetadataRecord for bibliographic records (not done in this patch set). Test plan: - Update the DBIC Schema - Add / Edit / Delete / Import / Export bibliographic records - Add items - Reindex records using ES - Confirm that the following scripts still work: * misc/cronjobs/delete_records_via_leader.pl * misc/migration_tools/build_oai_sets.pl - Look at the reading history at the OPAC (opac-readingrecord.pl) - At the OPAC, click on a tag, you must see the result Note: Changes in Koha/OAI/Server/ListRecords.pm is planned on bug 15108. Signed-off-by: Mason James Signed-off-by: Josef Moravec Signed-off-by: Zeno Tajoli Signed-off-by: Nick Clemens Signed-off-by: Marcel de Rooy -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Marcel de Rooy changed: What|Removed |Added Attachment #58506|0 |1 is obsolete|| --- Comment #100 from Marcel de Rooy --- Created attachment 58924 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58924&action=edit Bug 17196: Fix query builder for item search The item search needs to join on biblio_metadata to allow search on marcxml field Test plan: Launch complex item searches (using marc fields). Signed-off-by: Mason James Signed-off-by: Josef Moravec Signed-off-by: Zeno Tajoli Signed-off-by: Nick Clemens Signed-off-by: Marcel de Rooy -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 --- Comment #98 from Marcel de Rooy --- QA: Working on this one now. -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 --- Comment #97 from Marcel de Rooy --- Still applies. If it does on early Friday morning, I will have a look. -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 --- Comment #96 from Nick Clemens --- Tested and provided a small update -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 --- Comment #95 from Nick Clemens --- Created attachment 58517 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58517&action=edit Bug 17196 - (QA Followup) Add items() to Koha::Biblioitems Signed-off-by: Nick Clemens -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Nick Clemens changed: What|Removed |Added Attachment #58504|0 |1 is obsolete|| --- Comment #94 from Nick Clemens --- Created attachment 58516 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58516&action=edit Bug 17196: Fix delete_records_via_leader.pl Signed-off-by: Nick Clemens -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Nick Clemens changed: What|Removed |Added Attachment #58048|0 |1 is obsolete|| --- Comment #93 from Nick Clemens --- Created attachment 58514 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58514&action=edit Bug 17196: Update POD of sanitise_records.pl Signed-off-by: Josef Moravec Signed-off-by: Zeno Tajoli Signed-off-by: Nick Clemens -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Nick Clemens changed: What|Removed |Added Attachment #58047|0 |1 is obsolete|| --- Comment #92 from Nick Clemens --- Created attachment 58513 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58513&action=edit Bug 17196: Fix build_oai_sets.pl The wrong value was retrieved. Signed-off-by: Josef Moravec Signed-off-by: Zeno Tajoli Signed-off-by: Nick Clemens -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Nick Clemens changed: What|Removed |Added Attachment #58045|0 |1 is obsolete|| --- Comment #90 from Nick Clemens --- Created attachment 58511 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58511&action=edit Bug 17196: Fix - Update metadata on update Signed-off-by: Mason James Signed-off-by: Josef Moravec Signed-off-by: Zeno Tajoli Signed-off-by: Nick Clemens -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Nick Clemens changed: What|Removed |Added Attachment #58046|0 |1 is obsolete|| --- Comment #91 from Nick Clemens --- Created attachment 58512 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58512&action=edit Bug 17196: follow-up for bug 17088 If bug 17088 is pushed first, we will need this patch. Signed-off-by: Josef Moravec Signed-off-by: Zeno Tajoli Signed-off-by: Nick Clemens -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Nick Clemens changed: What|Removed |Added Attachment #58043|0 |1 is obsolete|| --- Comment #88 from Nick Clemens --- Created attachment 58509 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58509&action=edit Bug 17196: DB Changes Remove biblioitems.marcxml and deletedbiblioitems.marcxml and adds 2 table biblio_metadata and deletedbiblio_metadata Signed-off-by: Mason James Signed-off-by: Josef Moravec Signed-off-by: Zeno Tajoli Signed-off-by: Nick Clemens -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Nick Clemens changed: What|Removed |Added Attachment #58044|0 |1 is obsolete|| --- Comment #89 from Nick Clemens --- Created attachment 58510 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58510&action=edit Bug 17196: Simplify tests for the different marc flavours centralize the way MARC field are set. Signed-off-by: Mason James Signed-off-by: Josef Moravec Signed-off-by: Zeno Tajoli Signed-off-by: Nick Clemens -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Nick Clemens changed: What|Removed |Added Attachment #58041|0 |1 is obsolete|| --- Comment #86 from Nick Clemens --- Created attachment 58507 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58507&action=edit Bug 17196: Update misc/maintenance/sanitize_records.pl Test plan: Use the sanitize_records.pl maintenance script with the --auto-search option Signed-off-by: Mason James Signed-off-by: Josef Moravec Signed-off-by: Zeno Tajoli Signed-off-by: Nick Clemens -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Nick Clemens changed: What|Removed |Added Attachment #58042|0 |1 is obsolete|| --- Comment #87 from Nick Clemens --- Created attachment 58508 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58508&action=edit Bug 17196: Update switch_marc21_series_info.pl Not sure if this script is still used, could someone confirm? Test plan: If you know how to test it, please do Signed-off-by: Mason James Signed-off-by: Josef Moravec Signed-off-by: Zeno Tajoli Signed-off-by: Nick Clemens -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Nick Clemens changed: What|Removed |Added Attachment #58040|0 |1 is obsolete|| --- Comment #85 from Nick Clemens --- Created attachment 58506 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58506&action=edit Bug 17196: Fix query builder for item search The item search needs to join on biblio_metadata to allow search on marcxml field Test plan: Launch complex item searches (using marc fields). Signed-off-by: Mason James Signed-off-by: Josef Moravec Signed-off-by: Zeno Tajoli Signed-off-by: Nick Clemens -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Nick Clemens changed: What|Removed |Added Attachment #58039|0 |1 is obsolete|| --- Comment #84 from Nick Clemens --- Created attachment 58505 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58505&action=edit Bug 17196: Move marcxml out of the biblioitems table Two discussions on koha-devel lead to the same conclusion: biblioitems.marcxml should be moved out this table - biblio and biblioitems http://lists.koha-community.org/pipermail/koha-devel/2013-April/039239.html - biblioitems.marcxml & biblioitems.marc / HUGE performance issue ! http://lists.koha-community.org/pipermail/koha-devel/2016-July/042821.html There are several goals to do it: - Performance As Paul Poulain wrote, a simple query like SELECT publicationyear, count(publicationyear) FROM biblioitems GROUP BY publicationyear; takes more than 10min on a DB with more than 1M bibliographic records but only 3sec (!) on the same DB without the biblioitems.marcxml field Note that priori to this patch set, the biblioitems.marcxml was not retrieved systematically, but was, at least, in C4::Acquisition::GetOrdersByBiblionumber and C4::Acquisition::GetOrders - Flexibility Storing the marcxml in a specific table would allow use to store several kind of metadata (USMARC, MARCXML, MIJ, etc.) and different formats (marcflavour) - Clean code It would be a first step toward Koha::MetadataRecord for bibliographic records (not done in this patch set). Test plan: - Update the DBIC Schema - Add / Edit / Delete / Import / Export bibliographic records - Add items - Reindex records using ES - Confirm that the following scripts still work: * misc/cronjobs/delete_records_via_leader.pl * misc/migration_tools/build_oai_sets.pl - Look at the reading history at the OPAC (opac-readingrecord.pl) - At the OPAC, click on a tag, you must see the result Note: Changes in Koha/OAI/Server/ListRecords.pm is planned on bug 15108. Signed-off-by: Mason James Signed-off-by: Josef Moravec Signed-off-by: Zeno Tajoli Signed-off-by: Nick Clemens -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 --- Comment #83 from Jonathan Druart --- Created attachment 58504 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58504&action=edit Bug 17196: Fix delete_records_via_leader.pl -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Jonathan Druart changed: What|Removed |Added Status|Failed QA |Signed Off -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Nick Clemens changed: What|Removed |Added Status|Signed Off |Failed QA CC||n...@bywatersolutions.com --- Comment #82 from Nick Clemens --- Testing this I found one things: When trying delete_records_via_leader.pl: kohadev-koha@kohadevbox:/home/vagrant/kohaclone$ perl misc/cronjobs/delete_records_via_leader.pl -v -c -i RECORD: 288 Can't use string ("Koha::Biblioitem") as a HASH ref while "strict refs" in use at /home/vagrant/kohaclone/Koha/Object.pm line 219. -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 --- Comment #81 from Zeno Tajoli --- I have done a second sign-off and written notes about this develop. -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Zeno Tajoli changed: What|Removed |Added Text to go in the||This develop moves marcxml release notes||out of the biblioitems ||table and inserts it inside ||two new tables: ||biblio_metadata and ||deletedbiblio_metadata. SQL ||query on table biblioitems ||will boost on performance. ||Storing the marcxml in a ||specific table would allow ||use to store several kind ||of metadata (USMARC, ||MARCXML, MIJ, etc.) and ||different formats ||(marcflavour). ||ATTENTION: ||all reports that use XPATH ||to retrive MARC tags from ||biblioitems.marcxml need to ||be updated/rewritten -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Zeno Tajoli changed: What|Removed |Added Attachment #58031|0 |1 is obsolete|| Attachment #58032|0 |1 is obsolete|| --- Comment #80 from Zeno Tajoli --- Created attachment 58048 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58048&action=edit [SIGNED-OFF] Bug 17196: Update POD of sanitise_records.pl -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 --- Comment #79 from Zeno Tajoli --- Created attachment 58047 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58047&action=edit [SIGNED-OFF] Bug 17196: Fix build_oai_sets.pl -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Zeno Tajoli changed: What|Removed |Added Attachment #58030|0 |1 is obsolete|| --- Comment #78 from Zeno Tajoli --- Created attachment 58046 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58046&action=edit [SIGNED-OFF] Bug 17196: follow-up for bug 17088 -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Zeno Tajoli changed: What|Removed |Added Attachment #58029|0 |1 is obsolete|| --- Comment #77 from Zeno Tajoli --- Created attachment 58045 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58045&action=edit [SIGNED-OFF] Bug 17196: Fix - Update metadata on update -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Zeno Tajoli changed: What|Removed |Added Attachment #58028|0 |1 is obsolete|| --- Comment #76 from Zeno Tajoli --- Created attachment 58044 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58044&action=edit [SIGNED-OFF] Bug 17196: Simplify tests for the different marc flavours -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Zeno Tajoli changed: What|Removed |Added Attachment #58027|0 |1 is obsolete|| --- Comment #75 from Zeno Tajoli --- Created attachment 58043 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58043&action=edit [SIGNED-OFF] Bug 17196: DB Changes -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Zeno Tajoli changed: What|Removed |Added Attachment #58025|0 |1 is obsolete|| Attachment #58026|0 |1 is obsolete|| --- Comment #74 from Zeno Tajoli --- Created attachment 58042 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58042&action=edit [SIGNED-OFF] Bug 17196: Update switch_marc21_series_info.pl -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 --- Comment #73 from Zeno Tajoli --- Created attachment 58041 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58041&action=edit [SIGNED-OFF] Bug 17196: Update misc/maintenance/sanitize_records.pl -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Zeno Tajoli changed: What|Removed |Added Attachment #58037|0 |1 is obsolete|| Attachment #58038|0 |1 is obsolete|| --- Comment #72 from Zeno Tajoli --- Created attachment 58040 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58040&action=edit [SIGNED-OFF] Bug 17196: Fix query builder for item search -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 --- Comment #71 from Zeno Tajoli --- Created attachment 58039 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58039&action=edit [SIGNED-OFF] Bug 17196: Move marcxml out of the biblioitems table -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Zeno Tajoli changed: What|Removed |Added Attachment #58024|0 |1 is obsolete|| --- Comment #70 from Zeno Tajoli --- Created attachment 58038 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58038&action=edit Fix query builder for item search -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Zeno Tajoli changed: What|Removed |Added Attachment #58023|0 |1 is obsolete|| --- Comment #69 from Zeno Tajoli --- Created attachment 58037 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58037&action=edit Move marcxml out of the biblioitems table -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Josef Moravec changed: What|Removed |Added Attachment #57835|0 |1 is obsolete|| Attachment #57836|0 |1 is obsolete|| Attachment #57837|0 |1 is obsolete|| Attachment #57838|0 |1 is obsolete|| Attachment #57839|0 |1 is obsolete|| Attachment #57840|0 |1 is obsolete|| Attachment #57841|0 |1 is obsolete|| Attachment #58000|0 |1 is obsolete|| Attachment #58007|0 |1 is obsolete|| Attachment #58008|0 |1 is obsolete|| --- Comment #68 from Josef Moravec --- Created attachment 58032 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58032&action=edit [SIGNED-OFF] Bug 17196: Update POD of sanitise_records.pl Signed-off-by: Josef Moravec -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 Josef Moravec changed: What|Removed |Added Status|Needs Signoff |Signed Off -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 --- Comment #65 from Josef Moravec --- Created attachment 58029 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58029&action=edit [SIGNED-OFF] Bug 17196: Fix - Update metadata on update Signed-off-by: Mason James Signed-off-by: Josef Moravec -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 --- Comment #67 from Josef Moravec --- Created attachment 58031 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58031&action=edit [SIGNED-OFF] Bug 17196: Fix build_oai_sets.pl The wrong value was retrieved. Signed-off-by: Josef Moravec -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 --- Comment #66 from Josef Moravec --- Created attachment 58030 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58030&action=edit [SIGNED-OFF] Bug 17196: follow-up for bug 17088 If bug 17088 is pushed first, we will need this patch. Signed-off-by: Josef Moravec -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 --- Comment #63 from Josef Moravec --- Created attachment 58027 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58027&action=edit [SIGNED-OFF] Bug 17196: DB Changes Remove biblioitems.marcxml and deletedbiblioitems.marcxml and adds 2 table biblio_metadata and deletedbiblio_metadata Signed-off-by: Mason James Signed-off-by: Josef Moravec -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 --- Comment #64 from Josef Moravec --- Created attachment 58028 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58028&action=edit [SIGNED-OFF] Bug 17196: Simplify tests for the different marc flavours centralize the way MARC field are set. Signed-off-by: Mason James Signed-off-by: Josef Moravec -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 --- Comment #62 from Josef Moravec --- Created attachment 58026 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58026&action=edit [SIGNED-OFF] Bug 17196: Update switch_marc21_series_info.pl Not sure if this script is still used, could someone confirm? Test plan: If you know how to test it, please do Signed-off-by: Mason James Signed-off-by: Josef Moravec -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 --- Comment #61 from Josef Moravec --- Created attachment 58025 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58025&action=edit [SIGNED-OFF] Bug 17196: Update misc/maintenance/sanitize_records.pl Test plan: Use the sanitize_records.pl maintenance script with the --auto-search option Signed-off-by: Mason James Signed-off-by: Josef Moravec -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 --- Comment #60 from Josef Moravec --- Created attachment 58024 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58024&action=edit [SIGNED-OFF] Bug 17196: Fix query builder for item search The item search needs to join on biblio_metadata to allow search on marcxml field Test plan: Launch complex item searches (using marc fields). Signed-off-by: Mason James Signed-off-by: Josef Moravec -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 --- Comment #59 from Josef Moravec --- Created attachment 58023 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=58023&action=edit [SIGNED-OFF] Bug 17196: Move marcxml out of the biblioitems table Two discussions on koha-devel lead to the same conclusion: biblioitems.marcxml should be moved out this table - biblio and biblioitems http://lists.koha-community.org/pipermail/koha-devel/2013-April/039239.html - biblioitems.marcxml & biblioitems.marc / HUGE performance issue ! http://lists.koha-community.org/pipermail/koha-devel/2016-July/042821.html There are several goals to do it: - Performance As Paul Poulain wrote, a simple query like SELECT publicationyear, count(publicationyear) FROM biblioitems GROUP BY publicationyear; takes more than 10min on a DB with more than 1M bibliographic records but only 3sec (!) on the same DB without the biblioitems.marcxml field Note that priori to this patch set, the biblioitems.marcxml was not retrieved systematically, but was, at least, in C4::Acquisition::GetOrdersByBiblionumber and C4::Acquisition::GetOrders - Flexibility Storing the marcxml in a specific table would allow use to store several kind of metadata (USMARC, MARCXML, MIJ, etc.) and different formats (marcflavour) - Clean code It would be a first step toward Koha::MetadataRecord for bibliographic records (not done in this patch set). Test plan: - Update the DBIC Schema - Add / Edit / Delete / Import / Export bibliographic records - Add items - Reindex records using ES - Confirm that the following scripts still work: * misc/cronjobs/delete_records_via_leader.pl * misc/migration_tools/build_oai_sets.pl - Look at the reading history at the OPAC (opac-readingrecord.pl) - At the OPAC, click on a tag, you must see the result Note: Changes in Koha/OAI/Server/ListRecords.pm is planned on bug 15108. Signed-off-by: Mason James Signed-off-by: Josef Moravec -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 --- Comment #58 from Josef Moravec --- (In reply to Jonathan Druart from comment #53) > (In reply to Josef Moravec from comment #48) > > > 2. When I click on tag in opac, I get ISE, the log says: > > Can't locate object method "subfield" via package " > encoding="UTF-8"?> > It's a bug from master, please open a new bug report. > Note that it only happens when SearchEngine=Elastic Done in bug 17739 as you have seen ;) -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 --- Comment #57 from Jonathan Druart --- (In reply to Zeno Tajoli from comment #56) > I go here:Home › Administration › Item search fields and I add a index based > on tag 245$c. > But I check the default here: > http://kohastaffsandbox.ptfs-europe.co.uk and also on master it doesn't work. > So it is an other bug. Ok thanks, so please report it on another bug report. -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 --- Comment #56 from Zeno Tajoli --- Hi, I go here:Home › Administration › Item search fields and I add a index based on tag 245$c. But I check the default here: http://kohastaffsandbox.ptfs-europe.co.uk and also on master it doesn't work. So it is an other bug. Bye -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 --- Comment #55 from Jonathan Druart --- (In reply to Zeno Tajoli from comment #54) > Hi Jonathan, > > I think there problems on "Fix query builder for item search". > I try to do a search with a personalized index based on 245$c. > The search doesn't use the index based on 245$c. > But it use the standard indexes (based on table 'items'). > > No errors in intranet logs > > Bye Hi Zeno, I am not sure to understand correctly what you mean. Which index did you create? Did you confirm that what you describe is not the same behaviour as in master? -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 17196] Move marcxml out of the biblioitems table
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17196 --- Comment #54 from Zeno Tajoli --- Hi Jonathan, I think there problems on "Fix query builder for item search". I try to do a search with a personalized index based on 245$c. The search doesn't use the index based on 245$c. But it use the standard indexes (based on table 'items'). No errors in intranet logs Bye -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/