Hi
Something wrong with database deployment in postgresql (at the beginning of
the process and 2nd at the end):
#/usr/local/bin/imdbpy2sql.py -o sqlalchemy -d /root/test/database/ -u
postgresql://imdb:imdb_xxxxxx@pghost/imdb
1 error:
WARNING: unknown exception caught committing the data
WARNING: to the database; report this as a bug, since
WARNING: many data (99999 items) were lost: current transaction is aborted,
commands ignored until end of transaction block
#postgresql log:
STATEMENT: DROP TABLE title_extract
ERROR: current transaction is aborted, commands ignored until end of
transaction block
STATEMENT: SELECT * FROM title LIMIT 1
ERROR: current transaction is aborted, commands ignored until end of
transaction block
STATEMENT: DROP TABLE name_extract
ERROR: current transaction is aborted, commands ignored until end of
transaction block
STATEMENT: SELECT * FROM name LIMIT 1
ERROR: current transaction is aborted, commands ignored until end of
transaction block
STATEMENT: DROP TABLE char_name_extract
ERROR: current transaction is aborted, commands ignored until end of
transaction block
STATEMENT: SELECT * FROM char_name LIMIT 1
ERROR: current transaction is aborted, commands ignored until end of
transaction block
STATEMENT: DROP TABLE company_name_extract
ERROR: current transaction is aborted, commands ignored until end of
transaction block
STATEMENT: SELECT * FROM company_name LIMIT 1
ERROR: current transaction is aborted, commands ignored until end of
transaction block
STATEMENT: INSERT INTO title (id, title, imdb_index, kind_id,
production_year, imdb_id, phonetic_code, episode_of_id, season_nr,
episode_nr, series_years, md5sum) VALUES (73996, E'(#1.66)', NULL, 7, 1980,
NULL, NULL, 73922, 1, 66, NULL, E'4de45f35edf0b753c54ab72dcbe68bb5')
It is critical !?
process continues - at the end of deployment:
2 error at the end:
# TIME completeCast() : 0min, 22sec (wall) 0min, 8sec (user) 0min, 1sec
(system)
# TIME fushing caches... : 0min, 1sec (wall) 0min, 0sec (user) 0min, 0sec
(system)
# TIME TOTAL TIME TO INSERT/WRITE DATA : 258min, 6sec (wall) 107min, 16sec
(user) 16min, 48sec (system)
building database indexes (this may take a while)
# TIME createIndexes() : 21min, 57sec (wall) 0min, 0sec (user) 0min, 0sec
(system)
adding foreign keys (this may take a while)
ERROR caught exception creating a foreign key: (IntegrityError) insert or
update on table "aka_title" violates foreign key constraint "fk_title_id_2"
DETAIL: Key (movie_id)=(0) is not present in table "title".
'ALTER TABLE aka_title ADD CONSTRAINT fk_title_id_2 FOREIGN KEY(movie_id)
REFERENCES title (id)' {}
# TIME createForeignKeys() : 5min, 52sec (wall) 0min, 0sec (user) 0min,
0sec (system)
RESTORING imdbIDs values for movies... WARNING: unable to restore imdbIDs
using the temporary table (falling back to dbm): missing "title_extract"
table (ok if this is the first run)
WARNING: unable to restore imdbIDs (ok if this is the first run)
RESTORING imdbIDs values for people... WARNING: unable to restore imdbIDs
using the temporary table (falling back to dbm): missing "name_extract"
table (ok if this is the first run)
WARNING: unable to restore imdbIDs (ok if this is the first run)
RESTORING imdbIDs values for characters... WARNING: unable to restore
imdbIDs using the temporary table (falling back to dbm): missing
"char_name_extract" table (ok if this is the first run)
WARNING: unable to restore imdbIDs (ok if this is the first run)
RESTORING imdbIDs values for companies... WARNING: unable to restore
imdbIDs using the temporary table (falling back to dbm): missing
"company_name_extract" table (ok if this is the first run)
WARNING: unable to restore imdbIDs (ok if this is the first run)
# TIME FINAL : 285min, 56sec (wall) 107min, 16sec (user) 16min, 48sec
(system)
How about this - is this ok ?
Best regards,
Sergey
------------------------------------------------------------------------------
Keep yourself connected to Go Parallel:
VERIFY Test and improve your parallel project with help from experts
and peers. http://goparallel.sourceforge.net
_______________________________________________
Imdbpy-devel mailing list
Imdbpy-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-devel