dr0ptp4kt closed this task as "Resolved".
dr0ptp4kt added a comment.
I'm going to close this for now given that the later dump munged okay and
there seems to be an underlying issue somewhere probably related to file
transfer. The ``-- --skolemize`` will be a thing to consider for any future
dr0ptp4kt added a comment.
I did manage to run a `sha1sum` on the older dump where the import had failed.
/mnt/w$ time sha1sum latest-all.ttl.gz
dedad5a589b3a3661a1f9ebb7f1a6bcbce1b4ef2 latest-all.ttl.gz
real28m47.000s
user3m21.104s
sys 0m46.825s
dr0ptp4kt added a comment.
The addshore .jnl (August file) does launch nicely with `./runBlazegraph.sh`.
TASK DETAIL
https://phabricator.wikimedia.org/T347647
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: dr0ptp4kt
Cc: Aklapper, Stang,
Gehel added a project: Data-Engineering.
TASK DETAIL
https://phabricator.wikimedia.org/T347647
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: dr0ptp4kt, Gehel
Cc: Aklapper, Stang, dr0ptp4kt, bking, Danny_Benjafield_WMDE, Mohamed-Awnallah,
dr0ptp4kt added a comment.
The addshore .jnl (August file) download completed, with use of the Linux
tool axel. Working from my memory as I checked on the download on my 1 Gbps
connection the first 800 or so GB downloaded over the first 3-4 hours, thrn (as
some Clodflare connections seemed
dr0ptp4kt added a comment.
Update - the newer dump munged without any problems.
TASK DETAIL
https://phabricator.wikimedia.org/T347647
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: dr0ptp4kt
Cc: Aklapper, Stang, dr0ptp4kt, bking,
Maintenance_bot added a project: Wikidata.
TASK DETAIL
https://phabricator.wikimedia.org/T347647
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: dr0ptp4kt, Maintenance_bot
Cc: Aklapper, Stang, dr0ptp4kt, bking, Danny_Benjafield_WMDE, Astuthiodit_1,
dr0ptp4kt claimed this task.
dr0ptp4kt updated Other Assignee, removed: dr0ptp4kt.
TASK DETAIL
https://phabricator.wikimedia.org/T347647
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: dr0ptp4kt
Cc: Aklapper, Stang, dr0ptp4kt, bking, AWesterinen,
dr0ptp4kt moved this task from needs triage to Current work on the
Discovery-Search board.
dr0ptp4kt edited projects, added Discovery-Search (Current work); removed
Discovery-Search.
TASK DETAIL
https://phabricator.wikimedia.org/T347647
WORKBOARD
dr0ptp4kt triaged this task as "Medium" priority.
TASK DETAIL
https://phabricator.wikimedia.org/T347647
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: dr0ptp4kt
Cc: Aklapper, Stang, dr0ptp4kt, bking, AWesterinen, Namenlos314, Gq86,
dr0ptp4kt added a project: Discovery-Search.
dr0ptp4kt updated Other Assignee, added: dr0ptp4kt.
TASK DETAIL
https://phabricator.wikimedia.org/T347647
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: dr0ptp4kt
Cc: Aklapper, Stang, dr0ptp4kt, bking,
dr0ptp4kt created this task.
dr0ptp4kt added a project: Wikidata-Query-Service.
Restricted Application added subscribers: Stang, Aklapper.
TASK DESCRIPTION
Documenting an item discussed on `#wikimedia-search` on IRC.
$ ./munge.sh -c 5 -f /mnt/w/latest-all.ttl.gz -d /mnt/w/munge
12 matches
Mail list logo