dr0ptp4kt added a comment.
**More about bufferCapacity**
Similarly, with 150 munged files, was attempted with the buffer in
RWStore.properties increased from 100000 to 100000**0** with the target as the
NVMe.
com.bigdata.rdf.sail.bufferCapacity=1000000
ubuntu22:~/rdf/dist/target/service-0.3.138-SNAPSHOT$ time ./loadData.sh -n
wdq -d /mnt/firehose/munge_on_later_data_set -s 1 -e 150
...
real 240m5.344s
Remember, for //nine// munged files the difference in performance for NVMe ➡️
same NVMe between the `bufferCapacity` of 100000 versus about 100000*0* was
about 34%. (~1.3412 minus 1.0000), and what we see here for //150// munged
files is somewhat consistent at about 33%.
TASK DETAIL
https://phabricator.wikimedia.org/T359062
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: dr0ptp4kt
Cc: ssingh, bking, dr0ptp4kt, Aklapper, Danny_Benjafield_WMDE, Astuthiodit_1,
karapayneWMDE, Invadibot, maantietaja, ItamarWMDE, Akuckartz, Nandana, Lahi,
Gq86, GoranSMilovanovic, QZanden, EBjune, KimKelting, LawExplorer, _jensen,
rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331
_______________________________________________
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
