Today I created a 1GB collection with RAMDirectoryFactory and only id, stored unindexed without docValues text_sn fields in the schema.
 
In solrconfig.xml:
<directoryFactory name="DirectoryFactory" class="${solr.directoryFactory:solr.RAMDirectoryFactory}"/>
... and in <indexConfig> section:
<lockType>${solr.lock.type:single}</lockType>
 
In managed-schema:
...
    <field name="id" type="string" indexed="true" stored="true" required="true" multiValued="false" />
    <field name="text_sn"  type="string"  indexed="false" docValues="false" multiValued="false" stored="true"  />
...
 
Receiving all data from it is also carried out at slow speeds of approximately 300 Megabits (454 maximum at two+ runs) - one 4.3 Ghz core on  VM with Solr fully load (%wait is 50%-70%), wget output at the end - 2023-02-25 12:59:27 (454 Mb/s) - ‘/dev/null’ saved [898511406]) not Gigabit+. This is 10 times slower than downloading a 10Gb file from the same Solr Jetty (as shown above - 4.83 Gigabit/sec).
 
If you have a large collection, you can also estimate the speed of single threaded uncompressed data receiving, for example, using wget (change the ip address, collection name and rows number to your values, but so that the server response at least gigabyte. You can also use nload to track outgoing speed on the server.):
 
wget --report-speed=bits -O /dev/null --server-response --header='Accept-Encoding: ' --post-data 'q=*%3A*&rows=100000' http://192.168.220.135:8983/solr/test_collection/select
 
Please let me know if anyone gets a speed level of at least 1Gigabit+ and even more so of the order of 5Gigabit+, which according to my tests is in the capabilities of Solr Jetty.
 
Best Regards,
--------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@solr.apache.org For additional commands, e-mail: dev-h...@solr.apache.org

Reply via email to