Import times will depend on: - hardware (speed of disks, cpu, # of cpus, amount of memory, etc) - Java configuration (heap size, etc) - Lucene/Solr configuration (many ...) - Index configuration - how many fields, indexed how; faceting, etc - OS configuration (this usually to a lesser degree; _usually_) - Network issues if non-local - DB configuration (driver, etc)
If you can give more information about the above, people on this list should be able to better indicate whether 18 hours sounds right for your situation. -Glen Newton On Wed, Feb 22, 2012 at 10:14 AM, Devon Baumgarten <dbaumgar...@nationalcorp.com> wrote: > Hello, > > Would it be unusual for an import of 160 million documents to take 18 hours? > Each document is less than 1kb and I have the DataImportHandler using the > jdbc driver to connect to SQL Server 2008. The full-import query calls a > stored procedure that contains only a select from my target table. > > Is there any way I can speed this up? I saw recently someone on this list > suggested a new user could get all their Solr data imported in under an hour. > I sure hope that's true! > > > Devon Baumgarten > > -- - http://zzzoot.blogspot.com/ -
