IIRC, the only limit is the memory available to CouchDB. On 18.12.2010, at 05:08, Chris Johnson wrote:
> This worked and leads into another question. The file I am trying to batch > import has 1.5M docs. No luck. I had to reduce it down to 250K entries before > I was able to successfully able to do a batch import. Is there a limit to the > number of documents that are supported? > > Thanks > >>
>> Tim King >> December 17, 2010 5:07 PM >> >> Try adding this header argument after your curl command: >> >> -H "Content-Type: application/json" >> >> Tim >> >> >>
>> Chris Johnson >> December 17, 2010 3:52 PM >> >> I have an XML doc that I am parsing that results in 5M documents. I have >> been successful in serializing this and writing to the database but this >> takes an extremely long time. As a result, I am testing the _bulk_docs >> import but have not been successful. >> >> Below is a snapshot of the file that I am creating to do the bulk import, >> but when I use it, I get the following error: >> >> >curl -X POST -d @bulk.json http://192.168.1.133:5984/bulktest/_bulk_docs >> >{"error":"bad_content_type","reason":"Content-Type must be >> >application/json"} >> >> bulk.json >> { >> "docs": [ >> { "session_id":"849", "policyID":"trust-to-untrust/4", >> "in_srcIP":"192.168.199.108", "in_srcPort":"49174", >> "in_dstIP":"72.14.213.109", "in_dstPort":"993", "out_srcIP":"72.14.213.109", >> "out_srcPort":"993", "out_dstIP":"98.207.50.174", "out_dstPort":"38324", >> "protocol":"tcp" }, >> { "session_id":"2127", "policyID":"trust-to-untrust/4", >> "in_srcIP":"192.168.199.117", "in_srcPort":"49197", >> "in_dstIP":"17.148.16.38", "in_dstPort":"993", "out_srcIP":"17.148.16.38", >> "out_srcPort":"993", "out_dstIP":"98.207.50.174", "out_dstPort":"27540", >> "protocol":"tcp" }, >> { "session_id":"2364", "policyID":"trust-to-untrust/4", >> "in_srcIP":"192.168.199.117", "in_srcPort":"49309", >> "in_dstIP":"98.136.48.116", "in_dstPort":"5050", >> "out_srcIP":"98.136.48.116", "out_srcPort":"5050", >> "out_dstIP":"98.207.50.174", "out_dstPort":"38335", "protocol":"tcp" }, >> ] >> } >>
