Thank you for the information, Geoff.
A correction - We are planning to have 5 million rows in the CSV file, not 5,00,000. Below is a sample record we will have in the Test Data. 00 00 00 4B 02 00 30 20 05 80 20 C0 00 04 00 00 00 00 00 00 01 01 00 00 02 49 00 21 00 44 00 32 44 76 92 12 01 12 79 29 D0 80 61 01 10 00 04 35 39 39 31 31 32 30 30 31 30 30 Thank you, Muthu -----Original Message----- From: Geoff Simmons [mailto:[email protected]] Sent: Friday, February 17, 2012 1:37 PM To: JMeter Users List Cc: Muthukrishnan S. Subject: Re: Maximum number of rows that JMeter can read from a CSV file -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 On 2/17/12 7:24 AM, Muthukrishnan S. wrote: > > We are evaluating JMeter's capability on reading Test Data from a > voluminous data source. The Test Data file is expected to have > around 5,00,000 rows in a CSV file, we need JMeter to read them all > throughout the process of Performance Testing. Will JMeter be able > to read so much of rows? If not, what is the maximum number of rows > that JMeter can read from a CSV file? > > If it is not possible to read around 5,00,000 rows, please suggest > some best practices to achieve the same. - From a look at the sources, it appears to me that CSVDataSet reads from its file with calls to java.io.BufferedReader.readline() (via FileServer in the services package), so it should be fine with that. I've used JMeter for 24h continuous load testing, and I believe we've used CSV files with up to about 150,000 lines, and JMeter was OK. The best practice, I'd say, is to test it in a dry run -- run your 5M-line test against a test server overnight and see how it goes. Best, Geoff - -- UPLEX Systemoptimierung Schwanenwik 24 22087 Hamburg http://uplex.de/ Mob: +49-176-63690917 -----BEGIN PGP SIGNATURE----- Version: GnuPG/MacGPG2 v2.0.14 (Darwin) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iQIcBAEBCAAGBQJPPgqMAAoJEOUwvh9pJNURBHYP/3HllSxWlcC9PRUPOqOdPw+I NEIOViqPuJm/7nuPjseCbPqDMEGkPxMy+nC3xFJ7/STY36SGNk5medTJ6wcqCfbi OpqgHrhCg09ewi1o1h3jg6S7XWsbcQOBqfwAmE3q/HTYg5xZrhNzam4VsZFrfvhp +eXV0jWtb3XlDrPtgEqFQ2DZmZWDWL4WHr3xW0dAEBM/ttP+VAtA8GkP7UupalZY JM6dLVYJY2hTQxD4DRrhJSxwho+vQoCcUXgQTU65c9pXL6dXGoIZUxG22hVK+IMj AhmaxpIPBhhtRptx4zef34tfTaufd6JM3q+7wk/vOPHu5FpR4Rgc6g25M+3s7bhF gbSwVUank5Uctr6jWYckh8uGr/VpobQ19Ae9dOjtCRLDzNl08tzkOzllgAsR5Biq Xiz26TYgwycAoAfNKVmD0MZiVldTdFsN+iUgzNEFIDmA8tqo63+IVkIW/R3OdNzM MBxEhdBFpQ+6sp8iyiCJLUenYQCrp2JqHNiv5LVXkuiGrqkCaxqTxd2RtT5zwp+m TnmAQ501clpjxlPCNOt9LffZzeNUc8OyczGddAdIdt6JlgXuBSrMkRQIEaG4mpKY naLY7hxO7y9VFHN5t7+b6+qE4oobckqSMCOfmBP8DT4IZTueDHg7AuWLKwzkEGou l1IDy2zAUyPlOMw4oEB1 =aDA2 -----END PGP SIGNATURE-----
