Re: Running stress tests on spark cluster to avoid wild-goose chase later

2016-11-15 Thread Dave Jaffe
...@vmware.com From: Mich Talebzadeh Date: Tuesday, November 15, 2016 at 11:09 AM To: "user @spark" Subject: Running stress tests on spark cluster to avoid wild-goose chase later Hi, This is rather a broad question. We would like to run a set of stress tests against our Spark clusters to en

Running stress tests on spark cluster to avoid wild-goose chase later

2016-11-15 Thread Mich Talebzadeh
Hi, This is rather a broad question. We would like to run a set of stress tests against our Spark clusters to ensure that the build performs as expected before deploying the cluster. Reasoning behind this is that the users were reporting some ML jobs running on two equal clusters reporting back