[jira] [Commented] (IGNITE-4212) Ignite Benchmarking Simplification and Automation
[
https://issues.apache.org/jira/browse/IGNITE-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15868200#comment-15868200
]
Denis Magda commented on IGNITE-4212:
-
[~oleg-ostanin],
Please update the doc with this text below. I've edited it a bit.
*By default, all the necessary files will be automatically uploaded from the
host in which you run the command above to every other host to the same path.
If you prefer to do it manually set the AUTO_COPY variable in property file to
`false`.*
//I've double checked project compilation and for me it worked fine. Sorry I
did not mention it before. Please attach maven //building logs if you can.
I didn't build the project, I rather opened it with Intellij IDEA and Intellij
IDEA showed me that it can't find these two methods
{code}
cc.setReadThrough(args.isStoreEnabled());
cc.setWriteThrough(args.isStoreEnabled());
{code}
> Ignite Benchmarking Simplification and Automation
> -
>
> Key: IGNITE-4212
> URL: https://issues.apache.org/jira/browse/IGNITE-4212
> Project: Ignite
> Issue Type: Task
>Reporter: Denis Magda
>Assignee: Oleg Ostanin
> Fix For: 1.9
>
> Attachments: benchmark-remote.properties,
> benchmark-remote-sample.properties, DEVNOTES.txt, ignite-remote-config.xml,
> README.txt
>
>
> There is a plenty of useful Yardstick benchmarks located in ignite-yardstick
> module that is used by the community to check Ignite performance across
> deployments of different configurations.
> However, it's not easy to start with the benchmarking process because the
> user needs to download Ignite, build and set up benchmarks and only after
> that run them.
> The goal of this task is to simplify the process in the following way:
> 1) ignite-yardstick benchmarks have to be pre-compiled and available with
> every Ignite deliverable.
> 2) every deliverable must contain an executable (bat or sh file) with a clear
> instruction on how to start a specific benchmark from the console.
> 3) the executable has to use some default yardstick configuration. The first
> configuration should be intented for local execution (multicast IP finder)
> and the second needs to be AWS oriented.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (IGNITE-4212) Ignite Benchmarking Simplification and Automation
[ https://issues.apache.org/jira/browse/IGNITE-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15867459#comment-15867459 ] Oleg Ostanin commented on IGNITE-4212: -- [~dmagda] Your version of README.txt says: "1. These Ignite Yardstick Benchmarks have to be uploaded to every remote host. The path to the uploaded benchmarks should be exactly the same on each host." But now we added the functionality to help user upload Benchmarks from one remote host or from local machine to every other remote hosts. I think it would be better if we say: By default all the necessary files will be automatically uploaded from the host in which you run the command above to every other host in exact same path. If you prefer to do it manually set the AUTO_COPY variable in property file to `false`. I've double checked compile the project and for me it worked fine. Sorry I did not mention it before. Please attach maven building logs if you can. > Ignite Benchmarking Simplification and Automation > - > > Key: IGNITE-4212 > URL: https://issues.apache.org/jira/browse/IGNITE-4212 > Project: Ignite > Issue Type: Task >Reporter: Denis Magda >Assignee: Oleg Ostanin > Fix For: 1.9 > > Attachments: benchmark-remote.properties, > benchmark-remote-sample.properties, DEVNOTES.txt, ignite-remote-config.xml, > README.txt > > > There is a plenty of useful Yardstick benchmarks located in ignite-yardstick > module that is used by the community to check Ignite performance across > deployments of different configurations. > However, it's not easy to start with the benchmarking process because the > user needs to download Ignite, build and set up benchmarks and only after > that run them. > The goal of this task is to simplify the process in the following way: > 1) ignite-yardstick benchmarks have to be pre-compiled and available with > every Ignite deliverable. > 2) every deliverable must contain an executable (bat or sh file) with a clear > instruction on how to start a specific benchmark from the console. > 3) the executable has to use some default yardstick configuration. The first > configuration should be intented for local execution (multicast IP finder) > and the second needs to be AWS oriented. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (IGNITE-4212) Ignite Benchmarking Simplification and Automation
[
https://issues.apache.org/jira/browse/IGNITE-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15867087#comment-15867087
]
Denis Magda commented on IGNITE-4212:
-
[~oleg-ostanin]
Final notes from my side:
* This issue reported before has not been fixed yet: if to create an
IntellijIDEA project from the sources you will not be able to compile
{{IgniteNode}} class because of the two lines below
{code}
cc.setReadThrough(args.isStoreEnabled());
cc.setWriteThrough(args.isStoreEnabled());
{code}
* I prefer not to mention how to active multiple drivers mode in README. This
should be a straightforward getting started guide. If the user requires
advanced settings he can go to Yardstick page. So, I removed the mentioning of
multiple drivers introduced by you. Please copy the content from the attached
README.
* If it's possible I would put "charts-{DATE}" under "result-{DATE}" folder.
Now they are on the same directory level.
This is all from my side. You got a green light for me. Please take into
account my minor comments and pass the benchmarks for review to [~skozlov].
> Ignite Benchmarking Simplification and Automation
> -
>
> Key: IGNITE-4212
> URL: https://issues.apache.org/jira/browse/IGNITE-4212
> Project: Ignite
> Issue Type: Task
>Reporter: Denis Magda
>Assignee: Oleg Ostanin
> Fix For: 1.9
>
> Attachments: benchmark-remote.properties,
> benchmark-remote-sample.properties, DEVNOTES.txt, ignite-remote-config.xml,
> README.txt
>
>
> There is a plenty of useful Yardstick benchmarks located in ignite-yardstick
> module that is used by the community to check Ignite performance across
> deployments of different configurations.
> However, it's not easy to start with the benchmarking process because the
> user needs to download Ignite, build and set up benchmarks and only after
> that run them.
> The goal of this task is to simplify the process in the following way:
> 1) ignite-yardstick benchmarks have to be pre-compiled and available with
> every Ignite deliverable.
> 2) every deliverable must contain an executable (bat or sh file) with a clear
> instruction on how to start a specific benchmark from the console.
> 3) the executable has to use some default yardstick configuration. The first
> configuration should be intented for local execution (multicast IP finder)
> and the second needs to be AWS oriented.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (IGNITE-4212) Ignite Benchmarking Simplification and Automation
[
https://issues.apache.org/jira/browse/IGNITE-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15865995#comment-15865995
]
Oleg Ostanin commented on IGNITE-4212:
--
[~dmagda]
Thank you for your help! I've moved the files you had suggested to the `config`
directory.
I also added graphs auto generation to the main script which does run
benchmarks. I suggest putting the garbage collector logs along with the other
logs in logs-{DATE-TIME} directory.
Please take a look on this version:
https://drive.google.com/open?id=0B9teTzJ9iIvHbFFmcEtWWVpaRWs
> Ignite Benchmarking Simplification and Automation
> -
>
> Key: IGNITE-4212
> URL: https://issues.apache.org/jira/browse/IGNITE-4212
> Project: Ignite
> Issue Type: Task
>Reporter: Denis Magda
>Assignee: Oleg Ostanin
> Fix For: 1.9
>
> Attachments: benchmark-remote.properties,
> benchmark-remote-sample.properties, DEVNOTES.txt, ignite-remote-config.xml,
> README.txt
>
>
> There is a plenty of useful Yardstick benchmarks located in ignite-yardstick
> module that is used by the community to check Ignite performance across
> deployments of different configurations.
> However, it's not easy to start with the benchmarking process because the
> user needs to download Ignite, build and set up benchmarks and only after
> that run them.
> The goal of this task is to simplify the process in the following way:
> 1) ignite-yardstick benchmarks have to be pre-compiled and available with
> every Ignite deliverable.
> 2) every deliverable must contain an executable (bat or sh file) with a clear
> instruction on how to start a specific benchmark from the console.
> 3) the executable has to use some default yardstick configuration. The first
> configuration should be intented for local execution (multicast IP finder)
> and the second needs to be AWS oriented.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (IGNITE-4212) Ignite Benchmarking Simplification and Automation
[
https://issues.apache.org/jira/browse/IGNITE-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15861846#comment-15861846
]
Denis Magda commented on IGNITE-4212:
-
[~oleg-ostanin], great, finally I could execute the benchmarks. Awesome
contribution!
A couple of comments so far to make it even better:
* I suggest creating and using "remote" alternatives of configs for "Running
Ignite Benchmarks Remotely" section. Please take the newly attached README and
copy it to your branch. Also, copy these new files, attached to the ticket, to
the "config" directory of "benchmarks/config" and "benchmarks/source/config"
foldes:
- benchmark-remote-sample.properties
- benchmark-remote.properties
- ignite-remote-config.xml
Refer to updated "Running Ignite Benchmarks Remotely" to find out why they are
needed.
* Auto-generate "benchmarks/output" directory during benchmarks execution and
put "results-{DATE-TIME}" and "logs-{DATE-TIME}" there. The README has been
already updated to reflect this.
* Presently garbage collection logs are added under "benchmarks" directory. Put
them under "benchmarks/output" under their own "gc-{DATE-TIME}" folder.
* The graphs are not generated at the end of benchmarks execution. Only a
couple of CSV files are added into "results-{DATE-TIME}". Could you add the
graphs as well?
* Please replace the content of DEVNOTES with the content of the file attached.
* If to create an IntellijIDEA project from the sources you will not be able to
compile {{IgniteNode}} class because of the two lines below
{code}
cc.setReadThrough(args.isStoreEnabled());
cc.setWriteThrough(args.isStoreEnabled());
{code}
[~skozlov], this is all from my side. Once the issues are addressed please
validate the benchmarks on QA side trying to use them for 1.9 benchmarking
purposes.
> Ignite Benchmarking Simplification and Automation
> -
>
> Key: IGNITE-4212
> URL: https://issues.apache.org/jira/browse/IGNITE-4212
> Project: Ignite
> Issue Type: Task
>Reporter: Denis Magda
>Assignee: Oleg Ostanin
> Fix For: 1.9
>
> Attachments: benchmark-remote.properties,
> benchmark-remote-sample.properties, DEVNOTES.txt, ignite-remote-config.xml,
> README.txt
>
>
> There is a plenty of useful Yardstick benchmarks located in ignite-yardstick
> module that is used by the community to check Ignite performance across
> deployments of different configurations.
> However, it's not easy to start with the benchmarking process because the
> user needs to download Ignite, build and set up benchmarks and only after
> that run them.
> The goal of this task is to simplify the process in the following way:
> 1) ignite-yardstick benchmarks have to be pre-compiled and available with
> every Ignite deliverable.
> 2) every deliverable must contain an executable (bat or sh file) with a clear
> instruction on how to start a specific benchmark from the console.
> 3) the executable has to use some default yardstick configuration. The first
> configuration should be intented for local execution (multicast IP finder)
> and the second needs to be AWS oriented.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (IGNITE-4212) Ignite Benchmarking Simplification and Automation
[ https://issues.apache.org/jira/browse/IGNITE-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15860259#comment-15860259 ] Oleg Ostanin commented on IGNITE-4212: -- Sorry it took so long, but we had to wait until new Yardstick framework release to get rid of ssh connection to localhost. Here is the new version of Ignite release with Yardstick: > Ignite Benchmarking Simplification and Automation > - > > Key: IGNITE-4212 > URL: https://issues.apache.org/jira/browse/IGNITE-4212 > Project: Ignite > Issue Type: Task >Reporter: Denis Magda >Assignee: Oleg Ostanin > Fix For: 1.9 > > Attachments: README.txt > > > There is a plenty of useful Yardstick benchmarks located in ignite-yardstick > module that is used by the community to check Ignite performance across > deployments of different configurations. > However, it's not easy to start with the benchmarking process because the > user needs to download Ignite, build and set up benchmarks and only after > that run them. > The goal of this task is to simplify the process in the following way: > 1) ignite-yardstick benchmarks have to be pre-compiled and available with > every Ignite deliverable. > 2) every deliverable must contain an executable (bat or sh file) with a clear > instruction on how to start a specific benchmark from the console. > 3) the executable has to use some default yardstick configuration. The first > configuration should be intented for local execution (multicast IP finder) > and the second needs to be AWS oriented. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (IGNITE-4212) Ignite Benchmarking Simplification and Automation
[ https://issues.apache.org/jira/browse/IGNITE-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15856401#comment-15856401 ] Oleg Ostanin commented on IGNITE-4212: -- [~dmagda] You need to configure ssh key-based authentication to localhost because Yardstick works this way - scripts run another scripts by ssh commands. There is a patch available to fix it. > Ignite Benchmarking Simplification and Automation > - > > Key: IGNITE-4212 > URL: https://issues.apache.org/jira/browse/IGNITE-4212 > Project: Ignite > Issue Type: Task >Reporter: Denis Magda >Assignee: Oleg Ostanin > Fix For: 2.0 > > Attachments: README.txt > > > There is a plenty of useful Yardstick benchmarks located in ignite-yardstick > module that is used by the community to check Ignite performance across > deployments of different configurations. > However, it's not easy to start with the benchmarking process because the > user needs to download Ignite, build and set up benchmarks and only after > that run them. > The goal of this task is to simplify the process in the following way: > 1) ignite-yardstick benchmarks have to be pre-compiled and available with > every Ignite deliverable. > 2) every deliverable must contain an executable (bat or sh file) with a clear > instruction on how to start a specific benchmark from the console. > 3) the executable has to use some default yardstick configuration. The first > configuration should be intented for local execution (multicast IP finder) > and the second needs to be AWS oriented. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (IGNITE-4212) Ignite Benchmarking Simplification and Automation
[ https://issues.apache.org/jira/browse/IGNITE-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15854635#comment-15854635 ] Oleg Ostanin commented on IGNITE-4212: -- I fixed issue with missing file. > Ignite Benchmarking Simplification and Automation > - > > Key: IGNITE-4212 > URL: https://issues.apache.org/jira/browse/IGNITE-4212 > Project: Ignite > Issue Type: Task >Reporter: Denis Magda >Assignee: Oleg Ostanin > Fix For: 2.0 > > Attachments: README.txt > > > There is a plenty of useful Yardstick benchmarks located in ignite-yardstick > module that is used by the community to check Ignite performance across > deployments of different configurations. > However, it's not easy to start with the benchmarking process because the > user needs to download Ignite, build and set up benchmarks and only after > that run them. > The goal of this task is to simplify the process in the following way: > 1) ignite-yardstick benchmarks have to be pre-compiled and available with > every Ignite deliverable. > 2) every deliverable must contain an executable (bat or sh file) with a clear > instruction on how to start a specific benchmark from the console. > 3) the executable has to use some default yardstick configuration. The first > configuration should be intented for local execution (multicast IP finder) > and the second needs to be AWS oriented. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (IGNITE-4212) Ignite Benchmarking Simplification and Automation
[
https://issues.apache.org/jira/browse/IGNITE-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15851982#comment-15851982
]
Denis Magda commented on IGNITE-4212:
-
* {{Building the project}} section says that {{Please look for the building
instructions in `DEVNOTES.txt`}}. However, the devnotes are located under
"source" folder. They either have to be placed under "benchmarks" folder or the
documentation has to say that they are under "sources" folder.
* Documented property {{config/benchmark-atomic-put.properties}} is missing.
Can't check benchmarks execution as README says.
* If to follow the instructions and execute {{`./bin/benchmark-run-all.sh`}}
then I see this error all the time
{code}
<11:14:35> Starting driver config '...eTxBenchmark -sn IgniteNode
-ds RELEASE-tx-invoke-1-backup' on localhost with id=0
ssh: connect to host localhost port 22: Connection refused
ssh: connect to host localhost port 22: Connection refused
ssh: connect to host localhost port 22: Connection refused
{code}
* Why do I need this?
{{NOTE: You need to configure ssh key-based authentication to localhost for
running benchmarks on your local machine.}}
I've edited the README file. Please copy-paste all the content from the
attached one in this ticket. I'll review and edit {{Running Ignite Benchmarks
Remotely}} section after the issues above are resolved.
> Ignite Benchmarking Simplification and Automation
> -
>
> Key: IGNITE-4212
> URL: https://issues.apache.org/jira/browse/IGNITE-4212
> Project: Ignite
> Issue Type: Task
>Reporter: Denis Magda
>Assignee: Oleg Ostanin
> Fix For: 2.0
>
>
> There is a plenty of useful Yardstick benchmarks located in ignite-yardstick
> module that is used by the community to check Ignite performance across
> deployments of different configurations.
> However, it's not easy to start with the benchmarking process because the
> user needs to download Ignite, build and set up benchmarks and only after
> that run them.
> The goal of this task is to simplify the process in the following way:
> 1) ignite-yardstick benchmarks have to be pre-compiled and available with
> every Ignite deliverable.
> 2) every deliverable must contain an executable (bat or sh file) with a clear
> instruction on how to start a specific benchmark from the console.
> 3) the executable has to use some default yardstick configuration. The first
> configuration should be intented for local execution (multicast IP finder)
> and the second needs to be AWS oriented.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (IGNITE-4212) Ignite Benchmarking Simplification and Automation
[ https://issues.apache.org/jira/browse/IGNITE-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15850195#comment-15850195 ] Oleg Ostanin commented on IGNITE-4212: -- [~dmagda] I've fixed README.txt and DEVNOTES.txt. > Ignite Benchmarking Simplification and Automation > - > > Key: IGNITE-4212 > URL: https://issues.apache.org/jira/browse/IGNITE-4212 > Project: Ignite > Issue Type: Task >Reporter: Denis Magda >Assignee: Oleg Ostanin > Fix For: 2.0 > > > There is a plenty of useful Yardstick benchmarks located in ignite-yardstick > module that is used by the community to check Ignite performance across > deployments of different configurations. > However, it's not easy to start with the benchmarking process because the > user needs to download Ignite, build and set up benchmarks and only after > that run them. > The goal of this task is to simplify the process in the following way: > 1) ignite-yardstick benchmarks have to be pre-compiled and available with > every Ignite deliverable. > 2) every deliverable must contain an executable (bat or sh file) with a clear > instruction on how to start a specific benchmark from the console. > 3) the executable has to use some default yardstick configuration. The first > configuration should be intented for local execution (multicast IP finder) > and the second needs to be AWS oriented. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (IGNITE-4212) Ignite Benchmarking Simplification and Automation
[ https://issues.apache.org/jira/browse/IGNITE-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15843359#comment-15843359 ] Oleg Ostanin commented on IGNITE-4212: -- [~dmagda] I've made some changes in the doc files. Please take a look when you have a moment. https://github.com/apache/ignite/pull/1471 > Ignite Benchmarking Simplification and Automation > - > > Key: IGNITE-4212 > URL: https://issues.apache.org/jira/browse/IGNITE-4212 > Project: Ignite > Issue Type: Task >Reporter: Denis Magda >Assignee: Oleg Ostanin > Fix For: 2.0 > > > There is a plenty of useful Yardstick benchmarks located in ignite-yardstick > module that is used by the community to check Ignite performance across > deployments of different configurations. > However, it's not easy to start with the benchmarking process because the > user needs to download Ignite, build and set up benchmarks and only after > that run them. > The goal of this task is to simplify the process in the following way: > 1) ignite-yardstick benchmarks have to be pre-compiled and available with > every Ignite deliverable. > 2) every deliverable must contain an executable (bat or sh file) with a clear > instruction on how to start a specific benchmark from the console. > 3) the executable has to use some default yardstick configuration. The first > configuration should be intented for local execution (multicast IP finder) > and the second needs to be AWS oriented. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (IGNITE-4212) Ignite Benchmarking Simplification and Automation
[ https://issues.apache.org/jira/browse/IGNITE-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15822005#comment-15822005 ] Oleg Ostanin commented on IGNITE-4212: -- Thank you. I will fix it. > Ignite Benchmarking Simplification and Automation > - > > Key: IGNITE-4212 > URL: https://issues.apache.org/jira/browse/IGNITE-4212 > Project: Ignite > Issue Type: Task >Reporter: Denis Magda >Assignee: Oleg Ostanin > Fix For: 2.0 > > > There is a plenty of useful Yardstick benchmarks located in ignite-yardstick > module that is used by the community to check Ignite performance across > deployments of different configurations. > However, it's not easy to start with the benchmarking process because the > user needs to download Ignite, build and set up benchmarks and only after > that run them. > The goal of this task is to simplify the process in the following way: > 1) ignite-yardstick benchmarks have to be pre-compiled and available with > every Ignite deliverable. > 2) every deliverable must contain an executable (bat or sh file) with a clear > instruction on how to start a specific benchmark from the console. > 3) the executable has to use some default yardstick configuration. The first > configuration should be intented for local execution (multicast IP finder) > and the second needs to be AWS oriented. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (IGNITE-4212) Ignite Benchmarking Simplification and Automation
[ https://issues.apache.org/jira/browse/IGNITE-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15820835#comment-15820835 ] Ilya Suntsov commented on IGNITE-4212: -- [~oleg-ostanin] We need to add "benchmarks" subdirectory only to AI fabric build. Now I see it also in hadoop edition. > Ignite Benchmarking Simplification and Automation > - > > Key: IGNITE-4212 > URL: https://issues.apache.org/jira/browse/IGNITE-4212 > Project: Ignite > Issue Type: Task >Reporter: Denis Magda >Assignee: Oleg Ostanin > Fix For: 2.0 > > > There is a plenty of useful Yardstick benchmarks located in ignite-yardstick > module that is used by the community to check Ignite performance across > deployments of different configurations. > However, it's not easy to start with the benchmarking process because the > user needs to download Ignite, build and set up benchmarks and only after > that run them. > The goal of this task is to simplify the process in the following way: > 1) ignite-yardstick benchmarks have to be pre-compiled and available with > every Ignite deliverable. > 2) every deliverable must contain an executable (bat or sh file) with a clear > instruction on how to start a specific benchmark from the console. > 3) the executable has to use some default yardstick configuration. The first > configuration should be intented for local execution (multicast IP finder) > and the second needs to be AWS oriented. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (IGNITE-4212) Ignite Benchmarking Simplification and Automation
[ https://issues.apache.org/jira/browse/IGNITE-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15819425#comment-15819425 ] Denis Magda commented on IGNITE-4212: - I would use the configuration used for this set of benchmarks https://www.gridgain.com/resources/benchmarks/gridgain-benchmarks-results > Ignite Benchmarking Simplification and Automation > - > > Key: IGNITE-4212 > URL: https://issues.apache.org/jira/browse/IGNITE-4212 > Project: Ignite > Issue Type: Task >Reporter: Denis Magda >Assignee: Oleg Ostanin > Fix For: 2.0 > > > There is a plenty of useful Yardstick benchmarks located in ignite-yardstick > module that is used by the community to check Ignite performance across > deployments of different configurations. > However, it's not easy to start with the benchmarking process because the > user needs to download Ignite, build and set up benchmarks and only after > that run them. > The goal of this task is to simplify the process in the following way: > 1) ignite-yardstick benchmarks have to be pre-compiled and available with > every Ignite deliverable. > 2) every deliverable must contain an executable (bat or sh file) with a clear > instruction on how to start a specific benchmark from the console. > 3) the executable has to use some default yardstick configuration. The first > configuration should be intented for local execution (multicast IP finder) > and the second needs to be AWS oriented. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (IGNITE-4212) Ignite Benchmarking Simplification and Automation
[ https://issues.apache.org/jira/browse/IGNITE-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15818867#comment-15818867 ] Oleg Ostanin commented on IGNITE-4212: -- [~dmagda] Do you have any suggestion about default configuration for running benchmarks on AWS? How many instances, which instance type it should be? > Ignite Benchmarking Simplification and Automation > - > > Key: IGNITE-4212 > URL: https://issues.apache.org/jira/browse/IGNITE-4212 > Project: Ignite > Issue Type: Task >Reporter: Denis Magda >Assignee: Oleg Ostanin > Fix For: 2.0 > > > There is a plenty of useful Yardstick benchmarks located in ignite-yardstick > module that is used by the community to check Ignite performance across > deployments of different configurations. > However, it's not easy to start with the benchmarking process because the > user needs to download Ignite, build and set up benchmarks and only after > that run them. > The goal of this task is to simplify the process in the following way: > 1) ignite-yardstick benchmarks have to be pre-compiled and available with > every Ignite deliverable. > 2) every deliverable must contain an executable (bat or sh file) with a clear > instruction on how to start a specific benchmark from the console. > 3) the executable has to use some default yardstick configuration. The first > configuration should be intented for local execution (multicast IP finder) > and the second needs to be AWS oriented. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (IGNITE-4212) Ignite Benchmarking Simplification and Automation
[ https://issues.apache.org/jira/browse/IGNITE-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15815861#comment-15815861 ] Oleg Ostanin commented on IGNITE-4212: -- I'm working on executable files to run benchmarks on aws. > Ignite Benchmarking Simplification and Automation > - > > Key: IGNITE-4212 > URL: https://issues.apache.org/jira/browse/IGNITE-4212 > Project: Ignite > Issue Type: Task >Reporter: Denis Magda >Assignee: Oleg Ostanin > Fix For: 2.0 > > > There is a plenty of useful Yardstick benchmarks located in ignite-yardstick > module that is used by the community to check Ignite performance across > deployments of different configurations. > However, it's not easy to start with the benchmarking process because the > user needs to download Ignite, build and set up benchmarks and only after > that run them. > The goal of this task is to simplify the process in the following way: > 1) ignite-yardstick benchmarks have to be pre-compiled and available with > every Ignite deliverable. > 2) every deliverable must contain an executable (bat or sh file) with a clear > instruction on how to start a specific benchmark from the console. > 3) the executable has to use some default yardstick configuration. The first > configuration should be intented for local execution (multicast IP finder) > and the second needs to be AWS oriented. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (IGNITE-4212) Ignite Benchmarking Simplification and Automation
[ https://issues.apache.org/jira/browse/IGNITE-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15787876#comment-15787876 ] Oleg Ostanin commented on IGNITE-4212: -- Added DEVNOTES.txt to the source directoiry > Ignite Benchmarking Simplification and Automation > - > > Key: IGNITE-4212 > URL: https://issues.apache.org/jira/browse/IGNITE-4212 > Project: Ignite > Issue Type: Task >Reporter: Denis Magda >Assignee: Oleg Ostanin > Fix For: 2.0 > > > There is a plenty of useful Yardstick benchmarks located in ignite-yardstick > module that is used by the community to check Ignite performance across > deployments of different configurations. > However, it's not easy to start with the benchmarking process because the > user needs to download Ignite, build and set up benchmarks and only after > that run them. > The goal of this task is to simplify the process in the following way: > 1) ignite-yardstick benchmarks have to be pre-compiled and available with > every Ignite deliverable. > 2) every deliverable must contain an executable (bat or sh file) with a clear > instruction on how to start a specific benchmark from the console. > 3) the executable has to use some default yardstick configuration. The first > configuration should be intented for local execution (multicast IP finder) > and the second needs to be AWS oriented. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (IGNITE-4212) Ignite Benchmarking Simplification and Automation
[ https://issues.apache.org/jira/browse/IGNITE-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15785637#comment-15785637 ] Oleg Ostanin commented on IGNITE-4212: -- I decided to name directory containing source files "source" and put "src" directory in it along with pom.xml file. > Ignite Benchmarking Simplification and Automation > - > > Key: IGNITE-4212 > URL: https://issues.apache.org/jira/browse/IGNITE-4212 > Project: Ignite > Issue Type: Task >Reporter: Denis Magda >Assignee: Oleg Ostanin > Fix For: 2.0 > > > There is a plenty of useful Yardstick benchmarks located in ignite-yardstick > module that is used by the community to check Ignite performance across > deployments of different configurations. > However, it's not easy to start with the benchmarking process because the > user needs to download Ignite, build and set up benchmarks and only after > that run them. > The goal of this task is to simplify the process in the following way: > 1) ignite-yardstick benchmarks have to be pre-compiled and available with > every Ignite deliverable. > 2) every deliverable must contain an executable (bat or sh file) with a clear > instruction on how to start a specific benchmark from the console. > 3) the executable has to use some default yardstick configuration. The first > configuration should be intented for local execution (multicast IP finder) > and the second needs to be AWS oriented. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (IGNITE-4212) Ignite Benchmarking Simplification and Automation
[ https://issues.apache.org/jira/browse/IGNITE-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15783249#comment-15783249 ] Oleg Ostanin commented on IGNITE-4212: -- Thank you for your response. I have placed source files in the release-package/benchmarks directory along with compiled module. > Ignite Benchmarking Simplification and Automation > - > > Key: IGNITE-4212 > URL: https://issues.apache.org/jira/browse/IGNITE-4212 > Project: Ignite > Issue Type: Task >Reporter: Denis Magda >Assignee: Oleg Ostanin > Fix For: 2.0 > > > There is a plenty of useful Yardstick benchmarks located in ignite-yardstick > module that is used by the community to check Ignite performance across > deployments of different configurations. > However, it's not easy to start with the benchmarking process because the > user needs to download Ignite, build and set up benchmarks and only after > that run them. > The goal of this task is to simplify the process in the following way: > 1) ignite-yardstick benchmarks have to be pre-compiled and available with > every Ignite deliverable. > 2) every deliverable must contain an executable (bat or sh file) with a clear > instruction on how to start a specific benchmark from the console. > 3) the executable has to use some default yardstick configuration. The first > configuration should be intented for local execution (multicast IP finder) > and the second needs to be AWS oriented. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (IGNITE-4212) Ignite Benchmarking Simplification and Automation
[ https://issues.apache.org/jira/browse/IGNITE-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15780407#comment-15780407 ] Oleg Ostanin commented on IGNITE-4212: -- [~dmagda] I've sent a message to the dev list about removing some configuration files from compiled module. Please look and tell me what do you think about this subject. > Ignite Benchmarking Simplification and Automation > - > > Key: IGNITE-4212 > URL: https://issues.apache.org/jira/browse/IGNITE-4212 > Project: Ignite > Issue Type: Task >Reporter: Denis Magda >Assignee: Oleg Ostanin > Fix For: 2.0 > > > There is a plenty of useful Yardstick benchmarks located in ignite-yardstick > module that is used by the community to check Ignite performance across > deployments of different configurations. > However, it's not easy to start with the benchmarking process because the > user needs to download Ignite, build and set up benchmarks and only after > that run them. > The goal of this task is to simplify the process in the following way: > 1) ignite-yardstick benchmarks have to be pre-compiled and available with > every Ignite deliverable. > 2) every deliverable must contain an executable (bat or sh file) with a clear > instruction on how to start a specific benchmark from the console. > 3) the executable has to use some default yardstick configuration. The first > configuration should be intented for local execution (multicast IP finder) > and the second needs to be AWS oriented. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (IGNITE-4212) Ignite Benchmarking Simplification and Automation
[ https://issues.apache.org/jira/browse/IGNITE-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15772614#comment-15772614 ] Oleg Ostanin commented on IGNITE-4212: -- Thank you for your comment, I renamed the subtasks. > Ignite Benchmarking Simplification and Automation > - > > Key: IGNITE-4212 > URL: https://issues.apache.org/jira/browse/IGNITE-4212 > Project: Ignite > Issue Type: Task >Reporter: Denis Magda >Assignee: Oleg Ostanin > Fix For: 2.0 > > > There is a plenty of useful Yardstick benchmarks located in ignite-yardstick > module that is used by the community to check Ignite performance across > deployments of different configurations. > However, it's not easy to start with the benchmarking process because the > user needs to download Ignite, build and set up benchmarks and only after > that run them. > The goal of this task is to simplify the process in the following way: > 1) ignite-yardstick benchmarks have to be pre-compiled and available with > every Ignite deliverable. > 2) every deliverable must contain an executable (bat or sh file) with a clear > instruction on how to start a specific benchmark from the console. > 3) the executable has to use some default yardstick configuration. The first > configuration should be intented for local execution (multicast IP finder) > and the second needs to be AWS oriented. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (IGNITE-4212) Ignite Benchmarking Simplification and Automation
[ https://issues.apache.org/jira/browse/IGNITE-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15769841#comment-15769841 ] Anton Vinogradov commented on IGNITE-4212: -- Oleg, we should name subtasks in proper way. Now I see 3 "Part of IGNITE-4212" and it's impossible to understand what these tasks responsible for. > Ignite Benchmarking Simplification and Automation > - > > Key: IGNITE-4212 > URL: https://issues.apache.org/jira/browse/IGNITE-4212 > Project: Ignite > Issue Type: Task >Reporter: Denis Magda >Assignee: Oleg Ostanin > Fix For: 2.0 > > > There is a plenty of useful Yardstick benchmarks located in ignite-yardstick > module that is used by the community to check Ignite performance across > deployments of different configurations. > However, it's not easy to start with the benchmarking process because the > user needs to download Ignite, build and set up benchmarks and only after > that run them. > The goal of this task is to simplify the process in the following way: > 1) ignite-yardstick benchmarks have to be pre-compiled and available with > every Ignite deliverable. > 2) every deliverable must contain an executable (bat or sh file) with a clear > instruction on how to start a specific benchmark from the console. > 3) the executable has to use some default yardstick configuration. The first > configuration should be intented for local execution (multicast IP finder) > and the second needs to be AWS oriented. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (IGNITE-4212) Ignite Benchmarking Simplification and Automation
[ https://issues.apache.org/jira/browse/IGNITE-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15769805#comment-15769805 ] Oleg Ostanin commented on IGNITE-4212: -- I divided original task into three smaller subtasks to resolve each step individually. > Ignite Benchmarking Simplification and Automation > - > > Key: IGNITE-4212 > URL: https://issues.apache.org/jira/browse/IGNITE-4212 > Project: Ignite > Issue Type: Task >Reporter: Denis Magda >Assignee: Oleg Ostanin > Fix For: 2.0 > > > There is a plenty of useful Yardstick benchmarks located in ignite-yardstick > module that is used by the community to check Ignite performance across > deployments of different configurations. > However, it's not easy to start with the benchmarking process because the > user needs to download Ignite, build and set up benchmarks and only after > that run them. > The goal of this task is to simplify the process in the following way: > 1) ignite-yardstick benchmarks have to be pre-compiled and available with > every Ignite deliverable. > 2) every deliverable must contain an executable (bat or sh file) with a clear > instruction on how to start a specific benchmark from the console. > 3) the executable has to use some default yardstick configuration. The first > configuration should be intented for local execution (multicast IP finder) > and the second needs to be AWS oriented. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (IGNITE-4212) Ignite Benchmarking Simplification and Automation
[ https://issues.apache.org/jira/browse/IGNITE-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15767266#comment-15767266 ] Oleg Ostanin commented on IGNITE-4212: -- [~dmagda] Thank you for your help. I'll place the compiled ignite-yardstick module and all the scripts in the new benchmarks folder. > Ignite Benchmarking Simplification and Automation > - > > Key: IGNITE-4212 > URL: https://issues.apache.org/jira/browse/IGNITE-4212 > Project: Ignite > Issue Type: Task >Reporter: Denis Magda >Assignee: Oleg Ostanin > Fix For: 2.0 > > > There is a plenty of useful Yardstick benchmarks located in ignite-yardstick > module that is used by the community to check Ignite performance across > deployments of different configurations. > However, it's not easy to start with the benchmarking process because the > user needs to download Ignite, build and set up benchmarks and only after > that run them. > The goal of this task is to simplify the process in the following way: > 1) ignite-yardstick benchmarks have to be pre-compiled and available with > every Ignite deliverable. > 2) every deliverable must contain an executable (bat or sh file) with a clear > instruction on how to start a specific benchmark from the console. > 3) the executable has to use some default yardstick configuration. The first > configuration should be intented for local execution (multicast IP finder) > and the second needs to be AWS oriented. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (IGNITE-4212) Ignite Benchmarking Simplification and Automation
[ https://issues.apache.org/jira/browse/IGNITE-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15765156#comment-15765156 ] Denis Magda commented on IGNITE-4212: - Oleg, we already create AMIs for AWS (https://apacheignite.readme.io/docs/aws-deployment). When this feature is released all the benchmark will be a part of it. > Ignite Benchmarking Simplification and Automation > - > > Key: IGNITE-4212 > URL: https://issues.apache.org/jira/browse/IGNITE-4212 > Project: Ignite > Issue Type: Task >Reporter: Denis Magda >Assignee: Oleg Ostanin > Fix For: 2.0 > > > There is a plenty of useful Yardstick benchmarks located in ignite-yardstick > module that is used by the community to check Ignite performance across > deployments of different configurations. > However, it's not easy to start with the benchmarking process because the > user needs to download Ignite, build and set up benchmarks and only after > that run them. > The goal of this task is to simplify the process in the following way: > 1) ignite-yardstick benchmarks have to be pre-compiled and available with > every Ignite deliverable. > 2) every deliverable must contain an executable (bat or sh file) with a clear > instruction on how to start a specific benchmark from the console. > 3) the executable has to use some default yardstick configuration. The first > configuration should be intented for local execution (multicast IP finder) > and the second needs to be AWS oriented. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (IGNITE-4212) Ignite Benchmarking Simplification and Automation
[ https://issues.apache.org/jira/browse/IGNITE-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15765151#comment-15765151 ] Denis Magda commented on IGNITE-4212: - Summarizing the discussion happened on the dev list. Let's reconsider the task a bit. We need to create "benchmarks" folder and put it under the root of an Apache Ignite distribution. The structure of this folder is shown below. apache_ignite_root_folder -- bin -- examples ... -- benchmarks — bin (contains scripts needed to run the benchmarks) — src (contains benchmarks sources and a pom.xml in order to create a project in an IDE instantaneously) — config (configs for amazon and well as for local benchmarks execution) — libs (compiled and ready-to-run benchmarks) — README.txt (instructions how to run the benchmarks) More details can be found here. > Ignite Benchmarking Simplification and Automation > - > > Key: IGNITE-4212 > URL: https://issues.apache.org/jira/browse/IGNITE-4212 > Project: Ignite > Issue Type: Task >Reporter: Denis Magda >Assignee: Oleg Ostanin > Fix For: 2.0 > > > There is a plenty of useful Yardstick benchmarks located in ignite-yardstick > module that is used by the community to check Ignite performance across > deployments of different configurations. > However, it's not easy to start with the benchmarking process because the > user needs to download Ignite, build and set up benchmarks and only after > that run them. > The goal of this task is to simplify the process in the following way: > 1) ignite-yardstick benchmarks have to be pre-compiled and available with > every Ignite deliverable. > 2) every deliverable must contain an executable (bat or sh file) with a clear > instruction on how to start a specific benchmark from the console. > 3) the executable has to use some default yardstick configuration. The first > configuration should be intented for local execution (multicast IP finder) > and the second needs to be AWS oriented. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (IGNITE-4212) Ignite Benchmarking Simplification and Automation
[ https://issues.apache.org/jira/browse/IGNITE-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15764524#comment-15764524 ] Oleg Ostanin commented on IGNITE-4212: -- I've managed to run a compiled ignite-yardstick module on AWS and for now it takes some extra effort to configure instances after they have been started. I think if we want to make benchmarks run a single step operation we need to go further and create a custom properly pre-configured AMI. > Ignite Benchmarking Simplification and Automation > - > > Key: IGNITE-4212 > URL: https://issues.apache.org/jira/browse/IGNITE-4212 > Project: Ignite > Issue Type: Task >Reporter: Denis Magda >Assignee: Oleg Ostanin > Fix For: 2.0 > > > There is a plenty of useful Yardstick benchmarks located in ignite-yardstick > module that is used by the community to check Ignite performance across > deployments of different configurations. > However, it's not easy to start with the benchmarking process because the > user needs to download Ignite, build and set up benchmarks and only after > that run them. > The goal of this task is to simplify the process in the following way: > 1) ignite-yardstick benchmarks have to be pre-compiled and available with > every Ignite deliverable. > 2) every deliverable must contain an executable (bat or sh file) with a clear > instruction on how to start a specific benchmark from the console. > 3) the executable has to use some default yardstick configuration. The first > configuration should be intented for local execution (multicast IP finder) > and the second needs to be AWS oriented. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (IGNITE-4212) Ignite Benchmarking Simplification and Automation
[ https://issues.apache.org/jira/browse/IGNITE-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15761530#comment-15761530 ] Oleg Ostanin commented on IGNITE-4212: -- [~dmagda] There is a good suggestion to create a new directory named "Extras" and put compiled Ignite-Yardstick module in it. What do you think? > Ignite Benchmarking Simplification and Automation > - > > Key: IGNITE-4212 > URL: https://issues.apache.org/jira/browse/IGNITE-4212 > Project: Ignite > Issue Type: Task >Reporter: Denis Magda >Assignee: Oleg Ostanin > Fix For: 2.0 > > > There is a plenty of useful Yardstick benchmarks located in ignite-yardstick > module that is used by the community to check Ignite performance across > deployments of different configurations. > However, it's not easy to start with the benchmarking process because the > user needs to download Ignite, build and set up benchmarks and only after > that run them. > The goal of this task is to simplify the process in the following way: > 1) ignite-yardstick benchmarks have to be pre-compiled and available with > every Ignite deliverable. > 2) every deliverable must contain an executable (bat or sh file) with a clear > instruction on how to start a specific benchmark from the console. > 3) the executable has to use some default yardstick configuration. The first > configuration should be intented for local execution (multicast IP finder) > and the second needs to be AWS oriented. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (IGNITE-4212) Ignite Benchmarking Simplification and Automation
[ https://issues.apache.org/jira/browse/IGNITE-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15753874#comment-15753874 ] Oleg Ostanin commented on IGNITE-4212: -- [~dmagda] Thank you for your advise. I'v send the message. Meanwhile I'm working on module integration and documentation. > Ignite Benchmarking Simplification and Automation > - > > Key: IGNITE-4212 > URL: https://issues.apache.org/jira/browse/IGNITE-4212 > Project: Ignite > Issue Type: Task >Reporter: Denis Magda >Assignee: Oleg Ostanin > Fix For: 2.0 > > > There is a plenty of useful Yardstick benchmarks located in ignite-yardstick > module that is used by the community to check Ignite performance across > deployments of different configurations. > However, it's not easy to start with the benchmarking process because the > user needs to download, build, set up and only after that run the benchmarks. > The goal of this task is to simplify the process in the following way: > 1) ignite-yardstick benchmarks have to be pre-compiled and available with > every Ignite deliverable. > 2) every deliverable must contain an executable (bat or sh file) with a clear > instruction on how to start a specific benchmark from the console. > 3) the executable has use some default yardstick configuration that > apparently should be AWS oriented. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (IGNITE-4212) Ignite Benchmarking Simplification and Automation
[ https://issues.apache.org/jira/browse/IGNITE-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15751906#comment-15751906 ] Denis Magda commented on IGNITE-4212: - I'm ok with the "optional" dir. However, I would recommend to ask for an opinion of the community by sending a message to the dev list. > Ignite Benchmarking Simplification and Automation > - > > Key: IGNITE-4212 > URL: https://issues.apache.org/jira/browse/IGNITE-4212 > Project: Ignite > Issue Type: Task >Reporter: Denis Magda >Assignee: Oleg Ostanin > Fix For: 2.0 > > > There is a plenty of useful Yardstick benchmarks located in ignite-yardstick > module that is used by the community to check Ignite performance across > deployments of different configurations. > However, it's not easy to start with the benchmarking process because the > user needs to download, build, set up and only after that run the benchmarks. > The goal of this task is to simplify the process in the following way: > 1) ignite-yardstick benchmarks have to be pre-compiled and available with > every Ignite deliverable. > 2) every deliverable must contain an executable (bat or sh file) with a clear > instruction on how to start a specific benchmark from the console. > 3) the executable has use some default yardstick configuration that > apparently should be AWS oriented. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (IGNITE-4212) Ignite Benchmarking Simplification and Automation
[ https://issues.apache.org/jira/browse/IGNITE-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15750814#comment-15750814 ] Oleg Ostanin commented on IGNITE-4212: -- [~dmagda] Where do you think is the most appropriate place to put a compiled yardstick module in the apache-ignite binary assembly? We can put it in the libs/optional along with an others optional libraries or we can create a new directory named "tools" in the root directory and put "ignite-yardstick" in it. > Ignite Benchmarking Simplification and Automation > - > > Key: IGNITE-4212 > URL: https://issues.apache.org/jira/browse/IGNITE-4212 > Project: Ignite > Issue Type: Task >Reporter: Denis Magda >Assignee: Oleg Ostanin > Fix For: 2.0 > > > There is a plenty of useful Yardstick benchmarks located in ignite-yardstick > module that is used by the community to check Ignite performance across > deployments of different configurations. > However, it's not easy to start with the benchmarking process because the > user needs to download, build, set up and only after that run the benchmarks. > The goal of this task is to simplify the process in the following way: > 1) ignite-yardstick benchmarks have to be pre-compiled and available with > every Ignite deliverable. > 2) every deliverable must contain an executable (bat or sh file) with a clear > instruction on how to start a specific benchmark from the console. > 3) the executable has use some default yardstick configuration that > apparently should be AWS oriented. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
