[jira] [Commented] (SOLR-13155) CLI tool for testing autoscaling suggestions against a live cluster
[ https://issues.apache.org/jira/browse/SOLR-13155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16768074#comment-16768074 ] ASF subversion and git services commented on SOLR-13155: Commit 34117c0688e3058353157dd093e1d92490cfdd1b in lucene-solr's branch refs/heads/branch_8_0 from Andrzej Bialecki [ https://gitbox.apache.org/repos/asf?p=lucene-solr.git;h=34117c0 ] SOLR-13155: Minor addition to the "stats" section to make it easier to estimate the distribution of cores across nodes. > CLI tool for testing autoscaling suggestions against a live cluster > --- > > Key: SOLR-13155 > URL: https://issues.apache.org/jira/browse/SOLR-13155 > Project: Solr > Issue Type: Improvement > Security Level: Public(Default Security Level. Issues are Public) > Components: AutoScaling >Reporter: Andrzej Bialecki >Assignee: Andrzej Bialecki >Priority: Major > Fix For: 8.0, master (9.0) > > Attachments: SOLR-13155.patch, SOLR-13155.patch, SOLR-13155.patch > > > Solr already provides /autoscaling/diagnostics and /autoscaling/suggestions > endpoints. In some situations it would be very helpful to be able to run > "what if" scenarios using data about nodes and replicas taken from a > production cluster but with a different autoscaling policy than the one that > is deployed, without also worrying that the calculations would negatively > impact a production cluster's Overseer leader. > All necessary classes (including the Policy engine) are self-contained in the > SolrJ component, so it's just a matter of packaging and writing a CLI tool + > a wrapper script. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-13155) CLI tool for testing autoscaling suggestions against a live cluster
[ https://issues.apache.org/jira/browse/SOLR-13155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16768072#comment-16768072 ] ASF subversion and git services commented on SOLR-13155: Commit abcda8282c8cdff66ff00e4476de7926a9ec0587 in lucene-solr's branch refs/heads/master from Andrzej Bialecki [ https://gitbox.apache.org/repos/asf?p=lucene-solr.git;h=abcda82 ] SOLR-13155: Minor addition to the "stats" section to make it easier to estimate the distribution of cores across nodes. > CLI tool for testing autoscaling suggestions against a live cluster > --- > > Key: SOLR-13155 > URL: https://issues.apache.org/jira/browse/SOLR-13155 > Project: Solr > Issue Type: Improvement > Security Level: Public(Default Security Level. Issues are Public) > Components: AutoScaling >Reporter: Andrzej Bialecki >Assignee: Andrzej Bialecki >Priority: Major > Fix For: 8.0, master (9.0) > > Attachments: SOLR-13155.patch, SOLR-13155.patch, SOLR-13155.patch > > > Solr already provides /autoscaling/diagnostics and /autoscaling/suggestions > endpoints. In some situations it would be very helpful to be able to run > "what if" scenarios using data about nodes and replicas taken from a > production cluster but with a different autoscaling policy than the one that > is deployed, without also worrying that the calculations would negatively > impact a production cluster's Overseer leader. > All necessary classes (including the Policy engine) are self-contained in the > SolrJ component, so it's just a matter of packaging and writing a CLI tool + > a wrapper script. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-13155) CLI tool for testing autoscaling suggestions against a live cluster
[ https://issues.apache.org/jira/browse/SOLR-13155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16768073#comment-16768073 ] ASF subversion and git services commented on SOLR-13155: Commit b6ebc748c9edfbbbdf97da763e83f8d5496e8e8c in lucene-solr's branch refs/heads/branch_8x from Andrzej Bialecki [ https://gitbox.apache.org/repos/asf?p=lucene-solr.git;h=b6ebc74 ] SOLR-13155: Minor addition to the "stats" section to make it easier to estimate the distribution of cores across nodes. > CLI tool for testing autoscaling suggestions against a live cluster > --- > > Key: SOLR-13155 > URL: https://issues.apache.org/jira/browse/SOLR-13155 > Project: Solr > Issue Type: Improvement > Security Level: Public(Default Security Level. Issues are Public) > Components: AutoScaling >Reporter: Andrzej Bialecki >Assignee: Andrzej Bialecki >Priority: Major > Fix For: 8.0, master (9.0) > > Attachments: SOLR-13155.patch, SOLR-13155.patch, SOLR-13155.patch > > > Solr already provides /autoscaling/diagnostics and /autoscaling/suggestions > endpoints. In some situations it would be very helpful to be able to run > "what if" scenarios using data about nodes and replicas taken from a > production cluster but with a different autoscaling policy than the one that > is deployed, without also worrying that the calculations would negatively > impact a production cluster's Overseer leader. > All necessary classes (including the Policy engine) are self-contained in the > SolrJ component, so it's just a matter of packaging and writing a CLI tool + > a wrapper script. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-13155) CLI tool for testing autoscaling suggestions against a live cluster
[ https://issues.apache.org/jira/browse/SOLR-13155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16767336#comment-16767336 ] ASF subversion and git services commented on SOLR-13155: Commit 1b6c8fa95ba8c5b0646f599132c8ffd20c697e72 in lucene-solr's branch refs/heads/branch_8_0 from Jason Gerlowski [ https://gitbox.apache.org/repos/asf?p=lucene-solr.git;h=1b6c8fa ] SOLR-13241: Add 'autoscaling' tool to solr.cmd Prior to this commit, SOLR-13155 added support for an 'autoscaling' tool to bin/solr, but not to the Windows equivalent bin/solr.cmd. This commit adds the necessary plumbing to the Windows version of this script. It also removes some dead help-text from the bin/solr script. > CLI tool for testing autoscaling suggestions against a live cluster > --- > > Key: SOLR-13155 > URL: https://issues.apache.org/jira/browse/SOLR-13155 > Project: Solr > Issue Type: Improvement > Security Level: Public(Default Security Level. Issues are Public) > Components: AutoScaling >Reporter: Andrzej Bialecki >Assignee: Andrzej Bialecki >Priority: Major > Fix For: 8.0, master (9.0) > > Attachments: SOLR-13155.patch, SOLR-13155.patch, SOLR-13155.patch > > > Solr already provides /autoscaling/diagnostics and /autoscaling/suggestions > endpoints. In some situations it would be very helpful to be able to run > "what if" scenarios using data about nodes and replicas taken from a > production cluster but with a different autoscaling policy than the one that > is deployed, without also worrying that the calculations would negatively > impact a production cluster's Overseer leader. > All necessary classes (including the Policy engine) are self-contained in the > SolrJ component, so it's just a matter of packaging and writing a CLI tool + > a wrapper script. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-13155) CLI tool for testing autoscaling suggestions against a live cluster
[ https://issues.apache.org/jira/browse/SOLR-13155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16767334#comment-16767334 ] ASF subversion and git services commented on SOLR-13155: Commit a6f9f53ce590238e0496415bb1e6ac7bc603d304 in lucene-solr's branch refs/heads/branch_8x from Jason Gerlowski [ https://gitbox.apache.org/repos/asf?p=lucene-solr.git;h=a6f9f53 ] SOLR-13241: Add 'autoscaling' tool to solr.cmd Prior to this commit, SOLR-13155 added support for an 'autoscaling' tool to bin/solr, but not to the Windows equivalent bin/solr.cmd. This commit adds the necessary plumbing to the Windows version of this script. It also removes some dead help-text from the bin/solr script. > CLI tool for testing autoscaling suggestions against a live cluster > --- > > Key: SOLR-13155 > URL: https://issues.apache.org/jira/browse/SOLR-13155 > Project: Solr > Issue Type: Improvement > Security Level: Public(Default Security Level. Issues are Public) > Components: AutoScaling >Reporter: Andrzej Bialecki >Assignee: Andrzej Bialecki >Priority: Major > Fix For: 8.0, master (9.0) > > Attachments: SOLR-13155.patch, SOLR-13155.patch, SOLR-13155.patch > > > Solr already provides /autoscaling/diagnostics and /autoscaling/suggestions > endpoints. In some situations it would be very helpful to be able to run > "what if" scenarios using data about nodes and replicas taken from a > production cluster but with a different autoscaling policy than the one that > is deployed, without also worrying that the calculations would negatively > impact a production cluster's Overseer leader. > All necessary classes (including the Policy engine) are self-contained in the > SolrJ component, so it's just a matter of packaging and writing a CLI tool + > a wrapper script. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-13155) CLI tool for testing autoscaling suggestions against a live cluster
[ https://issues.apache.org/jira/browse/SOLR-13155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16767331#comment-16767331 ] ASF subversion and git services commented on SOLR-13155: Commit a084cc1e3304e826e58702c67f18294d49dcfcc6 in lucene-solr's branch refs/heads/master from Jason Gerlowski [ https://gitbox.apache.org/repos/asf?p=lucene-solr.git;h=a084cc1 ] SOLR-13241: Add 'autoscaling' tool to solr.cmd Prior to this commit, SOLR-13155 added support for an 'autoscaling' tool to bin/solr, but not to the Windows equivalent bin/solr.cmd. This commit adds the necessary plumbing to the Windows version of this script. It also removes some dead help-text from the bin/solr script. > CLI tool for testing autoscaling suggestions against a live cluster > --- > > Key: SOLR-13155 > URL: https://issues.apache.org/jira/browse/SOLR-13155 > Project: Solr > Issue Type: Improvement > Security Level: Public(Default Security Level. Issues are Public) > Components: AutoScaling >Reporter: Andrzej Bialecki >Assignee: Andrzej Bialecki >Priority: Major > Fix For: 8.0, master (9.0) > > Attachments: SOLR-13155.patch, SOLR-13155.patch, SOLR-13155.patch > > > Solr already provides /autoscaling/diagnostics and /autoscaling/suggestions > endpoints. In some situations it would be very helpful to be able to run > "what if" scenarios using data about nodes and replicas taken from a > production cluster but with a different autoscaling policy than the one that > is deployed, without also worrying that the calculations would negatively > impact a production cluster's Overseer leader. > All necessary classes (including the Policy engine) are self-contained in the > SolrJ component, so it's just a matter of packaging and writing a CLI tool + > a wrapper script. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-13155) CLI tool for testing autoscaling suggestions against a live cluster
[
https://issues.apache.org/jira/browse/SOLR-13155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16767213#comment-16767213
]
Jason Gerlowski commented on SOLR-13155:
Great, I'll remove it as a part of SOLR-13241.
bq. I think the pattern for other CLI commands is that there is some (partial)
validation of the arguments in the script and the remaining part is done in
Java. In this case it's perfectly valid to call this tool without any arguments
Yeah, it's a bit confusing with the two different tool-patterns we have right
now. As I understand things the difference is less about having a valid 0-arg
usage, and more around a decision that was made at some point to put as little
new code in {{bin/solr}} and {{bin/solr.cmd}} as we can get away with. e.g.
the {{config}} tool has required arguments but does all arg parsing in
Java.Windows-script is impossible to maintain. Even if it was a more
well-known language there's still the issue of duplicating logic that could
just live in one place. So all the newer tools do arg-parsing in Java afaik.
> CLI tool for testing autoscaling suggestions against a live cluster
> ---
>
> Key: SOLR-13155
> URL: https://issues.apache.org/jira/browse/SOLR-13155
> Project: Solr
> Issue Type: Improvement
> Security Level: Public(Default Security Level. Issues are Public)
> Components: AutoScaling
>Reporter: Andrzej Bialecki
>Assignee: Andrzej Bialecki
>Priority: Major
> Fix For: 8.0, master (9.0)
>
> Attachments: SOLR-13155.patch, SOLR-13155.patch, SOLR-13155.patch
>
>
> Solr already provides /autoscaling/diagnostics and /autoscaling/suggestions
> endpoints. In some situations it would be very helpful to be able to run
> "what if" scenarios using data about nodes and replicas taken from a
> production cluster but with a different autoscaling policy than the one that
> is deployed, without also worrying that the calculations would negatively
> impact a production cluster's Overseer leader.
> All necessary classes (including the Policy engine) are self-contained in the
> SolrJ component, so it's just a matter of packaging and writing a CLI tool +
> a wrapper script.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-13155) CLI tool for testing autoscaling suggestions against a live cluster
[ https://issues.apache.org/jira/browse/SOLR-13155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16767198#comment-16767198 ] Andrzej Bialecki commented on SOLR-13155: -- Hmm, indeed this is dead code now... I think the pattern for other CLI commands is that there is some (partial) validation of the arguments in the script and the remaining part is done in Java. In this case it's perfectly valid to call this tool without any arguments, so I guess we can defer all option parsing and the help message to Java. > CLI tool for testing autoscaling suggestions against a live cluster > --- > > Key: SOLR-13155 > URL: https://issues.apache.org/jira/browse/SOLR-13155 > Project: Solr > Issue Type: Improvement > Security Level: Public(Default Security Level. Issues are Public) > Components: AutoScaling >Reporter: Andrzej Bialecki >Assignee: Andrzej Bialecki >Priority: Major > Fix For: 8.0, master (9.0) > > Attachments: SOLR-13155.patch, SOLR-13155.patch, SOLR-13155.patch > > > Solr already provides /autoscaling/diagnostics and /autoscaling/suggestions > endpoints. In some situations it would be very helpful to be able to run > "what if" scenarios using data about nodes and replicas taken from a > production cluster but with a different autoscaling policy than the one that > is deployed, without also worrying that the calculations would negatively > impact a production cluster's Overseer leader. > All necessary classes (including the Policy engine) are self-contained in the > SolrJ component, so it's just a matter of packaging and writing a CLI tool + > a wrapper script. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-13155) CLI tool for testing autoscaling suggestions against a live cluster
[
https://issues.apache.org/jira/browse/SOLR-13155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16766434#comment-16766434
]
Jason Gerlowski commented on SOLR-13155:
Hey [~ab], took a look at your latest patch this morning while preparing to
write a Windows equivalent of the {{bin/solr}} bits you just added. One
question:
You add a {{print_usage}} section for the new autoscaling command...
{code}
+ elif [ "$CMD" == "autoscaling" ]; then
+echo ""
+echo "Usage: solr autoscaling [-z zkHost] [-a ]
[-s] [-d] [-n] [-r]"
+echo ""
+echo " Calculate autoscaling policy suggestions and diagnostic
information, using either the deployed"
+echo " autoscaling configuration or the one supplied on the command line.
This calculation takes place"
+echo " on the client-side without affecting the running cluster except
for fetching the node and replica"
+echo " metrics from the cluster. For detailed usage instructions, do:"
+echo ""
+echo "bin/solr autoscaling -help"
+echo ""
{code}
But I can't figure out what command would actually trigger this help text. The
"autoscaling" command defers parsing its args until Java-land, so any
{{-h}}/{{--help}}/etc. argument will trigger the commons-cli generated help
text instead:
{code}
➜ solr git:(master) ✗ bin/solr autoscaling -h
INFO - 2019-02-12 15:33:01.434;
org.apache.solr.util.configuration.SSLCredentialProviderFactory; Processing SSL
Credential Provider chain: env;sysprop
Failed to parse command-line arguments due to: Unrecognized option: -h
usage: org.apache.solr.util.SolrCLI
-a,--configAutoscaling config file, defaults to the one
deployed in the cluster.
-all Turn on all options to get all available
information.
-c,--clusterState Show ClusterState (collections layout)
-d,--diagnostics Show calculated diagnostics
-help Print this message
-n,--sortedNodes Show sorted nodes with diagnostics
-r,--redactRedact node and collection names (original names
will be consistently randomized)
-s,--suggestions Show calculated suggestions
-stats Show summarized collection & node statistics.
-verbose Generate verbose log messages
-zkHost Address of the Zookeeper ensemble; defaults to:
localhost:9983
{code}
Am I missing some command that manages to trigger that help text, or is it
dead-code that we can remove or change? (I'm only asking so I know whether to
include similar help text in the solr.cmd version. If the {{bin/solr}} help
text is dead code, I'm happy to remove it for you when I commit plumbing on the
Windows side tomorrow.)
> CLI tool for testing autoscaling suggestions against a live cluster
> ---
>
> Key: SOLR-13155
> URL: https://issues.apache.org/jira/browse/SOLR-13155
> Project: Solr
> Issue Type: Improvement
> Security Level: Public(Default Security Level. Issues are Public)
> Components: AutoScaling
>Reporter: Andrzej Bialecki
>Assignee: Andrzej Bialecki
>Priority: Major
> Fix For: 8.0, master (9.0)
>
> Attachments: SOLR-13155.patch, SOLR-13155.patch, SOLR-13155.patch
>
>
> Solr already provides /autoscaling/diagnostics and /autoscaling/suggestions
> endpoints. In some situations it would be very helpful to be able to run
> "what if" scenarios using data about nodes and replicas taken from a
> production cluster but with a different autoscaling policy than the one that
> is deployed, without also worrying that the calculations would negatively
> impact a production cluster's Overseer leader.
> All necessary classes (including the Policy engine) are self-contained in the
> SolrJ component, so it's just a matter of packaging and writing a CLI tool +
> a wrapper script.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-13155) CLI tool for testing autoscaling suggestions against a live cluster
[ https://issues.apache.org/jira/browse/SOLR-13155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16765928#comment-16765928 ] ASF subversion and git services commented on SOLR-13155: Commit 6a817b1c304bff9b9ca6d91f810d1c928ef761c5 in lucene-solr's branch refs/heads/branch_8_0 from Andrzej Bialecki [ https://gitbox.apache.org/repos/asf?p=lucene-solr.git;h=6a817b1 ] SOLR-13155: Add command-line option for testing autoscaling configurations. > CLI tool for testing autoscaling suggestions against a live cluster > --- > > Key: SOLR-13155 > URL: https://issues.apache.org/jira/browse/SOLR-13155 > Project: Solr > Issue Type: Improvement > Security Level: Public(Default Security Level. Issues are Public) > Components: AutoScaling >Reporter: Andrzej Bialecki >Assignee: Andrzej Bialecki >Priority: Major > Fix For: 8.0, master (9.0) > > Attachments: SOLR-13155.patch, SOLR-13155.patch, SOLR-13155.patch > > > Solr already provides /autoscaling/diagnostics and /autoscaling/suggestions > endpoints. In some situations it would be very helpful to be able to run > "what if" scenarios using data about nodes and replicas taken from a > production cluster but with a different autoscaling policy than the one that > is deployed, without also worrying that the calculations would negatively > impact a production cluster's Overseer leader. > All necessary classes (including the Policy engine) are self-contained in the > SolrJ component, so it's just a matter of packaging and writing a CLI tool + > a wrapper script. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-13155) CLI tool for testing autoscaling suggestions against a live cluster
[ https://issues.apache.org/jira/browse/SOLR-13155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16765926#comment-16765926 ] ASF subversion and git services commented on SOLR-13155: Commit 98cea5440f618ec2e3e63cf3f595ed34519a7d20 in lucene-solr's branch refs/heads/branch_8x from Andrzej Bialecki [ https://gitbox.apache.org/repos/asf?p=lucene-solr.git;h=98cea54 ] SOLR-13155: Add command-line option for testing autoscaling configurations. > CLI tool for testing autoscaling suggestions against a live cluster > --- > > Key: SOLR-13155 > URL: https://issues.apache.org/jira/browse/SOLR-13155 > Project: Solr > Issue Type: Improvement > Security Level: Public(Default Security Level. Issues are Public) > Components: AutoScaling >Reporter: Andrzej Bialecki >Assignee: Andrzej Bialecki >Priority: Major > Fix For: 8.0, master (9.0) > > Attachments: SOLR-13155.patch, SOLR-13155.patch, SOLR-13155.patch > > > Solr already provides /autoscaling/diagnostics and /autoscaling/suggestions > endpoints. In some situations it would be very helpful to be able to run > "what if" scenarios using data about nodes and replicas taken from a > production cluster but with a different autoscaling policy than the one that > is deployed, without also worrying that the calculations would negatively > impact a production cluster's Overseer leader. > All necessary classes (including the Policy engine) are self-contained in the > SolrJ component, so it's just a matter of packaging and writing a CLI tool + > a wrapper script. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-13155) CLI tool for testing autoscaling suggestions against a live cluster
[ https://issues.apache.org/jira/browse/SOLR-13155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16765925#comment-16765925 ] ASF subversion and git services commented on SOLR-13155: Commit 242ff88e0253e67cb97a9e17ded69dd50e917c55 in lucene-solr's branch refs/heads/master from Andrzej Bialecki [ https://gitbox.apache.org/repos/asf?p=lucene-solr.git;h=242ff88 ] SOLR-13155: Add command-line option for testing autoscaling configurations. > CLI tool for testing autoscaling suggestions against a live cluster > --- > > Key: SOLR-13155 > URL: https://issues.apache.org/jira/browse/SOLR-13155 > Project: Solr > Issue Type: Improvement > Security Level: Public(Default Security Level. Issues are Public) > Components: AutoScaling >Reporter: Andrzej Bialecki >Assignee: Andrzej Bialecki >Priority: Major > Fix For: 8.0, master (9.0) > > Attachments: SOLR-13155.patch, SOLR-13155.patch, SOLR-13155.patch > > > Solr already provides /autoscaling/diagnostics and /autoscaling/suggestions > endpoints. In some situations it would be very helpful to be able to run > "what if" scenarios using data about nodes and replicas taken from a > production cluster but with a different autoscaling policy than the one that > is deployed, without also worrying that the calculations would negatively > impact a production cluster's Overseer leader. > All necessary classes (including the Policy engine) are self-contained in the > SolrJ component, so it's just a matter of packaging and writing a CLI tool + > a wrapper script. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-13155) CLI tool for testing autoscaling suggestions against a live cluster
[ https://issues.apache.org/jira/browse/SOLR-13155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16765090#comment-16765090 ] Andrzej Bialecki commented on SOLR-13155: -- This patch adds more options: * dump the ClusterState * dump the aggregated collection and node statistics. If there are no objections I'm going to commit this, and I'll create a separate issue for hooking this up to the Windows script. > CLI tool for testing autoscaling suggestions against a live cluster > --- > > Key: SOLR-13155 > URL: https://issues.apache.org/jira/browse/SOLR-13155 > Project: Solr > Issue Type: Improvement > Security Level: Public(Default Security Level. Issues are Public) > Components: AutoScaling >Reporter: Andrzej Bialecki >Assignee: Andrzej Bialecki >Priority: Major > Fix For: 8.0, master (9.0) > > Attachments: SOLR-13155.patch, SOLR-13155.patch, SOLR-13155.patch > > > Solr already provides /autoscaling/diagnostics and /autoscaling/suggestions > endpoints. In some situations it would be very helpful to be able to run > "what if" scenarios using data about nodes and replicas taken from a > production cluster but with a different autoscaling policy than the one that > is deployed, without also worrying that the calculations would negatively > impact a production cluster's Overseer leader. > All necessary classes (including the Policy engine) are self-contained in the > SolrJ component, so it's just a matter of packaging and writing a CLI tool + > a wrapper script. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-13155) CLI tool for testing autoscaling suggestions against a live cluster
[ https://issues.apache.org/jira/browse/SOLR-13155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754034#comment-16754034 ] Andrzej Bialecki commented on SOLR-13155: -- Updated patch with some improvements in the RedactionUtils. I'll leave it here for now without committing - I need someone else to add the Windows script support. > CLI tool for testing autoscaling suggestions against a live cluster > --- > > Key: SOLR-13155 > URL: https://issues.apache.org/jira/browse/SOLR-13155 > Project: Solr > Issue Type: Improvement > Security Level: Public(Default Security Level. Issues are Public) > Components: AutoScaling >Reporter: Andrzej Bialecki >Assignee: Andrzej Bialecki >Priority: Major > Fix For: 8.0, master (9.0) > > Attachments: SOLR-13155.patch, SOLR-13155.patch > > > Solr already provides /autoscaling/diagnostics and /autoscaling/suggestions > endpoints. In some situations it would be very helpful to be able to run > "what if" scenarios using data about nodes and replicas taken from a > production cluster but with a different autoscaling policy than the one that > is deployed, without also worrying that the calculations would negatively > impact a production cluster's Overseer leader. > All necessary classes (including the Policy engine) are self-contained in the > SolrJ component, so it's just a matter of packaging and writing a CLI tool + > a wrapper script. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-13155) CLI tool for testing autoscaling suggestions against a live cluster
[
https://issues.apache.org/jira/browse/SOLR-13155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749848#comment-16749848
]
Andrzej Bialecki commented on SOLR-13155:
--
This patch implements a tool for getting the current suggestions / diagnostics
and/or testing the current cluster against the supplied autoscaling
configuration.
The tool is integrated into the SolrCLI suite, and hooked up to the {{bin/solr
autoscaling}} script.
One notable addition is a method in {{RedactionUtils}} for replacing collection
names and node names / IPs in the output data. You can see it in action when
you invoke the tool with the {{-r}} option:
{code}
...
{
"liveNodes":[
"N_1_solr",
"N_0_solr"],
"violations":[
{
"collection":"COLL_0",
"node":"N_1_solr",
"tagKey":"N_1_solr",
"violation":{
"replica":{
"NRT":2,
"count":2},
"delta":1.0},
"clause":{
"replica":"<2",
"shard":"#ANY",
"node":"#ANY",
"collection":"COLL_0"},
"violatingReplicas":[
{"core_node7":{
"core":"COLL_0_shard2_replica_n3",
"shard":"shard2",
"collection":"COLL_0",
"node_name":"N_1_solr",
"type":"NRT",
"leader":"true",
"base_url":"http://N_1/solr;,
"state":"active",
"force_set_state":"false",
"INDEX.sizeInGB":6.426125764846802E-8}},
{"core_node6":{
"core":"COLL_0_shard1_replica_n2",
"shard":"shard1",
"collection":"COLL_0",
"node_name":"N_1_solr",
"type":"NRT",
"leader":"true",
"base_url":"http://N_1/solr;,
"state":"active",
"force_set_state":"false",
"INDEX.sizeInGB":6.426125764846802E-8}}]},
...
{code}
TODO: hook up the tool to the Windows scripts. My {{COMMAND.COM}}-fu is nearly
nonexistent ;)
> CLI tool for testing autoscaling suggestions against a live cluster
> ---
>
> Key: SOLR-13155
> URL: https://issues.apache.org/jira/browse/SOLR-13155
> Project: Solr
> Issue Type: Improvement
> Security Level: Public(Default Security Level. Issues are Public)
> Components: AutoScaling
>Reporter: Andrzej Bialecki
>Assignee: Andrzej Bialecki
>Priority: Major
> Fix For: 8.0, master (9.0)
>
> Attachments: SOLR-13155.patch
>
>
> Solr already provides /autoscaling/diagnostics and /autoscaling/suggestions
> endpoints. In some situations it would be very helpful to be able to run
> "what if" scenarios using data about nodes and replicas taken from a
> production cluster but with a different autoscaling policy than the one that
> is deployed, without also worrying that the calculations would negatively
> impact a production cluster's Overseer leader.
> All necessary classes (including the Policy engine) are self-contained in the
> SolrJ component, so it's just a matter of packaging and writing a CLI tool +
> a wrapper script.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
