Re: [openstack-dev] [swift] a way of checking replicate completion on swift cluster
Thank you for the response. I updated the following patch with the idea. https://review.openstack.org/#/c/138342/ On Friday, December 05, 2014 5:50 AM, Clay Gerrard wrote: > more fidelity in the recon's seems fine, statsd emissions are > also a popular target >for telemetry radiation. Thanks again! Hisashi Osanai ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [swift] a way of checking replicate completion on swift cluster
more fidelity in the recon's seems fine, statsd emissions are also a
popular target for telemetry radiation.
On Thu, Nov 27, 2014 at 5:01 AM, Osanai, Hisashi <
osanai.hisa...@jp.fujitsu.com> wrote:
>
> Hi,
>
> I think it is a good idea to have the object-replicator's failure info
> in recon like the other replicators.
>
> I think the following info can be added in object-replicator in addition to
> "object_replication_last" and "object_replication_time".
>
> If there is any technical reason to not add them, I can make it. What do
> you think?
>
> {
> "replication_last": 1416334368.60865,
> "replication_stats": {
> "attempted": 13346,
> "empty": 0,
> "failure": 870,
> "failure_nodes": {"192.168.0.1": 3,
> "192.168.0.2": 860,
> "192.168.0.3": 7},
> "hashmatch": 0,
> "remove": 0,
> "start": 1416354240.9761429,
> "success": 1908
> "ts_repl": 0
> },
> "replication_time": 2316.5563162644703,
> "object_replication_last": 1416334368.60865,
> "object_replication_time": 2316.5563162644703
> }
>
> Cheers,
> Hisashi Osanai
>
> On Tuesday, November 25, 2014 4:37 PM, Matsuda, Kenichiro [mailto:
> matsuda_keni...@jp.fujitsu.com] wrote:
> > I understood that the logs are necessary to judge whether no failure on
> > object-replicator.
> > And also, I thought that the recon info of object-replicator having
> failure
> > (just like the recon info of account-replicator and container-replicator)
> > is useful.
> > Are there any reason to not included failure in recon?
>
> On Tuesday, November 25, 2014 5:53 AM, Clay Gerrard [mailto:
> clay.gerr...@gmail.com] wrote:
> > > replication logs
>
> On Friday, November 21, 2014 4:22 AM, Clay Gerrard [mailto:
> clay.gerr...@gmail.com] wrote:
> > You might check if the swift-recon tool has the data you're looking
> for. It can report
> > the last completed replication pass time across nodes in the ring.
>
>
> ___
> OpenStack-dev mailing list
> OpenStack-dev@lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [swift] a way of checking replicate completion on swift cluster
Hi,
I think it is a good idea to have the object-replicator's failure info
in recon like the other replicators.
I think the following info can be added in object-replicator in addition to
"object_replication_last" and "object_replication_time".
If there is any technical reason to not add them, I can make it. What do
you think?
{
"replication_last": 1416334368.60865,
"replication_stats": {
"attempted": 13346,
"empty": 0,
"failure": 870,
"failure_nodes": {"192.168.0.1": 3,
"192.168.0.2": 860,
"192.168.0.3": 7},
"hashmatch": 0,
"remove": 0,
"start": 1416354240.9761429,
"success": 1908
"ts_repl": 0
},
"replication_time": 2316.5563162644703,
"object_replication_last": 1416334368.60865,
"object_replication_time": 2316.5563162644703
}
Cheers,
Hisashi Osanai
On Tuesday, November 25, 2014 4:37 PM, Matsuda, Kenichiro
[mailto:matsuda_keni...@jp.fujitsu.com] wrote:
> I understood that the logs are necessary to judge whether no failure on
> object-replicator.
> And also, I thought that the recon info of object-replicator having failure
> (just like the recon info of account-replicator and container-replicator)
> is useful.
> Are there any reason to not included failure in recon?
On Tuesday, November 25, 2014 5:53 AM, Clay Gerrard
[mailto:clay.gerr...@gmail.com] wrote:
> > replication logs
On Friday, November 21, 2014 4:22 AM, Clay Gerrard
[mailto:clay.gerr...@gmail.com] wrote:
> You might check if the swift-recon tool has the data you're looking for. It
> can report
> the last completed replication pass time across nodes in the ring.
___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [swift] a way of checking replicate completion on swift cluster
Hi, Thanks for your advice. I understood that the logs are necessary to judge whether no failure on object-replicator. And also, I thought that the recon info of object-replicator having failure (just like the recon info of account-replicator and container-replicator) is useful. Are there any reason to not included failure in recon? Kenichiro Matsuda. > -Original Message- > From: Clay Gerrard [mailto:clay.gerr...@gmail.com] > Sent: Tuesday, November 25, 2014 5:53 AM > To: OpenStack Development Mailing List (not for usage questions) > Subject: Re: [openstack-dev] [swift] a way of checking replicate completion > on swift cluster > > replication logs > > On Thu, Nov 20, 2014 at 9:32 PM, Matsuda, Kenichiro > wrote: > Hi, > > Thank you for the info. > > I was able to get replication info easily by swift-recon API. > But, I wasn't able to judge whether no failure from recon info of > object-replicator. > > Could you please advise me for a way of get object-replicator's failure info? ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [swift] a way of checking replicate completion on swift cluster
replication logs
On Thu, Nov 20, 2014 at 9:32 PM, Matsuda, Kenichiro <
matsuda_keni...@jp.fujitsu.com> wrote:
> Hi,
>
> Thank you for the info.
>
> I was able to get replication info easily by swift-recon API.
> But, I wasn't able to judge whether no failure from recon info of
> object-replicator.
>
> Could you please advise me for a way of get object-replicator's failure
> info?
>
> [replication info from recon]
> * account
>
> --
> # curl http://192.168.1.11:6002/recon/replication/account | python
> -mjson.tool
> {
> "replication_last": 1416354262.7157061,
> "replication_stats": {
> "attempted": 20,
> "diff": 0,
> "diff_capped": 0,
> "empty": 0,
> "failure": 20,
> "hashmatch": 0,
> "no_change": 40,
> "remote_merge": 0,
> "remove": 0,
> "rsync": 0,
> "start": 1416354240.9761429,
> "success": 40,
> "ts_repl": 0
> },
> "replication_time": 21.739563226699829
> }
>
> --
>
> * container
>
> --
> # curl http://192.168.1.11:6002/recon/replication/container | python
> -mjson.tool
> {
> "replication_last": 1416353436.9448521,
> "replication_stats": {
> "attempted": 13346,
> "diff": 0,
> "diff_capped": 0,
> "empty": 0,
> "failure": 870,
> "hashmatch": 0,
> "no_change": 1908,
> "remote_merge": 0,
> "remove": 0,
> "rsync": 0,
> "start": 1416349377.3627851,
> "success": 1908,
> "ts_repl": 0
> },
> "replication_time": 4059.5820670127869
> }
>
> --
>
> * object
>
> --
> # curl http://192.168.1.11:6002/recon/replication | python -mjson.tool
> {
> "object_replication_last": 1416334368.60865,
> "object_replication_time": 2316.5563162644703
> }
> # curl http://192.168.1.11:6002/recon/replication/object | python
> -mjson.tool
> {
> "object_replication_last": 1416334368.60865,
> "object_replication_time": 2316.5563162644703
> }
>
> --
>
> Best Regards,
> Kenichiro Matsuda.
>
>
> From: Clay Gerrard [mailto:clay.gerr...@gmail.com]
> Sent: Friday, November 21, 2014 4:22 AM
> To: OpenStack Development Mailing List (not for usage questions)
> Subject: Re: [openstack-dev] [swift] a way of checking replicate
> completion on swift cluster
>
> You might check if the swift-recon tool has the data you're looking for.
> It can report the last completed replication pass time across nodes in the
> ring.
>
> On Thu, Nov 20, 2014 at 1:28 AM, Matsuda, Kenichiro <
> matsuda_keni...@jp.fujitsu.com> wrote:
> Hi,
>
> I would like to know about a way of checking replicate completion on swift
> cluster.
> (e.g. after rebalanced Ring)
>
> I found the way of using swift-dispersion-report from Administrator's
> Guide.
> But, this way is not enough, because swift-dispersion-report can't checking
> replicate completion for other data that made by not
> swift-dispersion-populate.
>
> And also, I found the way of using replicator's logs from Q&A.
> But, I would like to more easy way, because check of below logs is very
> heavy.
>
> (account/container/object)-replicator * All storage node on swift cluster
>
> Could you please advise me for it?
>
> Findings:
> Administrator's Guide Cluster Health
>
> http://docs.openstack.org/developer/swift/admin_guide.html#cluster-health
> how to check replicator work complete
>
> https://ask.openstack.org/en/question/18654/how-to-check-replicator-work-complete/
>
> Best Regards,
> Kenichiro Matsuda.
>
>
> ___
> OpenStack-dev mailing list
> OpenStack-dev@lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
> ___
> OpenStack-dev mailing list
> OpenStack-dev@lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [swift] a way of checking replicate completion on swift cluster
Hi,
Thank you for the info.
I was able to get replication info easily by swift-recon API.
But, I wasn't able to judge whether no failure from recon info of
object-replicator.
Could you please advise me for a way of get object-replicator's failure info?
[replication info from recon]
* account
--
# curl http://192.168.1.11:6002/recon/replication/account | python -mjson.tool
{
"replication_last": 1416354262.7157061,
"replication_stats": {
"attempted": 20,
"diff": 0,
"diff_capped": 0,
"empty": 0,
"failure": 20,
"hashmatch": 0,
"no_change": 40,
"remote_merge": 0,
"remove": 0,
"rsync": 0,
"start": 1416354240.9761429,
"success": 40,
"ts_repl": 0
},
"replication_time": 21.739563226699829
}
--
* container
--
# curl http://192.168.1.11:6002/recon/replication/container | python -mjson.tool
{
"replication_last": 1416353436.9448521,
"replication_stats": {
"attempted": 13346,
"diff": 0,
"diff_capped": 0,
"empty": 0,
"failure": 870,
"hashmatch": 0,
"no_change": 1908,
"remote_merge": 0,
"remove": 0,
"rsync": 0,
"start": 1416349377.3627851,
"success": 1908,
"ts_repl": 0
},
"replication_time": 4059.5820670127869
}
--
* object
--
# curl http://192.168.1.11:6002/recon/replication | python -mjson.tool
{
"object_replication_last": 1416334368.60865,
"object_replication_time": 2316.5563162644703
}
# curl http://192.168.1.11:6002/recon/replication/object | python -mjson.tool
{
"object_replication_last": 1416334368.60865,
"object_replication_time": 2316.5563162644703
}
--
Best Regards,
Kenichiro Matsuda.
From: Clay Gerrard [mailto:clay.gerr...@gmail.com]
Sent: Friday, November 21, 2014 4:22 AM
To: OpenStack Development Mailing List (not for usage questions)
Subject: Re: [openstack-dev] [swift] a way of checking replicate completion on
swift cluster
You might check if the swift-recon tool has the data you're looking for. It
can report the last completed replication pass time across nodes in the ring.
On Thu, Nov 20, 2014 at 1:28 AM, Matsuda, Kenichiro
wrote:
Hi,
I would like to know about a way of checking replicate completion on swift
cluster.
(e.g. after rebalanced Ring)
I found the way of using swift-dispersion-report from Administrator's Guide.
But, this way is not enough, because swift-dispersion-report can't checking
replicate completion for other data that made by not swift-dispersion-populate.
And also, I found the way of using replicator's logs from Q&A.
But, I would like to more easy way, because check of below logs is very heavy.
(account/container/object)-replicator * All storage node on swift cluster
Could you please advise me for it?
Findings:
Administrator's Guide Cluster Health
http://docs.openstack.org/developer/swift/admin_guide.html#cluster-health
how to check replicator work complete
https://ask.openstack.org/en/question/18654/how-to-check-replicator-work-complete/
Best Regards,
Kenichiro Matsuda.
___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [swift] a way of checking replicate completion on swift cluster
You might check if the swift-recon tool has the data you're looking for. It can report the last completed replication pass time across nodes in the ring. On Thu, Nov 20, 2014 at 1:28 AM, Matsuda, Kenichiro < matsuda_keni...@jp.fujitsu.com> wrote: > Hi, > > I would like to know about a way of checking replicate completion on swift > cluster. > (e.g. after rebalanced Ring) > > I found the way of using swift-dispersion-report from Administrator's > Guide. > But, this way is not enough, because swift-dispersion-report can't checking > replicate completion for other data that made by not > swift-dispersion-populate. > > And also, I found the way of using replicator's logs from Q&A. > But, I would like to more easy way, because check of below logs is very > heavy. > > (account/container/object)-replicator * All storage node on swift cluster > > Could you please advise me for it? > > Findings: > Administrator's Guide Cluster Health > > http://docs.openstack.org/developer/swift/admin_guide.html#cluster-health > how to check replicator work complete > > https://ask.openstack.org/en/question/18654/how-to-check-replicator-work-complete/ > > Best Regards, > Kenichiro Matsuda. > > > ___ > OpenStack-dev mailing list > OpenStack-dev@lists.openstack.org > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev > ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
[openstack-dev] [swift] a way of checking replicate completion on swift cluster
Hi, I would like to know about a way of checking replicate completion on swift cluster. (e.g. after rebalanced Ring) I found the way of using swift-dispersion-report from Administrator's Guide. But, this way is not enough, because swift-dispersion-report can't checking replicate completion for other data that made by not swift-dispersion-populate. And also, I found the way of using replicator's logs from Q&A. But, I would like to more easy way, because check of below logs is very heavy. (account/container/object)-replicator * All storage node on swift cluster Could you please advise me for it? Findings: Administrator's Guide Cluster Health http://docs.openstack.org/developer/swift/admin_guide.html#cluster-health how to check replicator work complete https://ask.openstack.org/en/question/18654/how-to-check-replicator-work-complete/ Best Regards, Kenichiro Matsuda. ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
