Re: [openstack-dev] [swift] a way of checking replicate completion on swift cluster
more fidelity in the recon's seems fine, statsd emissions are also a
popular target for telemetry radiation.
On Thu, Nov 27, 2014 at 5:01 AM, Osanai, Hisashi
osanai.hisa...@jp.fujitsu.com wrote:
Hi,
I think it is a good idea to have the object-replicator's failure info
in recon like the other replicators.
I think the following info can be added in object-replicator in addition to
object_replication_last and object_replication_time.
If there is any technical reason to not add them, I can make it. What do
you think?
{
replication_last: 1416334368.60865,
replication_stats: {
attempted: 13346,
empty: 0,
failure: 870,
failure_nodes: {192.168.0.1: 3,
192.168.0.2: 860,
192.168.0.3: 7},
hashmatch: 0,
remove: 0,
start: 1416354240.9761429,
success: 1908
ts_repl: 0
},
replication_time: 2316.5563162644703,
object_replication_last: 1416334368.60865,
object_replication_time: 2316.5563162644703
}
Cheers,
Hisashi Osanai
On Tuesday, November 25, 2014 4:37 PM, Matsuda, Kenichiro [mailto:
matsuda_keni...@jp.fujitsu.com] wrote:
I understood that the logs are necessary to judge whether no failure on
object-replicator.
And also, I thought that the recon info of object-replicator having
failure
(just like the recon info of account-replicator and container-replicator)
is useful.
Are there any reason to not included failure in recon?
On Tuesday, November 25, 2014 5:53 AM, Clay Gerrard [mailto:
clay.gerr...@gmail.com] wrote:
replication logs
On Friday, November 21, 2014 4:22 AM, Clay Gerrard [mailto:
clay.gerr...@gmail.com] wrote:
You might check if the swift-recon tool has the data you're looking
for. It can report
the last completed replication pass time across nodes in the ring.
___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [swift] a way of checking replicate completion on swift cluster
Thank you for the response. I updated the following patch with the idea. https://review.openstack.org/#/c/138342/ On Friday, December 05, 2014 5:50 AM, Clay Gerrard wrote: more fidelity in the recon's seems fine, statsd emissions are also a popular target for telemetry radiation. Thanks again! Hisashi Osanai ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [swift] a way of checking replicate completion on swift cluster
Hi,
I think it is a good idea to have the object-replicator's failure info
in recon like the other replicators.
I think the following info can be added in object-replicator in addition to
object_replication_last and object_replication_time.
If there is any technical reason to not add them, I can make it. What do
you think?
{
replication_last: 1416334368.60865,
replication_stats: {
attempted: 13346,
empty: 0,
failure: 870,
failure_nodes: {192.168.0.1: 3,
192.168.0.2: 860,
192.168.0.3: 7},
hashmatch: 0,
remove: 0,
start: 1416354240.9761429,
success: 1908
ts_repl: 0
},
replication_time: 2316.5563162644703,
object_replication_last: 1416334368.60865,
object_replication_time: 2316.5563162644703
}
Cheers,
Hisashi Osanai
On Tuesday, November 25, 2014 4:37 PM, Matsuda, Kenichiro
[mailto:matsuda_keni...@jp.fujitsu.com] wrote:
I understood that the logs are necessary to judge whether no failure on
object-replicator.
And also, I thought that the recon info of object-replicator having failure
(just like the recon info of account-replicator and container-replicator)
is useful.
Are there any reason to not included failure in recon?
On Tuesday, November 25, 2014 5:53 AM, Clay Gerrard
[mailto:clay.gerr...@gmail.com] wrote:
replication logs
On Friday, November 21, 2014 4:22 AM, Clay Gerrard
[mailto:clay.gerr...@gmail.com] wrote:
You might check if the swift-recon tool has the data you're looking for. It
can report
the last completed replication pass time across nodes in the ring.
___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [swift] a way of checking replicate completion on swift cluster
replication logs
On Thu, Nov 20, 2014 at 9:32 PM, Matsuda, Kenichiro
matsuda_keni...@jp.fujitsu.com wrote:
Hi,
Thank you for the info.
I was able to get replication info easily by swift-recon API.
But, I wasn't able to judge whether no failure from recon info of
object-replicator.
Could you please advise me for a way of get object-replicator's failure
info?
[replication info from recon]
* account
--
# curl http://192.168.1.11:6002/recon/replication/account | python
-mjson.tool
{
replication_last: 1416354262.7157061,
replication_stats: {
attempted: 20,
diff: 0,
diff_capped: 0,
empty: 0,
failure: 20,
hashmatch: 0,
no_change: 40,
remote_merge: 0,
remove: 0,
rsync: 0,
start: 1416354240.9761429,
success: 40,
ts_repl: 0
},
replication_time: 21.739563226699829
}
--
* container
--
# curl http://192.168.1.11:6002/recon/replication/container | python
-mjson.tool
{
replication_last: 1416353436.9448521,
replication_stats: {
attempted: 13346,
diff: 0,
diff_capped: 0,
empty: 0,
failure: 870,
hashmatch: 0,
no_change: 1908,
remote_merge: 0,
remove: 0,
rsync: 0,
start: 1416349377.3627851,
success: 1908,
ts_repl: 0
},
replication_time: 4059.5820670127869
}
--
* object
--
# curl http://192.168.1.11:6002/recon/replication | python -mjson.tool
{
object_replication_last: 1416334368.60865,
object_replication_time: 2316.5563162644703
}
# curl http://192.168.1.11:6002/recon/replication/object | python
-mjson.tool
{
object_replication_last: 1416334368.60865,
object_replication_time: 2316.5563162644703
}
--
Best Regards,
Kenichiro Matsuda.
From: Clay Gerrard [mailto:clay.gerr...@gmail.com]
Sent: Friday, November 21, 2014 4:22 AM
To: OpenStack Development Mailing List (not for usage questions)
Subject: Re: [openstack-dev] [swift] a way of checking replicate
completion on swift cluster
You might check if the swift-recon tool has the data you're looking for.
It can report the last completed replication pass time across nodes in the
ring.
On Thu, Nov 20, 2014 at 1:28 AM, Matsuda, Kenichiro
matsuda_keni...@jp.fujitsu.com wrote:
Hi,
I would like to know about a way of checking replicate completion on swift
cluster.
(e.g. after rebalanced Ring)
I found the way of using swift-dispersion-report from Administrator's
Guide.
But, this way is not enough, because swift-dispersion-report can't checking
replicate completion for other data that made by not
swift-dispersion-populate.
And also, I found the way of using replicator's logs from QA.
But, I would like to more easy way, because check of below logs is very
heavy.
(account/container/object)-replicator * All storage node on swift cluster
Could you please advise me for it?
Findings:
Administrator's Guide Cluster Health
http://docs.openstack.org/developer/swift/admin_guide.html#cluster-health
how to check replicator work complete
https://ask.openstack.org/en/question/18654/how-to-check-replicator-work-complete/
Best Regards,
Kenichiro Matsuda.
___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [swift] a way of checking replicate completion on swift cluster
Hi, Thanks for your advice. I understood that the logs are necessary to judge whether no failure on object-replicator. And also, I thought that the recon info of object-replicator having failure (just like the recon info of account-replicator and container-replicator) is useful. Are there any reason to not included failure in recon? Kenichiro Matsuda. -Original Message- From: Clay Gerrard [mailto:clay.gerr...@gmail.com] Sent: Tuesday, November 25, 2014 5:53 AM To: OpenStack Development Mailing List (not for usage questions) Subject: Re: [openstack-dev] [swift] a way of checking replicate completion on swift cluster replication logs On Thu, Nov 20, 2014 at 9:32 PM, Matsuda, Kenichiro matsuda_keni...@jp.fujitsu.com wrote: Hi, Thank you for the info. I was able to get replication info easily by swift-recon API. But, I wasn't able to judge whether no failure from recon info of object-replicator. Could you please advise me for a way of get object-replicator's failure info? ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [swift] a way of checking replicate completion on swift cluster
You might check if the swift-recon tool has the data you're looking for. It can report the last completed replication pass time across nodes in the ring. On Thu, Nov 20, 2014 at 1:28 AM, Matsuda, Kenichiro matsuda_keni...@jp.fujitsu.com wrote: Hi, I would like to know about a way of checking replicate completion on swift cluster. (e.g. after rebalanced Ring) I found the way of using swift-dispersion-report from Administrator's Guide. But, this way is not enough, because swift-dispersion-report can't checking replicate completion for other data that made by not swift-dispersion-populate. And also, I found the way of using replicator's logs from QA. But, I would like to more easy way, because check of below logs is very heavy. (account/container/object)-replicator * All storage node on swift cluster Could you please advise me for it? Findings: Administrator's Guide Cluster Health http://docs.openstack.org/developer/swift/admin_guide.html#cluster-health how to check replicator work complete https://ask.openstack.org/en/question/18654/how-to-check-replicator-work-complete/ Best Regards, Kenichiro Matsuda. ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [swift] a way of checking replicate completion on swift cluster
Hi,
Thank you for the info.
I was able to get replication info easily by swift-recon API.
But, I wasn't able to judge whether no failure from recon info of
object-replicator.
Could you please advise me for a way of get object-replicator's failure info?
[replication info from recon]
* account
--
# curl http://192.168.1.11:6002/recon/replication/account | python -mjson.tool
{
replication_last: 1416354262.7157061,
replication_stats: {
attempted: 20,
diff: 0,
diff_capped: 0,
empty: 0,
failure: 20,
hashmatch: 0,
no_change: 40,
remote_merge: 0,
remove: 0,
rsync: 0,
start: 1416354240.9761429,
success: 40,
ts_repl: 0
},
replication_time: 21.739563226699829
}
--
* container
--
# curl http://192.168.1.11:6002/recon/replication/container | python -mjson.tool
{
replication_last: 1416353436.9448521,
replication_stats: {
attempted: 13346,
diff: 0,
diff_capped: 0,
empty: 0,
failure: 870,
hashmatch: 0,
no_change: 1908,
remote_merge: 0,
remove: 0,
rsync: 0,
start: 1416349377.3627851,
success: 1908,
ts_repl: 0
},
replication_time: 4059.5820670127869
}
--
* object
--
# curl http://192.168.1.11:6002/recon/replication | python -mjson.tool
{
object_replication_last: 1416334368.60865,
object_replication_time: 2316.5563162644703
}
# curl http://192.168.1.11:6002/recon/replication/object | python -mjson.tool
{
object_replication_last: 1416334368.60865,
object_replication_time: 2316.5563162644703
}
--
Best Regards,
Kenichiro Matsuda.
From: Clay Gerrard [mailto:clay.gerr...@gmail.com]
Sent: Friday, November 21, 2014 4:22 AM
To: OpenStack Development Mailing List (not for usage questions)
Subject: Re: [openstack-dev] [swift] a way of checking replicate completion on
swift cluster
You might check if the swift-recon tool has the data you're looking for. It
can report the last completed replication pass time across nodes in the ring.
On Thu, Nov 20, 2014 at 1:28 AM, Matsuda, Kenichiro
matsuda_keni...@jp.fujitsu.com wrote:
Hi,
I would like to know about a way of checking replicate completion on swift
cluster.
(e.g. after rebalanced Ring)
I found the way of using swift-dispersion-report from Administrator's Guide.
But, this way is not enough, because swift-dispersion-report can't checking
replicate completion for other data that made by not swift-dispersion-populate.
And also, I found the way of using replicator's logs from QA.
But, I would like to more easy way, because check of below logs is very heavy.
(account/container/object)-replicator * All storage node on swift cluster
Could you please advise me for it?
Findings:
Administrator's Guide Cluster Health
http://docs.openstack.org/developer/swift/admin_guide.html#cluster-health
how to check replicator work complete
https://ask.openstack.org/en/question/18654/how-to-check-replicator-work-complete/
Best Regards,
Kenichiro Matsuda.
___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
