Re: Tracking down coprocessor pauses

2012-09-12 Thread Tom Brown
I have captured some logs from what is happening during one of these pauses. http://pastebin.com/K162Einz Can someone help me figure out what's actually going on from these logs? --- My interpretation of the logs --- As you can see at the start of the logs, my coprocessor for updating the data

Re: Tracking down coprocessor pauses

2012-09-12 Thread Andrew Purtell
Inline On Wed, Sep 12, 2012 at 10:40 AM, Tom Brown tombrow...@gmail.com wrote: I have captured some logs from what is happening during one of these pauses. http://pastebin.com/K162Einz Can someone help me figure out what's actually going on from these logs? --- My interpretation of the

Tracking down coprocessor pauses

2012-09-10 Thread Tom Brown
Hi, We have our system setup such that all interaction is done through co-processors. We update the database via a co-processor (it has the appropriate logic for dealing with concurrent access to rows), and we also query/aggregate via co-processor (since we don't want to send all the data over

Re: Tracking down coprocessor pauses

2012-09-10 Thread Andrew Purtell
On Mon, Sep 10, 2012 at 10:32 AM, Tom Brown tombrow...@gmail.com wrote: I want to know more details about the specifics of those requests; Is there an API I can use that will allow my coprocessor requests to be tracked more functionally? Is there a way to hook into the UI so I can provide my

Re: Tracking down coprocessor pauses

2012-09-10 Thread Michael Segel
On Sep 10, 2012, at 12:32 PM, Tom Brown tombrow...@gmail.com wrote: We have our system setup such that all interaction is done through co-processors. We update the database via a co-processor (it has the appropriate logic for dealing with concurrent access to rows), and we also

Re: Tracking down coprocessor pauses

2012-09-10 Thread Tom Brown
Micheal, We are using HBase to track the usage of our service. Specifically, each client sends an update when they start a task, at regular intervals during the task, and an update when they finish a task (and then presumably they start another, continuing the cycle). Each user has various