G'day David,

It looks like you might be hitting this bug: https://github.com/basho/riak_kv/issues/290

It doesn't look like there's an easy fix unless you want to backport the patch into your current system. :-(

Shane.

On 10/12/12 04:03, David Montgomery wrote:


Hi,

I am having an issues with getting data out of MR......


If I run on a few  particular days I get the below error and returns
almost immediate.  On other days returns valid data.  I am using a key
filter to select by day when I noticed that a date range was failing.
key_filter.starts_with('20121207').  I am running on a three node
cluster with 2 cores each an 4 gigs of ram.  When it works it returns
data pretty fast.  So..per the below error..a key did exist from that day.

Even further, I can get the values of that key in the error.

Why the time out error?  I have a generous timeout.

for result in query.run(timeout=300000):
         #print pprint(result)
         for k,v in result.iteritems():
             print k,v



Traceback (most recent call last):
   File
"/home/ubuntu/workspace/rtbopsConfig/rtbServers/rtbWorkerServer/riak/mapreduce_v1.py",
line 61, in <module>
     main()
   File
"/home/ubuntu/workspace/rtbopsConfig/rtbServers/rtbWorkerServer/riak/mapreduce_v1.py",
line 57, in main
     for result in query.run(timeout=30000):
   File
"/usr/local/lib/python2.7/dist-packages/riak-1.5.0-py2.7.egg/riak/mapreduce.py",
line 232, in run
     result = t.mapred(self._inputs, query, timeout)
   File
"/usr/local/lib/python2.7/dist-packages/riak-1.5.0-py2.7.egg/riak/transports/pbc.py",
line 454, in mapred
     _handle_response)
   File
"/usr/local/lib/python2.7/dist-packages/riak-1.5.0-py2.7.egg/riak/transports/pbc.py",
line 548, in send_msg_multi
     msg_code, resp = self.recv_msg(conn, expect)
   File
"/usr/local/lib/python2.7/dist-packages/riak-1.5.0-py2.7.egg/riak/transports/pbc.py",
line 589, in recv_msg
     raise Exception(msg.errmsg)
Exception:
{"phase":0,"error":"[timeout]","input":"{<<\"impressions\">>,<<\"0109d84f-20d9-48cd-b098-716e016cae9b:cid6587015966:agid5748040653:2012120107:SG\">>}","type":"forward_preflist","stack":"[]"}


So....how do I get data out without causing an exception?  Otherwise I
have to write a loop that skips a day which does not quite seem right.

Thanks



_______________________________________________
riak-users mailing list
[email protected]
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com



_______________________________________________
riak-users mailing list
[email protected]
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Reply via email to