This is good. What we are NOT seeing is the contents of the metadata
changing while going to-and-from your precommit hook.  I think you need to
be concerned about a few issues when using JS precommit hooks:

1) Your data must never contain a character that is not encoded in UTF-8.
Yours looks like ASCII/Latin-1 so that should be fine.
2) Large objects will take a while to transfer to and from the JS VM because
it has to be marshalled in each direction, which could be the source of a
timeout.

Those things said, it would be good to get more information on what the
exact error was as reported by Riak. Do you have riak logs or transcripts of
client sessions?

Thanks,

Sean

On Fri, Oct 14, 2011 at 4:08 PM, Hal Eisen <[email protected]> wrote:

> Ah!  Much better - thank you!
>
> Attaching to /var/run/riak/erlang.pipe.2 (^D to exit)
>
> {ok, C} = riak:local_client().
> {ok,{riak_client,'[email protected]',undefined}}
> ([email protected])4> rp(C:get(<<"test-with">>,<<"x000071257">>)).
> {ok,{r_object,<<"test-with">>,<<"x000071257">>,
>              [{r_content,{dict,6,16,16,8,80,48,
>
>  {[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},
>                                {{[],[],
>                                  [[<<"Links">>]],
>                                  [],[],[],[],[],[],[],
>
>  [[<<"X-Riak-VTag">>,99,70,100,97,67,116,100,97,57,84,66,121,
>                                    54,81,66,74,76,66,85,69,80],
>
> [<<"content-type">>,116,101,120,116,47,112,108,97,105,110]],
>                                  [[<<"index">>]],
>                                  [],
>
>  [[<<"X-Riak-Last-Modified">>|{1318,620010,543066}]],
>                                  [],
>                                  [[<<"X-Riak-Meta">>]]}}},
>                          <<"z80ghJXVZe9m59/5+Ydk2g xMpCOKC5I4INzFCab3WEmw
> yB5yjZ1ML2NvBn+JzBSGLA 7MvIfktc4v4oMI/Z8qe68w qH/2eaLz5x2RgaZ7dUISLA
> 5No7f7vOI0XXdysGdKMY1Q FnkJHFqID69vteYIfrGy3A jxTkX87qFnpaNt7dS+olQw
> yfD4lfuYq5FZ9R/QKX4jbQ RcSMzi4tf73qGvxRx8atJg 09lEaAKkQll1XTjm0WPoIA
> ZRK9Q9nKpuAsmQsKgmUtyg wgrU12/pd1mqJ6DJm/9nEA xRzkEMEkoQ4NteS5f8KvOQ
> qrMjiSK8wlpvYG61Jf/cVg m/Mcf/Bik2qW08i9H48v8w x02XsB6uJX5Eqp1brel7rw
> cO/fLsmwhgeXlcRCY2tV+w b0ki9FVoFhqM30rSKZ9tIw Hw49rZmQg0X3Q5+P+r3/xA
> mPE3CCEBlMR1aHvmEGo7hA PFncBI6IUCQ76AeaXHTQeQ ttdn0vjtXSGkSw5YhmgMuQ
> N2k8/HSASeRdh7jH2LmqzQ H/Hed0AF+NoT9ClDiBxlXw jilqBno3VjNw3tBfWjvz7A
> TnMs7TRj0G3gypoVthU2dw AudPEOAyetho0TjytP3W8A M+df8J3WAbvmnzUQORUhiQ
> bqmrG6oO+54ZCURAwxfiGw NBc8s48H+J3b68KskSgwPw wWpTIPpHVTDZWDw0/TVu9Q
> Y2TT8PSVtqudz407XG4LAQ GCvgxc3NUHK7GGTN7k09bg 42mFPfdm+kTh7Q/2E/VjvQ
> HDg80wt8KYq1ApOt/st7GA GcoU5+pjKKQuDrE9WF5MIg pb/J4Hlk+N3euV/FhM2WXQ
> pXcbzpPiAMNvfNnf0OXeqg 1n2KtPTBC/Iqo1PieHkTPA 1kWSDjlf7a17u+0Oyj/i4A
> NBanX0zqkQlQfKzY4vKu/A odDG6D8CcyfYRhBj9KxYpg F+YhZvyFht+k0bwOF0LAiw
> 9xdxY8gz3/Szj8jShy8exg bINJzHJgrmLjsTloMag5jw 2dT0leh1ouB1oaSm4bl3Dw
> Z8ah585W09b6dIq22a8/1w ZC6S77eUIXNIgbU+HhsYtg 9FfFRane2I8Y7O5HFFpywA
> wMfHbTC9PcrvyW9AJ1vcCg KDgCOneN+uzcIScI9yG3iA mhFYFU36QsrdvQaUpOm9yA
> 2CyNFhmtgXbWZUU8+y5V8A poTs7udvxSJ3MoaolbyENg tTs6PWq5DOAmgikVHJveEQ
> n2FAjjr7Yz5QzfGyDeb0Zg crMqH3VLocCbNpXgy2zefw ZvBB4WpgkosFp+IoqJw3mQ
> CT9l4ICilfgHaxxXIqRqog BysDC6EmsvSyN080K+ntRA fzn4MX+9sZiO9MYo66AlkQ
> RPaDqEFjs1I6/lfC4Ai8jA A6/b1m55KbEl+Fl4NPqDpA 6l0vHEYIIy4H06o9mY5RNQ
> /EkMpFwAsSSbvjVUpP32+w MpXHasv0yq7TPDaxtfwssQ c1uQtFaBJe1sP2eIGbbgWA
> o/OQ2I5MQfJ0e/ovG1+H2w FL+muxSHXkW7oCiiHtOARg fLvECeyZDxnHjHW9HgbyFQ
> 4sQg2SjUv4zg/y7BmzcVFA MruQ6Jdqq1KY1doQ/mbyHQ 0t3qGPAGZc6GI+Nr1OPHxQ
> rWGrFDIj77wkx9JYO+aSUQ 0Jv0FUSjNlpGyQd+u141ww +9eTnWdJl820aS003oYzxA
> KN0seVXOkmRWJAsv8BAL3g NfSo1GXm4e3AXz2KtljFUQ 0f4XPQjpWTl63zSx136I1w
> 8DOrN8MCAfc/FCRJ0DcCjQ Q+xRfWi27dMBWz7cmhE2ew l3jV0hnFCAuaahe+8CkzHA
> /p/CicP/CvFCttO+rZipIw aNMKlZRyi8OaokvpSzGdIQ PvgVQW93UJj+l3AEAVxhkw
> k9uF7ZCcE4OP+VzPqUzr2Q x+Ekn/wD653tkIwja9GZbQ KjikqTFsSeWoM1F8RdMQcA
> dkeWa3NDwpBIZzJS5JD3Ng hhOYXsSeuPdXrmQ56Hm7Kg VCKav8+lZJ5wA7g91HVSlA
> kswidTLRflbgeQKyVN+tEA mNzoPaV7A5XhY0Z8na5SGw 9LnsMK2faPibKWOXhsti7w
> gStLoof17gvJ1Du/W76H+w JmV9X/kCDSq+/lWHlrmVhA 4u9ST789n+YR1ajpD+/cnA
> 7T0sIZkeO+9eBpcTr5+myg rGJ6scy9ti7JbnAvB/ZCWw +JkTnfXhBZOWQxQV53DG3Q
> OLPv+Lr1ZidHjsdqcE6bUg 7IlWY3qZeHvRl+rNd6zOXg aXTOWsZgYQtE2bn+0P+VSA
> yeEHT1s/n8jqFdFSrdBylA ZbnupuHMa7nwzSpHdRoYbw 8JNeTNWSCqbHyZal7lOnDw
> qX2mKbCYt1wpTf/cPkY5BA o8ZcKXQnD9CT7oqb+K59Cw JyPQkrY4heDXwmDMAH6LnQ
> X5P5g1JN7z3KRkRp0s+fPg aY1RoZ2KEhzlgUmde3AWaA f2/6prsLQIAXtiJUIRaRtQ
> cyeKSoaWDutXao/Uyexplw X9CzfNfbuwD5e6bOkr9a3Q K0SSiuEfuThMTPOHCGd8SA
> xFFH3ucpMR71tcMAOUbEjw 6xYN4d6J2QWPywuWjbu9aA XvBZk4unmaqoReHC6KdivQ
> B+HNfcqJoWeAQkdxg7esPw 2k+1xuk+dNPfhSdZn6YmQg TFb/TOSq+Vc6pd/5E9+Zeg
> oKCA9C5vE7Oi3xM/BzCV3Q ICy5YqxZB1uWSwcVLSNLcA yP/ppYexJvFS7T2JoUa0RQ
> Pe8YStj0dV/yaYYup3OT3Q BpBZt++EDwx0qBTskje27A 7F3syl7T1rgHni5+e6zJ8g
> dtxhHW66r8ZswIeccbXbXA 0fSRpATWhUiAlD5cPNnKJQ m4YZJRoZBXz/cHeSc+lapg
> Gvo0p/mE7qvbsKfUlBMu5Q Zd7VNTxe5I0LfUjFkbj0MA n8PXFSupM2pnDjbQ7Xm8Qw
> AlIqKycm+woDuxny2NlSTQ fx3inm2hnSK1HGgAHn4OVA QqDhiPUDO8Zb+NeGIid8Tg
> OYjH+I68tYxs6TK5V7bzMg AT1AcWbsT6VuseH4y+GDuQ
> 4A2gO2haDdGPtqCK8JI94A,[],[],[],[],[],[],[],[],[],[],[],[],
>                      [[clean|true]],
>                      []}}},
>
> What does this tell me?
>
> Hal
>
>
> On Fri, Oct 14, 2011 at 03:52:16PM -0400, Sean Cribbs wrote:
> > Hal,
> >
> > Wrap those strings in double-angle brackets, e.g.
> >
> > rp(C:get(<<"test-with">>,<<"x000071257">>)).
> >
> > On Fri, Oct 14, 2011 at 3:27 PM, Hal Eisen <[email protected]> wrote:
> >
> > > Sean,
> > >
> > > Interesting.
> > >
> > > This is what I get using the console:
> > >
> > > bash$ /usr/sbin/riak attach
> > > Attempting to restart script through sudo -u riak
> > > Attaching to /var/run/riak/erlang.pipe.2 (^D to exit)
> > >
> > > {ok, C} = riak:local_client().
> > > {ok,{riak_client,'[email protected]',undefined}}
> > > ([email protected])2> rp(C:get("test-with","x000071257")).
> > > {error,notfound}
> > > ok
> > > ([email protected])3> [Quit]
> > >
> > > However, if I use the HTTP API (sorry for the excessive output):
> > >
> > > bash$ curl http://127.0.0.1:8098/riak/test-with/x000071257
> > > z80ghJXVZe9m59/5+Ydk2g xMpCOKC5I4INzFCab3WEmw yB5yjZ1ML2NvBn+JzBSGLA
> > > 7MvIfktc4v4oMI/Z8qe68w qH/2eaLz5x2RgaZ7dUISLA 5No7f7vOI0XXdysGdKMY1Q
> > > FnkJHFqID69vteYIfrGy3A jxTkX87qFnpaNt7dS+olQw yfD4lfuYq5FZ9R/QKX4jbQ
> > > RcSMzi4tf73qGvxRx8atJg 09lEaAKkQll1XTjm0WPoIA ZRK9Q9nKpuAsmQsKgmUtyg
> > > wgrU12/pd1mqJ6DJm/9nEA xRzkEMEkoQ4NteS5f8KvOQ qrMjiSK8wlpvYG61Jf/cVg
> > > m/Mcf/Bik2qW08i9H48v8w x02XsB6uJX5Eqp1brel7rw cO/fLsmwhgeXlcRCY2tV+w
> > > b0ki9FVoFhqM30rSKZ9tIw Hw49rZmQg0X3Q5+P+r3/xA mPE3CCEBlMR1aHvmEGo7hA
> > > PFncBI6IUCQ76AeaXHTQeQ ttdn0vjtXSGkSw5YhmgMuQ N2k8/HSASeRdh7jH2LmqzQ
> > > H/Hed0AF+NoT9ClDiBxlXw jilqBno3VjNw3tBfWjvz7A TnMs7TRj0G3gypoVthU2dw
> > > AudPEOAyetho0TjytP3W8A M+df8J3WAbvmnzUQORUhiQ bqmrG6oO+54ZCURAwxfiGw
> > > NBc8s48H+J3b68KskSgwPw wWpTIPpHVTDZWDw0/TVu9Q Y2TT8PSVtqudz407XG4LAQ
> > > GCvgxc3NUHK7GGTN7k09bg 42mFPfdm+kTh7Q/2E/VjvQ HDg80wt8KYq1ApOt/st7GA
> > > GcoU5+pjKKQuDrE9WF5MIg pb/J4Hlk+N3euV/FhM2WXQ pXcbzpPiAMNvfNnf0OXeqg
> > > 1n2KtPTBC/Iqo1PieHkTPA 1kWSDjlf7a17u+0Oyj/i4A NBanX0zqkQlQfKzY4vKu/A
> > > odDG6D8CcyfYRhBj9KxYpg F+YhZvyFht+k0bwOF0LAiw 9xdxY8gz3/Szj8jShy8exg
> > > bINJzHJgrmLjsTloMag5jw 2dT0leh1ouB1oaSm4bl3Dw Z8ah585W09b6dIq22a8/1w
> > > ZC6S77eUIXNIgbU+HhsYtg 9FfFRane2I8Y7O5HFFpywA wMfHbTC9PcrvyW9AJ1vcCg
> > > KDgCOneN+uzcIScI9yG3iA mhFYFU36QsrdvQaUpOm9yA 2CyNFhmtgXbWZUU8+y5V8A
> > > poTs7udvxSJ3MoaolbyENg tTs6PWq5DOAmgikVHJveEQ n2FAjjr7Yz5QzfGyDeb0Zg
> > > crMqH3VLocCbNpXgy2zefw ZvBB4WpgkosFp+IoqJw3mQ CT9l4ICilfgHaxxXIqRqog
> > > BysDC6EmsvSyN080K+ntRA fzn4MX+9sZiO9MYo66AlkQ RPaDqEFjs1I6/lfC4Ai8jA
> > > A6/b1m55KbEl+Fl4NPqDpA 6l0vHEYIIy4H06o9mY5RNQ /EkMpFwAsSSbvjVUpP32+w
> > > MpXHasv0yq7TPDaxtfwssQ c1uQtFaBJe1sP2eIGbbgWA o/OQ2I5MQfJ0e/ovG1+H2w
> > > FL+muxSHXkW7oCiiHtOARg fLvECeyZDxnHjHW9HgbyFQ 4sQg2SjUv4zg/y7BmzcVFA
> > > MruQ6Jdqq1KY1doQ/mbyHQ 0t3qGPAGZc6GI+Nr1OPHxQ rWGrFDIj77wkx9JYO+aSUQ
> > > 0Jv0FUSjNlpGyQd+u141ww +9eTnWdJl820aS003oYzxA KN0seVXOkmRWJAsv8BAL3g
> > > NfSo1GXm4e3AXz2KtljFUQ 0f4XPQjpWTl63zSx136I1w 8DOrN8MCAfc/FCRJ0DcCjQ
> > > Q+xRfWi27dMBWz7cmhE2ew l3jV0hnFCAuaahe+8CkzHA /p/CicP/CvFCttO+rZipIw
> > > aNMKlZRyi8OaokvpSzGdIQ PvgVQW93UJj+l3AEAVxhkw k9uF7ZCcE4OP+VzPqUzr2Q
> > > x+Ekn/wD653tkIwja9GZbQ KjikqTFsSeWoM1F8RdMQcA dkeWa3NDwpBIZzJS5JD3Ng
> > > hhOYXsSeuPdXrmQ56Hm7Kg VCKav8+lZJ5wA7g91HVSlA kswidTLRflbgeQKyVN+tEA
> > > mNzoPaV7A5XhY0Z8na5SGw 9LnsMK2faPibKWOXhsti7w gStLoof17gvJ1Du/W76H+w
> > > JmV9X/kCDSq+/lWHlrmVhA 4u9ST789n+YR1ajpD+/cnA 7T0sIZkeO+9eBpcTr5+myg
> > > rGJ6scy9ti7JbnAvB/ZCWw +JkTnfXhBZOWQxQV53DG3Q OLPv+Lr1ZidHjsdqcE6bUg
> > > 7IlWY3qZeHvRl+rNd6zOXg aXTOWsZgYQtE2bn+0P+VSA yeEHT1s/n8jqFdFSrdBylA
> > > ZbnupuHMa7nwzSpHdRoYbw 8JNeTNWSCqbHyZal7lOnDw qX2mKbCYt1wpTf/cPkY5BA
> > > o8ZcKXQnD9CT7oqb+K59Cw JyPQkrY4heDXwmDMAH6LnQ X5P5g1JN7z3KRkRp0s+fPg
> > > aY1RoZ2KEhzlgUmde3AWaA f2/6prsLQIAXtiJUIRaRtQ cyeKSoaWDutXao/Uyexplw
> > > X9CzfNfbuwD5e6bOkr9a3Q K0SSiuEfuThMTPOHCGd8SA xFFH3ucpMR71tcMAOUbEjw
> > > 6xYN4d6J2QWPywuWjbu9aA XvBZk4unmaqoReHC6KdivQ B+HNfcqJoWeAQkdxg7esPw
> > > 2k+1xuk+dNPfhSdZn6YmQg TFb/TOSq+Vc6pd/5E9+Zeg oKCA9C5vE7Oi3xM/BzCV3Q
> > > ICy5YqxZB1uWSwcVLSNLcA yP/ppYexJvFS7T2JoUa0RQ Pe8YStj0dV/yaYYup3OT3Q
> > > BpBZt++EDwx0qBTskje27A 7F3syl7T1rgHni5+e6zJ8g dtxhHW66r8ZswIeccbXbXA
> > > 0fSRpATWhUiAlD5cPNnKJQ m4YZJRoZBXz/cHeSc+lapg Gvo0p/mE7qvbsKfUlBMu5Q
> > > Zd7VNTxe5I0LfUjFkbj0MA n8PXFSupM2pnDjbQ7Xm8Qw AlIqKycm+woDuxny2NlSTQ
> > > fx3inm2hnSK1HGgAHn4OVA QqDhiPUDO8Zb+NeGIid8Tg OYjH+I68tYxs6TK5V7bzMg
> > > AT1AcWbsT6VuseH4y+GDuQ 4A2gO2haDdGPtqCK8JI94A E4WXTtWQSkOGFv972z90OQ
> > > Dyi11JswIK/uzZW0AJrfTA qLqlZVT5Y2mrk+TzuwaMIg kDzpIl/KPpiMKvIV1OVE0w
> > > CgnIhEuo8JNsIL15ETDWtg KyTUlQUqjOZjWOtXa4kSyA peABMjc6cDEAD9mHo8n4ew
> > > jV6Vfyl4k0h72Y+oMPpkEw R9HpkFg8nGdCTTafNBRyjg 8iFwYumjl6HcpCnn1wvGyg
> > > fvYF/I26VCXWll+9TI++Hw qPFe2oDFCtsOcZQ63IAVzw N6dJ2AjkZJWo2h5TUtA8rg
> > > s+Pjk8d+NaSj88vR5Cm13A HX96vBj8tDl1BlOZsNHkjg KnnqJ8J55HH00YCwjWKwCg
> > > HJrAFZyU2NDL7clzRFry2g bEt2Gii3NP6Tgx4/tADOhw BkCWYyJq8vMRRIWqTgojtA
> > > FA9padUhP9Ds4DFI5i5GHg tzzjmMOfUGr3YdInfYU6kg vUyatzD1UTIGuZnsDZDR+w
> > > gqpLCvNMIxOlYgdpkuUKow B3fVwX1AZrgquG3/ikavbw +nzfrRpar4Nw6+2keh/xww
> > > l2ZSfytdPpXUpzP8+3e9fg fndXseEqvLc2q5p1T/theg WHinq4T7Q0AhBsV1ZYRy+g
> > > AG9S6RAqjTvi/lYU9CupiQ NjZjiBd3LkK1nXTP9XH7sw FJ6Wd6WYn9NCrkQhPfaIaA
> > > pKBCz0/Wv7R3AcvIoWU62g H/intdx6fR8O1lqqKcBLHg 9+bIVQTOboJELHcPfIYG8A
> > > v4IpaW96O7RwDP3e8Z+iPw ghYSQoJ7cD5qz5xya
> > >
> > >
> > > Hal
> > >
> > > On Fri, Oct 14, 2011 at 08:22:39AM -0400, Sean Cribbs wrote:
> > > > Hal,
> > > >
> > > > I would be interested to see what the format of the object is after
> it
> > > has
> > > > passed through your precommit hook.  We recently fixed some bugs
> related
> > > to
> > > > the JSON format of riak_objects that might result in an unclean
> > > round-trip
> > > > through the JavaScript VM. That is, the format coming out is not the
> same
> > > as
> > > > went in.
> > > >
> > > > Could you do the first step (store a new object through your
> precommit
> > > > hook), and then fetch it by attaching to the console?  Here's what
> you
> > > can
> > > > do on the console:
> > > >
> > > > 1> {ok, C} = riak:local_client().
> > > > 2> rp(C:get(<<"bucket">>,<<"key">>)).
> > > >
> > > > Of course, replace "bucket" and "key" as appropriate for your object.
> > > >
> > > > On Fri, Oct 14, 2011 at 3:57 AM, Hal Eisen <[email protected]>
> wrote:
> > > >
> > > > > I made progress, thanks to Russell who answered my email the other
> day.
> > > > >
> > > > > I've got a simple javascript precommit hook installed and it seems
> to
> > > > > work fine, most of the time.  However, it will randomly timeout.
>  There
> > > > > aren't any interesting messages in any of the logs.  I am able to
> store
> > > > > a key/value pair one minute, but then not be able to store the same
> > > pair
> > > > > in the next minute.
> > > > >
> > > > > Where should I be looking to get more info?  Are there any "safe"
> > > > > operations, or operations that are discouraged in precommit hooks?
> > > > >
> > > > > Thanks,
> > > > > Hal
> > > > >
> > > > >
> > > > > _______________________________________________
> > > > > riak-users mailing list
> > > > > [email protected]
> > > > > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
> > > > >
> > > >
> > > >
> > > >
> > > > --
> > > > Sean Cribbs <[email protected]>
> > > > Developer Advocate
> > > > Basho Technologies, Inc.
> > > > http://www.basho.com/
> > >
> >
> >
> >
> > --
> > Sean Cribbs <[email protected]>
> > Developer Advocate
> > Basho Technologies, Inc.
> > http://www.basho.com/
>



-- 
Sean Cribbs <[email protected]>
Developer Advocate
Basho Technologies, Inc.
http://www.basho.com/
_______________________________________________
riak-users mailing list
[email protected]
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Reply via email to