Re: What in RiakS2 do AS3
Hi Brad! You're most of the way there. The access key and the secret key go into the riak-cs.conf file (usually located in /etc/riak-cs/ ). And you get them from creating an admin user. (And then copy paste them into the config file). http://docs.basho.com/riakcs/latest/cookbooks/configuration/Configuring-Riak-CS/#Specifying-the-Admin-User walks you through the steps. (You can create an admin user using a curl HTTP call, from the command line). The JSON response to issuing that http command will contain the key id and key secret. After creating the admin user and recording those keys in the config, there's a few more steps to take, to configure Riak for use with S2: http://docs.basho.com/riakcs/latest/cookbooks/configuration/Configuring-Riak/ Let us know if you have more questions. Dmitri On Mon, Aug 10, 2015 at 5:05 PM, Brad Aisa brad.a...@thetradedesk.com wrote: I'm new to both S3 and Riak -- I'm trying to set up local RiakS2 to run our integration tests (instead of writing to S3) -- where do I find or configure Access Key ID and Secret Key for the S3 api? The only thing I've found on the Basho site relates to setting up a S3cmd client. It provides this cryptic suggestion: To configure the s3cmd client for the user, you must change the access_key and secret_key settings. Any help is appreciated. *Brad Aisa* Senior Software Engineer brad.a...@thetradedesk.com amber.scou...@thetradedesk.com cell: 720-233-0225 1615 Pearl St., Boulder, CO 80302 @TheTradeDeskInc http://twitter.com/TheTradeDeskinc // Facebook http://www.facebook.com/TheTradeDesk // LinkedIn http://www.linkedin.com/company/the-trade-desk // TheTradeDesk.com http://www.thetradedesk.com/ [image: cid:8BA8BF40-3F6C-48D1-89D1-F8A3D3D4C074] ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Riak Go Client Beta is Available! .Net Client Update!
Hi All, The clients team has been hard at work on an official Riak Go client, and we’re ready to share our progress. To install it in your go project, just run `go get github.com/basho/riak-go-client` http://github.com/basho/riak-go-client%60. You can find more information on the project page (https://github.com/basho/riak-go-client https://github.com/basho/riak-go-client), and in the API docs (https://godoc.org/github.com/basho/riak-go-client https://godoc.org/github.com/basho/riak-go-client). Special thanks to Luke Bakkan Chris Mancini for their work on the client, and Timo Gatsonides for his inspiring work on goriakpbc. .NET Client 2.1.1 Available at: https://www.nuget.org/packages/RiakClient/2.1.1 https://www.nuget.org/packages/RiakClient/2.1.1 This release fixes a bug in the RiakPbcSocket class where connections were not being reclaimed after a forcible disconnect, which could result in running out of connections. Special thanks to Joseph Jeganathan for reporting the issue the PR. Thanks, Alex signature.asc Description: Message signed with OpenPGP using GPGMail ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
What in RiakS2 do AS3
I'm new to both S3 and Riak -- I'm trying to set up local RiakS2 to run our integration tests (instead of writing to S3) -- where do I find or configure Access Key ID and Secret Key for the S3 api? The only thing I've found on the Basho site relates to setting up a S3cmd client. It provides this cryptic suggestion: To configure the s3cmd client for the user, you must change the access_key and secret_key settings. Any help is appreciated. Brad Aisa Senior Software Engineer brad.a...@thetradedesk.commailto:amber.scou...@thetradedesk.com cell: 720-233-0225 1615 Pearl St., Boulder, CO 80302 @TheTradeDeskInchttp://twitter.com/TheTradeDeskinc // Facebookhttp://www.facebook.com/TheTradeDesk // LinkedInhttp://www.linkedin.com/company/the-trade-desk // TheTradeDesk.comhttp://www.thetradedesk.com/ [cid:8BA8BF40-3F6C-48D1-89D1-F8A3D3D4C074] ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Riak Search in bucket with write_once = true
Hi everyone,
Riak Search does not seem to work in a bucket whose bucket type has
write_once = true. I could not see this mentioned anywhere in the
documentation, but I was curious if it is to be expected? It seems like the
objects never get indexed.
My bucket type is:
riak-admin bucket-type create raw_tweets \
'{props: {search: true, search_index: index_raw_tweets,
n_val: 2, allow_mult: false, write_once: true}}' \
riak-admin bucket-type activate raw_tweets
If I remove write_once:true, the objects are indexed.
Many thanks
Marius
--
--
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: Riak Search in bucket with write_once = true
Hey Marius,
To put it simply, yes, 2.1.1 does not support write_once with search. Some
objects will get indexed, but it will take a very long time and there will be
issues with the cluster, etc…
There should have been a note about this. Our apologies. We have solved the
issue, and it will be supported in 2.1.2, which is our next release. You can
read more about it here: https://github.com/basho/yokozuna/issues/512
https://github.com/basho/yokozuna/issues/512.
Thanks.
Zeeshan Lakhani
programmer |
software engineer at @basho |
org. member/founder of @papers_we_love | paperswelove.org
twitter = @zeeshanlakhani
On Aug 10, 2015, at 4:22 PM, Marius Cobzarenco mar...@reinfer.io wrote:
Hi everyone,
Riak Search does not seem to work in a bucket whose bucket type has
write_once = true. I could not see this mentioned anywhere in the
documentation, but I was curious if it is to be expected? It seems like the
objects never get indexed.
My bucket type is:
riak-admin bucket-type create raw_tweets \
'{props: {search: true, search_index: index_raw_tweets, n_val:
2, allow_mult: false, write_once: true}}' \
riak-admin bucket-type activate raw_tweets
If I remove write_once:true, the objects are indexed.
Many thanks
Marius
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
SolrException: Error CREATEing SolrCore after deleting index
Hi, I deleted a search index through Erlang client. Then I saw this in solr log showing every minute: org.apache.solr.common.SolrException: Error CREATEing SolrCore 'todoriak_main_movie_idx': Unable to create core: todoriak_main_movie_idx Caused by: /var/lib/riak/yz/todoriak_main_movie_idx/data/index/_0.si (No such file or directory) at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:546) at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:152) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135) at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:732) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:268) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:217) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1075) Solr admin panel displays: SolrCore Initialization Failures todoriak_main_movie_idx: org.apache.solr.common.SolrException:org.apache.solr.common.SolrException: Error opening new searcher How can I fix it? -Hao___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
riak-admin diag errors
Hi Riak-users,
when I run riak-admin diag command, sometimes it's ok, sometimes it found
run time errors like below:
root@cluster1-hd13:~# riak-admin diag
RPC to 'riak@10.21.136.81' failed: {'EXIT',
{function_clause,
[{lists,zip,
[['riak@10.21.136.94'],[]],
[{file,lists.erl},{line,321}]},
{lists,zip,2,
[{file,lists.erl},{line,321}]},
{lists,zip,2,
[{file,lists.erl},{line,321}]},
{riaknostic_check_search,check,0,
[{file,
src/riaknostic_check_search.erl},
{line,49}]},
{riaknostic_check,check,1,
[{file,src/riaknostic_check.erl},
{line,74}]},
{riaknostic,'-run/1-fun-1-',2,
[{file,src/riaknostic.erl},
{line,106}]},
{lists,foldl,3,
[{file,lists.erl},{line,1197}]},
{riaknostic,run,1,
[{file,src/riaknostic.erl},
{line,105}]}]}}
By the way, I used riak 1.4.2 version on ubuntu with 9 nodes. (four nodes
have been added last month).
Any more background, do u want to know?
--
Amao Wang
Best Regards
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: SolrException: Error CREATEing SolrCore after deleting index
Hello Hao, I’m guessing that `todoriak_main_movie_idx` is the index you removed? Can you check to see if there are any buckets or bucket_types associated with that search_index? Also, what version of Riak are you using? We have a test here w/ the pb client to test a delete: https://github.com/basho/yokozuna/blob/3e749512d2df07c81def3c9c592615fd8d2d1234/riak_test/yz_pb.erl#L175 https://github.com/basho/yokozuna/blob/3e749512d2df07c81def3c9c592615fd8d2d1234/riak_test/yz_pb.erl#L175. I’m guessing that there may have been a race condition set in when deleting the index and the delete registering on all the nodes, as the operation happens asynchronously over cluster metadata. Is the error occurring on many nodes or just one? Thanks. On Aug 10, 2015, at 4:54 AM, Hao jusf...@163.com wrote: Error opening new searcher ___ riak-users mailing list riak-users@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Re: why leaving riak cluster so slowly and how to accelerate the speed
Hi Changmao,
The state of the cluster can be determined from running 'riak-admin
member-status' and 'riak-admin ring-status'.
If I understand the sequence of events, you:
1) Joined four new nodes to the cluster. (Which crashed due to not enough
disk space)
2) Removed them from the cluster via 'riak-admin cluster leave'. This is a
planned remove command, and expects for the nodes to gradually hand off
their partitions (to transfer ownership) before actually leaving. So this
is probably the main problem - the ring is stuck waiting for those nodes to
properly hand off.
3) Re-formatted those four nodes and re-installed Riak. Here is where it
gets tricky though. Several questions for you:
- Did you attempt to re-join those 4 reinstalled nodes into the cluster?
What was the output of the cluster join and cluster plan commands?
- Did the IP address change, after they were reformatted? If so, you
probably need to use something like 'reip' at this point:
http://docs.basho.com/riak/latest/ops/running/tools/riak-admin/#reip
The 'failed because of enotconn' error message is happening because the
cluster is waiting to hand off partitions to .94, but cannot connect to it.
Anyways, here's what I recommend. If you can lose the data, it's probably
easier to format and reinstall the whole cluster.
If not, you can 'force-remove' those four nodes, one by one (see
http://docs.basho.com/riak/latest/ops/running/cluster-admin/#force-remove )
On Thu, Aug 6, 2015 at 11:55 PM, changmao wang wang.chang...@gmail.com
wrote:
Dmitri,
Thanks for your quick reply.
my question are as below:
1. what's the current status of the whole cluster? Is't doing data balance?
2. there's so many errors during one of the node error log. how to handle
it?
2015-08-05 01:38:59.717 [error]
0.23000.298@riak_core_handoff_sender:start_fold:262 ownership_transfer
transfer of riak_kv_vnode from 'riak@10.21.136.81'
525227150915793236229449236757414210188850757632 to 'riak@10.21.136.94'
525227150915793236229449236757414210188850757632 failed because of enotconn
2015-08-05 01:38:59.718 [error]
0.195.0@riak_core_handoff_manager:handle_info:289 An outbound handoff of
partition riak_kv_vnode 525227150915793236229449236757414210188850757632
was terminated for reason: {shutdown,{error,enotconn}}
During the last 5 days, there's no changes of the riak-admin member
status output.
3. how to accelerate the data balance?
On Fri, Aug 7, 2015 at 6:41 AM, Dmitri Zagidulin dzagidu...@basho.com
wrote:
Ok, I think I understand so far. So what's the question?
On Thursday, August 6, 2015, Changmao.Wang changmao.w...@datayes.com
wrote:
Hi Riak users,
Before adding new nodes, the cluster only have five nodes. The member
list are as below:
10.21.136.66,10.21.136.71,10.21.136.76,10.21.136.81,10.21.136.86.
We did not setup http proxy for the cluster, only one node of the
cluster provide the http service. so the CPU load is always high on this
node.
After that, I added four nodes (10.21.136.[91-94]) to those cluster.
During the ring/data balance progress, each node failed(riak stopped)
because of disk 100% full.
I used multi-disk path to data_root parameter in
'/etc/riak/app.config'. Each disk is only 580MB size.
As you know, bitcask storage engine did not support multi-disk path.
After one of the disks is 100% full, it can not switch next idle disk. So
the riak service is down.
After that, I removed the new add four nodes at active nodes with
riak-admin cluster leave riak@'10.21.136.91'.
and then stop riak service on other active new nodes, reformat the
above new nodes with LVM disk management (bind 6 disk with virtual disk
group).
Replace the data-root parameter with one folder, and then start riak
service again. After that, the cluster began the data balance again.
That's the whole story.
Amao
--
*From: *Dmitri Zagidulin dzagidu...@basho.com
*To: *Changmao.Wang changmao.w...@datayes.com
*Sent: *Thursday, August 6, 2015 10:46:59 PM
*Subject: *Re: why leaving riak cluster so slowly and how to accelerate
the speed
Hi Amao,
Can you explain a bit more which steps you've taken, and what the
problem is?
Which nodes have been added, and which nodes are leaving the cluster?
On Tue, Jul 28, 2015 at 11:03 PM, Changmao.Wang
changmao.w...@datayes.com wrote:
Hi Raik user group,
I'm using riak and riak-cs 1.4.2. Last weekend, I added four nodes to
cluster with 5 nodes. However, it's failed with one of disks 100% full.
As you know bitcask storage engine can not support multifolders.
After that, I restarted the riak and leave the cluster with the
command riak-admin cluster leave and riak-admin cluster plan, and the
commit.
However, riak is always doing KV balance after my submit leaving
command. I guess that it's doing join cluster progress.
Could you show us how to accelerate the leaving progress? I have tuned
the transfer-limit parameters on 9 nodes.
below is some
