date:20150831

Re: Riak Recap - August 31, 2015

2015-08-31 Thread Christopher Meiklejohn

Hi Matthew,

I've been trying to get the Riak Mesos framework to compile and I've
been having difficulty.  Is there a definitive document that shows how
to get the beta running?  I've filed numerous issues and keep running
into compilation difficulties; it appears that it requires a specific
version of Ubuntu to compile and it uses a outdated version of godep
to compile dependencies.

For what it's worth, the Go developers I've talked to have advised
that godep should no longer be used for dependency management, and the
Makefile for the project seems to assume a number of dependencies are
installed without actually testing that they are present.

Has anyone else had success with getting this running?

- Christopher

On Mon, Aug 31, 2015 at 12:44 PM, Matthew Brender  wrote:
> We're starting the week with a Recap!
>
> The most common questions have come up around Riak Search (Apache Solr
> integration) in Riak KV. Here are some highlights of that topic and more.
>
> ## Announcements
> * The Riak KV Go (golang) client is out! 1.1 is the latest update [0]
> * The Riak Mesos framework is in beta and welcomes your feedback [1]
>
> ## Community Update
> * Our community repository received a major update this past week. We
> retired the Release Notes concept and added a set of labels to track
> projects and priorities [2]. See how you can get involved by checking out
> the open issues [3]
>
> ## Recently Answered
> * Zeeshan continues to teach us how Riak Search (Solr) works to help Hao
> learn about his configuration [4]
> * Dmitri explains getting started with Riak S2 (aka Riak CS) [5]
> * Zeeshan confirms that write_once buckets are not (yet) indexed in Riak
> Search [6]
> * Dmitri and Zeeshan give examples of custom indexing in Riak Search [7]
> * There's a great thread on monitoring protobufs [8]
> * We learn that the HTTP listening port is identical on all Riak KV nodes by
> default [9]
> * Toby found a way to get the FQDN recognized in a new cluster [10]
> * Dmitri explains that stale pending transfers in riak-admin will be
> dismissed with force commands [11]
> * Magnus links to helpful resources on deep pagination using Riak Search
> (Solr) [12]
>
> ## Open Questions - Need Your Help
> * Timur is writing a Scala wrapper project and has some further questions on
> CRDT logic [13]
> * Pete is running into an issue using Riak KV in Docker on Windows and he's
> due to send out his Vagrantfile [14]
>
> Have a great week,
> Matt Brender
> Developer Advocate @ Basho
> @mjbrender
>
> [0] https://github.com/basho/riak-go-client
> [1] https://github.com/basho-labs/riak-mesos#riak-mesos-framework-in-beta
> [2] https://github.com/basho-labs/the-basho-community#labels
> [3] https://github.com/basho-labs/the-basho-community/issues
> [4]
> http://lists.basho.com/pipermail/riak-users_lists.basho.com/2015-August/017451.html
> [5]
> http://lists.basho.com/pipermail/riak-users_lists.basho.com/2015-August/017454.html
> [6]
> http://lists.basho.com/pipermail/riak-users_lists.basho.com/2015-August/017457.html
> [7]
> http://lists.basho.com/pipermail/riak-users_lists.basho.com/2015-August/017466.html
> [8]
> http://lists.basho.com/pipermail/riak-users_lists.basho.com/2015-August/017445.html
> [9]
> http://lists.basho.com/pipermail/riak-users_lists.basho.com/2015-August/017474.html
> [10]
> http://lists.basho.com/pipermail/riak-users_lists.basho.com/2015-August/017478.html
> [11]
> http://lists.basho.com/pipermail/riak-users_lists.basho.com/2015-August/017489.html
> [12]
> http://lists.basho.com/pipermail/riak-users_lists.basho.com/2015-August/017515.html
> [13]
> http://lists.basho.com/pipermail/riak-users_lists.basho.com/2015-August/017502.html
> [14]
> http://lists.basho.com/pipermail/riak-users_lists.basho.com/2015-August/017527.html
>
> ___
> riak-users mailing list
> riak-users@lists.basho.com
> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>

___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: s3cmd error: access to bucket was denied

2015-08-31 Thread Shunichi Shinohara

Hmm.. it seems that situation is not good.

GET Bucket (aka List Objects) of Riak CS uses a kind of coverage
operation of Riak (KV),
and it shows timeout. There may be some log at riak nodes. You have to
look into logs in
all nodes because all nodes participate in coverage operations.

Could you try some further commands?
1. for sanity check,
   s3cmd -c s3cfg1 ls
2. To try list objects for completely empty buckets,
   s3cmd -c s3cfg1 mb s3://
   s3cmd -c s3cfg1 ls s3://
3. Another coverage operation, without riak cs
   curl -v 'http://127.0.0.1:8098/buckets/foobar/keys?keys=true'
   # 127.0.0.1 and 8098 should be changed to HTTP host and port
   # (*NOT* PB host/port) of one of riak nodes

Thanks,
Shino

On Thu, Aug 27, 2015 at 6:41 PM, changmao wang  wrote:
> Shunichi,
>
> Just now, I followed your direction to change fold_objects_for_list_keys to
> true, and restart riak-cs service.
>
>
> sed -i '/fold_objects_for_list_keys/ s/false/true/g'
> /etc/riak-cs/app.config; riak-cs restart
>
> After that, I run below command and got same error.
>
> s3cmd -c s3cfg1 ls s3://stock/XSHE/0/50/2008/XSHE-50-20080102 -d
>
> ...
> DEBUG: Unicodising 'ls' using UTF-8
> DEBUG: Unicodising 's3://stock/XSHE/0/50/2008/XSHE-50-20080102'
> using UTF-8
> DEBUG: Command: ls
> DEBUG: Bucket 's3://stock':
> DEBUG: String 'XSHE/0/50/2008/XSHE-50-20080102' encoded to
> 'XSHE/0/50/2008/XSHE-50-20080102'
> DEBUG: SignHeaders: 'GET\n\n\n\nx-amz-date:Thu, 27 Aug 2015 09:35:51
> +\n/stock/'
> DEBUG: CreateRequest: resource[uri]=/
> DEBUG: SignHeaders: 'GET\n\n\n\nx-amz-date:Thu, 27 Aug 2015 09:35:51
> +\n/stock/'
> DEBUG: Processing request, please wait...
> DEBUG: get_hostname(stock): stock.api2.cloud-datayes.com
> DEBUG: format_uri():
> http://stock.api2.cloud-datayes.com/?prefix=XSHE/0/50/2008/XSHE-50-20080102&delimiter=/
> WARNING: Retrying failed request:
> /?prefix=XSHE/0/50/2008/XSHE-50-20080102&delimiter=/ (timed out)
> WARNING: Waiting 3 sec...
> DEBUG: SignHeaders: 'GET\n\n\n\nx-amz-date:Thu, 27 Aug 2015 09:37:34
> +\n/stock/'
> DEBUG: Processing request, please wait...
> DEBUG: get_hostname(stock): stock.api2.cloud-datayes.com
> DEBUG: format_uri():
> http://stock.api2.cloud-datayes.com/?prefix=XSHE/0/50/2008/XSHE-50-20080102&delimiter=/
>
> below was last 10 errors from "/var/log/riak-cs/console.log"
> 2015-08-27 17:35:40.085 [error]
> <0.27146.26>@riak_cs_wm_common:maybe_create_user:223 Retrieval of user
> record for s3 failed. Reason: no_user_key
> 2015-08-27 17:37:34.744 [error]
> <0.27147.26>@riak_cs_wm_common:maybe_create_user:223 Retrieval of user
> record for s3 failed. Reason: no_user_key
> 2015-08-27 17:37:49.356 [error]
> <0.27146.26>@riak_cs_wm_common:maybe_create_user:223 Retrieval of user
> record for s3 failed. Reason: no_user_key
> 2015-08-27 17:39:49.249 [error]
> <0.27147.26>@riak_cs_wm_common:maybe_create_user:223 Retrieval of user
> record for s3 failed. Reason: no_user_key
> 2015-08-27 17:39:54.811 [error]
> <0.27146.26>@riak_cs_wm_common:maybe_create_user:223 Retrieval of user
> record for s3 failed. Reason: no_user_key
>
>
>
> On Wed, Aug 26, 2015 at 5:35 PM, Shunichi Shinohara  wrote:
>>
>> Sorry for delay and thanks for further information.
>> The log of Riak CS shows timeout in list query to Riak:
>>2015-08-24 16:59:49.717 [error] <0.18027.7> gen_fsm <0.18027.7> in
>> state
>>waiting_list_keys terminated with reason: <<"timeout">>
>>
>> There are some kinds of possibility for timeout, e.g. hardware resource.
>> But if the timeout is occured by large number of objects (manifests) in
>> your
>> bucket, improvement from 1.4.0 may help.
>> It can be used by setting
>>{fold_objects_for_list_keys, true}
>> in your app.config's riak_cs section or executing
>>application:set_env(riak_cs, fold_objects_for_list_keys, true).
>> by attaching to riak-cs node.
>> For more information about it, please refer the original PR [1].
>>
>> [1] https://github.com/basho/riak_cs/pull/600
>> --
>> Shunichi Shinohara
>> Basho Japan KK
>>
>>
>> On Wed, Aug 26, 2015 at 2:04 PM, Stanislav Vlasov
>>  wrote:
>> > 2015-08-25 11:03 GMT+05:00 changmao wang :
>> >> Any ideas on this issue?
>> >
>> > Can you check credentials with another client?
>> > s3curl, for example?
>> >
>> > I got some bugs in s3cmd after debian upgrade, so if another client
>> > works, than s3cmd has bug.
>> >
>> >> On Mon, Aug 24, 2015 at 5:09 PM, changmao wang
>> >> 
>> >> wrote:
>> >>>
>> >>> Please check attached file for details.
>> >>>
>> >>> On Mon, Aug 24, 2015 at 4:48 PM, Shunichi Shinohara 
>> >>> wrote:
>> 
>>  Then, back to my first questions:
>>  Could you provide results following commands with s3cfg1?
>>  - s3cmd ls
>>  - s3cmd info s3://stock
>> 
>>  From log file, gc index queries timed out again and again.
>>  Not sure but it may be subtle situation...
>> 
>>  --
>>  Shunichi Shinohara
>>  Basho Japan KK
>> >>

Riak Recap - August 31, 2015

2015-08-31 Thread Matthew Brender

We're starting the week with a Recap!

The most common questions have come up around Riak Search (Apache Solr
integration) in Riak KV. Here are some highlights of that topic and more.

## Announcements
* The Riak KV Go (golang) client is out! 1.1 is the latest update [0]
* The Riak Mesos framework is in beta and welcomes your feedback [1]

## Community Update
* Our community repository received a major update this past week. We
retired the Release Notes concept and added a set of labels to track
projects and priorities [2]. See how you can get involved by checking out
the open issues [3]

## Recently Answered
* Zeeshan continues to teach us how Riak Search (Solr) works to help Hao
learn about his configuration [4]
* Dmitri explains getting started with Riak S2 (aka Riak CS) [5]
* Zeeshan confirms that write_once buckets are not (yet) indexed in Riak
Search [6]
* Dmitri and Zeeshan give examples of custom indexing in Riak Search [7]
* There's a great thread on monitoring protobufs [8]
* We learn that the HTTP listening port is identical on all Riak KV nodes
by default [9]
* Toby found a way to get the FQDN recognized in a new cluster [10]
* Dmitri explains that stale pending transfers in riak-admin will be
dismissed with force commands [11]
* Magnus links to helpful resources on deep pagination using Riak Search
(Solr) [12]

## Open Questions - Need Your Help
* Timur is writing a Scala wrapper project and has some further questions
on CRDT logic [13]
* Pete is running into an issue using Riak KV in Docker on Windows and he's
due to send out his Vagrantfile [14]

Have a great week,
Matt Brender
Developer Advocate @ Basho
@mjbrender

[0] https://github.com/basho/riak-go-client
[1] https://github.com/basho-labs/riak-mesos#riak-mesos-framework-in-beta
[2] https://github.com/basho-labs/the-basho-community#labels
[3] https://github.com/basho-labs/the-basho-community/issues
[4]
http://lists.basho.com/pipermail/riak-users_lists.basho.com/2015-August/017451.html
[5]
http://lists.basho.com/pipermail/riak-users_lists.basho.com/2015-August/017454.html
[6]
http://lists.basho.com/pipermail/riak-users_lists.basho.com/2015-August/017457.html
[7]
http://lists.basho.com/pipermail/riak-users_lists.basho.com/2015-August/017466.html
[8]
http://lists.basho.com/pipermail/riak-users_lists.basho.com/2015-August/017445.html
[9]
http://lists.basho.com/pipermail/riak-users_lists.basho.com/2015-August/017474.html
[10]
http://lists.basho.com/pipermail/riak-users_lists.basho.com/2015-August/017478.html
[11]
http://lists.basho.com/pipermail/riak-users_lists.basho.com/2015-August/017489.html
[12]
http://lists.basho.com/pipermail/riak-users_lists.basho.com/2015-August/017515.html
[13]
http://lists.basho.com/pipermail/riak-users_lists.basho.com/2015-August/017502.html
[14]
http://lists.basho.com/pipermail/riak-users_lists.basho.com/2015-August/017527.html
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: A problem running Riak in a Docker image under Vagrant on Windows 7,8 and 10

2015-08-31 Thread Christopher Mancini

Hey Pete,

If you want to share your setup, I will try to replicate the problem and
see if I can help.

Chris

On Mon, Aug 31, 2015 at 2:08 PM Matthew Brender  wrote:

> Hey Pete,
>
> That's an interesting situation that leads me to think its a Windows
> Vagrant consideration, given that everything runs on OS X. Is your
> Dockerfile in a place we could see it and/or run it?
>
> FWIW, Hector has a project that works well. Maybe you can reference
> his setup [0]. I'd also welcome a cross-post to StackOverflow in case
> its a common Windows + Vagrant issue that our community may miss [1].
>
> [0] http://stackoverflow.com/questions/tagged/riak
> [1] https://github.com/hectcastro/vagrant-multi-docker-riak
>
> Matt Brender | Developer Advocacy Lead
> Basho Technologies
> t: @mjbrender
>
>
> On Fri, Aug 28, 2015 at 3:49 AM, Pete Slater  wrote:
> >
> > I am having a problem with a Docker image running Riak which is causing
> me concern.
> >
> > I have a Docker image which is being run inside of a Vagrant container.
> The Docker image is running Riak in a CentOS 7 guest OS and is configured
> to start via a supervisor script.
> >
> > The issue I am having is that when running the Vagrant VM in a MacOS
> host OS, Riak in the Docker image starts fine.
> >
> > However when I run the same Vagrantfile in a Windows host OS, Riak fails
> to start with an error ‘Protocol: ~tp: the name riak@127.0.0.1 riak@127.0.0.1> seems to be in use by another erlang node’
> >
> > I have tried changing the codename but the error persists.
> >
> > The strange thing is that Riak seems to be running as we can query it
> via the REST API. But when trying to communicate to it when logged into the
> Docker container and doing something like ‘riak ping’ we get Node ‘
> riak@127.0.0.1’ not responding to pings.
> >
> > Any help would be appreciated. If you need further information then
> please ask.
> >
> >
> >
> >
> >
> >
> > ___
> > riak-users mailing list
> > riak-users@lists.basho.com
> > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>
> ___
> riak-users mailing list
> riak-users@lists.basho.com
> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: A problem running Riak in a Docker image under Vagrant on Windows 7,8 and 10

2015-08-31 Thread Matthew Brender

Hey Pete,

That's an interesting situation that leads me to think its a Windows
Vagrant consideration, given that everything runs on OS X. Is your
Dockerfile in a place we could see it and/or run it?

FWIW, Hector has a project that works well. Maybe you can reference
his setup [0]. I'd also welcome a cross-post to StackOverflow in case
its a common Windows + Vagrant issue that our community may miss [1].

[0] http://stackoverflow.com/questions/tagged/riak
[1] https://github.com/hectcastro/vagrant-multi-docker-riak

Matt Brender | Developer Advocacy Lead
Basho Technologies
t: @mjbrender


On Fri, Aug 28, 2015 at 3:49 AM, Pete Slater  wrote:
>
> I am having a problem with a Docker image running Riak which is causing me 
> concern.
>
> I have a Docker image which is being run inside of a Vagrant container. The 
> Docker image is running Riak in a CentOS 7 guest OS and is configured to 
> start via a supervisor script.
>
> The issue I am having is that when running the Vagrant VM in a MacOS host OS, 
> Riak in the Docker image starts fine.
>
> However when I run the same Vagrantfile in a Windows host OS, Riak fails to 
> start with an error ‘Protocol: ~tp: the name 
> riak@127.0.0.1 seems to be in use by another erlang 
> node’
>
> I have tried changing the codename but the error persists.
>
> The strange thing is that Riak seems to be running as we can query it via the 
> REST API. But when trying to communicate to it when logged into the Docker 
> container and doing something like ‘riak ping’ we get Node 
> ‘riak@127.0.0.1’ not responding to pings.
>
> Any help would be appreciated. If you need further information then please 
> ask.
>
>
>
>
>
>
> ___
> riak-users mailing list
> riak-users@lists.basho.com
> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: Fastest Method for Importing Into Riak.

2015-08-31 Thread Alex Moore

Hi Dennis,

The fastest way would be to chunk your file, and use a Parallel.ForEach
loop to do parallel puts.  Just make sure you have your connection pool size

turned up, and you override the default MaxDegreesOfParallelism

limit
too (these two should match, or the pool should be bigger).

Thanks,
Alex

On Tue, Aug 18, 2015 at 5:03 PM, Dennis Nicolay 
wrote:

> Hi,
>
>
>
> What is the fastest way to import data from a delimited file into Riak
> using the .net RiakClient?
>
>
>
> Is there a bulk insert using the other Riak clients?
>
>
>
> Thanks in advance,
>
> Dennis
>
> ___
> riak-users mailing list
> riak-users@lists.basho.com
> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>
>
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: Riak Recap - August 31, 2015

Re: s3cmd error: access to bucket was denied

Riak Recap - August 31, 2015

Re: A problem running Riak in a Docker image under Vagrant on Windows 7,8 and 10

Re: A problem running Riak in a Docker image under Vagrant on Windows 7,8 and 10

Re: Fastest Method for Importing Into Riak.

6 matches

Site Navigation

Mail list logo

Footer information