Re: map reduce on multiple buckets

[Alex Moore]

One possibility would be to get the intermediate results from each bucket,
and then compute the final results on the client. How much data would be
involved in the initial MR, and at the point where you would have to
combine the results?

--Alex

On Thu, Jan 28, 2016 at 12:10 PM, Eugene Shubin  wrote:

> I want to keep daily and weekly data in different buckets, and generate
> monthly report using map reduce on these two.
> so 2 buckets and MR operations are custom.
>
> Best,
> Eugene
>
> 2016-01-28 17:29 GMT+01:00 Alex Moore :
>
>> Hi Eugene,
>>
>> MR is limited to one bucket for inputs, and the Solr inputs to a map
>> phase have this restriction too.
>>
>> How many buckets are you trying to MR across, and also what type of MR
>> operation are you trying to do? There may be another way to get around this
>> restriction.
>>
>> Thanks,
>> Alex
>>
>> On Thu, Jan 28, 2016 at 8:10 AM, Eugene Shubin 
>> wrote:
>>
>>> Is it possible to run mapreduce job on two or more buckets?
>>> I see from documentation that it might be possible if I specify inputs
>>> as list of {bucket, key} pairs,
>>> although list of secondary index inputs causes an error:
>>> riakc_pb_socket:mapred(P, [
>>> {index, Bucket1, Index1, From, To},
>>> {index, Bucket2, Index2, From, To}
>>>   ], ...
>>>  {error,<<"{inputs,{\"Inputs target tuples must be {B,K} or
>>> {{B,K},KeyData}:\",\n
>>>
>>> Is it possible using Solr (riak search) indexes?
>>>
>>> Evgenii Shubin
>>>
>>> ___
>>> riak-users mailing list
>>> riak-users@lists.basho.com
>>> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>>>
>>>
>>
>
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Cluster balance problem

[Stanislav Vlasov]

Hello!

We have riak cluster for riak-cs.
Failed node riak@192.168.0.133 has been replaced via 'riak-admin
replace' by riak@192.168.0.141 (new node), then cleaned up, prepared
and joined to cluster as new.
Member-status after last 'riak-admin cluster commit', when all
transfers complete:

= Membership ==
Status RingPendingNode
---
valid   8.6%  --  'riak@192.168.0.130'
valid   8.2%  --  'riak@192.168.0.131'
valid   8.2%  --  'riak@192.168.0.132'
valid   8.2%  --  'riak@192.168.0.133'
valid   8.2%  --  'riak@192.168.0.134'
valid   8.2%  --  'riak@192.168.0.135'
valid   8.2%  --  'riak@192.168.0.136'
valid   8.2%  --  'riak@192.168.0.137'
valid   8.2%  --  'riak@192.168.0.138'
valid   8.2%  --  'riak@192.168.0.139'
valid   8.2%  --  'riak@192.168.0.140'
valid   9.4%  --  'riak@192.168.0.141'
---
Valid:12 / Leaving:0 / Exiting:0 / Joining:0 / Down:0

Every node have 3.6T raid.
Free place on disk and used %:

192.168.0.130 996G 73%
192.168.0.131 1.2T 69%
192.168.0.132 1.2T 68%
192.168.0.133 1.1T 70%
192.168.0.134 1.1T 70%
192.168.0.135 1.2T 69%
192.168.0.136 1.2T 68%
192.168.0.137 1.2T 69%
192.168.0.138 1.2T 69%
192.168.0.139 1.2T 69%
192.168.0.140 1.2T 68%
192.168.0.141 808G 78%

Problem: on 192.168.0.141 very little free space compared to rest,
which may affect in merges on this node after uploading some
additional data into cluster.

Software versions:
ii riak 2.1.3-1 amd64 Riak is a distributed data store
ii riak-cs 2.0.0-1 amd64 Riak CS

Can i rebalance riak without adding/removing nodes or any hardware changes?

-- 
Stanislav

___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: A Solr join query in Riak KV?

[Zeeshan Lakhani]

Hey Joe,

Riak Search operates via Distributed Solr, for which “join” is *still* not 
supported: https://issues.apache.org/jira/browse/LUCENE-3759 
.

I’d recommend reading this LucidWorks post as well, related to “joins” and 
SolrCloud - 
https://support.lucidworks.com/hc/en-us/articles/201298257-Sharding-w-joins-SolrCloud-question
 
.
 

Thanks.

Zeeshan Lakhani
programmer | 
software engineer at @basho | 
org. member/founder of @papers_we_love | paperswelove.org
twitter => @zeeshanlakhani

> On Feb 8, 2016, at 2:36 PM, Joe Olson  wrote:
> 
> I'm trying to get a Solr join query to work on our Riak KV cluster. 
> 
> The Solr join query is documented here:
> 
> https://wiki.apache.org/solr/Join
> 
> Using the example under the "Compared to SQL" heading, I am formatting my 
> http request to Riak as:
> 
> curl "http:// IP>:8098/search/query/?wt=json=_yz_rk=xxx,yyy={%21join+from=+to=}zzz:vvv"
>  | jsonpp
> 
> The Riak listener will accept this query, but will return no documents. I've 
> verified each half of the query returns data when queried standalone using 
> the non-join notation.
> 
> Is anyone currently using Solr localparms notation successfully in Riak KV?
> ___
> riak-users mailing list
> riak-users@lists.basho.com
> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

A Solr join query in Riak KV?

[Joe Olson]

I'm trying to get a Solr join query to work on our Riak KV cluster. 

The Solr join query is documented here: 

https://wiki.apache.org/solr/Join 

Using the example under the "Compared to SQL" heading, I am formatting my http 
request to Riak as: 

curl "http://:8098/search/query/?wt=json=_yz_rk=xxx,yyy={%21join+from=+to=}zzz:vvv"
 | jsonpp 

The Riak listener will accept this query, but will return no documents. I've 
verified each half of the query returns data when queried standalone using the 
non-join notation. 

Is anyone currently using Solr localparms notation successfully in Riak KV? 
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com