Re: How to control max RAM size of a Solr process?

[mtakahashi-ivi]

Hello,

I found cause of this issue.
If solr.directoryFactory is set as "solr.NRTCachingDirectoryFactory"(that is
default value of directoryFactory), solr allocates off-heap memory. Which is
used for memory mapped file, I think.

Thank you,
Masanori Takahashi




--
View this message in context: 
http://riak-users.197444.n3.nabble.com/How-to-control-max-RAM-size-of-a-Solr-process-tp4033727p4033734.html
Sent from the Riak Users mailing list archive at Nabble.com.

___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Riak Ruby Client 2.2.2

[Bryce Kerley]

The Riak Ruby Client has been updated to version 2.2.2, which is a bugfix 
release.

* Corrected Hidekazu Tanaka's name in the 2.2.1 release notes.
* Deleting maps inside map CRDTs works, thanks to Kazuhiro Suzuki.
* Fix `Riak::Search::Index` documentation in the readme, thanks to Zshawn Syed.
* Tighten up the i18n gem requirement, thanks to Sean Kelly.

To update your applications to use this newest version:

1) Make sure your Gemfile’s version declaration for riak-client does not rule 
out a 2.2.2 version.
2) Run `bundle update`
3) Run your tests and make sure everything works

This release mostly includes changes by and for users like you! If you have any 
issues, please let us know!

Thanks,
Bryce Kerley
br...@basho.com

smime.p7s
Description: S/MIME cryptographic signature
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: Memory Errors when using RiakCS

[Charlie Voiselle]

Ben:

Awesome!  Happy that that got you sorted out.  

-cv


> On Nov 24, 2015, at 11:57 AM, Ben Rudolph  wrote:
> 
> Right you are:
> 2015-11-23 18:11:19.260 [warning] 
> <0.142.0>@riak_cs_app:check_bucket_props:128 Unable to verify moss.access 
> bucket settings (disconnected).
> 2015-11-23 18:11:19.261 [warning] 
> <0.142.0>@riak_cs_app:check_bucket_props:128 Unable to verify moss.storage 
> bucket settings (disconnected).
> 2015-11-23 18:11:19.261 [warning] 
> <0.142.0>@riak_cs_app:check_bucket_props:128 Unable to verify moss.buckets 
> bucket settings (disconnected).
> 2015-11-23 18:11:19.261 [error] <0.142.0>@riak_cs_app:sanity_check:70 Could 
> not verify bucket properties. Error was disconnected.
> 2015-11-23 18:11:19.261 [error] <0.141.0> CRASH REPORT Process <0.141.0> with 
> 0 neighbours exited with reason: 
> {error_verifying_props,{riak_cs_app,start,[normal,[]]}} in 
> application_master:init/4 line 133
> 2015-11-23 18:11:19.262 [info] <0.7.0> Application riak_cs exited with 
> reason: {error_verifying_props,{riak_cs_app,start,[normal,[]]}}
> 
> Dang, sorry I think I was misled by the `config OK` signal at the beginning 
> of the error.
> 
> On Tue, Nov 24, 2015 at 11:40 AM, Charlie Voiselle  > wrote:
> Ben:
> 
> It is not uncommon to see the 
>> [os_mon] memory supervisor port (memsup): Erlang has closed 
> message when the Erlang VM shuts down.   Would it be possible for you to 
> share your console.log file to the list?  There is probably another 
> configuration error causing your riak-cs nodes to shut down automatically.   
> Misconfigured default bucket types is one such problem that will cause a 
> riak-cs node to start and then stop immediately.
> 
> Thanks,
> Charlie Voiselle
> Basho, Client Services.
> 
> 
>> On Nov 23, 2015, at 1:30 PM, Ben Rudolph > > wrote:
>> 
>> Hi,
>> 
>> We've been trying to setup RiakCS for storing files on our website, 
>> http://commcarehq.org/ . It's been difficult for us 
>> to deploy because we've been having issues with our servers not being able 
>> to start Riak due to memory errors. Here's what a traceback looks like when 
>> I try and start Riak with `riak-console`:
>> 
>> config is OK
>> -config /var/lib/riak-cs/generated.configs/app.2015.11.23.18.11.17.config 
>> -args_file /var/lib/riak-cs/generated.configs/vm.2015.11.23.18.11.17.args 
>> -vm_args /var/lib/riak-cs/generated.configs/vm.2015.11.23.18.11.17.args
>> Exec:  /usr/lib/riak-cs/erts-5.10.3/bin/erlexec -boot 
>> /usr/lib/riak-cs/releases/2.0.1/riak-cs   -config 
>> /var/lib/riak-cs/generated.configs/app.2015.11.23.18.11.17.config -args_file 
>> /var/lib/riak-cs/generated.configs/vm.2015.11.23.18.11.17.args -vm_args 
>> /var/lib/riak-cs/generated.configs/vm.2015.11.23.18.11.17.args  
>> -pa /usr/lib/riak-cs/lib/basho-patches -- console
>> Root: /usr/lib/riak-cs
>> Erlang R16B02_basho8 (erts-5.10.3) [source] [64-bit] [smp:8:8] 
>> [async-threads:64] [kernel-poll:true] [frame-pointer]
>> 
>> =INFO REPORT 23-Nov-2015::18:11:18 ===
>> alarm_handler: {set,{system_memory_high_watermark,[]}}
>> =INFO REPORT 23-Nov-2015::18:11:18 ===
>> opening log file: "/var/log/riak-cs/access.log.2015_11_23_18"
>> Eshell V5.10.3  (abort with ^G)
>> (**)1> [os_mon] memory supervisor port (memsup): Erlang has closed 
>>  
>> The machines we are trying to deploy to have 8GB of RAM and also running a 
>> few other services, but have 3-4GB of RAM available. Are there any 
>> configuration params we can use so it consumes less memory? I've taken a 
>> look at the `system_memory_high_watermark` which is the error we see 
>> (http://docs.basho.com/riak/latest/ops/running/recovery/errors/ 
>> ). Our 
>> configs can be found here in case that's useful:
>> 
>> https://github.com/dimagi/commcarehq-ansible/tree/riak/ansible/roles/riakcs/templates
>>  
>> 
>> 
>> Any insight would be useful! Thank you!
>> 
>> Ben
>> 
>> 
>> 
>> ___
>> riak-users mailing list
>> riak-users@lists.basho.com 
>> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com 
>> 
> 
> 

___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Sorting of data using 2i pagination

[Grigory Fateyev]

Hello!

We use 2i pagination and it is very good. The only thing that
bothering me is sorting. Now data returns in ascending order but we
need descending order. How can we do it?

-- 
Best regards!
gfborn [at] gmail [dot] com

___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

How to control max RAM size of a Solr process?

[mtakahashi-ivi]

If I use riak search, riak launches solr process.
After I put half a million objects, Solr process allocates bigger size of
RAM than I set in search.solr.jvm_options.
For example, even if I set "-Xmx 512", Solr process allocates 2GB of memory.
My questions are
* How to control max RAM size of a Solr process?
* What the off-heap memory is used for?


Masanori Takahashi



--
View this message in context: 
http://riak-users.197444.n3.nabble.com/How-to-control-max-RAM-size-of-a-Solr-process-tp4033727.html
Sent from the Riak Users mailing list archive at Nabble.com.

___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Memory Errors when using RiakCS

[Ben Rudolph]

Hi,

We've been trying to setup RiakCS for storing files on our website,
http://commcarehq.org/. It's been difficult for us to deploy because we've
been having issues with our servers not being able to start Riak due to
memory errors. Here's what a traceback looks like when I try and start Riak
with `riak-console`:

config is OK
> -config /var/lib/riak-cs/generated.configs/app.2015.11.23.18.11.17.config
> -args_file /var/lib/riak-cs/generated.configs/vm.2015.11.23.18.11.17.args
> -vm_args /var/lib/riak-cs/generated.configs/vm.2015.11.23.18.11.17.args
> Exec:  /usr/lib/riak-cs/erts-5.10.3/bin/erlexec -boot
> /usr/lib/riak-cs/releases/2.0.1/riak-cs   -config
> /var/lib/riak-cs/generated.configs/app.2015.11.23.18.11.17.config
> -args_file /var/lib/riak-cs/generated.configs/vm.2015.11.23.18.11.17.args
> -vm_args /var/lib/riak-cs/generated.configs/vm.2015.11.23.18.11.17.args
>  -pa /usr/lib/riak-cs/lib/basho-patches -- console
> Root: /usr/lib/riak-cs
> Erlang R16B02_basho8 (erts-5.10.3) [source] [64-bit] [smp:8:8]
> [async-threads:64] [kernel-poll:true] [frame-pointer]
>
> =INFO REPORT 23-Nov-2015::18:11:18 ===
> alarm_handler: {set,{system_memory_high_watermark,[]}}
> =INFO REPORT 23-Nov-2015::18:11:18 ===
> opening log file: "/var/log/riak-cs/access.log.2015_11_23_18"
> Eshell V5.10.3  (abort with ^G)
> (**)1> [os_mon] memory supervisor port (memsup): Erlang has closed



The machines we are trying to deploy to have 8GB of RAM and also running a
few other services, but have 3-4GB of RAM available. Are there any
configuration params we can use so it consumes less memory? I've taken a
look at the `system_memory_high_watermark` which is the error we see (
http://docs.basho.com/riak/latest/ops/running/recovery/errors/). Our
configs can be found here in case that's useful:

https://github.com/dimagi/commcarehq-ansible/tree/riak/ansible/roles/riakcs/templates

Any insight would be useful! Thank you!

Ben
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Re: How to control max RAM size of a Solr process?

[Jason Voegele]

> On Nov 24, 2015, at 4:03 AM, mtakahashi-ivi  
> wrote:
> 
> If I use riak search, riak launches solr process.
> After I put half a million objects, Solr process allocates bigger size of
> RAM than I set in search.solr.jvm_options.
> For example, even if I set "-Xmx 512", Solr process allocates 2GB of memory.
> My questions are
> * How to control max RAM size of a Solr process?
> * What the off-heap memory is used for?

Hi Masanori,

Can you please provide the full and exact value you have for the 
search.sol.jvm_options property? Better yet, your full Riak config file if you 
can share it.

As for off-heap memory, I don’t believe Solr utilizes off-heap memory in any 
way. Do you have any indication otherwise?

-- 
Jason Voegele
"Most of us, when all is said and done, like what we like and make up reasons 
for it afterwards."
-- Soren F. Petersen
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Solr Results Grouping using RiakSearchRequest

[Dennis Nicolay]

Hi,

 

Is there a way to use RiakSearchRequest to accomplish the following http
solr query?

 

http://10.3.3.190:8091/solr/cdkcdrbucketindex/select?wt=json

=true=DateOnly_s=TransmissionStateName_s:DELIVERED=true
oup.field=DateOnly_s=1000

Thanks,

Dennis

 

 

 

___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com