Json facet api method stream

2015-12-21 Thread Yago Riveiro
Hi, The json facet API method "stream" uses the docvalues internally for do the aggregation on the fly? I wan't to know if using this method justifies have the docvalues configured in schema. - Best regards -- View this message in context: http://lucene.472066.n3.nabble.com/Json-facet-api

Re: Json facet api method stream

2015-12-22 Thread Yago Riveiro
Ok, I’m surprised with the difference of speed between DV and stream, the same query (aggregate 7M unique keys) with stream method takes 21s and with DV is about 3 minutes ...  —/Yago Riveiro On Tue, Dec 22, 2015 at 1:46 AM, Yonik Seeley wrote: > On Mon, Dec 21, 2015 at 6:56 PM, Y

Indexing using a collection alias

2015-12-22 Thread Yago Riveiro
Hi, It's possible index documents using the alias and not the collection name, if the alias only point to one collection? The Solr collection API doesn't allow rename a collection, so I wan't to know if with aliases I can achieve this functionality. All documentation that I googled use the alias

Json facet query error "null:java.lang.IllegalArgumentException"

2015-12-22 Thread Yago Riveiro
Hi, I'm hitting an error when a try to run a json facet query in a node that doesn't have any shard that belongs to collection. The same query using using the legacy facet method works. http://devel-16:8983/solr/collection-perf/query?rows=0&q=*:*&json.facet={label:{type:terms,field:url,limit:-1,s

Re: Json facet query error "null:java.lang.IllegalArgumentException"

2015-12-22 Thread Yago Riveiro
I’m in 5.3.1. I’m waiting some time to upgrade to 5.4 to see if some nasty bug is reported. But after hitting this issue I think that I should upgrade ... —/Yago Riveiro On Tue, Dec 22, 2015 at 3:17 PM, Yonik Seeley wrote: > OK found the issue: > https://issues.apache.org/jira/

Re: Json facet api method stream

2015-12-22 Thread Yago Riveiro
url with the unique users and the average response time (minutes is acceptable, but less as possible is desirable) —/Yago Riveiro On Tue, Dec 22, 2015 at 3:27 PM, Yonik Seeley wrote: > On Tue, Dec 22, 2015 at 6:06 AM, Yago Riveiro wrote: >> I’m surprised with the difference of spe

Re: Json facet api method stream

2015-12-22 Thread Yago Riveiro
ceived % Xferd  Average Speed   Time    Time     Time  Current                                  Dload  Upload   Total   Spent    Left  Speed 100 90.7M    0 90.7M    0     0  9276k      0 --:--:--  0:00:10 --:--:-- 22.6M real0m10.026s user0m0.038s sys 0m0.245s [yago@dev-1 ~]$ diff dum

Re: Scaling SolrCloud

2016-01-19 Thread Yago Riveiro
ull-recover replicas that in some point are out of sync, happen a lot restarting nodes (this is annoying with replicas with 100G), don't underestimate this point. Free space can save your life. \-- /Yago Riveiro > On Jan 19 2016, at 11:26 pm, Shawn Heisey <apa...@elyograg.org> w

Re: Scaling SolrCloud

2016-01-20 Thread Yago Riveiro
d with replicas with 100G take an hour or more (normally when this happen, we disable indexing to release IO and CPU and not kill the node with a load of 50 or 60). In this department my advice is "keep it simple" in the end is an HTTP POST to a node of the cluster. \-- /Yago Ri

Re: Scaling SolrCloud

2016-01-21 Thread Yago Riveiro
Is not a typo. I was wrong, for zookeeper 2 nodes still count as majority. It's not the desirable configuration but is tolerable. Thanks Erick. \-- /Yago Riveiro > On Jan 21 2016, at 4:15 am, Erick Erickson <erickerick...@gmail.com> wrote: > > bq: 3 are to ris

Solr Replication error

2016-01-24 Thread Yago Riveiro
I cached this in my logs. Any reason to this happen? My Solr version is 5.3.1. Index fetch failed :org.apache.solr.common.SolrException: Index fetch failed : at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:515) at org.apache.solr.handler.IndexFetcher.fe

Re: Bulk delete of Solr documents

2016-02-08 Thread Yago Riveiro
Yes. You can delete using a query http://blog.dileno.com/archive/201106/delete-documents-from-solr-index-by- query/ \-- /Yago Riveiro > On Feb 8 2016, at 4:35 pm, Anil <anilk...@gmail.com> wrote: > > Hi , > > Can we delete solr documents from a

How can I monitor the jetty thread pool

2016-03-07 Thread Yago Riveiro
Hi, How can I monitor the jetty thread pool? I want to do a zabbix graph with this info but the JMX doesn't show any entry for this. - Best regards -- View this message in context: http://lucene.472066.n3.nabble.com/How-can-I-monitor-the-jetty-thread-pool-tp4262298.html Sent from the Solr

IllegalArgumentException: Seeking to negative position

2016-03-08 Thread Yago Riveiro
I saw this exception in my log. What can caused this? java.lang.IllegalArgumentException: Seeking to negative position: MMapIndexInput(path="/opt/solr/node/collections/2016_shard9_replica2/data/index/_0.fdx") at org.apache.lucene.store.ByteBufferIndexInput$SingleBufferImpl.seek(ByteBufferI

Re: JSON facets, count a long or an integer in cloud and non-cloud modes

2016-03-22 Thread Yago Riveiro
I have the same problem with a custom response writer. In production works but in my dev doesn't and are the same version 5.3.1 -- Yago Riveiro On 22 Mar 2016 08:47 +, Markus Jelsma, wrote: > Hello, > > Using SolrJ i built a method that consumes output produced by JSON face

Re: JSON facets, count a long or an integer in cloud and non-cloud modes

2016-03-22 Thread Yago Riveiro
I have a felling that this is related with the number of nodes of the cluster. My dev runs in cloud mode but only has one node, production has 12, and the version is the same. \-- /Yago Riveiro > On Mar 22 2016, at 9:13 am, Markus Jelsma <markus.jel...@openindex.io&

java.lang.NullPointerException in json facet hll function

2016-03-22 Thread Yago Riveiro
Solr version: 5.3.1 With this query: group: { type:terms, limit:-1, field:group, sort:{index:asc}, numBuckets:true, facet:{ col_1_unique_visitors:'hll(visitor__visitor_i

Re: java.lang.NullPointerException in json facet hll function

2016-03-22 Thread Yago Riveiro
ields, isn't it? \-- /Yago Riveiro > On Mar 22 2016, at 5:00 pm, Yonik Seeley <ysee...@gmail.com> wrote: > > Hmmm, looks like the "hll" value is missing for some reason. It's not clear why that would happen... are you running any custom code? > > -Yo

Re: Next Solr Release - 5.5.1 or 6.0 ?

2016-03-24 Thread Yago Riveiro
-index can take several months). Optimize one replica at a time doesn't work (All replicas are optimize at the same time) killing CPU an IO and as result the cluster. Conclusion, if I need to do it again to upgrade to a newer version of Solr I'm in literally in troubles ... \-

Unable to create collection in 5.5

2016-03-28 Thread Yago Riveiro
Hi, With solr 5.5 I can't create a collection with the name collection-16, and in 5.3.1 I can do it, Why? 4001org.apache.solr.common.SolrExceptionorg.apache.solr.common.SolrExceptionInvalid name: 'collection-16' Identifiers must consist entirely of periods, underscores and alphanumerics400

Re: Unable to create collection in 5.5

2016-03-28 Thread Yago Riveiro
This kind of stuff can't be released without a way to rename the current collections with hyphens (even for 6.0) \-- /Yago Riveiro ![](https://link.nylas.com/open/m7fkqw0yim04itb62itnp7r9/d6c3ba33ed5f4ac8af3b2 9c07e2c5e91) On Mar 28 2016, at 5:19 pm, Anshum Gupta

Re: Unable to create collection in 5.5

2016-03-28 Thread Yago Riveiro
uster with thousand of collections is like no-no. Sorry but without a way to rename old collection to collection_*, the enforce to do not allow hyphens is frustrating as a user. \-- /Yago Riveiro ![](https://link.nylas.com/open/m7fkqw0yim04itb62itnp7r9/ec42b9ccdd9a4285b0ff0 8cf203af0f

Re: Facet by truncated date

2016-03-31 Thread Yago Riveiro
. date:"2016-03-31T12:00:0Z" truncated_date_s:'2016-03-31' or truncated_date_i:20160331 (this should be more memory efficient) \-- /Yago Riveiro ![](https://link.nylas.com/open/m7fkqw0yim04itb62itnp7r9/4708d221e9a24b519bab6 3936013ce59) On Mar 31 2016, at 10:08

Re: Facet by truncated date

2016-03-31 Thread Yago Riveiro
ounts? \-- /Yago Riveiro ![](https://link.nylas.com/open/m7fkqw0yim04itb62itnp7r9/eae9e3a3308049849ef01 3655c85f3ba) On Mar 31 2016, at 10:26 am, Emir Arnautovic <emir.arnauto...@sematext.com> wrote: > Hi Yago, Not sure if I misunderstood the case, but assuming you have date

shareSchema property unknown in new solr.xml format

2015-07-20 Thread Yago Riveiro
:615)         at org.eclipse.jetty.start.Main.main(Main.java:96) —/Yago Riveiro

Re: shareSchema property unknown in new solr.xml format

2015-07-20 Thread Yago Riveiro
Thank Hoss this was the example that I saw to configure my solr.xml I have more than 250 cores and any resource that I can optimize is always welcome but if in 5.x this feature is deprecated I will try to upgrade as soon as possible.

upgrade clusterstate.json fom 4.10.4 to split state.json in 5.2.1

2015-07-21 Thread Yago Riveiro
? —/Yago Riveiro

Solr 4.10.4 - Index is bigger before optimize for the same data in 4.6.1

2015-07-22 Thread Yago Riveiro
I'm preparing my data to migrate to 5.x from 4.6.1. One step referred in documentation is upgrade the index to 4.10.4 format. To do this, I used the command "java -cp lucene-core-4.10.4.jar org.apache.lucene.index.IndexUpgrader". The index size was 395 gigas and now is ~430 gigas. The only differen

Too many updates received since start

2015-08-22 Thread Yago Riveiro
Hi, Can anyone explain me the possible causes of this warning? too many updates received since start - startingUpdates no longer overlaps with our currentUpdates This warning triggers an full recovery for the shard that throw the warning. - Best regards -- View this message in context: h

Re: Too many updates received since start

2015-08-22 Thread Yago Riveiro
My heap is about 24G an I tuned it using this link https://wiki.apache.org/solr/ShawnHeisey#GC_Tuning_for_Solr Shawn updated since I use it and some configuration are not in this document any more. I see on my GC logs pauses about 6s, my index has a high index rate > 1000 docs/s. I'm running jav

Re: Too many updates received since start

2015-08-22 Thread Yago Riveiro
, Aug 22, 2015 at 8:53 PM, Shawn Heisey wrote: > On 8/22/2015 11:51 AM, Yago Riveiro wrote: >> My heap is about 24G an I tuned it using this link >> https://wiki.apache.org/solr/ShawnHeisey#GC_Tuning_for_Solr >> >> Shawn updated since I use it and some configuration a

Re: Too many updates received since start

2015-08-23 Thread Yago Riveiro
Indeed, I don't understand the caveat too, but I can imagine that is related with some algorithm to trigger a full sync if necessary. I will waiting for 5.3 to do the upgrade and have this configuration available. —/Yago Riveiro On Sun, Aug 23, 2015 at 3:37 AM, Shawn Heisey wrote: &

Re: GC parameters tuning for core of 140M docs on 50G of heap memory

2015-08-24 Thread Yago Riveiro
Do you have docValues on for your fields? On Mon, Aug 24, 2015 at 7:48 AM, Pavel Hladik wrote: > Hi, > we have a Solr 5.2.1 with 9 cores and one of them has 140M docs. Can you > please recommend tuning of those GC parameters? The performance is not a > issue, sometimes during peaks we have OOM a

Problem with CoreAdmin API CREATE command

2015-09-15 Thread Yago Riveiro
Hi, I’m having some issues with the command CREATE of the CoreAdmin API in solr 4.10.4. When I try to load a previous unloaded core with CREATE command, the result of this operation is 2 replicas in down state. One with the original coreNodeName set in clusterstate.json and other with an new one.

Re: Problem with CoreAdmin API CREATE command

2015-09-17 Thread Yago Riveiro
shard param and creates a new random coreNodeName that doesn’t correspond to the name of the clusterstate, the result … the core is loaded twice or even worse, in some situation is attached to a wrong shard. —/Yago Riveiro On Wed, Sep 16, 2015 at 4:38 PM, Erick Erickson wrote: > The

Re: Problem with CoreAdmin API CREATE command

2015-09-17 Thread Yago Riveiro
4.6.1 that returns data with source 4.6.1, in 5.3 some times returned zero docs (in a random fashion way, I can’t find the pattern that produced the failure of the query). The same data upgraded to 4.10.4 with source code of 5.3 worked as expected with any issue. —/Yago Riveiro On Thu, Sep 17

DELETEREPLICA command shouldn't delete de last replica of a shard

2015-11-08 Thread Yago Riveiro
I don't know if this behaviour makes sense but in my IMHO the last replica of a shard should be removed only by the DELETESHARD command ... If you don't not notice about this behaviour, the result is the deletion of the whole shard, and as a consequence, the deletion of the shard in the clustersta

Re: DELETEREPLICA command shouldn't delete de last replica of a shard

2015-11-09 Thread Yago Riveiro
I raised a JIRA with this, SOLR-8257 - Best regards -- View this message in context: http://lucene.472066.n3.nabble.com/DELETEREPLICA-command-shouldn-t-delete-de-last-replica-of-a-shard-tp4239054p4239139.html Sent from the Solr - User mailing list archive at Nabble.com.

The time that init.d script waits before shutdown should be configurable

2015-11-09 Thread Yago Riveiro
The time that init.d script waits before shutdown should be configurable The 5 seconds is not enough to all my shards notify the shutdown and the process ends with a kill command I think that in solr.in.sh should exists a entry to configure the time to wait before use a kill command - Best

Re: The time that init.d script waits before shutdown should be configurable

2015-11-10 Thread Yago Riveiro
Patch attached to https://issues.apache.org/jira/browse/SOLR-8065 The windows script is voodo for me :D, I haven’t the knowledge to port this to cmd script. —/Yago Riveiro On Mon, Nov 9, 2015 at 3:23 PM, Upayavira wrote: > Yago, > I think a JIRA has been raised for this. I'

Json facet api NullPointerException

2015-11-12 Thread Yago Riveiro
Hi, I'm hitting this NullPointerException using the json facet API. Same query using Facet component is working. Json facet query: curl -s http://node1:8983/solr/metrics/query -d 'q=datetime:[2015-10-01T00:00:00Z TO 2015-10-04T23:59:59Z]&rows=0&json.facet={ urls: { type: terms,

Re: Json facet api NullPointerException

2015-11-12 Thread Yago Riveiro
Solr 5.3.1 —/Yago Riveiro On Thu, Nov 12, 2015 at 4:21 PM, Yonik Seeley wrote: > Thanks for the report Yago, > What version is this? > -Yonik > On Thu, Nov 12, 2015 at 10:53 AM, Yago Riveiro wrote: >> Hi, >> >> I'm hitting this NullPointerException using t

Re: Json facet api NullPointerException

2015-11-12 Thread Yago Riveiro
I found the bug … In my query I have  sort: index, And should be sort:{index:desc|asc} I think that the json parser should raise a “json parsing error” ... —/Yago Riveiro On Thu, Nov 12, 2015 at 4:44 PM, Yago Riveiro wrote: > Solr 5.3.1 > —/Yago Riveiro > On Th

Nested document query with wrong numFound value

2015-12-11 Thread Yago Riveiro
Hi, I'm playing with the nested documents feature and after run this query: http://localhost:8983/solr/ecommerce-15/query?q=id:3181426982318142698228* The documents has the IDs: - Parent : 3181426982318142698228 - Child_1 : 31814269823181426982280 - Child_2 : 31814269823181426982281 I have t

Schema API, change the defaultoperator

2015-12-11 Thread Yago Riveiro
Hi, How can I change the defaultoperator parameter through the schema API? Thanks. - Best regards -- View this message in context: http://lucene.472066.n3.nabble.com/Schema-API-change-the-defaultoperator-tp4244857.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Nested document query with wrong numFound value

2015-12-11 Thread Yago Riveiro
}, expand: { time: 0 }, debug: { time: 3 } } }, rawquerystring: "id:318142698

Re: Schema API, change the defaultoperator

2015-12-11 Thread Yago Riveiro
t handlers works with POST http calls? On Fri, Dec 11, 2015 at 2:26 PM, Shawn Heisey wrote: > On 12/11/2015 4:23 AM, Yago Riveiro wrote: >> How can I change the defaultoperator parameter through the schema API? > The default operator and default field settings in the schema have been

How Json facet API works with domains and facet functions?

2015-12-11 Thread Yago Riveiro
Hi, How the json facet api works with domains and facet functions? I try to google some info and I do not find nothing useful. How can do a query that find all parents that match a clause (a date) and calculate the avg price of all of children that have property X? Following yonik's blog exampl

Re: How Json facet API works with domains and facet functions?

2015-12-11 Thread Yago Riveiro
ry and filters. —/Yago Riveiro On Fri, Dec 11, 2015 at 5:17 PM, Yonik Seeley wrote: > If you search on the parents and want to match child documents, I > think you want {!child} and not {!parent} in your queries or filters. > fq={!child of=...}date_query_on_parents > fq=child_prop:X >

Re: Nested document query with wrong numFound value

2015-12-11 Thread Yago Riveiro
2280" } ] } responseHeader:  { status: 0, QTime: 3, params:  { q: "id:31814269823181426982281", fl: "id", q.op: "AND" } }, response:  { numFound: 1, start: 0, maxScore: 9.919363, docs:  [ { id: "31814269823181426982281&q

Re: Nested document query with wrong numFound value

2015-12-11 Thread Yago Riveiro
lways  31814269823181426982280 and 31814269823181426982281 as a children of   3181426982318142698228   Can this issue be related to SOLR-5211?. —/Yago Riveiro On Fri, Dec 11, 2015 at 8:46 PM, Mikhail Khludnev wrote: > On Fri, Dec 11, 2015 at 11:05 PM, Yago Riveiro > wrote: >> When do yo

Re: Divide 4 Nodes into 100 nodes in Solr Cloud

2015-02-18 Thread Yago Riveiro
You can try the SPLIT command — /Yago Riveiro On Wed, Feb 18, 2015 at 3:19 PM, Nitin Solanki wrote: > Hi, > I have created 4 nodes having 8 shards. Now, I want to divide those > 4 Nodes into 100 Nodes without any failure/ or re-indexing the data. Any > help please?

Re: Divide 4 Nodes into 100 nodes in Solr Cloud

2015-02-18 Thread Yago Riveiro
No, SPLIT operation doesn’t destroy the data. When the SPLIT operation is finished, the PARENT is deactivate and you can remove it. More info: https://cwiki.apache.org/confluence/display/solr/Collections+API#CollectionsAPI-api3 — /Yago Riveiro On Wed, Feb 18, 2015 at 3:39 PM, Nitin

Re: Atomic Update while having fields with attribute stored="true" in schema

2015-02-23 Thread Yago Riveiro
"Which means I have to change all my fields to stored=”true” if I want to use atomic update.Right?” Yes, and re-index all your data. "Will it affect the performance of the Solr?” What type of queries are you doing now? — /Yago Riveiro On Mon, Feb 23, 2015 at 12:05

Re: Atomic Update while having fields with attribute stored="true" in schema

2015-02-23 Thread Yago Riveiro
Field with store=true has the downside of disk space. Your index will grow in space requirements. Maybe update the whole document can be an option ... — /Yago Riveiro On Mon, Feb 23, 2015 at 1:02 PM, Rahul Bhooteshwar wrote: > Hi Yago Riveiro, > Thanks for your quick reply

Re: Solr TCP layer

2015-03-12 Thread Yago Riveiro
IMO each mega of memory saved has more impact that 0.001 less in latency … an OOM is killer, a lag of 2 second … is not catastrophic. — /Yago Riveiro On Tue, Mar 10, 2015 at 4:03 PM, Erick Erickson wrote: > Just to pile on: > I admire your bravery! I'll add to the other comme

Re: Facet sorting algorithm for index

2015-04-02 Thread Yago Riveiro
The result is a custom responseWriter, I found a bug in my code that append de \ to “. The JSON response shows the data without the \. Where can I found the source code used in index sorting? I need to ensure that the external data has the same sorting that the facet result. — /Yago

Re: Can Solr 5.5 recognize the index result generated by SolrIndexer of old version Nutch ?

2016-06-01 Thread Yago Riveiro
You need to upgrade your index to version 4.10 using the IndexUpgrade tool. -- Yago Riveiro On 1 Jun 2016 10:53 +0100, t...@sina.com, wrote: > Hi, > We plan to upgrade the solr server to 5.5.0. And we have a customized crawler > based on Nutch 1.2 and Solr 1.4.1. > > So, the q

Re: Re: Can Solr 5.5 recognize the index result generated by SolrIndexer of old version Nutch ?

2016-06-01 Thread Yago Riveiro
like Erick said, you will need to do this process in several steps before reach 5.x \-- /Yago Riveiro ![](https://link.nylas.com/open/m7fkqw0yim04itb62itnp7r9/local-1f481cc8-d5e2) On Jun 1 2016, at 5:22 pm, Erick Erickson <erickerick...@gmail.com> wrote: > https://luc

Re: Idle timeout expired: 50000/50000 ms

2016-07-14 Thread Yago Riveiro
Recently I started to buffering docs and send them to Solr in blocks of 250 and 50 workers. But now I'm hitting this issue too with Solr 5.3.1 Googling a bit I found this https://bugs.eclipse.org/bugs/show_bug.cgi?id=435322 that was fixes in 9.2 version. There is another link

Unable to upgrade from 5.4 to 5.5.2

2016-08-12 Thread Yago Riveiro
e way how shard synchronization is done. Can this issue be related with my problem? \-- /Yago Riveiro ![](https://link.nylas.com/open/m7fkqw0yim04itb62itnp7r9/local-2eefb82c- 7bf1?r=c29sci11c2VyQGx1Y2VuZS5hcGFjaGUub3Jn)

Re: Miserable Experience Using Solr. Again.

2016-09-13 Thread Yago Riveiro
f http connection in each node, the utilization of the jetty thread pool and stuff like that. Solr is a great tool, but it's hard, too hard to get in. \-- /Yago Riveiro ![](https://link.nylas.com/open/m7fkqw0yim04itb62itnp7r9/local- 89046b47-a272?r=c29sci11c2VyQGx1Y2VuZS5hcGFjaGUub

Heap memory usage is -1 in UI

2016-09-22 Thread Yago Riveiro
The Heap Memory Usage in the UI it's always -1. There is some way to get the amount of heap that a core consumes? - Best regards -- View this message in context: http://lucene.472066.n3.nabble.com/Heap-memory-usage-is-1-in-UI-tp4297601.html Sent from the Solr - User mailing list archive at

Re: Heap memory usage is -1 in UI

2016-09-23 Thread Yago Riveiro
onsumption in services like zabbix. -- /Yago Riveiro On 23 Sep 2016, 01:08 +0100, Shawn Heisey , wrote: > On 9/22/2016 4:59 PM, Yago Riveiro wrote: > > The Heap Memory Usage in the UI it's always -1. There is some way to > > get the amount of heap that a core consumes? >

Re: Whether SolrCloud can support 2 TB data?

2016-09-23 Thread Yago Riveiro
will know) -- /Yago Riveiro On 23 Sep 2016, 23:44 +0100, Pushkar Raste , wrote: > Solr is RAM hungry. Make sure that you have enough RAM to have most if the > index of a core in the RAM itself. > > You should also consider using really good SSDs. > > That would be a good start.

Re: Whether SolrCloud can support 2 TB data?

2016-09-24 Thread Yago Riveiro
clean index (voodoo magic thing can happen, thrust me), and it will drain a huge amount of hardware resources to do it without downtime. \-- /Yago Riveiro ![](https://link.nylas.com/open/m7fkqw0yim04itb62itnp7r9/local-277ee09e- 1aee?r=c29sci11c2VyQGx1Y2VuZS5hcGFjaGUub3Jn) On Sep 24 201

Permission error using install_solr_service script.sh

2016-09-29 Thread Yago Riveiro
Hi, I'm having troubles to run the install_solr_service in Centos 7.2. I have this errors: -bash: /opt/usr/solr/bin/solr: Permission denied -bash: /opt/usr/solr/bin/solr: Permission denied the problematic line is the line 315 on install_solr_service.sh find "$SOLR_VAR_DIR" -type f -print0 | x

Re: Permission error using install_solr_service script.sh

2016-10-01 Thread Yago Riveiro
I was running the install into a vm, I deleted it and did a new provisioning. Now it woks. The weird thing is that before delete the vm I ran a chmod over that files and the install finished without that errors. -- /Yago Riveiro On 1 Oct 2016, 15:18 +0100, Shawn Heisey , wrote: > On 9

Re: Permission error using install_solr_service script.sh

2016-10-01 Thread Yago Riveiro
And yes, I executed the script as root using the /opt folder as install folder -- /Yago Riveiro On 1 Oct 2016, 15:18 +0100, Shawn Heisey , wrote: > On 9/29/2016 3:42 AM, Yago Riveiro wrote: > > I'm having troubles to run the install_solr_service in Centos 7.2. > > &g

Re: IndexReaders cannot exceed 2 Billion

2017-08-07 Thread Yago Riveiro
You have the maximum number of docs in a single shard. If I'm not wrong, the only solution is split the index in more shards (if you are running solrcloud mode). -- /Yago Riveiro On 7 Aug 2017, 16:48 +0100, Wael Kader , wrote: > Hello, > > I faced an issue that is making me go

Re: How many collections in a solrcloud are too many, how to determine this?

2017-08-09 Thread Yago Riveiro
minutes. The tradeoff is not easy, depends of the number of machines, the volume of data, hardware and so on. -- /Yago Riveiro On 8 Aug 2017 20:27 +0100, Webster Homer , wrote: > Yes we do see replicas go into recovery. > > Most of our clouds are hosted in the google cloud. So flaky net

Re: Solr 6.5.1 process crash after jshort_disjoint_arraycopy error

2017-11-15 Thread Yago Riveiro
Nop, I never found a fix for this problem, sorry. Regards. -- Yago Riveiro On 15 Nov 2017 09:44 +, tothis , wrote: > Hi Yago, > > we are facing the same problem. Could you solve it somehow? > > thx > > > > > -- > Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Protect a collection to be deleted

2017-12-12 Thread Yago Riveiro
Hi, Is it possible in Solr protect a collection to be deleted through a property? Regards - Best regards /Yago -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

RE: Protect a collection to be deleted

2017-12-12 Thread Yago Riveiro
I don’t know if it’s possible but, if we can mark the collection like protected, we can avoid DELETE command to remove de collection. Maybe set the flag when CREATE command is executed? This is an interesting feature to avoid human errors, and relatively easy to implement. Regards -- Yago

Re: Protect a collection to be deleted

2017-12-12 Thread Yago Riveiro
Thanks Shawn for address the question to Jira. Indeed I want to continue to insert data in the collection. I found that delete a collection by mistake using the API it’s to easy and prone to human error. Regards, -- Yago Riveiro On 12 Dec 2017 19:05 +, Shawn Heisey , wrote: > On 12

Re: Protect a collection to be deleted

2017-12-13 Thread Yago Riveiro
That can work, but the goal it’s to avoid human error (like the UI that enforce you to type de name of the collection on delete) independently of the access level. Regards -- /Yago Riveiro On 12 Dec 2017 20:24 +, Anshum Gupta , wrote: > You might want to explore Rule based authorizat

Load core process changed between 5.5.3 and 5.3.1

2016-11-20 Thread Yago Riveiro
Hi, I'm trying to upgrade my cluster from Solr version 5.3.1. to 5.5.3 and I noticed that the core loading process in 5.5.3 is different from 5.3.1. The number of core loaded in parallel in 5.5.3 are about 5 or 6, when in 5.3.1 all cores were published as state "recovering" all together. This i

Re: Load core process changed between 5.5.3 and 5.3.1

2016-11-20 Thread Yago Riveiro
Indeed in 5.3.1 the CPU spikes to 80 of load and now the cluster is more stable, slower but more stable. Thanks. \-- /Yago Riveiro ![](https://link.nylas.com/open/m7fkqw0yim04itb62itnp7r9/local- a46120b4-69a7?r=c29sci11c2VyQGx1Y2VuZS5hcGFjaGUub3Jn) On Nov 20 2016, at 4:31 pm

Re: How to enable JMX to monitor Jetty

2016-11-28 Thread Yago Riveiro
Hi, Rallavagu, the jetty-jmx.xml file is the basic file of the github repository or something custom? I modified the file modules/http.mod and I can't see jetty stuff ... - Best regards -- View this message in context: http://lucene.472066.n3.nabble.com/How-to-enable-JMX-to-monitor-Jetty-

Zookeeper connection lost in 5.5.3

2016-11-28 Thread Yago Riveiro
Hi, I upgraded my cluster to 5.5.3 and now I'm having a lot of this warnings. Unable to read /collections/collectionX/leader_initiated_recovery/shard9/core_node12 due to: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /collections/collectionX/l

Uncaught exception java.lang.StackOverflowError in 6.3.0

2016-12-15 Thread Yago Riveiro
Hi, I'm getting this error in my log 12/15/2016, 9:28:18 AM ERROR true ExecutorUtilUncaught exception java.lang.StackOverflowError thrown by thread: coreZkRegister-1-thread-48-processing-n:XXX.XXX.XXX.XXX:8983_solr x:collection1_shard3_replica2 s:shard3 c:collection1-visitors r

Re: Uncaught exception java.lang.StackOverflowError in 6.3.0

2016-12-15 Thread Yago Riveiro
nodes in 10 minutes. I need to review the value to something more conservative maybe. -- /Yago Riveiro On 15 Dec 2016, 16:43 +, Erick Erickson , wrote: > Hmmm, have you changed coreLoadThreads? We had a problem with this a > while back with loading lots and lots of cores, see: &

Re: Getting Error - Session expired for /collections/sprod/state.json

2016-12-16 Thread Yago Riveiro
I had some of this error in my logs too on 6.3.0 My cluster also index like 20K docs/sec I don't know why. -- /Yago Riveiro On 16 Dec 2016, 08:39 +, Piyush Kunal , wrote: > Anyone has noticed such issue before? > > On Thu, Dec 15, 2016 at 4:36 PM, Piyush Kunal wrote:

Re: Getting Error - Session expired for /collections/sprod/state.json

2016-12-16 Thread Yago Riveiro
Do some gc profiling to get some information about. It's possible you have configure a small heap and you are running in gc stop the world issues. Normally zookeeper erros are bounded to gc and network latency issues -- /Yago Riveiro On 16 Dec 2016, 09:49 +, Piyush Kunal , wrote: &g

ClassCastException: BasicResultContext cannot be cast to SolrDocumentList

2016-12-20 Thread Yago Riveiro
I'm hitting this exception in 6.3.0, any ideas? null:java.lang.ClassCastException: org.apache.solr.response.BasicResultContext cannot be cast to org.apache.solr.common.SolrDocumentList at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:315) at o

Re: Uncaught exception java.lang.StackOverflowError in 6.3.0

2016-12-26 Thread Yago Riveiro
My cluster holds more than 10B documents stored in 15T. The size of my collections is variable but I have collections with 800M documents distributed over the 12 nodes, the amount of documents per shard is ~66M and indeed the performance is good. I need the collections to isolate the data of my c

Bad version writing to ZK in 6.3.0

2016-12-26 Thread Yago Riveiro
Lately I can read this warning in my logs some times: Bad version writing to ZK using compare-and-set, will force refresh cluster state: KeeperErrorCode = BadVersion for /collections/X/state.json Why this happen? it's normal? -- /Yago - Best regards -- View this message in context:

Re: Uncaught exception java.lang.StackOverflowError in 6.3.0

2016-12-27 Thread Yago Riveiro
t manage a big cluster without custom tools. Solr continues to improve with each version, and I saw issues with a lot of nice stuff like SOLR-9735 and SOLR-9241 -- /Yago Riveiro On 26 Dec 2016 22:10 +, Toke Eskildsen , wrote: > Yago Riveiro wrtoe: > > My cluster holds more than 10B

Re: Uncaught exception java.lang.StackOverflowError in 6.3.0

2016-12-27 Thread Yago Riveiro
auto magic management stuff. You have all the power and therefore all the work :p Following your advices I will try to review the topology of my collection and try to point the oversharded collections. -- /Yago Riveiro On 27 Dec 2016 21:54 +, Toke Eskildsen , wrote: > Yago Riveiro wrote:

Cannot talk to ZooKeeper - Updates are disabled (Solr 6.3.0)

2016-12-29 Thread Yago Riveiro
There is any way to recover from a exception "org.apache.solr.common.SolrException: Cannot talk to ZooKeeper - Updates are disabled" without restart the affected node node? Regards, /Yago - Best regards /Yago -- View this message in context: http://lucene.472066.n3.nabble.com/Cannot-talk-

Re: Cannot talk to ZooKeeper - Updates are disabled (Solr 6.3.0)

2016-12-29 Thread Yago Riveiro
if I’m lost the Zookeeper quorum? -- /Yago Riveiro On 29 Dec 2016 16:07 +, Susheel Kumar , wrote: > I believe this comes when Zookeeper quorum is not maintained. Do not see > any way around except bringing the quorum back? > > Thanks, > Susheel > > On Thu, Dec 29,

Boolean type supports docValues?

2017-01-03 Thread Yago Riveiro
Hi, The boolean type has support for DocValues? the documentation says that only StrField, UUIDField and Trie* numeric fields have support ( doc ) but I found this Jira issue SOLR-9187

Re: Boolean type supports docValues?

2017-01-03 Thread Yago Riveiro
Reading the actual documentation is not clear ... After test it, 6.3.0 indeed have docValues support for boolean type. Thanks Erick. -- /Yago Riveiro On 3 Jan 2017 10:39 +, Yago Riveiro , wrote: > Hi, > > The boolean type has support for DocValues? the documentation says

CloudSolrStream client doesn't validate sort order

2017-01-07 Thread Yago Riveiro
Hi, The CloudSolrStream client (Solr 6.3.0) assumes that the sort param always have the order. starting in line 326: String[] sorts = sort.split(","); StreamComparator[] comps = new StreamComparator[sorts.length]; for(int i=0; ihttp://lucene.472066.n3.nabble.com/CloudSolrStream-clien

Re: CloudSolrStream client doesn't validate sort order

2017-01-07 Thread Yago Riveiro
Ok, good to know :) - Best regards /Yago -- View this message in context: http://lucene.472066.n3.nabble.com/CloudSolrStream-client-doesn-t-validate-sort-order-tp4312936p4312943.html Sent from the Solr - User mailing list archive at Nabble.com.

Question about Lucene FieldCache

2017-01-09 Thread Yago Riveiro
Hi, After some reading into the documentation, supposedly the Lucene FieldCache is the only one that it's not possible to disable. Fetching the config for a collection through the REST API I found an entry like this: "query": { "useFilterForSortedQuery": true, "queryResultWindowSize": 1, "queryR

Re: Question about Lucene FieldCache

2017-01-09 Thread Yago Riveiro
Thanks for re reply Mikhail, Do you know if the 1 value is configurable? My insert rate is so high (5000 docs/s) that the cache it's quite useless. In the case of the Lucene field cache, it's possible "clean" it in some way? Some cache is eating my memory heap. - Best regards /Yago -

Re: Question about Lucene FieldCache

2017-01-09 Thread Yago Riveiro
The documentation says that the only caches configurable are: - filterCache - queryResultCache - documentCache - user defined caches There is no entry for fieldValueCache and in my case all of list in the documentation are disable ... -- /Yago Riveiro On 9 Jan 2017 13:20 +, Mikhail

Re: Help needed in breaking large index file into smaller ones

2017-01-09 Thread Yago Riveiro
You can try to reindex your data to another collection with more shards -- /Yago Riveiro On 9 Jan 2017 14:15 +, Narsimha Reddy CHALLA , wrote: > No, it does not work by splitting. First of all lucene index files are not > text files. There is a segment_NN file which will refer index

CloudSolrStream can't set the setZkClientTimeout and setZkConnectTimeout properties

2017-01-09 Thread Yago Riveiro
Hi, Using the CloudSolrStream, is it possible define the setZkConnectTimeout and setZkClientTimeout of internal CloudSolrClient? The default negotiation timeout is set to 10 seconds. Regards, /Yago - Best regards /Yago -- View this message in context: http://lucene.472066.n3.nabble.com

  1   2   3   >