[IMPORTANT] Apache Solr TLP Update - Solr User email list migration

2021-02-23 Thread Anshum Gupta
fix them accordingly. The migration has been requested and ASF Infra is working with the Lucene/Solr PMC for this[1]. We will update the list once the migration is completed. - Anshum Gupta On behalf of the Apache Solr PMC [1] - https://issues.apache.org/jira/browse/INFRA-21443

Congratulations to the new Apache Solr PMC Chair, Jan Høydahl!

2021-02-18 Thread Anshum Gupta
Hi everyone, I’d like to inform everyone that the newly formed Apache Solr PMC nominated and elected Jan Høydahl for the position of the Solr PMC Chair and Vice President. This decision was approved by the board in its February 2021 meeting. Congratulations Jan! -- Anshum Gupta

[ANNOUNCE] Apache Solr TLP Created

2021-02-18 Thread Anshum Gupta
Hi everyone, On behalf of the Apache Lucene PMC, and the newly formed Apache Solr PMC, I’d like to inform folks that the ASF board has approved the resolution to create the Solr TLP (Top Level Project). We are currently working on the next steps but would like to assure the community that they

Re: Solr Slack Workspace

2021-02-05 Thread Anshum Gupta
> > > > > > training class and assume it's mostly open to solr community. > > > > > > > > > > > > > > On Fri, Jan 15, 2021 at 8:10 PM Justin Sweeney > > > > > > > wrote: > > > > > > >> Hi all, > > > > > > >> > > > > > > >> I did some googling and didn't find anything, but is there a > > Slack > > > > > > >> workspace for Solr? I think this could be useful to expand > > > > interaction > > > > > > >> within the community of Solr users and connect people solving > > > > similar > > > > > > >> problems. > > > > > > >> > > > > > > >> I'd be happy to get this setup if it does not exist already. > > > > > > >> > > > > > > >> Justin > > > > > > > > > > > > > > > > > > -- > > > > > > Charlie Hull - Managing Consultant at OpenSource Connections > > Limited > > > > > > > > > > > > Founding member of The Search Network < > > https://thesearchnetwork.com/ > > > > > > > > > > and co-author of Searching the Enterprise > > > > > > <https://opensourceconnections.com/about-us/books-resources/> > > > > > > tel/fax: +44 (0)8700 118334 > > > > > > mobile: +44 (0)7767 825828 > > > > > > > > > > > > > > > > > > > > > > > > > > -- Anshum Gupta

Re: CPU and memory circuit breaker documentation issues

2020-12-18 Thread Anshum Gupta
lang/management/MemoryMXBean.html > < > https://docs.oracle.com/javase/7/docs/api/java/lang/management/MemoryMXBean.html > > > > > https://docs.oracle.com/javase/7/docs/api/java/lang/management/MemoryUsage.html > < > https://docs.oracle.com/javase/7/docs/api/java/lang/management/MemoryUsage.html > > > > > > wunder > > Walter Underwood > > wun...@wunderwood.org <mailto:wun...@wunderwood.org> > > http://observer.wunderwood.org/ (my blog) > > > > -- Anshum Gupta

Re: Performance issues with CursorMark

2020-10-26 Thread Anshum Gupta
on the collection are still going fast, but CursorMarking > even through a tiny portion is taking time and memory. > > Many thanks, > Markus > -- Anshum Gupta

ApacheCon at Home 2020 starts tomorrow!

2020-09-28 Thread Anshum Gupta
://www.apachecon.com/acah2020/tracks/search.html See you at ApacheCon. -- Anshum Gupta

Re: [ANNOUNCE] Apache Solr 8.6.0 released

2020-07-16 Thread Anshum Gupta
tml> > > >>>>> > > >>>>> > > >>>>> ### Solr 8.6.0 Release Highlights: > > >>>>> > > >>>>> > > >>>>> * Cross-Collection Join Queries: Join queries can now work > > >>>>> cross-collection, even when shared or when spanning nodes. > > >>>>> > > >>>>> * Search: Performance improvement for some types of queries when > > >> exact > > >>>>> hit count isn't needed by using BlockMax WAND algorithm. > > >>>>> > > >>>>> * Streaming Expression: Percentiles and standard deviation > > >> aggregations > > >>>>> added to stats, facet and time series. Streaming expressions added > > to > > >>>>> /export handler. Drill Streaming Expression for efficient and > > >> accurate > > >>>>> high cardinality aggregation. > > >>>>> > > >>>>> * Package manager: Support for cluster (CoreContainer) level > plugins. > > >>>>> > > >>>>> * Health Check: HealthCheckHandler can now require that all cores > are > > >>>>> healthy before returning OK. > > >>>>> > > >>>>> * Zookeeper read API: A read API at /api/cluster/zk/* to fetch raw > ZK > > >>>>> data and view contents of a ZK directory. > > >>>>> > > >>>>> * Admin UI: New panel with security info in admin UI's dashboard. > > >>>>> > > >>>>> * Query DSL: Support for {param:ref} and {bool: {excludeTags:""}} > > >>>>> > > >>>>> * Ref Guide: Major redesign of Solr's documentation. > > >>>>> > > >>>>> > > >>>>> Please read CHANGES.txt for a full list of new features and > changes: > > >>>>> > > >>>>> > > >>>>> <https://lucene.apache.org/solr/8_6_0/changes/Changes.html> > > >>>>> > > >>>>> > > >>>>> Solr 8.6.0 also includes features, optimizations and bugfixes in > the > > >>>>> corresponding Apache Lucene release: > > >>>>> > > >>>>> > > >>>>> <https://lucene.apache.org/core/8_6_0/changes/Changes.html> > > >>>>> > > >>>>> > > >>>>> Note: The Apache Software Foundation uses an extensive mirroring > > >> network > > >>>>> for > > >>>>> > > >>>>> distributing releases. It is possible that the mirror you are using > > >> may > > >>>>> not have > > >>>>> > > >>>>> replicated the release yet. If that is the case, please try another > > >>> mirror. > > >>>>> > > >>>>> This also applies to Maven access. > > >>>>> > > >>>> > > >>> > > >> > > > -- Anshum Gupta

Getting rid of Master/Slave nomenclature in Solr

2020-06-17 Thread Anshum Gupta
Hi everyone, Moving a conversation that was happening on the PMC list to the public forum. Most of the following is just me recapping the conversation that has happened so far. Some members of the community have been discussing getting rid of the master/slave nomenclature from Solr. While this

Re: Solr process getting killed suddenly

2019-08-21 Thread Anshum Gupta
gt; *Adriano Melo* > Tel.: (83) 98875-1868 > -- Anshum Gupta

Re: CursorMarks and 'end of results'

2018-06-19 Thread Anshum Gupta
I might have been wrong there. Having an explicit check for the # results returned vs rows requested, would allow you to avoid the last request that would otherwise come back with 0 results. That check isn’t automatically done within Solr.  Anshum > On Jun 19, 2018, at 2:39 PM, Anshum Gu

Re: CursorMarks and 'end of results'

2018-06-19 Thread Anshum Gupta
Hi David, The cursormark would be the same if you get back fewer than the max records requested and so you should exit, as per the documentation. I think the documentation says just what you are suggesting, but if you think it could be improved, feel free to put up a patch.  Anshum > On

Re: MoreLikeThis in Solr 7.3.1

2018-06-19 Thread Anshum Gupta
for test purposes), so I suppose they share configuration in >> solr-7.3.1/server/solr/configsets/_default/conf/solrconfig.xml. >> >> So should I recreate the collection ? >> >> Thanks, >> Monique >> >> On Tue, Jun 19, 2018 at 4:41 PM Anshum Gupt

Re: MoreLikeThis in Solr 7.3.1

2018-06-19 Thread Anshum Gupta
Hi Monique, Is this standalone Solr or SolrCloud ? If it is cloud, then you’d have to make sure that you uploaded the right config and collection should also be reloaded if you enabled it after creating the collection. Also, did you check the MLT Query parser that does the same thing but

Re: [nesting] Any way to return the whole hierarchical structure when doing Block Join queries?

2018-03-14 Thread Anshum Gupta
Hi Jan, The way I remember it was done (or at least we did it) is by storing the depth information as a field in the document using an update request processor and using a custom transformer to reconstruct the original multi-level document from it. Also, this was a reasonably long time ago, so

Re: Negative Core Node Numbers

2018-01-04 Thread Anshum Gupta
Hi Chris, The core node numbers should be cleared out when the collection is deleted. Is that something you see consistently ? P.S: I just tried creating a collection with 1 shard and 200 replicas and saw the core node numbers as expected. On deleting and recreating the collection, I saw that

Re: Protect a collection to be deleted

2017-12-13 Thread Anshum Gupta
/ <https://lucidworks.com/2015/08/17/securing-solr-basic-auth-permission-rules/> -Anshum > On Dec 13, 2017, at 7:20 AM, Shawn Heisey <apa...@elyograg.org> wrote: > > On 12/12/2017 1:23 PM, Anshum Gupta wrote: >> You might want to explore Rule based authorization in

Re: Protect a collection to be deleted

2017-12-12 Thread Anshum Gupta
You might want to explore Rule based authorization in Solr and stop non-admin users from deleting collections etc. Here’s the link to the documentation: https://lucene.apache.org/solr/guide/6_6/rule-based-authorization-plugin.html

Re: Need help detecting Relatedness in documents

2017-10-26 Thread Anshum Gupta
I would suggest you look at the mlt query parser. That allows you to find documents similar to a particular documents, and also allows for specifying the field to use for similarity purposes. https://lucene.apache.org/solr/guide/7_0/other-parsers.html#more-like-this-query-parser

Re: [ANNOUNCE] Apache Solr 7.0.0 released

2017-09-20 Thread Anshum Gupta
e case, please try another mirror. This also goes for Maven access. -Anshum > On Sep 20, 2017, at 12:09 PM, Anshum Gupta <ansh...@apple.com> wrote: > > 20 September 2017, Apache Solr™ 7.0.0 available > > Solr is the popular, blazing fast, open source NoSQL search platform from t

[ANNOUNCE] Apache Solr 7.0.0 released

2017-09-20 Thread Anshum Gupta
mirror you are using may not have replicated the release yet. If that is the case, please try another mirror. This also goes for Maven access. Anshum Gupta

Re: Unable to create core [collection] Caused by: null

2017-07-26 Thread Anshum Gupta
Hi Lucas, It would be super useful if you provided more information with the question. A few things you might want to include are - version of Solr, how did you start it, stack trace from the log etc. -Anshum > On Jul 25, 2017, at 4:21 PM, Lucas Pelegrino wrote: > >

Trouble connecting to IRC

2017-06-29 Thread Anshum Gupta
Hi, I’ve been having issues connecting to the freenode IRC server for about 45 min now. Any one else seeing something similar ? -Anshum

Re: How to Apply 'implicit' routing in exist collection in solr 6.1.0

2017-04-04 Thread Anshum Gupta
Hi Ketan, I just want to be sure about your understanding of the 'implicit' router. Implicit router in Solr puts the onus of correctly routing the documents on the user, instead of 'implicitly' or automatically routing them. -Anshum On Tue, Apr 4, 2017 at 2:01 AM Ketan Thanki

Re: Solr Shard Splitting Issue

2017-01-30 Thread Anshum Gupta
I see a successful completion of the request in the logs here: 2017-01-18 14:43:55.439 INFO (OverseerStateUpdate-97304349976428549-10.1.1.78:4983_solr-n_00) [ ] o.a.s.c.o.SliceMutator Update shard state invoked for collection: collection1 with message: { "shard1":"inactive",

Re: Advanced Document Routing Questions

2017-01-29 Thread Anshum Gupta
SolrCloud auto routes the documents to the correct shard leader, however you would be able to reduce the extra hop by sending the document to the correct shard. Here are a few posts that explain how the document routing in SolrCloud works:

Re: Solr Shard Splitting Issue

2017-01-18 Thread Anshum Gupta
Hi Ekta, Rule#1 - You shouldn't forcefully and manually change the state unless you know what you're doing and have performed all the checks. Seems like the child shards were still getting created i.e. copying the entire index from the parent shard when you manually switched. One of the reasons

Re: Help needed in breaking large index file into smaller ones

2017-01-09 Thread Anshum Gupta
Can you provide more information about: - Are you using Solr in standalone or SolrCloud mode? What version of Solr? - Why do you want this? Lack of disk space? Uneven distribution of data on shards? - Do you want this data together i.e. as part of a single collection? You can check out the

Re: MLT Java example for Solr 6.3

2016-12-23 Thread Anshum Gupta
Hi Todd, You can query for similar documents using the MLT Query Parser. The code would look something like: // Assuming you want to use CloudSolrClient CloudSolrClient client = new CloudSolrClient.Builder() .withZkHost(zkHost) .build();

Re: CREATEALIAS to non-existing collections

2016-12-09 Thread Anshum Gupta
I think that might have just been an oversight. We shouldn't allow creation of an alias for non-existent collections. On a similar note, I think we should also be clearing out the aliases when we DELETE a collection. -Anshum On Fri, Dec 9, 2016 at 12:57 PM Tomás Fernández Löbbe

Re: Hackday next month

2016-09-22 Thread Anshum Gupta
it for the Hackday. > In any case, the venue is all arranged now and people have signed up, so > Tuesday it is. There will also be beer & pizza that evening! > > Cheers > > Charlie > > > > My 2 cents, > > > > Trey Grainger > > SVP of Engineering @ Lu

Re: Hackday next month

2016-09-21 Thread Anshum Gupta
This is good but is there a way to instead do this on Wednesday? Considering that the conference starts on Thursday, perhaps it makes sense to do it just a day before ? Not sure about others but it certainly would work much better for me. -Anshum On Wed, Sep 21, 2016 at 2:18 PM Charlie Hull

Re: Solr Collection Create API queries

2016-09-09 Thread Anshum Gupta
> > Can you point me to the git repo branch where I can dig deeper and see this > functionality ? > > > > Thanks, > Swathi. > > > > > > On Fri, Sep 9, 2016 at 1:10 PM, Anshum Gupta <ans...@anshumgupta.net> > wrote: > > > Just to clarify

Re: Solr Collection Create API queries

2016-09-09 Thread Anshum Gupta
Just to clarify here, I said that I really think it's an XY problem here. I still don't know what is being attempted/built. >From the last email, sounds like you want to build/support auto-addition of replica but I would wait until you clarify the use case to suggest anything. -Anshum On Fri,

[ANNOUNCE] Apache Solr 5.5.3 released

2016-09-09 Thread Anshum Gupta
: The Apache Software Foundation uses an extensive mirroring network for distributing releases. It is possible that the mirror you are using may not have replicated the release yet. If that is the case, please try another mirror. This also goes for Maven access. -Anshum Gupta

Re: /select results different between 5.4 and 6.1

2016-08-19 Thread Anshum Gupta
The default similarity changed from TF-IDF to BM25 in 6.0. On Fri, Aug 19, 2016 at 3:00 PM John Bickerstaff wrote: > Bump! > > TL;DR Question: Are scores (and debug output) *expected* to be different > between 5.4 and 6.1? > > On Thu, Aug 18, 2016 at 2:44 PM, John

Re: Creating a SolrJ Data Service to send JSON to Solr

2016-08-16 Thread Anshum Gupta
I would also suggest sending the JSON directly to the JSON end point, with the mapping : https://cwiki.apache.org/confluence/display/solr/Uploading+Data+with+Index+Handlers#UploadingDatawithIndexHandlers-JSONUpdateConveniencePaths On Tue, Aug 16, 2016 at 4:43 PM Alexandre Rafalovitch

Re: Create collection on all nodes using the Collection API

2016-08-11 Thread Anshum Gupta
Hi Alexandre, You can you the CLUSTERSTATUS Collections API ( https://cwiki.apache.org/confluence/display/solr/Collections+API#CollectionsAPI-api18) to get a list of live nodes. -Anshum On Thu, Aug 11, 2016 at 10:16 AM Alexandre Drouin < alexandre.dro...@orckestra.com> wrote: > Hi, > > What

Re: Is it possible to force a Shard Leader change?

2016-07-28 Thread Anshum Gupta
guys! > > Regards, > Tim > > > [Roots Wednesday 27 July 8.30pm]<http://www.sbs.com.au/programs/roots/> > -- Anshum Gupta

Re: Schema Changes

2016-07-28 Thread Anshum Gupta
quires re-indexing. Does it? None of the > existing field has changed. schema.xml is the only file that s modified. > So what's the point in re-indexing? > > Appreciate any insight. > > Thanks > -- Anshum Gupta

Re: File Descriptor/Memory Leak

2016-07-07 Thread Anshum Gupta
wo machines our program isn't transmitting the data > > directly > > > to. The last machine is unaffected by the GC, and both memory nor FDC > > > doesn't reset before Solr is restarted on that machine. > > > > > > Performing a netstat reveals that the FDC mostly consists of > > > TCP-connections in the state of "CLOSE_WAIT". > > > > > > > > > > > > > > > -- > > Regards, > > Shalin Shekhar Mangar. > > > -- Anshum Gupta

Re: Shard vs Replica

2016-07-06 Thread Anshum Gupta
like a true to me, but what is shard then here and how is it > connected with all this context ? Can someone explain this in brief and > give some examples ? > > Thank you in advance > -- Anshum Gupta

Re: Disable leaders in SolrCloud mode

2016-05-16 Thread Anshum Gupta
we don't need leaders to maintain > the correct status of the index. So if we can get rid of that part, our > solr restart will be more robust. > > Any suggestions will be appreciated. > > Thanks, > > Li > -- Anshum Gupta

Re: ConcurrentUpdateSolrClient Invalid version (expected 2, but 60) or the data in not in 'javabin' format

2016-04-25 Thread Anshum Gupta
:41:50] > > > > > > > > at > > > >> > > > > > > org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229) > > > >> [solr-solrj-6.0.0.jar:6.0.0 > 48c80f91b8e5cd9b3a9b48e6184bd53e7619e7e3 - > > > >> nknize - 2016-04-01 14:41:50] > > > > > > > > at > > > >> > > > > > > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > > > >> ~[na:1.8.0_92] > > > > > > > > at > > > >> > > > > > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > > > >> ~[na:1.8.0_92] > > > > > > > > at java.lang.Thread.run(Thread.java:745) ~[na:1.8.0_92] > > > > > > > > > > > Any help suggestions is appreciated. > > > > > > Cheers, > > > > > > Joe Lawson > > > > > > -- Anshum Gupta

Re: Anticipated Solr 5.5.1 release date

2016-04-15 Thread Anshum Gupta
st > finished validating 5.5.0 with our original queries! > > Cheers > > Tom > -- Anshum Gupta

Re: Release date for Solr 6.0

2016-04-07 Thread Anshum Gupta
nsight as to the release schedule for this new version? > > Thanks, > > Ben Earley > -- Anshum Gupta

Re: Adding configset in SolrCloud via API

2016-04-06 Thread Anshum Gupta
As of now, there's no way to do so. There were some efforts on those lines but it's been on hold. -Anshum > On Apr 6, 2016, at 12:21 PM, Don Bosco Durai wrote: > > Is there an equivalent of server/scripts/cloud-scripts/zkcli.sh -zkhost > $zk_host -cmd upconfig -confdir

Re: Solr 5.5 Security feature is not working on it.

2016-04-05 Thread Anshum Gupta
> "class":"solr.RuleBasedAuthorizationPlugin", > "permissions":[{"name":"security-edit", "role":"admin"}] > "user-role":{"solr":"admin"}}} > > ThanksVijay -- Anshum Gupta

Re: Parallel Updates

2016-04-04 Thread Anshum Gupta
> internally for my microservices to hit with indexing work. > > I was assuming that if I hit my "solr4" IP address, only "solr4" will do > the indexing... Perhaps I'm making a dangerous assumption? > On Apr 4, 2016 3:49 PM, "Anshum Gupta" <ans.

Re: Parallel Updates

2016-04-04 Thread Anshum Gupta
nts > during the day from ~200 downloaded files - I'd like to fork off multiple > processes to deal with the incoming data to get it into Solr quicker. > > Thanks, > Rob > > > -- Anshum Gupta

Re: [possible bug]: [child] - ChildDocTransformerFactory returns top level documents nested under middle level documents when queried for the middle level ones

2016-03-30 Thread Anshum Gupta
> doc// and this a > grandparent!!! > > > > > And so on, bringing the whole tree up and down all under my middle-level > document. > I really hope this is not the expected behavior. > > I appreciate your help in advance. > > -- > Alisa Zhila -- Anshum Gupta

Re: Unable to create collection in 5.5

2016-03-28 Thread Anshum Gupta
wrote: > This kind of stuff can't be released without a way to rename the current > collections with hyphens (even for 6.0) > > > > \-- > > > > /Yago Riveiro > > > > ![]( > https://link.nylas.com/open/m7fkqw0yim04itb62itnp7r9/d6c3ba33ed5f4ac8af3b2 > 9c07e2c

Re: Unable to create collection in 5.5

2016-03-28 Thread Anshum Gupta
6.n3.nabble.com/Unable-to-create-collection-in-5-5-tp4266437.html > Sent from the Solr - User mailing list archive at Nabble.com. > -- Anshum Gupta

Re: Re[2]: [nesting] Any way to return the whole hierarchical structure when doing Block Join queries?

2016-03-25 Thread Anshum Gupta
the 2nd child > >> CHILD > >> > >> > >> 1.2.1 > >> I am a grandchildren > >> GRANDCHILD > >> > >> Indeed, the JAVAdocs for ChildDocTransformerFactory say: "This > >> transformer returns all descendants of each parent document in a flat > list > >> nested inside the parent document". > >> > >> Yet is there any way to preserve the hierarchy in the response? I really > >> need to find the way to preserve the structure in the response. > >> > >> Thank you in advance! > >> > >> -- > >> Alisa Zhila > >> -- > >> > > > > > > > >-- > >Sincerely yours > >Mikhail Khludnev > >Principal Engineer, > >Grid Dynamics > > > >< http://www.griddynamics.com > > >< mkhlud...@griddynamics.com > > > -- Anshum Gupta

Re: Solrj , how to create collection

2016-03-19 Thread Anshum Gupta
,standalone client. > > Thanks, > Iana > -- Anshum Gupta

Re: Do all SolrCloud nodes communicate with the database when indexing a collection?

2016-02-18 Thread Anshum Gupta
that will perform the > querying. Or is that intuition wrong, and it¹s better to have documents > that fit a search criteria sorted in some way and placed near each other > on a single or small number of machines? > > Any insights much appreciated! > > -Colin > > > &g

Re: Do all SolrCloud nodes communicate with the database when indexing a collection?

2016-02-17 Thread Anshum Gupta
the expected behavior? Is there any way to have all nodes of a > SolrCloud index communicate with the database during the indexing? Would > that speed up indexing? Maybe this isn’t a bottleneck I should be worried > about. > > Thanks, > -Colin > -- Anshum Gupta

Re: Request for SOLR-wiki edit permissions

2016-02-08 Thread Anshum Gupta
lowski", and my wiki email is > "gerlowsk...@gmail.com". > > I spotted a few things that could use some clarification on the > HowToContribute page (https://wiki.apache.org/solr/HowToContribute) > and wanted to make them a bit clearer. > > Jason > -- Anshum Gupta

[ANNOUNCE] Apache Solr 5.3.2 released

2016-01-23 Thread Anshum Gupta
. -- Anshum Gupta

Re: Rolling upgrade to 5.4 from 5.0 - "bug" caused by leader changes - is there a workaround?

2016-01-19 Thread Anshum Gupta
? Should I just stay with 5.3 for now? I need to implement >> programmatic schema changes in our collection via solrj, and based on what >> I'm reading this is a very new feature and requires the latest (or near >> latest) solrcloud. >> >> Thanks! >> >> -Mike >> > > -- Anshum Gupta

Re: Rolling upgrade to 5.4 from 5.0 - "bug" caused by leader changes - is there a workaround?

2016-01-19 Thread Anshum Gupta
the cluster down to > upgrade to 5.4? Should I just stay with 5.3 for now? I need to implement > programmatic schema changes in our collection via solrj, and based on what > I'm reading this is a very new feature and requires the latest (or near > latest) solrcloud. > > Thanks! > > -Mike > -- Anshum Gupta

Re: [More Like This] Query building

2015-12-29 Thread Anshum Gupta
t; Benedetti Alessandro > Visiting card : http://about.me/alessandro_benedetti > > "Tyger, tyger burning bright > In the forests of the night, > What immortal hand or eye > Could frame thy fearful symmetry?" > > William Blake - Songs of Experience -1794 England > -- Anshum Gupta

Re: Authorization API versus zkcli.sh

2015-12-11 Thread Anshum Gupta
; like > >> > >> "":{"v":47}}, > >> > >> Am I correct in thinking that this 47 (in this case) is a version > number, and that ANY number could be used in the file uploaded to > security.json using "zkcli.sh -putfile"? > >> >

Re: Authorization API versus zkcli.sh

2015-12-06 Thread Anshum Gupta
would > have to include plain-text passwords)? > > I figured there is no harm in asking. > -- Anshum Gupta

Re: How to config security.json?

2015-12-05 Thread Anshum Gupta
y.replicate(RecoveryStrategy.java:147) > > at > > org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:437) > > at > org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:227) > > 1531614 ERROR (qtp5264648-21) [c:gettingstarted s:shard1 r:core_node1 > x:gettingstarted_shard1_replica2] o.a.s.h.a.ShowFileRequestHandler Can not > find: /configs/gettingstarted/admin-extra.menu-top.html > > 1531614 ERROR (qtp5264648-16) [c:gettingstarted s:shard1 r:core_node1 > x:gettingstarted_shard1_replica2] o.a.s.h.a.ShowFileRequestHandler Can not > find: /configs/gettingstarted/admin-extra.menu-bottom.html > > 1531661 ERROR (qtp5264648-14) [c:gettingstarted s:shard1 r:core_node1 > x:gettingstarted_shard1_replica2] o.a.s.h.a.ShowFileRequestHandler Can not > find: /configs/gettingstarted/admin-extra.html > > .. > > > > Kind regards, > > Byzen Ma > > -- Anshum Gupta

Re: Re:Re: Implementing security.json is breaking ADDREPLICA

2015-11-30 Thread Anshum Gupta
est, > Erick > > On Tue, Nov 24, 2015 at 10:22 AM, Oakley, Craig (NIH/NLM/NCBI) [C] > <craig.oak...@nih.gov> wrote: > > Thanks for the reply, > > > > I don't suppose there is an ETA for 5.4? > > > > > > Thanks again > > > > -Original Message- > ... > -- Anshum Gupta

Re: Re:Re: Implementing security.json is breaking ADDREPLICA

2015-11-24 Thread Anshum Gupta
> at > org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:210) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecu

Re: Re:Re: Implementing security.json is breaking ADDREPLICA

2015-11-23 Thread Anshum Gupta
correct the Wiki before too long). > Other than that, I don’t know whether the order and/or the square brackets > make a difference. I can try with different permutations. > > Thanks again > > P.S. for the record, the Wiki currently has > { > "authentication":{ >

Re: Re:Re: Implementing security.json is breaking ADDREPLICA

2015-11-23 Thread Anshum Gupta
Yes, I see the same issue. I'll update the JIRA and drill down. Thanks. On Mon, Nov 23, 2015 at 4:18 PM, Anshum Gupta <ans...@anshumgupta.net> wrote: > To restart solr, you should instead use something like: > bin/solr start -c -p 8983 -s "example/cloud/node1/solr" -z loc

Re: Re:Re: Implementing security.json is breaking ADDREPLICA

2015-11-20 Thread Anshum Gupta
st one shard. I'll create a JIRA for this and mark it to be a blocker for 5.4. Thanks for bringing this up. On Thu, Nov 19, 2015 at 12:43 PM, Anshum Gupta <ans...@anshumgupta.net> wrote: > I'll try out what you did later in the day, as soon as I get time but why > exactly are

Re: shard range is empty...

2015-11-20 Thread Anshum Gupta
; > Bosco > > > > > > On 11/20/15, 9:56 AM, "Anshum Gupta" <ans...@anshumgupta.net> wrote: > > >You can manually update the cluster state so that the range for shard1 > says > >8000-d554. Also remove the "parent" tag from there. &g

Re: Re:Re: Implementing security.json is breaking ADDREPLICA

2015-11-20 Thread Anshum Gupta
ht531outofbox/solr-5.3.1/example/solr > ./solr -c -p 4685 -d ~dbman/solr/straight531outofbox/solr-5.3.1/server/ -z > localhost:4545/solr/xmpl3 -s > ~dbman/solr/straight531outofbox/solr-5.3.1/server/solr > curl -u solr:SolrRocks ' > http://nosqltest11:4685/solr/admin/collections?ac

Re: shard range is empty...

2015-11-20 Thread Anshum Gupta
/172.22.64.64:8886/solr;, > "node_name":"172.22.64.64:8886_solr", > "state":"active", > "leader":"true"}}}, > "shard1":{ > "parent":null, > "range":null, > "state":"active", > "replicas":{"core_node4":{ > "core":"my_collection_shard1_replica1", > "base_url":"http://172.22.64.63:8886/solr;, > "node_name":"172.22.64.63:8886_solr", > "state":"active", > "leader":"true", > "router":{"name":"compositeId"}, > "maxShardsPerNode":"1", > "autoAddReplicas":"false"}, retry? 0 > > Thanks > > Bosco > > > -- Anshum Gupta

Re: Re:Re: Implementing security.json is breaking ADDREPLICA

2015-11-20 Thread Anshum Gupta
- 2015-11-20 22:48:41.319; [c:solr8326 s:shard1 r:core_node3 > x:solr8326_shard1_replica1] org.apache.solr.cloud.RecoveryStrategy; Wait > 32.0 seconds before trying to recover again (5) > > > I would not be surprised if this were to be some unrelated issue (the > symptoms are quite

Re: Re:Re: Implementing security.json is breaking ADDREPLICA

2015-11-19 Thread Anshum Gupta
"collection":"xmpl", > "path":"/select/*", > "role":null}, > { > "name":"all-admin", > "collection":null, > "path":"/*", > "role":"xmplgen"}, > { > "name":"all-core-handlers", > "path":"/*", > "role":"xmplgen"}], > "":{"v":42}}} > > -Original Message- > From: Oakley, Craig (NIH/NLM/NCBI) [C] > Sent: Thursday, November 19, 2015 1:46 PM > To: 'solr-user@lucene.apache.org' <solr-user@lucene.apache.org> > Subject: RE: Re:Re: Implementing security.json is breaking ADDREPLICA > > I note that the thread called "Security Problems" (most recent post by > Nobel Paul) seems like it may help with much of what I'm trying to do. I > will see to what extent that may help. > -- Anshum Gupta

Re: Large multivalued field and overseer problem

2015-11-19 Thread Anshum Gupta
; with an overseer per collection it can fix our issues ? > Or do we have to rethink the schema to avoid this very large multivalued > field ? > > Thanks, > Best, > > Olivier > -- Anshum Gupta

Re: Implementing security.json is breaking ADDREPLICA

2015-11-18 Thread Anshum Gupta
,a=DISPATCHED,uri=/solr/xmpl/update} > 2015-11-17 21:03:54.164 INFO (qtp59559151-87) [c:xmpl s:shard1 > r:core_node1 x:xmpl] o.a.s.s.HttpSolrCall userPrincipal: [null] type: > [WRITE], collections: [xmpl,], Path: [/update] > 2015-11-17 21:03:54.164 DEBUG (qtp59559151-87) [c:xmpl s:shard1 > r:core_node1 x:xmpl] o.e.j.s.Server RESPONSE /solr/xmpl/update 401 > handled=true > > > > My impression from Anshum Gupta's 10/16/15 talk in Austin at the Solr > conference was that this was supposed to work. It does seem that one might > be able to add security to replication, but there does not seem to be a way > to add SolrCloud replication to this type of security. > > Also, on a side note, I notice that http://hostname:port/solr/ does bring > up the GUI without prompting for a password: the Security team here would > like us to implement security.json in such a way that even the front page > of the GUI will require a password (although they will allow us to allow > select access without a password): I have not yet found a way via > security.json to implement that a password would be required in order to > access the GUI front page. > > > > Please advise. > > -- Anshum Gupta

Re: DocValues error

2015-11-13 Thread Anshum Gupta
r index with docvalues. > > Do we really need to wipe & rebuild the entire index to add docValues to > an existing dataset? > > Thanks > -- Anshum Gupta

Re: Solr Search: Access Control / Role based security

2015-11-10 Thread Anshum Gupta
trolling data during search. > > > > > > > > > > > > > > https://cwiki.apache.org/confluence/display/solr/Authentication+and+Authorization+Plugins > > > > > > > > > > > > Please share your thoughts. > > > > > > > > Thanks, > > > > Susheel > > > > > > > > > > > > > > > > -- > > > Scott Stults | Founder & Solutions Architect | OpenSource Connections, > > LLC > > > | 434.409.2780 > > > http://www.opensourceconnections.com > > > > > > > > > > > -- > > -- > > > > Benedetti Alessandro > > Visiting card : http://about.me/alessandro_benedetti > > > > "Tyger, tyger burning bright > > In the forests of the night, > > What immortal hand or eye > > Could frame thy fearful symmetry?" > > > > William Blake - Songs of Experience -1794 England > > > -- Anshum Gupta

Re: Security Problems

2015-11-10 Thread Anshum Gupta
le-Based Authorization Plugin, How can I prevent the > strangers from visiting my solr by browser? For example, if the stranger > visit the http://(my host):8983, the browser will pop up a window and > says "the server http://(my host):8983 requires a username and > password" > > > > > > > > -- > > - > > Noble Paul > -- Anshum Gupta

Re: Security Problems

2015-11-10 Thread Anshum Gupta
hentication tokens on every > request? > > Upayavira > > On Tue, Nov 10, 2015, at 07:33 PM, Anshum Gupta wrote: > > The reason why we bypass that is so that we don't hit the authentication > > plugin for every request that comes in for static content. I think we > >

Re: SolrCloud Startup question

2015-09-21 Thread Anshum Gupta
wrote: > Thank you Anshum & Upayavira. > > BTW do any of you guys know if CloudSolrClient is ThreadSafe ?? > > Thanks, > > Ravi Kiran Bhaskar > > On Monday, September 21, 2015, Anshum Gupta <ans...@anshumgupta.net> > wrote: > > > Hi Ravi, > > &

Re: SolrCloud Startup question

2015-09-21 Thread Anshum Gupta
also launch the embedded > ZooKeeper instance included with Solr. > > This option can be shortened to simply -c. > > If you are already running a ZooKeeper ensemble that you want to use > instead of the embedded (single-node) ZooKeeper, you should also pass the > -z parameter." > > - > > Thanks > > Ravi Kiran Bhaskar > -- Anshum Gupta

Re: Securing solr 5.2 basic auth permission rules

2015-09-16 Thread Anshum Gupta
t;, "collection":"MyCollection", "role": "dev"}}' > > curl --user solr:SolrRocks http://localhost:8983/solr/admin/authorization > -H 'Content-type:application/json' -d '{ "set-user-role": {"tom":["dev"}}' > > always MyCollection is not protected. > > > thank you for your help. > -- Anshum Gupta

Re: SolrJ CollectionAdminRequest.Reload fails

2015-09-11 Thread Anshum Gupta
thod argument. > > Can you give us the full error message (including any stacktrace) so I > can look into it later this evening? > > Thanks, > Shawn > > -- Anshum Gupta

Re: How to secure Admin UI with Basic Auth in Solr 5.3.x

2015-09-11 Thread Anshum Gupta
> >> > I just installed solr cloud 5.3.x and found that the way to secure > the > > >> amin > > >> > ui has changed. Aparently there is a new plugin which does role > based > > >> > authentification and all info on how to secure the admin UI found on > > the > > >> > net is outdated. > > >> > > > >> > I do not need role based authentification but just simply want to > put > > >> basic > > >> > authentification to the Admin UI. > > >> > > > >> > How do I configure solr cloud 5.3.x in order to restrict access to > the > > >> > Admin UI via Basic Authentification? > > >> > > > >> > Thank you for any help > > >> > > >> > > >> > > >> -- > > >> - > > >> Noble Paul > > >> > > > > > > > > -- > > - > > Noble Paul > > > -- Anshum Gupta

Re: Hash of solr documents

2015-08-26 Thread Anshum Gupta
post in the Internet that the hash Solr Cloud calculates over the key field to send each document to a different shard is indexed. Is this true? If true, is there any way to show this hash for each document? Thanks, David -- Anshum Gupta

Re: splitting shards on 4.7.2 with custom plugins

2015-08-25 Thread Anshum Gupta
when trying too split shards on solr 4.2.7 with custom plugins. It fails regularily it cannot find the jar files for plugins when creating the new cores/shards. Ideas? -- Thanks, Jeff Courtade M: 240.507.6116 -- Anshum Gupta

Re: Core mismatch in org.apache.solr.update.StreamingSolrClients Errors for ConcurrentUpdateSolrClient

2015-08-11 Thread Anshum Gupta
*] org.apache.solr.update.StreamingSolrClients$1; error org.apache.solr.common.SolrException: Bad Request request: http://server:8983/solr/*CoreB*/update?update.distrib=TOLEADERdistrib.from=http%3A%2F%2Fserver2%3A8983%2Fsolr%2F*CoreB*%2Fwt=javabinversion=2 So this is also normal? Anshum Gupta wrote Hi Deniz, Seems like

Re: Core mismatch in org.apache.solr.update.StreamingSolrClients Errors for ConcurrentUpdateSolrClient

2015-08-11 Thread Anshum Gupta
-StreamingSolrClients-Errors-for-ConcurrentUpdateSolrClient-tp4222335p4222341.html Sent from the Solr - User mailing list archive at Nabble.com. -- Anshum Gupta

Re: Core mismatch in org.apache.solr.update.StreamingSolrClients Errors for ConcurrentUpdateSolrClient

2015-08-11 Thread Anshum Gupta
-update-StreamingSolrClients-Errors-for-ConcurrentUpdateSolrClient-tp4222335p4222345.html Sent from the Solr - User mailing list archive at Nabble.com. -- Anshum Gupta

Re: Core mismatch in org.apache.solr.update.StreamingSolrClients Errors for ConcurrentUpdateSolrClient

2015-08-10 Thread Anshum Gupta
the Solr - User mailing list archive at Nabble.com. -- Anshum Gupta

Re: Programmatically find out if node is overseer

2015-07-17 Thread Anshum Gupta
is the leader of a shard via isLeader(). I have looked everywhere but i cannot find an isOverseer. I did find the election stuff but i am unsure if that is what i need to use. Any thoughts? Thanks! Markus -- Anshum Gupta

Re: Programmatically find out if node is overseer

2015-07-17 Thread Anshum Gupta
be a point where you have multiple active Overseers in a single cluster How can multiple Overseers happen? And what are the consequences? Regards On 17 Jul 2015, at 19:37, Anshum Gupta ans...@anshumgupta.net wrote: ideally, there shouldn't be a point where you have multiple active

Re: Solr standalone + SSL and basic auth

2015-06-22 Thread Anshum Gupta
if we've missed updates INFO RecoveryThread-test_o_txs_shard3_replica1 cloud.RecoveryStrategy [Solr_335] [] PeerSync Recovery was not successful - trying replication. core=test_o_txs_shard3_replica1 any hints? Regards /Fadi -- Anshum Gupta

Re: Please help test the new Angular JS Admin UI

2015-06-17 Thread Anshum Gupta
Also, while you are at it, it'd be good to get SOLR-4777 in so the Admin UI is correct when users look at the SolrCloud graph post an operation that can leave the slice INACTIVE e.g. Shard split. On Wed, Jun 17, 2015 at 2:50 PM, Anshum Gupta ans...@anshumgupta.net wrote: This looks good overall

Re: Please help test the new Angular JS Admin UI

2015-06-17 Thread Anshum Gupta
that things may be moving pretty quickly, so trunk and 5x will always be the most current. That said looking at 5.2.1 will be much appreciated. Erick -- Anshum Gupta

[ANNOUNCE] Apache Solr 5.2.0 and Reference Guide for Solr 5.2 released

2015-06-07 Thread Anshum Gupta
network for distributing releases. It is possible that the mirror you are using may not have replicated the release yet. If that is the case, please try another mirror. This also goes for Maven access. -- Anshum Gupta

Re: Shard still around after calling splitshard

2015-06-04 Thread Anshum Gupta
splitshard. Should it look like that? Do I need to delete shard1 now? Thanks, Mike -- Anshum Gupta

Re: Verify a certain Replica contains a document

2015-05-18 Thread Anshum Gupta
/select?q=* Shai On Sat, May 16, 2015 at 8:08 AM, Anshum Gupta ans...@anshumgupta.net wrote: Did you also try querying /core.name/select with distrib=false ? On Fri, May 15, 2015 at 9:22 PM, Shai Erera ser...@gmail.com wrote: Hi Is there a REST API in Solr that allows me to query

  1   2   3   >