Re: [CAUTION] Converting graph query to stream graph query

[Rajeswari Natarajan]

Hi Joel,

Thanks for your reply. This is a little different issue. Here the root docs
have parent_id as null. The parent_id of the child will be the docid of the
parent. With the data above  and for the query below


nodes(s4,
  walk="1->parent_s",
  gather="docid_s",
  scatter="branches, leaves")

Below results returned, the result doesn't contain second level children.


{ "result-set": { "docs": [ { "node": "1", "collection": "s4", "field":
"node", "level": 0 }, { "node": "11", "collection": "s4", "field":
"docid_s", "level": 1 }, { "node": "12", "collection": "s4", "field":
"docid_s", "level": 1 }, { "node": "13", "collection": "s4", "field":
"docid_s", "level": 1 }, { "EOF": true, "RESPONSE_TIME": 63 } ] } }

Not sure how to map parent and docid and get all the children(docid) of a
particular parent docid.


Thanks,
Rajeswari

On Fri, Oct 18, 2019 at 2:02 PM Joel Bernstein  wrote:

> I believe we were debugging why graph results were not being returned in a
> different thread. It looks like the same problem.
>
> Is your Solr instance a straight install or have you moved config files
> from an older version of Solr to a newer version of Solr.
>
> Joel Bernstein
> http://joelsolr.blogspot.com/
>
>
> On Wed, Oct 16, 2019 at 1:09 AM Natarajan, Rajeswari <
> rajeswari.natara...@sap.com> wrote:
>
> > I need to gather all the children of docid  1 . Root item has parent as
> > null. (Sample data below)
> >
> > Tried as below
> >
> > nodes(graphtest,
> >   walk="1->parent",
> >   gather="docid",
> >   scatter="branches, leaves")
> >
> > Response :
> > {
> >   "result-set": {
> > "docs": [
> >   {
> > "node": "1",
> > "collection": "graphtest,",
> > "field": "node",
> > "level": 0
> >   },
> >   {
> > "EOF": true,
> > "RESPONSE_TIME": 5
> >   }
> > ]
> >   }
> > }
> >
> > Query just gets the  root item and not it's children. Looks like I am
> > missing something obvious . Any pointers , please.
> >
> > As I said earlier the below graph query gets all the children of docid 1.
> >
> > fq={!graph from=parent to=docid}docid:"1"
> >
> > Thanks,
> > Rajeswari
> >
> >
> >
> > On 10/15/19, 12:04 PM, "Natarajan, Rajeswari" <
> > rajeswari.natara...@sap.com> wrote:
> >
> > Hi,
> >
> >
> > curl -XPOST -H 'Content-Type: application/json' '
> > http://localhost:8983/solr/ggg/update' --data-binary '{
> > "add" : { "doc" : { "id" : "a", "docid" : "1", "name" : "Root
> document
> > one" } },
> > "add" : { "doc" : { "id" : "b", "docid" : "2", "name" : "Root
> document
> > two" } },
> > "add" : { "doc" : {  "id" : "c", "docid" : "3", "name" : "Root
> > document three" } },
> > "add" : { "doc" : {  "id" : "d", "docid" : "11", "parent" : "1",
> > "name" : "First level document 1, child one" } },
> > "add" : { "doc" : {  "id" : "e", "docid" : "12", "parent" : "1",
> > "name" : "First level document 1, child two" } },
> > "add" : { "doc" : {  "id" : "f", "docid" : "13", "parent" : "1",
> > "name" : "First level document 1, child three" } },
> > "add" : { "doc" : {  "id" : "g", "docid" : "21", "parent" : "2",
> > "name" : "First level document 2, child one" } },
> > "add" : { "doc" : {  "id" : "h", "docid" : "22", "parent" : "2",
> > "name" : "First level document 2, child two" } },
> > "add" : { "doc" : {  "id" : "j", "docid" : "121", "parent" : "12",
> > "name" : "Second level document 12, child one" } },
> > "add" : { "doc" : {  "id" : "k", "docid" : "122", "parent" : "12",
> > "name" : "Second level document 12, child two" } },
> > "add" : { "doc" : {  "id" : "l", "docid" : "131", "parent" : "13",
> > "name" : "Second level document 13, child three" } },
> > "commit" : {}
> > }'
> >
> >
> > For the above data , the below query gets all the children of
> document
> > with docid 1.
> >
> >
> >
> http://localhost:8983/solr/graphtest/select?q=*:*={!graph%20from=parent%20to=docid}docid
> 
> > <
> http://localhost:8983/solr/graphtest/select?q=*:*=%7B!graph%20from=parent%20to=docid%7Ddocid
> >
> > :"1<
> >
> http://localhost:8983/solr/graphtest/select?q=*:*=%7b!graph%20from=parent%20to=docid%7ddocid:%221
> > >"
> >
> >
> > How can I convert this query into streaming graph query with nodes
> > expression.
> >
> > Thanks,
> > Rajeswari
> >
> >
> >
> >
>

Re: Help with Stream Graph

[Rajeswari Natarajan]

Thanks Joel.  That fixed the problem.

Regards,
Rajeswari

On Fri, Oct 18, 2019 at 12:50 PM Joel Bernstein  wrote:

> The query that is created to me looks looked good but it returns no
> results. Let's just do a basic query using the select handler:
>
> product_s:product1
>
> If this brings back zero results then we know we have a problem with the
> data.
>
> Joel Bernstein
> http://joelsolr.blogspot.com/
>
>
> On Fri, Oct 18, 2019 at 1:41 PM Rajeswari Natarajan 
> wrote:
>
> > Hi Joel,
> >
> > Do you see anything wrong in the config or data . I am using 7.6.
> >
> > Thanks,
> > Rajeswari
> >
> > On Thu, Oct 17, 2019 at 8:36 AM Rajeswari Natarajan 
> > wrote:
> >
> > > My config is from
> > >
> > >
> > >
> >
> https://github.com/apache/lucene-solr/tree/branch_7_6/solr/solrj/src/test-files/solrj/solr/configsets/streaming/conf
> > >
> > >
> > >  />
> > >
> > >  > > docValues="true"/>
> > >
> > >
> > >
> > > 
> > >
> > >  > omitNorms="true"
> > > positionIncrementGap="0"/>
> > >
> > >
> > >
> > > Thanks,
> > >
> > > Rajeswari
> > >
> > > On Thu, Oct 17, 2019 at 8:16 AM Rajeswari Natarajan <
> rajis...@gmail.com>
> > > wrote:
> > >
> > >> I tried below query  and it returns o results
> > >>
> > >>
> > >>
> >
> http://localhost:8983/solr/knr/export?{!terms+f%3Dproduct_s}product1=false=basket_s,product_s=basket_s+asc,product_s+asc=json=2.2
> 
> > <
> http://localhost:8983/solr/knr/export?%7B!terms+f%3Dproduct_s%7Dproduct1=false=basket_s,product_s=basket_s+asc,product_s+asc=json=2.2
> >
> > >> <
> >
> http://localhost:8983/solr/knr/export?%7B!terms+f%3Dproduct_s%7Dproduct1=false=basket_s,product_s=basket_s+asc,product_s+asc=json=2.2
> > >
> > >>
> > >>
> > >> {
> > >>   "responseHeader":{"status":0},
> > >>   "response":{
> > >> "numFound":0,
> > >> "docs":[]}}
> > >>
> > >> Regards,
> > >> Rajeswari
> > >> On Thu, Oct 17, 2019 at 8:05 AM Rajeswari Natarajan <
> rajis...@gmail.com
> > >
> > >> wrote:
> > >>
> > >>> Thanks Joel.
> > >>>
> > >>> Here is the logs for below request
> > >>>
> > >>> curl --data-urlencode
> > >>> 'expr=gatherNodes(knr,walk="product1->product_s",gather="basket_s")'
> > >>> http://localhost:8983/solr/knr/stream
> > >>>
> > >>> 2019-10-17 15:02:06.969 INFO  (qtp952486988-280) [c:knr s:shard1
> > >>> r:core_node2 x:knr_shard1_replica_n1] o.a.s.c.S.Request
> > >>> [knr_shard1_replica_n1]  webapp=/solr path=/stream
> > >>>
> >
> params={expr=gatherNodes(knr,walk%3D"product1->product_s",gather%3D"basket_s")}
> > >>> status=0 QTime=0
> > >>>
> > >>> 2019-10-17 15:02:06.975 INFO  (qtp952486988-192) [c:knr s:shard1
> > >>> r:core_node2 x:knr_shard1_replica_n1] o.a.s.c.S.Request
> > >>> [knr_shard1_replica_n1]  webapp=/solr path=/export
> > >>>
> >
> params={q={!terms+f%3Dproduct_s}product1=false=off=basket_s,product_s=basket_s+asc,product_s+asc=json=2.2}
> > >>> hits=0 status=0 QTime=1
> > >>>
> > >>>
> > >>>
> > >>> Here is the logs for
> > >>>
> > >>>
> > >>>
> > >>> curl --data-urlencode
> > >>>
> >
> 'expr=gatherNodes(knr,walk="product1->product_s",gather="basket_s",scatter="branches,
> > >>> leaves")' http://localhost:8983/solr/knr/stream
> > >>>
> > >>>
> > >>> 2019-10-17 15:03:57.068 INFO  (qtp952486988-356) [c:knr s:shard1
> > >>> r:core_node2 x:knr_shard1_replica_n1] o.a.s.c.S.Request
> > >>> [knr_shard1_replica_n1]  webapp=/solr path=/stream
> > >>>
> >
> params={expr=gatherNodes(knr,walk%3D"product1->product_s",gather%3D"basket_s",scatter%3D"branches,+leaves")}
> > >>> status=0 QTime=0
> > >>>
> > >>> 2019-10-17 15:03:57.071 INFO  (qtp952486988-400) [c:knr s:shard1
> > >>> r:core_node2 x:knr_shard1_replica_n1] o.a.s.c.S.Request
> > >>> [knr_shard1_replica_n1]  webapp=/solr path=/export
> > >>>
> >
> params={q={!terms+f%3Dproduct_s}product1=false=off=basket_s,product_s=basket_s+asc,product_s+asc=json=2.2}
> > >>> hits=0 status=0 QTime=0
> > >>>
> > >>>
> > >>>
> > >>>
> > >>> Thank you,
> > >>>
> > >>> Rajeswari
> > >>>
> > >>> On Thu, Oct 17, 2019 at 5:23 AM Joel Bernstein 
> > >>> wrote:
> > >>>
> >  Can you show the logs from this request. There will be a Solr query
> > that
> >  gets sent with product1 searched against the product_s field. Let's
> > see
> >  how
> >  many documents that query returns.
> > 
> > 
> >  Joel Bernstein
> >  http://joelsolr.blogspot.com/
> > 
> > 
> >  On Thu, Oct 17, 2019 at 1:41 AM Rajeswari Natarajan <
> > rajis...@gmail.com
> >  >
> >  wrote:
> > 
> >  > Hi,
> >  >
> >  > Since the stream graph query for my use case , didn't work as  i
> > took
> >  the
> >  > data from solr source code test and also copied the schema and
> >  > solrconfig.xml from solr 7.6 source code.  Had to substitute few
> >  variables.
> >  >
> >  > Posted below data
> >  >
> >  > curl -X POST http://localhost:8983/solr/knr/update -H
> > 

Re: solr 8.1.1 many time slower returning query results than solr 4.10.4 or solr 6.5.1

[Russell Bahr]

Hi Shawn,
per your comments from before
  On Oct 15, 2019, 2:28 AM, Shawn Heisey wrote:
  > Java 12 is not recommended.  It is one of the "new feature" releases
  > that only gets 6 months of support.  We would recommend Java 8 or Java
  > 11.  These are the versions with long term support.  Probably a good
  > thing to be using OpenJDK, as the official Oracle Java now requires
  > paying for a license.

I have rebuilt my 30 server sorl 8 cluster using java11 and increased the
java heap -Xms10433m -Xmx10433m and am seeing the same slowness that I was
seeing with java12.
I have not yet tried to build out the solr 8 collection with java8.  Would
it be worthwhile to do that or were you able to see anything in the logs?

Thank you in advance,
Russ

*Manzama*a MODERN GOVERNANCE company

Russell Bahr
Lead Infrastructure Engineer

USA & CAN Office: +1 (541) 306 3271
USA & CAN Support: +1 (541) 706 9393
UK Office & Support: +44 (0)203 282 1633
AUS Office & Support: +61 (0) 2 8417 2339

543 NW York Drive, Suite 100, Bend, OR 97703

LinkedIn  | Twitter
 | Facebook
 | YouTube



On Wed, Oct 16, 2019 at 11:50 AM Russell Bahr  wrote:

> Hi Shawn,
>
> Just checking to see if you saw my reply and had any feedback. Thank you
> again for your help. It is much appreciated.
>
> Thank you,
>
> Russ
>
>
>
>
>
> *From: *Russell Bahr 
> *Date: *Tuesday, October 15, 2019 at 11:50 AM
> *To: *"solr-user@lucene.apache.org" 
> *Subject: *Re: solr 8.1.1 many time slower returning query results than
> solr 4.10.4 or solr 6.5.1
>
>
>
> Hi Shawn,
>
> I included the wrong file for solr4 and did not realize until you pointed
> out the heap size.  The correct file that is setting the Java environment
> is "Solr 4 tomcat setenv" I have uploaded that to the shared folder along
> with the requested screenshots "Solr 4 top screenshot","Solr 6 top
> screenshot","Solr 8 top screenshot".
>
>
>
> I have also uploaded the solr.log, solr_gc.log, and solr_slow_requests.log
> from a 2 hour period of time where I was running the email load test
> against the solr8 implementation in which the queued tasks are taking too
> long to complete.
>
>
>
> solr_gc.log, solr_gc.log.1, solr_gc.log.2, solr.log, solr.log.10,
> solr.log.6, solr.log.7, solr.log.8, solr.log.9, solr_slow_requests.log
>
>
>
> Let me know if there is any other information that I can provide that may
> help to work through this.
>
>
>
> *Manzama *a MODERN GOVERNANCE company
>
>
>
> Russell Bahr
> Lead Infrastructure Engineer
>
> USA & CAN Office: +1 (541) 306 3271
> USA & CAN Support: +1 (541) 706 9393
> UK Office & Support: +44 (0)203 282 1633
> AUS Office & Support: +61 (0) 2 8417 2339
>
> 543 NW York Drive, Suite 100, Bend, OR 97703
>
> LinkedIn  | Twitter
>  | Facebook
>  | YouTube
> 
>
>
>
>
>
> On Tue, Oct 15, 2019 at 2:28 AM Shawn Heisey  wrote:
>
> On 10/14/2019 1:36 PM, Russell Bahr wrote:
> > Backend replacement of solr4 and hopefully Frontend replacement as well.
> > solr-spec 8.1.1
> > lucene-spec 8.1.1
> > Runtime Oracle Corporation OpenJDK 64-Bit Server VM 12 12+33
> > 1 collection 6 shards 5 replicas per shard 17,919,889 current documents
> (35 days worth of documents) - indexing new documents regularly throughout
> the day, deleting aged out documents nightly.
>
> Java 12 is not recommended.  It is one of the "new feature" releases
> that only gets 6 months of support.  We would recommend Java 8 or Java
> 11.  These are the versions with long term support.  Probably a good
> thing to be using OpenJDK, as the official Oracle Java now requires
> paying for a license.
>
> Solr 8 ships with settings that enable the G1GC collector instead of
> CMS, because CMS is deprecated and will disappear in a future Java
> version.  We have seen problems with this when the system is
> misconfigured as far as heap size.  When the system is properly sized,
> G1 tends to do better than CMS, but when the heap is too large or too
> small, has a tendency to amplify garbage collection problems in comparison.
>
> Looking at your solr.in.sh files for each version ... the Solr 4 install
> appears to be setting the heap to 512 megabytes.  This is definitely not
> enough for millions of documents, and if this is what the heap size is
> actually set to, would almost certainly run into memory errors
> frequently and have absolutely terrible performance.  But you are saying
> that it works well, so I don't think the heap is actually set to 512
> megabytes.  Maybe the bin/solr script has been modified directly to set
> the memory size instead of setting it in solr.in.sh where it should be
> set.
>
> Solr 6 has a heap size of just under 27 gigabytes.  Solr 8 has a heap
> size of 

Solr enabled kerberos and create collection failed

[Lvyankui]

SolrCloud mode, Solr and Zookeeper enabled kerberos, create collection failed 
with following command
curl --negotiate -u : 'http:// 
noder27:8983/solr/admin/collections?action=CREATE=test01=1=1=_default=json'
The error is:
{
  "responseHeader":{
"status":0,
"QTime":31818},
  "failure":{

"noder27.hde.h3c.com:8983_solr":"org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException:Error
 from server at http://noder27.hde.h3c.com:8983/solr: Expected mime type 
application/octet-stream but got text/html. \n\n\nError 
401 Authentication required\n\nHTTP ERROR 
401\nProblem accessing /solr/admin/cores. Reason:\n
Authentication required\n\n\n"
}}

But if I restart Solr several times，it will return to normal probability.
-
本邮件及其附件含有新华三集团的保密信息，仅限于发送给上面地址中列出
的个人或群组。禁止任何其他人以任何形式使用（包括但不限于全部或部分地泄露、复制、
或散发）本邮件中的信息。如果您错收了本邮件，请您立即电话或邮件通知发件人并删除本
邮件！
This e-mail and its attachments contain confidential information from New H3C, 
which is
intended only for the person or entity whose address is listed above. Any use 
of the
information contained herein in any way (including, but not limited to, total 
or partial
disclosure, reproduction, or dissemination) by persons other than the intended
recipient(s) is prohibited. If you receive this e-mail in error, please notify 
the sender
by phone or email immediately and delete it!

Re: solr UI collection dropdown sorting order

[Erick Erickson]

Unfortunately not, although if you’d like to add that functionality to the 
admin UI that’d be great.

If you know the name, you can just start typing and not have to scroll.

Best,
Erick

> On Oct 20, 2019, at 4:06 AM, Sotiris Fragkiskos  wrote:
> 
> Hi everyone!
> 
> is there any way the collections available on the left-hand side of the
> solr UI can be sorted? I'm referring to the "collection selector" dropdown.
> But the same applies to the Collections button.
> The sorting seems kind of..random?
> 
> Thanks in advance!
> 
> Sotir

Re: WELCOME to solr-user@lucene.apache.org

[Erick Erickson]

In short, nothing that’s maintained as part of the Apache project. There may be 
commercial products, but I haven’t had occasion to look for one.

Best,
Erick

> On Oct 20, 2019, at 7:42 AM, Wasim S Kazi  wrote:
> 
> Good day
> 
> I would like to get some info or confirmation about configuring Solr 8+ to 
> get content from WCM (Websphere Content Management)
> 
> Essentially, we have manually index data from WCM into Solr and this all 
> works fine. We want to now automate this process, so checking is there is any 
> well established integration method between WCM and Solr. This integration 
> should allow content being indexed automatically, or periodically without 
> human intervention.
> 
> Regards
> Wasim Kazi
> 
> -Original Message-
> From: solr-user-h...@lucene.apache.org 
> Sent: Sunday, October 20, 2019 2:39 PM
> To: Wasim S Kazi 
> Subject: WELCOME to solr-user@lucene.apache.org
> 
> Hi! This is the ezmlm program. I'm managing the solr-user@lucene.apache.org 
> mailing list.
> 
> I'm working for my owner, who can be reached at 
> solr-user-ow...@lucene.apache.org.
> 
> Acknowledgment: I have added the address
> 
>   wasim.s.k...@za.ey.com
> 
> to the solr-user mailing list.
> 
> Welcome to solr-user@lucene.apache.org!
> 
> Please save this message so that you know the address you are subscribed 
> under, in case you later want to unsubscribe or change your subscription 
> address.
> 
> 
> --- Administrative commands for the solr-user list ---
> 
> I can handle administrative requests automatically. Please do not send them 
> to the list address! Instead, send your message to the correct command 
> address:
> 
> To subscribe to the list, send a message to:
>   
> 
> To remove your address from the list, send a message to:
>   
> 
> Send mail to the following for info and FAQ for this list:
>   
>   
> 
> Similar addresses exist for the digest list:
>   
>   
> 
> To get messages 123 through 145 (a maximum of 100 per request), mail:
>   
> 
> To get an index with subject and author for messages 123-456 , mail:
>   
> 
> They are always returned as sets of 100, max 2000 per request, so you'll 
> actually get 100-499.
> 
> To receive all messages with the same subject as message 12345, send a short 
> message to:
>   
> 
> The messages should contain one line or word of text to avoid being treated 
> as sp@m, but I will ignore their content.
> Only the ADDRESS you send to is important.
> 
> You can start a subscription for an alternate address, for example 
> "john@host.domain", just add a hyphen and your address (with '=' instead of 
> '@') after the command word:
> 
> 
> To stop subscription for this address, mail:
> 
> 
> In both cases, I'll send a confirmation message to that address. When you 
> receive it, simply reply to it to complete your subscription.
> 
> If despite following these instructions, you do not get the desired results, 
> please contact my owner at solr-user-ow...@lucene.apache.org. Please be 
> patient, my owner is a lot slower than I am ;-)
> 
> --- Enclosed is a copy of the request I received.
> 
> Return-Path: 
> Received: (qmail 96582 invoked by uid 99); 20 Oct 2019 11:38:52 -
> Received: from pnap-us-west-generic-nat.apache.org (HELO 
> spamd1-us-west.apache.org) (209.188.14.142)
>by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 20 Oct 2019 11:38:52 +
> Received: from localhost (localhost [127.0.0.1])
>by spamd1-us-west.apache.org (ASF Mail Server at 
> spamd1-us-west.apache.org) with ESMTP id 81232C0C8E
>for 
> ;
>  Sun, 20 Oct 2019 11:38:51 + (UTC)
> X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org
> X-Spam-Flag: NO
> X-Spam-Score: -4.8
> X-Spam-Level:
> X-Spam-Status: No, score=-4.8 tagged_above=-999 required=6.31
>tests=[HTML_FONT_LOW_CONTRAST=0.001, HTML_MESSAGE=0.2,
>KAM_SHORT=0.001, RCVD_IN_DNSWL_HI=-5, SPF_HELO_PASS=-0.001,
>SPF_PASS=-0.001] autolearn=disabled
> Received: from mx1-he-de.apache.org ([10.40.0.8])
>by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, 
> port 10024)
>with ESMTP id Kbk25gxC2elm
>for 
> ;
>Sun, 20 Oct 2019 11:38:50 + (UTC)
> Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=199.49.1.52; 
> helo=em01.ey.com; envelope-from=wasim.s.k...@za.ey.com; receiver=
> Received: from em01.ey.com (em01.ey.com [199.49.1.52])
>by mx1-he-de.apache.org (ASF Mail Server at mx1-he-de.apache.org) with 
> ESMTPS id 86E307DDFA
>for 
> ;
>  Sun, 20 Oct 2019 11:38:49 + (UTC)
> IronPort-SDR: 
> 0i+SrmLgncBfCsgonKDgt+Ll+5TCuN/hbDHsUS1V98D3LWk4dgqQE9qJPrbcZyYjLWRYXieztn
> Fjky8vaAREXw==
> X-IronPort-AV: E=Sophos;i="5.67,319,1566864000";
>   d="gif'147?scan'147,208,217,147";a="240843155"
> Received: from unknown (HELO DERUSRMPEXTP02.ey.net) ([10.151.33.58])
>  by defrakaeyip01.eurw.ey.net with ESMTP; 20 Oct 2019 11:38:42 +
> ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none;  
> 

Re: Solr Paryload example

[Erick Erickson]

You’d need to write one. Payloads are generally intended to hold numerics you 
can then use in a function query to factor into the score…

Best,
Erick

> On Oct 20, 2019, at 4:57 PM, Vincenzo D'Amore  wrote:
> 
> Sorry, I just realized that I was wrong in how I'm using the payload
> function.
> Give that the payload function only handles a numeric (integer or float)
> payload, could you suggest me an alternative function that handles strings?
> If not, should I write one?
> 
> On Sun, Oct 20, 2019 at 10:43 PM Vincenzo D'Amore 
> wrote:
> 
>> Hi all,
>> 
>> I'm trying to understand what I did wrong with a payload query that
>> returns
>> 
>> error: {
>> metadata: [ "error-class", "org.apache.solr.common.SolrException",
>> "root-error-class", "org.apache.solr.common.SolrException" ],
>> msg: "No payload decoder found for field: colorCode",
>> code: 400
>> }
>> 
>> I have reduced my problem in a little sample to show what happens to me.
>> Basically I have a document with a couple of payload fields one
>> delimited_payloads_string and one delimited_payloads_integer
>> 
>> {
>> field_dps: "key|data",
>> field_dpi: "key|1",
>> }
>> 
>> When I execute this query solr returns as expected the payload for the key
>> 
>> q=*:*=payload(field_dpi,key)
>> 
>> {
>> payload(field_dpi,key): 1
>> }
>> 
>> But for the strings there have to be something of different to do, because
>> I'm unable receive the payload value back. Executing this query, as in the
>> short introduction of this post, I receive an error.
>> 
>> ?q=*:*=payload(field_dps,key)
>> 
>> error: {
>> metadata: [ "error-class", "org.apache.solr.common.SolrException",
>> "root-error-class", "org.apache.solr.common.SolrException" ],
>> msg: "No payload decoder found for field: colorCode",
>> code: 400
>> }
>> 
>> Am I doing something wrong? How can I read strings payload data?
>> 
>> Thanks in advance for your time,
>> Vincenzo
>> 
>> --
>> Vincenzo D'Amore
>> 
>> 
> 
> -- 
> Vincenzo D'Amore

Solr Payload example

[Vincenzo D'Amore]

Hi all,

I'm trying to understand what I did wrong with a payload query that returns

error: {
metadata: [ "error-class", "org.apache.solr.common.SolrException",
"root-error-class", "org.apache.solr.common.SolrException" ],
msg: "No payload decoder found for field: colorCode",
code: 400
}

I have reduced my problem in a little sample to show what happens to me.
Basically I have a document with a couple of payload fields one
delimited_payloads_string and one delimited_payloads_integer

{
field_dps: "key|data",
field_dpi: "key|1",
}

When I execute this query solr returns as expected the payload for the key

q=*:*=payload(field_dpi,key)

{
payload(field_dpi,key): 1
}

But for the strings there have to be something of different to do, because
I'm unable receive the payload value back. Executing this query, as in the
short introduction of this post, I receive an error.

?q=*:*=payload(field_dps,key)

error: {
metadata: [ "error-class", "org.apache.solr.common.SolrException",
"root-error-class", "org.apache.solr.common.SolrException" ],
msg: "No payload decoder found for field: colorCode",
code: 400
}

Am I doing something wrong? How can I read strings payload data?

Thanks in advance for your time,
Vincenzo

-- 
Vincenzo D'Amore

Re: Solr Payload example

[Vincenzo D'Amore]

Sorry, I just realized that I was wrong in how I'm using the payload
function.
Give that the payload function only handles a numeric (integer or float)
payload, could you suggest me an alternative function that handles strings?
If not, should I write one?

On Sun, Oct 20, 2019 at 10:43 PM Vincenzo D'Amore 
wrote:

> Hi all,
>
> I'm trying to understand what I did wrong with a payload query that
> returns
>
> error: {
> metadata: [ "error-class", "org.apache.solr.common.SolrException",
> "root-error-class", "org.apache.solr.common.SolrException" ],
> msg: "No payload decoder found for field: colorCode",
> code: 400
> }
>
> I have reduced my problem in a little sample to show what happens to me.
> Basically I have a document with a couple of payload fields one
> delimited_payloads_string and one delimited_payloads_integer
>
> {
> field_dps: "key|data",
> field_dpi: "key|1",
> }
>
> When I execute this query solr returns as expected the payload for the key
>
> q=*:*=payload(field_dpi,key)
>
> {
> payload(field_dpi,key): 1
> }
>
> But for the strings there have to be something of different to do, because
> I'm unable receive the payload value back. Executing this query, as in the
> short introduction of this post, I receive an error.
>
> ?q=*:*=payload(field_dps,key)
>
> error: {
> metadata: [ "error-class", "org.apache.solr.common.SolrException",
> "root-error-class", "org.apache.solr.common.SolrException" ],
> msg: "No payload decoder found for field: colorCode",
> code: 400
> }
>
> Am I doing something wrong? How can I read strings payload data?
>
> Thanks in advance for your time,
> Vincenzo
>
> --
> Vincenzo D'Amore
>
>

-- 
Vincenzo D'Amore

Joins and text fields projection

[Ahmed Adel]

Hi,

Is there a way to select text fields in a query with a join clause in
Streaming Expressions or Parallel SQL? The following query:

SELECT field_s, field_t FROM t1 INNER JOIN t2 ON t1.a = t2.a LIMIT 10

requires that field_t, which is of type text, have docValues enabled, which
is not supported afaik:

java.io.IOException: --> http://172.31.34.56:8983/solr/t1:Failed to execute
sqlQuery 'SELECT field_s, field_t FROM t1 INNER JOIN t2 ON t1.a = t2.a
LIMIT 10' against JDBC connection 'jdbc:calcitesolr:'. Error while
executing SQL "SELECT field_s, field_t FROM t1 INNER JOIN t2 ON t1.a = t2.a
LIMIT 10": java.io.IOException: java.util.concurrent.ExecutionException:
java.io.IOException: -->
http://172.18.0.2:8983/solr/t1_shard1_replica_n1/:field_t{type=text_general,properties=indexed,tokenized,stored,useDocValuesAsStored,uninvertible}
must have DocValues to use this feature.

Its equivalent streaming expression clearly results in the same:

innerJoin(
  search(t1, q="*:*", qt="/export", fl="a1,field_t", sort="a asc"),
  search(t2, q="*:*", qt="/export", fl="a2,field_s", sort="a asc"),
  on="a"
)

java.io.IOException: -->
http://172.31.34.56:8983/solr/reviews:java.util.concurrent.ExecutionException:
java.io.IOException: -->
http://172.18.0.2:8983/solr/t1_shard1_replica_n1/:field_t{type=text_general,properties=indexed,tokenized,stored,useDocValuesAsStored,uninvertible}
must have DocValues to use this feature.

Thanks,
A.

RE: WELCOME to solr-user@lucene.apache.org

[Wasim S Kazi]

Good day

I would like to get some info or confirmation about configuring Solr 8+ to get 
content from WCM (Websphere Content Management)

Essentially, we have manually index data from WCM into Solr and this all works 
fine. We want to now automate this process, so checking is there is any well 
established integration method between WCM and Solr. This integration should 
allow content being indexed automatically, or periodically without human 
intervention.

Regards
Wasim Kazi

-Original Message-
From: solr-user-h...@lucene.apache.org 
Sent: Sunday, October 20, 2019 2:39 PM
To: Wasim S Kazi 
Subject: WELCOME to solr-user@lucene.apache.org

Hi! This is the ezmlm program. I'm managing the solr-user@lucene.apache.org 
mailing list.

I'm working for my owner, who can be reached at 
solr-user-ow...@lucene.apache.org.

Acknowledgment: I have added the address

   wasim.s.k...@za.ey.com

to the solr-user mailing list.

Welcome to solr-user@lucene.apache.org!

Please save this message so that you know the address you are subscribed under, 
in case you later want to unsubscribe or change your subscription address.


--- Administrative commands for the solr-user list ---

I can handle administrative requests automatically. Please do not send them to 
the list address! Instead, send your message to the correct command address:

To subscribe to the list, send a message to:
   

To remove your address from the list, send a message to:
   

Send mail to the following for info and FAQ for this list:
   
   

Similar addresses exist for the digest list:
   
   

To get messages 123 through 145 (a maximum of 100 per request), mail:
   

To get an index with subject and author for messages 123-456 , mail:
   

They are always returned as sets of 100, max 2000 per request, so you'll 
actually get 100-499.

To receive all messages with the same subject as message 12345, send a short 
message to:
   

The messages should contain one line or word of text to avoid being treated as 
sp@m, but I will ignore their content.
Only the ADDRESS you send to is important.

You can start a subscription for an alternate address, for example 
"john@host.domain", just add a hyphen and your address (with '=' instead of 
'@') after the command word:


To stop subscription for this address, mail:


In both cases, I'll send a confirmation message to that address. When you 
receive it, simply reply to it to complete your subscription.

If despite following these instructions, you do not get the desired results, 
please contact my owner at solr-user-ow...@lucene.apache.org. Please be 
patient, my owner is a lot slower than I am ;-)

--- Enclosed is a copy of the request I received.

Return-Path: 
Received: (qmail 96582 invoked by uid 99); 20 Oct 2019 11:38:52 -
Received: from pnap-us-west-generic-nat.apache.org (HELO 
spamd1-us-west.apache.org) (209.188.14.142)
by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 20 Oct 2019 11:38:52 +
Received: from localhost (localhost [127.0.0.1])
by spamd1-us-west.apache.org (ASF Mail Server at 
spamd1-us-west.apache.org) with ESMTP id 81232C0C8E
for 
;
 Sun, 20 Oct 2019 11:38:51 + (UTC)
X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org
X-Spam-Flag: NO
X-Spam-Score: -4.8
X-Spam-Level:
X-Spam-Status: No, score=-4.8 tagged_above=-999 required=6.31
tests=[HTML_FONT_LOW_CONTRAST=0.001, HTML_MESSAGE=0.2,
KAM_SHORT=0.001, RCVD_IN_DNSWL_HI=-5, SPF_HELO_PASS=-0.001,
SPF_PASS=-0.001] autolearn=disabled
Received: from mx1-he-de.apache.org ([10.40.0.8])
by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 
10024)
with ESMTP id Kbk25gxC2elm
for 
;
Sun, 20 Oct 2019 11:38:50 + (UTC)
Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=199.49.1.52; 
helo=em01.ey.com; envelope-from=wasim.s.k...@za.ey.com; receiver=
Received: from em01.ey.com (em01.ey.com [199.49.1.52])
by mx1-he-de.apache.org (ASF Mail Server at mx1-he-de.apache.org) with 
ESMTPS id 86E307DDFA
for 
;
 Sun, 20 Oct 2019 11:38:49 + (UTC)
IronPort-SDR: 
0i+SrmLgncBfCsgonKDgt+Ll+5TCuN/hbDHsUS1V98D3LWk4dgqQE9qJPrbcZyYjLWRYXieztn
 Fjky8vaAREXw==
X-IronPort-AV: E=Sophos;i="5.67,319,1566864000";
   d="gif'147?scan'147,208,217,147";a="240843155"
Received: from unknown (HELO DERUSRMPEXTP02.ey.net) ([10.151.33.58])
  by defrakaeyip01.eurw.ey.net with ESMTP; 20 Oct 2019 11:38:42 +
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none;  
b=Em+4qSC0AqZ4Ei+nYLvNi3BwVnwrjtXdFD2W5lnj3CNDBO0x9JJBOn5yWMUj4JNnCnhg4R524D5O+lX6dYrYut/tTe09g0pnRemmla9J7icpboVqK6i5gXJLHLFA9dERNQwRDieNKqKEkei0eIbCzLMJeVld1lvj7CJiXIZPZIySU5hHZI7N5+Q9i1eb4GRYxATio7ibfxNknvf3/2298wyUhY9EuQEEuTWNrylkhMtQORgdlgv+mEdpzGJO+FaiG0fv1MQ0TO8JcgybSjJ14hG7xYlhkGEO39qzV7Q9EDbsPwJuupwZg/r4XAIIZ0Bjc0f7YX11S2BhnV8mdm+T+A==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com;  
s=arcselector9901;  

solr UI collection dropdown sorting order

[Sotiris Fragkiskos]

Hi everyone!

is there any way the collections available on the left-hand side of the
solr UI can be sorted? I'm referring to the "collection selector" dropdown.
But the same applies to the Collections button.
The sorting seems kind of..random?

Thanks in advance!

Sotir

SolrCloud streaming innerJoin unexplained results

[Joe Andaverde]

I don't believe I am getting expected results when using a streaming
expression that simply uses innerJoin.

Here's the example:

innerJoin(
search(illuminate, q=(mrn:123) (*:*), fl="key,mrn", sort="mrn asc"),
search(illuminate, q=(foo*), fl="key,mrn,*", sort="mrn asc"),
on="mrn"
)

All documents in my scenario are sharded based on the mrn field. Therefore,
only one shard will have documents that match the left query. All shards
will match the right.

The problem I'm seeing is that I get no results back for this query. Even
though, on one of the shards, there is a match on the left and right.

When I add mrn:123 to the right side I get documents back, presumably
because of its returning results like Scenario 1 below! Here's what I'm
noticing:

Scenario1: no matches for either side on the first shard.

#L/R means match count

Shard:  #Left, #Right
1: 0 0
2: 1 100

Scenario 1 doesn't match anything in the first shard but does match in the
second. The result is what I would get if I only queried the second shard.
This is great!

Scenario 2: the first shard matches something on the right but not the left.

Shard:  #Left, #Right
1: 0 100
2: 1 100

Scenario 2 I get back no results.