Re: How to create my schema and add document, thank you
Thanks.
I have moved this to the next stage:
1. 3 fields are to be extracted from the raw files, the location of the raw
file is the fourth field, all the 4 fields become a document
2. Only the 3 fields will be index'ed?
3. The search result should be kind of re-formatted to include the 3 fields
and the content by parsing the location and retrieve the original raw
data's content.
Current challenge is: the raw data is zipped, I am not sure what can I do
to process the zipped file, can Solr handle that?
My plan is below:
AJava (?) based website will be created, a GUI is created for accepting
user's keyword, the keyword will be used to form a POST url, the url will
be used to GET response from Solr, the response will contain the
correspondent message location, the java program will fetch the zipped file
and unzip it, as one zip file could contain multiple messages, the java
program will need to parse out the matched message(s), the parsed matched
message(s) will be shown to the end user together with the other meta data
(the three index'ed fields).
Is this a feasible plan? is there better solution?
Thank you very much.
**
*Sincerely yours,*
*Raymond*
On Thu, Apr 5, 2018 at 7:11 AM, Adhyan Arizki <a.ari...@gmail.com> wrote:
> Raymond,
>
> 1. Please ensure your Solr instance does indeed load up the correct
> managed-schema file. You do not need to create the file, it should have
> been created automatically in the newer version of Solr out of the box. you
> just need to edit it
> 2. Have you reload your instance after you made the modification?
>
> On Thu, Apr 5, 2018 at 6:56 PM, Raymond Xie <xie3208...@gmail.com> wrote:
>
> > I have the data ready for index now, it is a json file:
> >
> > {"122": "20180320-08:08:35.038", "49": "VIPER", "382": "0", "151": "1.0",
> > "9": "653", "10071": "20180320-08:08:35.088", "15": "JPY", "56": "XSVC",
> > "54": "1", "10202": "APMKTMAKING", "10537": "XOSE", "10217": "Y", "48":
> > "179492540", "201": "1", "40": "2", "8": "FIX.4.4", "167": "OPT", "421":
> > "JPN", "10292": "115", "10184": "3379122", "456": "101", "11210":
> > "3379122", "1133": "G", "10515": "178", "10": "200", "11032":
> "-1",
> > "10436": "20180320-08:08:35.038", "10518": "178", "11":
> > "3379122", "75":
> > "20180320", "10005": "178", "10104": "Y", "35": "RIO", "10208":
> > "APAC.VIPER.OOE", "59": "0", "60": "20180320-08:08:35.088", "528": "P",
> > "581": "13", "1": "TEST", "202": "25375.0", "455": "179492540", "55":
> > "JNI253D8.OS", "100": "XOSE", "52": "20180320-08:08:35.088", "10241":
> > "viperooe", "150": "A", "10039": "viperooe", "39": "A", "10438":
> "RIO.4.5",
> > "38": "1", "37": "3379122", "372": "D", "660": "102", "44":
> "2.0",
> > "10066": "20180320-08:08:35.038", "29": "4", "50": "JPNIK01", "22":
> "101"}
> >
> > You can inspect the json here: https://jsonformatter.org/
> >
> > I need to create index and enable searching on tags: 37, 75 and 10242
> > (where available, this sample message doesn't have it)
> >
> > My understanding is I need to create the file managed-schema, I added two
> > fields as below:
> >
> > > multiValued="true"/>
> > > stored="false" multiValued="true"/>
> >
> > Then I go back to Solr Admin, I don't see the two new fields in Schema
> > section
> >
> > Anything I am missing here? and once the two fields are put in the
> > managed-schema, can I add the json file through upload in Solr Admin?
> >
> > Thank you very much.
> >
> >
> > **
> > *Sincerely yours,*
> >
> >
> > *Raymond*
> >
>
>
>
> --
>
> Best regards,
> Adhyan Arizki
>
Re: How to create my schema and add document, thank you
Raymond,
1. Please ensure your Solr instance does indeed load up the correct
managed-schema file. You do not need to create the file, it should have
been created automatically in the newer version of Solr out of the box. you
just need to edit it
2. Have you reload your instance after you made the modification?
On Thu, Apr 5, 2018 at 6:56 PM, Raymond Xie <xie3208...@gmail.com> wrote:
> I have the data ready for index now, it is a json file:
>
> {"122": "20180320-08:08:35.038", "49": "VIPER", "382": "0", "151": "1.0",
> "9": "653", "10071": "20180320-08:08:35.088", "15": "JPY", "56": "XSVC",
> "54": "1", "10202": "APMKTMAKING", "10537": "XOSE", "10217": "Y", "48":
> "179492540", "201": "1", "40": "2", "8": "FIX.4.4", "167": "OPT", "421":
> "JPN", "10292": "115", "10184": "3379122", "456": "101", "11210":
> "3379122", "1133": "G", "10515": "178", "10": "200", "11032": "-1",
> "10436": "20180320-08:08:35.038", "10518": "178", "11":
> "3379122", "75":
> "20180320", "10005": "178", "10104": "Y", "35": "RIO", "10208":
> "APAC.VIPER.OOE", "59": "0", "60": "20180320-08:08:35.088", "528": "P",
> "581": "13", "1": "TEST", "202": "25375.0", "455": "179492540", "55":
> "JNI253D8.OS", "100": "XOSE", "52": "20180320-08:08:35.088", "10241":
> "viperooe", "150": "A", "10039": "viperooe", "39": "A", "10438": "RIO.4.5",
> "38": "1", "37": "3379122", "372": "D", "660": "102", "44": "2.0",
> "10066": "20180320-08:08:35.038", "29": "4", "50": "JPNIK01", "22": "101"}
>
> You can inspect the json here: https://jsonformatter.org/
>
> I need to create index and enable searching on tags: 37, 75 and 10242
> (where available, this sample message doesn't have it)
>
> My understanding is I need to create the file managed-schema, I added two
> fields as below:
>
> multiValued="true"/>
> stored="false" multiValued="true"/>
>
> Then I go back to Solr Admin, I don't see the two new fields in Schema
> section
>
> Anything I am missing here? and once the two fields are put in the
> managed-schema, can I add the json file through upload in Solr Admin?
>
> Thank you very much.
>
>
> **
> *Sincerely yours,*
>
>
> *Raymond*
>
--
Best regards,
Adhyan Arizki
How to create my schema and add document, thank you
I have the data ready for index now, it is a json file:
{"122": "20180320-08:08:35.038", "49": "VIPER", "382": "0", "151": "1.0",
"9": "653", "10071": "20180320-08:08:35.088", "15": "JPY", "56": "XSVC",
"54": "1", "10202": "APMKTMAKING", "10537": "XOSE", "10217": "Y", "48":
"179492540", "201": "1", "40": "2", "8": "FIX.4.4", "167": "OPT", "421":
"JPN", "10292": "115", "10184": "3379122", "456": "101", "11210":
"3379122", "1133": "G", "10515": "178", "10": "200", "11032": "-1",
"10436": "20180320-08:08:35.038", "10518": "178", "11":
"3379122", "75":
"20180320", "10005": "178", "10104": "Y", "35": "RIO", "10208":
"APAC.VIPER.OOE", "59": "0", "60": "20180320-08:08:35.088", "528": "P",
"581": "13", "1": "TEST", "202": "25375.0", "455": "179492540", "55":
"JNI253D8.OS", "100": "XOSE", "52": "20180320-08:08:35.088", "10241":
"viperooe", "150": "A", "10039": "viperooe", "39": "A", "10438": "RIO.4.5",
"38": "1", "37": "3379122", "372": "D", "660": "102", "44": "2.0",
"10066": "20180320-08:08:35.038", "29": "4", "50": "JPNIK01", "22": "101"}
You can inspect the json here: https://jsonformatter.org/
I need to create index and enable searching on tags: 37, 75 and 10242
(where available, this sample message doesn't have it)
My understanding is I need to create the file managed-schema, I added two
fields as below:
Then I go back to Solr Admin, I don't see the two new fields in Schema
section
Anything I am missing here? and once the two fields are put in the
managed-schema, can I add the json file through upload in Solr Admin?
Thank you very much.
**
*Sincerely yours,*
*Raymond*
Re: Need help to get started on Solr, searching get nothing. Thank you very much in advance
I have the data ready for index now, it is a json file:
{"122": "20180320-08:08:35.038", "49": "VIPER", "382": "0", "151": "1.0",
"9": "653", "10071": "20180320-08:08:35.088", "15": "JPY", "56": "XSVC",
"54": "1", "10202": "APMKTMAKING", "10537": "XOSE", "10217": "Y", "48":
"179492540", "201": "1", "40": "2", "8": "FIX.4.4", "167": "OPT", "421":
"JPN", "10292": "115", "10184": "3379122", "456": "101", "11210":
"3379122", "1133": "G", "10515": "178", "10": "200", "11032": "-1",
"10436": "20180320-08:08:35.038", "10518": "178", "11":
"3379122", "75":
"20180320", "10005": "178", "10104": "Y", "35": "RIO", "10208":
"APAC.VIPER.OOE", "59": "0", "60": "20180320-08:08:35.088", "528": "P",
"581": "13", "1": "TEST", "202": "25375.0", "455": "179492540", "55":
"JNI253D8.OS", "100": "XOSE", "52": "20180320-08:08:35.088", "10241":
"viperooe", "150": "A", "10039": "viperooe", "39": "A", "10438": "RIO.4.5",
"38": "1", "37": "3379122", "372": "D", "660": "102", "44": "2.0",
"10066": "20180320-08:08:35.038", "29": "4", "50": "JPNIK01", "22": "101"}
You can inspect the json here: https://jsonformatter.org/
I need to create index and enable searching on tags: 37, 75 and 10242
(where available, this sample message doesn't have it)
My understanding is I need to create the file managed-schema, I added two
fields as below:
Then I go back to Solr Admin, I don't see the two new fields in Schema
section
Anything I am missing here? and once the two fields are put in the
managed-schema, can I add the json file through upload in Solr Admin?
Thank you very much.
**
*Sincerely yours,*
*Raymond*
On Mon, Apr 2, 2018 at 9:04 AM, Rick Leir <rl...@leirtech.com> wrote:
> Raymond
> There is a default field normally called df. You would normally use
> Copyfield to copy all searchable fields into the default field.
> Cheers -- Rick
>
> On April 1, 2018 11:34:07 PM EDT, Raymond Xie <xie3208...@gmail.com>
> wrote:
> >Hi Rick,
> >
> >I sorted it out half:
> >
> >I should have specified the field in the search query, so, instead of
> >http://localhost:8983/solr/films/browse?q=batman, I should use:
> >http://localhost:8983/solr/films/browse?q=name:batman
> >
> >Sorry for this newbie mistake.
> >
> >But what about if I/user doesn't know or doesn't want to specify the
> >search
> >scope to be restricted in field "name" but anywhere in the index'ed
> >documents?
> >
> >
> >**
> >*Sincerely yours,*
> >
> >
> >*Raymond*
> >
> >On Sun, Apr 1, 2018 at 2:10 PM, Rick Leir <rl...@leirtech.com> wrote:
> >
> >> Raymond
> >> The output is not visible to me because the mailing list strips
> >images.
> >> Please try a different way to show the output.
> >> Cheers -- Rick
> >>
> >> On March 29, 2018 10:17:13 PM EDT, Raymond Xie <xie3208...@gmail.com>
> >> wrote:
> >> > I am new to Solr, following Steve Rowe's example on
> >>
> >>https://github.com/apache/lucene-solr/tree/master/solr/example/films:
> >> >
> >> >It would be greatly appreciated if anyone can enlighten me where to
> >> >start
> >> >troubleshooting, thank you very much in advance.
> >> >
> >> >The steps I followed are:
> >> >
> >> >Here ya go << END_OF_SCRIPT
> >> >
> >> >bin/solr stop
> >> >rm server/logs/*.log
> >> >rm -Rf server/solr/films/
> >> >bin/solr start
> >> >bin/solr create -c films
> >> >curl http://localhost:8983/solr/films/schema -X POST -H
> >> >'Content-type:application/json' --data-binary '{
> >> >"add-field" : {
> >> >"name":"name",
> >> >"type":"text_general",
> >> >"multiValued":false,
> >> >"stored":true
> >> >},
> >> >"add-field" : {
> >> >"name":"initial_release_date",
> >> >"type":"pdate",
> >> >"stored":true
> >> >}
> >> >}'
> >> >bin/post -c films example/films/films.json
> >> >curl http://localhost:8983/solr/films/config/params -H
> >> >'Content-type:application/json' -d '{
> >> >"update" : {
> >> > "facets": {
> >> >"facet.field":"genre"
> >> >}
> >> > }
> >> >}'
> >> >
> >> ># END_OF_SCRIPT
> >> >
> >> >Additional fun -
> >> >
> >> >Add highlighting:
> >> >curl http://localhost:8983/solr/films/config/params -H
> >> >'Content-type:application/json' -d '{
> >> >"set" : {
> >> > "browse": {
> >> >"hl":"on",
> >> >"hl.fl":"name"
> >> >}
> >> > }
> >> >}'
> >> >try http://localhost:8983/solr/films/browse?q=batman now, and you'll
> >> >see "batman" highlighted in the results
> >> >
> >> >
> >> >
> >> >I got nothing in my search:
> >> >
> >> >
> >> >
> >> >
> >> >**
> >> >*Sincerely yours,*
> >> >
> >> >
> >> >*Raymond*
> >>
> >> --
> >> Sorry for being brief. Alternate email is rickleir at yahoo dot com
>
> --
> Sorry for being brief. Alternate email is rickleir at yahoo dot com
Re: Need help to get started on Solr, searching get nothing. Thank you very much in advance
On 4/2/2018 9:00 PM, Raymond Xie wrote: I see there is "/browse" in solrconfig.xml : explicit and name="defaults" with one item of "df" as shown below: _text_ My understanding is I can put whatever fields I want to enable index and searching here in parallel with _text_, am I correct? Be careful with the /browse handler. It is not intended for production use. The primary reason is that in order for /browse to work, the end user must have direct access to the Solr server -- the /browse handler instructs the user's browser to make direct calls to Solr's API. Those calls do not happen server side. The /browse handler serves as an example of Solr's capability. Giving end users direct access to Solr, unless you put an intelligent proxy in between them that can block undesirable requests, is a security risk. Configuring such a proxy is not a trivial exercise. The standard query parser uses the df parameter (default field) to indicate which field to search when no field is given. The df parameter can only use ONE field. The dismax and edismax parsers have qf, pf, and friends, to specify multiple fields to query. Thanks, Shawn
Re: Need help to get started on Solr, searching get nothing. Thank you very much in advance
Thanks Rick and Adhyan
I see there is "/browse" in solrconfig.xml :
explicit
and name="defaults" with one item of "df" as shown below:
_text_
My understanding is I can put whatever fields I want to enable index and
searching here in parallel with _text_, am I correct?
Thanks.
**
*Sincerely yours,*
*Raymond*
On Mon, Apr 2, 2018 at 3:24 PM, Adhyan Arizki <a.ari...@gmail.com> wrote:
> Raymond,
>
> You can specify the default behavior in solrconfig.xml under each handler.
> For instance for /browse you can specify it should look into name, and for
> /query you can default it to different field.
>
> On Mon, Apr 2, 2018 at 9:04 PM, Rick Leir <rl...@leirtech.com> wrote:
>
> > Raymond
> > There is a default field normally called df. You would normally use
> > Copyfield to copy all searchable fields into the default field.
> > Cheers -- Rick
> >
> > On April 1, 2018 11:34:07 PM EDT, Raymond Xie <xie3208...@gmail.com>
> > wrote:
> > >Hi Rick,
> > >
> > >I sorted it out half:
> > >
> > >I should have specified the field in the search query, so, instead of
> > >http://localhost:8983/solr/films/browse?q=batman, I should use:
> > >http://localhost:8983/solr/films/browse?q=name:batman
> > >
> > >Sorry for this newbie mistake.
> > >
> > >But what about if I/user doesn't know or doesn't want to specify the
> > >search
> > >scope to be restricted in field "name" but anywhere in the index'ed
> > >documents?
> > >
> > >
> > >**
> > >*Sincerely yours,*
> > >
> > >
> > >*Raymond*
> > >
> > >On Sun, Apr 1, 2018 at 2:10 PM, Rick Leir <rl...@leirtech.com> wrote:
> > >
> > >> Raymond
> > >> The output is not visible to me because the mailing list strips
> > >images.
> > >> Please try a different way to show the output.
> > >> Cheers -- Rick
> > >>
> > >> On March 29, 2018 10:17:13 PM EDT, Raymond Xie <xie3208...@gmail.com>
> > >> wrote:
> > >> > I am new to Solr, following Steve Rowe's example on
> > >>
> > >>https://github.com/apache/lucene-solr/tree/master/solr/example/films:
> > >> >
> > >> >It would be greatly appreciated if anyone can enlighten me where to
> > >> >start
> > >> >troubleshooting, thank you very much in advance.
> > >> >
> > >> >The steps I followed are:
> > >> >
> > >> >Here ya go << END_OF_SCRIPT
> > >> >
> > >> >bin/solr stop
> > >> >rm server/logs/*.log
> > >> >rm -Rf server/solr/films/
> > >> >bin/solr start
> > >> >bin/solr create -c films
> > >> >curl http://localhost:8983/solr/films/schema -X POST -H
> > >> >'Content-type:application/json' --data-binary '{
> > >> >"add-field" : {
> > >> >"name":"name",
> > >> >"type":"text_general",
> > >> >"multiValued":false,
> > >> >"stored":true
> > >> >},
> > >> >"add-field" : {
> > >> >"name":"initial_release_date",
> > >> >"type":"pdate",
> > >> >"stored":true
> > >> >}
> > >> >}'
> > >> >bin/post -c films example/films/films.json
> > >> >curl http://localhost:8983/solr/films/config/params -H
> > >> >'Content-type:application/json' -d '{
> > >> >"update" : {
> > >> > "facets": {
> > >> >"facet.field":"genre"
> > >> >}
> > >> > }
> > >> >}'
> > >> >
> > >> ># END_OF_SCRIPT
> > >> >
> > >> >Additional fun -
> > >> >
> > >> >Add highlighting:
> > >> >curl http://localhost:8983/solr/films/config/params -H
> > >> >'Content-type:application/json' -d '{
> > >> >"set" : {
> > >> > "browse": {
> > >> >"hl":"on",
> > >> >"hl.fl":"name"
> > >> >}
> > >> > }
> > >> >}'
> > >> >try http://localhost:8983/solr/films/browse?q=batman now, and you'll
> > >> >see "batman" highlighted in the results
> > >> >
> > >> >
> > >> >
> > >> >I got nothing in my search:
> > >> >
> > >> >
> > >> >
> > >> >
> > >> >**
> > >> >*Sincerely yours,*
> > >> >
> > >> >
> > >> >*Raymond*
> > >>
> > >> --
> > >> Sorry for being brief. Alternate email is rickleir at yahoo dot com
> >
> > --
> > Sorry for being brief. Alternate email is rickleir at yahoo dot com
> >
>
>
>
> --
>
> Best regards,
> Adhyan Arizki
>
Re: Need help to get started on Solr, searching get nothing. Thank you very much in advance
Raymond,
You can specify the default behavior in solrconfig.xml under each handler.
For instance for /browse you can specify it should look into name, and for
/query you can default it to different field.
On Mon, Apr 2, 2018 at 9:04 PM, Rick Leir <rl...@leirtech.com> wrote:
> Raymond
> There is a default field normally called df. You would normally use
> Copyfield to copy all searchable fields into the default field.
> Cheers -- Rick
>
> On April 1, 2018 11:34:07 PM EDT, Raymond Xie <xie3208...@gmail.com>
> wrote:
> >Hi Rick,
> >
> >I sorted it out half:
> >
> >I should have specified the field in the search query, so, instead of
> >http://localhost:8983/solr/films/browse?q=batman, I should use:
> >http://localhost:8983/solr/films/browse?q=name:batman
> >
> >Sorry for this newbie mistake.
> >
> >But what about if I/user doesn't know or doesn't want to specify the
> >search
> >scope to be restricted in field "name" but anywhere in the index'ed
> >documents?
> >
> >
> >**
> >*Sincerely yours,*
> >
> >
> >*Raymond*
> >
> >On Sun, Apr 1, 2018 at 2:10 PM, Rick Leir <rl...@leirtech.com> wrote:
> >
> >> Raymond
> >> The output is not visible to me because the mailing list strips
> >images.
> >> Please try a different way to show the output.
> >> Cheers -- Rick
> >>
> >> On March 29, 2018 10:17:13 PM EDT, Raymond Xie <xie3208...@gmail.com>
> >> wrote:
> >> > I am new to Solr, following Steve Rowe's example on
> >>
> >>https://github.com/apache/lucene-solr/tree/master/solr/example/films:
> >> >
> >> >It would be greatly appreciated if anyone can enlighten me where to
> >> >start
> >> >troubleshooting, thank you very much in advance.
> >> >
> >> >The steps I followed are:
> >> >
> >> >Here ya go << END_OF_SCRIPT
> >> >
> >> >bin/solr stop
> >> >rm server/logs/*.log
> >> >rm -Rf server/solr/films/
> >> >bin/solr start
> >> >bin/solr create -c films
> >> >curl http://localhost:8983/solr/films/schema -X POST -H
> >> >'Content-type:application/json' --data-binary '{
> >> >"add-field" : {
> >> >"name":"name",
> >> >"type":"text_general",
> >> >"multiValued":false,
> >> >"stored":true
> >> >},
> >> >"add-field" : {
> >> >"name":"initial_release_date",
> >> >"type":"pdate",
> >> >"stored":true
> >> >}
> >> >}'
> >> >bin/post -c films example/films/films.json
> >> >curl http://localhost:8983/solr/films/config/params -H
> >> >'Content-type:application/json' -d '{
> >> >"update" : {
> >> > "facets": {
> >> >"facet.field":"genre"
> >> >}
> >> > }
> >> >}'
> >> >
> >> ># END_OF_SCRIPT
> >> >
> >> >Additional fun -
> >> >
> >> >Add highlighting:
> >> >curl http://localhost:8983/solr/films/config/params -H
> >> >'Content-type:application/json' -d '{
> >> >"set" : {
> >> > "browse": {
> >> >"hl":"on",
> >> >"hl.fl":"name"
> >> >}
> >> > }
> >> >}'
> >> >try http://localhost:8983/solr/films/browse?q=batman now, and you'll
> >> >see "batman" highlighted in the results
> >> >
> >> >
> >> >
> >> >I got nothing in my search:
> >> >
> >> >
> >> >
> >> >
> >> >**
> >> >*Sincerely yours,*
> >> >
> >> >
> >> >*Raymond*
> >>
> >> --
> >> Sorry for being brief. Alternate email is rickleir at yahoo dot com
>
> --
> Sorry for being brief. Alternate email is rickleir at yahoo dot com
>
--
Best regards,
Adhyan Arizki
Re: Need help to get started on Solr, searching get nothing. Thank you very much in advance
Raymond
There is a default field normally called df. You would normally use Copyfield
to copy all searchable fields into the default field.
Cheers -- Rick
On April 1, 2018 11:34:07 PM EDT, Raymond Xie <xie3208...@gmail.com> wrote:
>Hi Rick,
>
>I sorted it out half:
>
>I should have specified the field in the search query, so, instead of
>http://localhost:8983/solr/films/browse?q=batman, I should use:
>http://localhost:8983/solr/films/browse?q=name:batman
>
>Sorry for this newbie mistake.
>
>But what about if I/user doesn't know or doesn't want to specify the
>search
>scope to be restricted in field "name" but anywhere in the index'ed
>documents?
>
>
>**
>*Sincerely yours,*
>
>
>*Raymond*
>
>On Sun, Apr 1, 2018 at 2:10 PM, Rick Leir <rl...@leirtech.com> wrote:
>
>> Raymond
>> The output is not visible to me because the mailing list strips
>images.
>> Please try a different way to show the output.
>> Cheers -- Rick
>>
>> On March 29, 2018 10:17:13 PM EDT, Raymond Xie <xie3208...@gmail.com>
>> wrote:
>> > I am new to Solr, following Steve Rowe's example on
>>
>>https://github.com/apache/lucene-solr/tree/master/solr/example/films:
>> >
>> >It would be greatly appreciated if anyone can enlighten me where to
>> >start
>> >troubleshooting, thank you very much in advance.
>> >
>> >The steps I followed are:
>> >
>> >Here ya go << END_OF_SCRIPT
>> >
>> >bin/solr stop
>> >rm server/logs/*.log
>> >rm -Rf server/solr/films/
>> >bin/solr start
>> >bin/solr create -c films
>> >curl http://localhost:8983/solr/films/schema -X POST -H
>> >'Content-type:application/json' --data-binary '{
>> >"add-field" : {
>> >"name":"name",
>> >"type":"text_general",
>> >"multiValued":false,
>> >"stored":true
>> >},
>> >"add-field" : {
>> >"name":"initial_release_date",
>> >"type":"pdate",
>> >"stored":true
>> >}
>> >}'
>> >bin/post -c films example/films/films.json
>> >curl http://localhost:8983/solr/films/config/params -H
>> >'Content-type:application/json' -d '{
>> >"update" : {
>> > "facets": {
>> >"facet.field":"genre"
>> >}
>> > }
>> >}'
>> >
>> ># END_OF_SCRIPT
>> >
>> >Additional fun -
>> >
>> >Add highlighting:
>> >curl http://localhost:8983/solr/films/config/params -H
>> >'Content-type:application/json' -d '{
>> >"set" : {
>> > "browse": {
>> >"hl":"on",
>> >"hl.fl":"name"
>> >}
>> > }
>> >}'
>> >try http://localhost:8983/solr/films/browse?q=batman now, and you'll
>> >see "batman" highlighted in the results
>> >
>> >
>> >
>> >I got nothing in my search:
>> >
>> >
>> >
>> >
>> >**
>> >*Sincerely yours,*
>> >
>> >
>> >*Raymond*
>>
>> --
>> Sorry for being brief. Alternate email is rickleir at yahoo dot com
--
Sorry for being brief. Alternate email is rickleir at yahoo dot com
Re: Need help to get started on Solr, searching get nothing. Thank you very much in advance
Hi Rick,
I sorted it out half:
I should have specified the field in the search query, so, instead of
http://localhost:8983/solr/films/browse?q=batman, I should use:
http://localhost:8983/solr/films/browse?q=name:batman
Sorry for this newbie mistake.
But what about if I/user doesn't know or doesn't want to specify the search
scope to be restricted in field "name" but anywhere in the index'ed
documents?
**
*Sincerely yours,*
*Raymond*
On Sun, Apr 1, 2018 at 2:10 PM, Rick Leir <rl...@leirtech.com> wrote:
> Raymond
> The output is not visible to me because the mailing list strips images.
> Please try a different way to show the output.
> Cheers -- Rick
>
> On March 29, 2018 10:17:13 PM EDT, Raymond Xie <xie3208...@gmail.com>
> wrote:
> > I am new to Solr, following Steve Rowe's example on
> >https://github.com/apache/lucene-solr/tree/master/solr/example/films:
> >
> >It would be greatly appreciated if anyone can enlighten me where to
> >start
> >troubleshooting, thank you very much in advance.
> >
> >The steps I followed are:
> >
> >Here ya go << END_OF_SCRIPT
> >
> >bin/solr stop
> >rm server/logs/*.log
> >rm -Rf server/solr/films/
> >bin/solr start
> >bin/solr create -c films
> >curl http://localhost:8983/solr/films/schema -X POST -H
> >'Content-type:application/json' --data-binary '{
> >"add-field" : {
> >"name":"name",
> >"type":"text_general",
> >"multiValued":false,
> >"stored":true
> >},
> >"add-field" : {
> >"name":"initial_release_date",
> >"type":"pdate",
> >"stored":true
> >}
> >}'
> >bin/post -c films example/films/films.json
> >curl http://localhost:8983/solr/films/config/params -H
> >'Content-type:application/json' -d '{
> >"update" : {
> > "facets": {
> >"facet.field":"genre"
> >}
> > }
> >}'
> >
> ># END_OF_SCRIPT
> >
> >Additional fun -
> >
> >Add highlighting:
> >curl http://localhost:8983/solr/films/config/params -H
> >'Content-type:application/json' -d '{
> >"set" : {
> > "browse": {
> >"hl":"on",
> >"hl.fl":"name"
> >}
> > }
> >}'
> >try http://localhost:8983/solr/films/browse?q=batman now, and you'll
> >see "batman" highlighted in the results
> >
> >
> >
> >I got nothing in my search:
> >
> >
> >
> >
> >**
> >*Sincerely yours,*
> >
> >
> >*Raymond*
>
> --
> Sorry for being brief. Alternate email is rickleir at yahoo dot com
Re: Need help to get started on Solr, searching get nothing. Thank you very much in advance
Raymond
The output is not visible to me because the mailing list strips images. Please
try a different way to show the output.
Cheers -- Rick
On March 29, 2018 10:17:13 PM EDT, Raymond Xie <xie3208...@gmail.com> wrote:
> I am new to Solr, following Steve Rowe's example on
>https://github.com/apache/lucene-solr/tree/master/solr/example/films:
>
>It would be greatly appreciated if anyone can enlighten me where to
>start
>troubleshooting, thank you very much in advance.
>
>The steps I followed are:
>
>Here ya go << END_OF_SCRIPT
>
>bin/solr stop
>rm server/logs/*.log
>rm -Rf server/solr/films/
>bin/solr start
>bin/solr create -c films
>curl http://localhost:8983/solr/films/schema -X POST -H
>'Content-type:application/json' --data-binary '{
>"add-field" : {
>"name":"name",
>"type":"text_general",
>"multiValued":false,
>"stored":true
>},
>"add-field" : {
>"name":"initial_release_date",
>"type":"pdate",
>"stored":true
>}
>}'
>bin/post -c films example/films/films.json
>curl http://localhost:8983/solr/films/config/params -H
>'Content-type:application/json' -d '{
>"update" : {
> "facets": {
>"facet.field":"genre"
>}
> }
>}'
>
># END_OF_SCRIPT
>
>Additional fun -
>
>Add highlighting:
>curl http://localhost:8983/solr/films/config/params -H
>'Content-type:application/json' -d '{
>"set" : {
> "browse": {
>"hl":"on",
>"hl.fl":"name"
>}
> }
>}'
>try http://localhost:8983/solr/films/browse?q=batman now, and you'll
>see "batman" highlighted in the results
>
>
>
>I got nothing in my search:
>
>
>
>
>**
>*Sincerely yours,*
>
>
>*Raymond*
--
Sorry for being brief. Alternate email is rickleir at yahoo dot com
Need help to get started on Solr, searching get nothing. Thank you very much in advance
I am new to Solr, following Steve Rowe's example on
https://github.com/apache/lucene-solr/tree/master/solr/example/films:
It would be greatly appreciated if anyone can enlighten me where to start
troubleshooting, thank you very much in advance.
The steps I followed are:
Here ya go << END_OF_SCRIPT
bin/solr stop
rm server/logs/*.log
rm -Rf server/solr/films/
bin/solr start
bin/solr create -c films
curl http://localhost:8983/solr/films/schema -X POST -H
'Content-type:application/json' --data-binary '{
"add-field" : {
"name":"name",
"type":"text_general",
"multiValued":false,
"stored":true
},
"add-field" : {
"name":"initial_release_date",
"type":"pdate",
"stored":true
}
}'
bin/post -c films example/films/films.json
curl http://localhost:8983/solr/films/config/params -H
'Content-type:application/json' -d '{
"update" : {
"facets": {
"facet.field":"genre"
}
}
}'
# END_OF_SCRIPT
Additional fun -
Add highlighting:
curl http://localhost:8983/solr/films/config/params -H
'Content-type:application/json' -d '{
"set" : {
"browse": {
"hl":"on",
"hl.fl":"name"
}
}
}'
try http://localhost:8983/solr/films/browse?q=batman now, and you'll
see "batman" highlighted in the results
I got nothing in my search:
**
*Sincerely yours,*
*Raymond*
Thank You Guys
Hi Guys, Thank you all - I got synonyms, highlighting, stemming all working the way I wanted to. I am sure I will have more questions later on =) Thanks! Sas
Thank you all
All, It appears my attempt at using solr for the application I support is about to fail. I'm personally and professionally disappointed, but I wanted to say Many Thanks to those of you who have provided so much help to so many on this list. In the right hands and in the right environments, it has so much potential. You all have shown the collective knowledge and cooperation it takes to bring that potential to fruition. I wish I'd been able to pick up on the right details of the toolset to be able to make this work. Best of luck to you all! Tim Hibbs On 2/7/2012 2:53 PM, Tim Hibbs wrote: Hi, all... I have a small problem retrieving the full set of query responses I need and would appreciate any help. I have a query string as follows: +((Title:sales) (+Title:sales) (TOC:sales) (+TOC:sales) (Keywords:sales) (+Keywords:sales) (text:sales) (+text:sales) (sales)) +(RepType:WRO Revenue Services) +(ContentType:SOP ContentType:Key Concept) -(Topics:Backup) The query is intended to be: MUST have at least one of: - exact phrase in field Title - all of the phrase words in field Title - exact phrase in field TOC - all of the phrase words in field TOC - exact phrase in field Keywords - all of the phrase words in field Keywords - exact phrase in field text - all of the phrase words in field text - any of the phrase words in field text MUST have WRO Revenue Services in field RepType MUST have at least one of: - SOP in field ContentType - Key Concept in field ContentType MUST NOT have Backup in field Topics It's almost working, but it misses a couple of items that contain a single occurrence of the word sale in a indexed field. The indexed field containing that single occurrence is named UrlContent. schema.xml UrlContent is defined as: field name=UrlContent type=text indexed=true stored=false required=false omitNorms=false/ Copyfields are as follows: copyField source=Title dest=text/ copyField source=Keywords dest=text/ copyField source=TOC dest=text/ copyField source=Overview dest=text/ copyField source=UrlContent dest=text/ Thanks, Tim Hibbs
Re: Thank you!
I feel the same way about this group and the Postgres group. VERY helpful people. All of us helping heacho other. Dennis Gearon Signature Warning - Original Message From: Adam Estrada estrada.a...@gmail.com Subject: Thank you! I just want to say that this list serve has been invaluable to a newbie like me ;-) I posted a question earlier today and literally 10 minutes later I got an answer that helped me solve my problem. This is proof that there is a experienced and energetic community behind this FOSS group of projects and I really appreciate everyone who has put up with my otherwise trivial questions! More importantly, thanks to all of the contributors who make the whole thing possible! I attended the Lucene Revolution conference in Boston this year and the information that I was able to take away from the whole thing has made me and my vocation a lot more valuable. Keep up the outstanding work in the discovery of useful information from a sea of bleh ;-) Kindest regards, Adam
Re: Thank you!
Hear hear! In the beginning of my journey with Solr/Lucene I couldn't have done it without this site. Smiley and Pugh's book was useful, but this forum was invaluable. I don't have as many questions now, but each new venture, Geospatial searching, replication and redundancy, performance tuning, brings me back again and again. This and stackoverflow.com have to be two of the most useful destinations on the internet for developers. Communities are so much more relevant than reference materials, and the consistent activity in this community is impressive. -- View this message in context: http://lucene.472066.n3.nabble.com/Thank-you-tp2096329p2098512.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Thank you!
If I ever make it, wikipedia, stackoverflow, PHP, Symfony, Doctrine, Apache are all going to get donations. I already send $20 to wikipedia, they're huring now. Dennis Gearon Signature Warning It is always a good idea to learn from your own mistakes. It is usually a better idea to learn from others’ mistakes, so you do not have to make them yourself. from 'http://blogs.techrepublic.com.com/security/?p=4501tag=nl.e036' EARTH has a Right To Life, otherwise we all die. - Original Message From: kenf_nc ken.fos...@realestate.com To: solr-user@lucene.apache.org Sent: Thu, December 16, 2010 6:11:24 AM Subject: Re: Thank you! Hear hear! In the beginning of my journey with Solr/Lucene I couldn't have done it without this site. Smiley and Pugh's book was useful, but this forum was invaluable. I don't have as many questions now, but each new venture, Geospatial searching, replication and redundancy, performance tuning, brings me back again and again. This and stackoverflow.com have to be two of the most useful destinations on the internet for developers. Communities are so much more relevant than reference materials, and the consistent activity in this community is impressive. -- View this message in context: http://lucene.472066.n3.nabble.com/Thank-you-tp2096329p2098512.html Sent from the Solr - User mailing list archive at Nabble.com.
Thank you!
I just want to say that this list serve has been invaluable to a newbie like me ;-) I posted a question earlier today and literally 10 minutes later I got an answer that helped me solve my problem. This is proof that there is a experienced and energetic community behind this FOSS group of projects and I really appreciate everyone who has put up with my otherwise trivial questions! More importantly, thanks to all of the contributors who make the whole thing possible! I attended the Lucene Revolution conference in Boston this year and the information that I was able to take away from the whole thing has made me and my vocation a lot more valuable. Keep up the outstanding work in the discovery of useful information from a sea of bleh ;-) Kindest regards, Adam
Thank you all for Solr 1.4
Not posting a problem or a solution. Just wanted to get word back to
the Solr developers, bug testers, and mailing list gurus how much I love
Solr 1.4. Our site search is more accurate, the search box offers
better suggestions must faster than before, and the elevate
functionality has appeased the product promotion department to no end.
I'd offer you a thousand thanks, but the spam filters would hate it, so
the safest way to thank you...
Me i = new Me();
for (int c = 0; c 1000; c++) { i.ThankYou(); }
Ryan T. Grange, IT Manager
DollarDays International, Inc.
http://www.dollardays.com/
rgra...@dollardays.com
Re: Thank you...
I haven't heard anyone say texis in any discussion since the aquisition. I'll ask about it specifically next week. On 3/22/07, Kevin Lewandowski [EMAIL PROTECTED] wrote: Thanks for sharing the info, Cass. Is eBay still using Texis? (this used to be obvious from eBay's URLs a few years ago). I used Texis with their Vortex script before Lucene was born. I'd guess no. I read a PDF about ebay's architecture a few months ago and it said all of the search stuff was custom. -- A complex system that works is invariably found to have evolved from a simple system that works. - John Gaule
Re: Thank you...
You all rock. I'm clearing the semi-official legal hurdle with my CTO and our head counsel to full (or something close to full) disclosure of some of the architectural details, so stay tuned for as much as I'm allowed to share (and btw, for any of you that live/work/vacation in the SF Bay area, I'd be happy to discuss things over a beer :) In the meantime, yes, much of the faceting you see on the Browse and Search pages is direct Solr faceting. We made *very* liberal use of faceting-specific fields in our event and ontology documents. Similarly, we rely on the standard query handler for almost all the Solr calls. Our business logic is modelled in a CoR pattern, and we did write one command to encapsulate SolrCore/Request/Response use for our highest throughput needs - the win there was direct building into our predominant xml object model (we use XOM) via a QueryResponseXOMBuilder.build( solrRequest, solrResponse ) call. I definitely need clearance before sharing hard perf numbers (anyone working for TicketMaster on these lists? - funny, I used to use eBay in lines like that - see below) but I will share the fact that our response times and q/s numbers were very good out-of-the-box. We've an Ehcache-based distributed caching framework that we threw in front of the Solr servers, and our final total throughput for the Solr queries utilized to support Browse runs into the 100's of requests per sec, per Solr server. Our Search (true free-text searches) numbers are lower, but not by that much. This might be the coolest (for me, anyway) result of the entire endeavor... StubHub was recently acquired by eBay. I've been working closely with a couple of their architects over the past few weeks, and we've done a bit of theoretical, comparative analysis between our search/browse platform and theirs (which is completely home grown), and things stack up favorably for the Solr/Lucene approach, esp. when considering the *vast* difference in hardware allocation per-request. Again, if I'm allowed, more details to follow. ...I've taken the liberty of adding stubhub to the Powered By Solr page... Awesome. I can't say it enough... thank you all. On 3/21/07, Yonik Seeley [EMAIL PROTECTED] wrote: On 3/20/07, Cass Costello [EMAIL PROTECTED] wrote: Heh - it used to be in my sig ... my bad. Thanks, all. :) http://www.stubhub.com I tried it out... looks great! Is the faceting stuff done with Solr too? If so is it the Solr built-in faceting, or a custom query handler? If the latter, can you think of ways to improve the built in faceting that would have made things easier? -Yonik -- A complex system that works is invariably found to have evolved from a simple system that works. - John Gaule
Thank you...
...to everyone who helps make Lucene and Solr such fantastic tools. I'm the Platform Architect for a leading online event ticket after-marketplace (think eBay for tickets), and we've just completed a 12 month project to rewrite the Browse and Search components of our customer-facing site. Both rely heavily on Solr and a smattering of custom Lucene API calls throughout the code base. As of this morning (2 weeks after our final-stage push to production), we've reduced our hardware needs over 50% and have improved page response times by 30-60% as compared to the old architecture (a mix of very old CF code for the browse pieces, and a couple GSAs for the seach pages). More importantly, we've established new patterns and flex points for future growth, and I have utmost confidence that we'll be leveraging the Lucene/Solr combo for years to come as we grow. The devs are proud, the execs are happy, our customers have noticed the speed improvements, and we all learned many positive lessons along the way. These forums and various online resources (the Solr wiki first and foremost) have been tremendously helpful. And so, thank you, all, for pointing the way to a simpler, faster, better solution for our needs. Cass Costello -- A complex system that works is invariably found to have evolved from a simple system that works. - John Gaule
Re: Thank you...
Heh - it used to be in my sig ... my bad. Thanks, all. :) http://www.stubhub.com On 3/20/07, bruce [EMAIL PROTECTED] wrote: hey cass... anyway you could let us know the site/app that we're powering!!! always good to see what's going on in the world! thanks -Original Message- From: Cass Costello [mailto:[EMAIL PROTECTED] Sent: Tuesday, March 20, 2007 12:58 PM To: solr-user@lucene.apache.org; java-user@lucene.apache.org Subject: Thank you... ...to everyone who helps make Lucene and Solr such fantastic tools. I'm the Platform Architect for a leading online event ticket after-marketplace (think eBay for tickets), and we've just completed a 12 month project to rewrite the Browse and Search components of our customer-facing site. Both rely heavily on Solr and a smattering of custom Lucene API calls throughout the code base. As of this morning (2 weeks after our final-stage push to production), we've reduced our hardware needs over 50% and have improved page response times by 30-60% as compared to the old architecture (a mix of very old CF code for the browse pieces, and a couple GSAs for the seach pages). More importantly, we've established new patterns and flex points for future growth, and I have utmost confidence that we'll be leveraging the Lucene/Solr combo for years to come as we grow. The devs are proud, the execs are happy, our customers have noticed the speed improvements, and we all learned many positive lessons along the way. These forums and various online resources (the Solr wiki first and foremost) have been tremendously helpful. And so, thank you, all, for pointing the way to a simpler, faster, better solution for our needs. Cass Costello -- A complex system that works is invariably found to have evolved from a simple system that works. - John Gaule -- A complex system that works is invariably found to have evolved from a simple system that works. - John Gaule
