Re: SolrCloud and configuration files on ZooKeeper

2015-06-08 Thread Erick Erickson
See downconfig here:
https://cwiki.apache.org/confluence/display/solr/Command+Line+Utilities

I'm guessing you started your cloud with one of the example (i.e. -e
cloud). Under the covers,
it did an upconfig to put the configs up in ZK in the first place,
this is the inverse.

Best,
Erick

On Mon, Jun 8, 2015 at 10:56 AM, mattia.martine...@gmail.com
mattia.martine...@gmail.com wrote:
 Hi.
 I setted up a SolrCloud cluster with 3 nodes and configuration files on
 Zookeeper.
 I read the document at
 https://cwiki.apache.org/confluence/display/solr/Using+ZooKeeper+to+Manage+Configuration+Files
 and saw that configuration files are stored on ZooKeeper of course.
 But now I have to update my custom schema.xml and I cannot realize how I
 can download the current config set to update it.
 Could you help me please?
 Thank you very much!
 Bye


Complete list of parameters in request handlers

2015-06-08 Thread Steven White
Hi,

I'm managing my Solr solrconfig.xml data using
https://cwiki.apache.org/confluence/display/solr/Config+API  In doing so,
I'm write code that will read and update request handlers.  Beside the top
level key / value parameters, I came across defaults, invariants and
appends as list items.  Are there any others I should be looking for?
Where can I find the complete list?

Thanks

Steve


Re: Complete list of parameters in request handlers

2015-06-08 Thread Shalin Shekhar Mangar
The defaults, appends, invariants apply to request handlers.
Similarly, each type of Solr plugin has different configuration parameters.
Unfortunately, there is no single list of all parameters. You will have to
look at the documentation of the plugin you are trying to configure to find
out the list of supported parameters.

On Mon, Jun 8, 2015 at 11:20 PM, Steven White swhite4...@gmail.com wrote:

 Hi,

 I'm managing my Solr solrconfig.xml data using
 https://cwiki.apache.org/confluence/display/solr/Config+API  In doing so,
 I'm write code that will read and update request handlers.  Beside the top
 level key / value parameters, I came across defaults, invariants and
 appends as list items.  Are there any others I should be looking for?
 Where can I find the complete list?

 Thanks

 Steve




-- 
Regards,
Shalin Shekhar Mangar.


Re: SolrCloud and configuration files on ZooKeeper

2015-06-08 Thread mattia.martine...@gmail.com
2015-06-08 21:42 GMT+02:00 Erick Erickson erickerick...@gmail.com:

 See downconfig here:
 https://cwiki.apache.org/confluence/display/solr/Command+Line+Utilities


Thank you Erick for your answer!
I've already seen that page, and I was trying with the following command:

root@index1:/opt/zookeeper/bin# ./zkCli.sh -z zk1 -cmd downconfig -confdir
/tmp/zkconfig/
(zk1 is the first node of the Zookeeper's cluster).

But no files are written in /tmp/zkconfig and I see this output:

root@index1:/opt/zookeeper/bin# ./zkCli.sh -z zk1 -cmd downconfig -confdir
/tmp/zkconfig/
Connecting to localhost:2181
2015-06-08 15:44:55,952 [myid:] - INFO  [main:Environment@100] - Client
environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09 GMT
2015-06-08 15:44:55,955 [myid:] - INFO  [main:Environment@100] - Client
environment:host.name=index1.dc.ems.network
2015-06-08 15:44:55,955 [myid:] - INFO  [main:Environment@100] - Client
environment:java.version=1.8.0_45
2015-06-08 15:44:55,957 [myid:] - INFO  [main:Environment@100] - Client
environment:java.vendor=Oracle Corporation
2015-06-08 15:44:55,957 [myid:] - INFO  [main:Environment@100] - Client
environment:java.home=/usr/lib/jvm/java-8-oracle/jre
2015-06-08 15:44:55,958 [myid:] - INFO  [main:Environment@100] - Client
environment:java.class.path=/opt/zookeeper/bin/../build/classes:/opt/zookeeper/bin/../build/lib/*.jar:/opt/zookeeper/bin/../lib/slf4j-log4j12-1.6.1.jar:/opt/zookeeper/bin/../lib/slf4j-api-1.6.1.jar:/opt/zookeeper/bin/../lib/netty-3.7.0.Final.jar:/opt/zookeeper/bin/../lib/log4j-1.2.16.jar:/opt/zookeeper/bin/../lib/jline-0.9.94.jar:/opt/zookeeper/bin/../zookeeper-3.4.6.jar:/opt/zookeeper/bin/../src/java/lib/*.jar:/opt/zookeeper/bin/../conf:
2015-06-08 15:44:55,958 [myid:] - INFO  [main:Environment@100] - Client
environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
2015-06-08 15:44:55,958 [myid:] - INFO  [main:Environment@100] - Client
environment:java.io.tmpdir=/tmp
2015-06-08 15:44:55,958 [myid:] - INFO  [main:Environment@100] - Client
environment:java.compiler=NA
2015-06-08 15:44:55,958 [myid:] - INFO  [main:Environment@100] - Client
environment:os.name=Linux
2015-06-08 15:44:55,958 [myid:] - INFO  [main:Environment@100] - Client
environment:os.arch=amd64
2015-06-08 15:44:55,958 [myid:] - INFO  [main:Environment@100] - Client
environment:os.version=2.6.32-39-pve
2015-06-08 15:44:55,958 [myid:] - INFO  [main:Environment@100] - Client
environment:user.name=root
2015-06-08 15:44:55,959 [myid:] - INFO  [main:Environment@100] - Client
environment:user.home=/root
2015-06-08 15:44:55,959 [myid:] - INFO  [main:Environment@100] - Client
environment:user.dir=/opt/zookeeper-3.4.6/bin
2015-06-08 15:44:55,960 [myid:] - INFO  [main:ZooKeeper@438] - Initiating
client connection, connectString=localhost:2181 sessionTimeout=3
watcher=org.apache.zookeeper.ZooKeeperMain$MyWatcher@3eb07fd3

I'm guessing you started your cloud with one of the example (i.e. -e
 cloud). Under the covers,
 it did an upconfig to put the configs up in ZK in the first place,
 this is the inverse.


I created a new collection with the following SOLR command:

./solr create_collection -c test -replicationFactor 3

I also tried to list the configuration in the ZooKeeper's CLI:

[zk: 127.0.0.1:2181(CONNECTED) 4] ls /configs/test
[currency.xml, protwords.txt, managed-schema, solrconfig.xml, synonyms.txt,
elevate.xml, stopwords.txt, params.json, lang]

But... Where is the schema.xml file?


Re: How important is the name of the data collection?

2015-06-08 Thread Erick Erickson
OK, assuming that by virtual machine you're talking JVMs and not
VMWare or something

bin/solr start -c -z localhost:2181 -p 8981 -s example/cloud/node1/solr
bin/solr start -c -z localhost:2181 -p 8982 -s example/cloud/node2/solr

Note that I cheat and use one of the example configs create
example/cloud/node1, example/cloud/node2 etc., then kill the Solr,
then start them individually as above.

It works just fine to create node1/solr and node2/solr somewhere, and
then just copy solr.xml and zoo.cfg into both

HTH,
Erick

On Mon, Jun 8, 2015 at 10:04 AM, David Patterson patt...@gmail.com wrote:
 I'm trying to make two virtual machines, each with one 4.10 SOLR-cloud code
 instance, connected to the same external Zookeeper site.

 I want to create one data collection with one shard on each of these two
 machines.

 If I use the start method as described in the Apache Solr Reference Guide
 for my release, will the two machines be connected if I declare the same
 data collection name for both of them? If not, how do I connect them?

 (I know the start method can make two solr-cloud instances on ONE virtual
 machine, but I want to make one on each of two virtual machines.)

 Thanks

 Dave P


SolrCloud and configuration files on ZooKeeper

2015-06-08 Thread mattia.martine...@gmail.com
Hi.
I setted up a SolrCloud cluster with 3 nodes and configuration files on
Zookeeper.
I read the document at
https://cwiki.apache.org/confluence/display/solr/Using+ZooKeeper+to+Manage+Configuration+Files
and saw that configuration files are stored on ZooKeeper of course.
But now I have to update my custom schema.xml and I cannot realize how I
can download the current config set to update it.
Could you help me please?
Thank you very much!
Bye


How do I unsubscribe?

2015-06-08 Thread Carl Roberts

How do I unsubscribe?


Problem with distributed search using grouping and highlighting

2015-06-08 Thread Rich Hume
I am currently using Solr 4.5.1.  In the hopes of seeing better query 
performance, I have sharded an index and I am trying to use the shards 
parameter along with grouping and highlighting.  I am not currently using Solr 
cloud.

I got past an earlier problem by adding a second sort parameter (as described 
in JIRA Solr-5046).  Unfortunately, I have found nothing related to my latest 
index out of bounds problem.  I do not believe that JIRA Solr-5709 is related 
since my unique keys are in fact unique across the shards.

If anyone can point out something that I am doing wrong it would be greatly 
appreciated.

Thanks,
Rich

I am seeing the following error, the parameters I am passing are below the 
stack trace.

null:java.lang.ArrayIndexOutOfBoundsException: 35
 at 
org.apache.solr.handler.component.HighlightComponent.finishStage(HighlightComponent.java:185)
 at 
org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:317)
 at 
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
 at org.apache.solr.core.SolrCore.execute(SolrCore.java:1859)
 at 
org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:703)
 at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:406)
 at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:195)
 at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)


Here are the parameters I am passing:

group=truegroup.offset=0group.limit=10group.field=DeDup
group.query=DocumentTypes:34group.query=DocumentTypes:35group.query=DocumentTypes:32
shards=localhost:8983/solr/IX1,localhost:8983/solr/IX2
fq=+DocumentTypes:(34 35 32)
defType=edismaxqf=csTitle^100 csContent
q=any matching search string
start=0rows=10
fl=PageNumber,FilePath,DocumentGUID,ResultDisplayContent,DocumentTypes
sort=score desc,DocumentGUID asc
hl=on
hl.fl=csTitle,csContent




Velocity UI and hyperlink

2015-06-08 Thread Sznajder ForMailingList
Hi

I would like one of the fields, I display in the results of Velocity UI, to
be a hyperlink.

In my example, I am storing a field url containing the link to the online
page of the indexed document and I would like to have this displayed field
a hyperlink to this page.

Could you please indicate me waht should I change to get that?

thanks!

Benjamin


Re: Velocity UI and hyperlink

2015-06-08 Thread Sznajder ForMailingList
Thanks!!

However, each time I change a *.vm file, I do not succeed to see the change
on my browser until, I delete + recreate the collectoin and re-index.

Isn't there a way to immediately see the display change?

Best regards

On Mon, Jun 8, 2015 at 11:46 PM, Erik Hatcher erik.hatc...@gmail.com
wrote:

 Benjamin -

 The templates for VelocityResponseWriter (/browse, etc) are under
 conf/velocity.  Find the template that generates the piece you want to
 affect (which may be hit.vm or hit_something.vm? - depends on which
 version of Solr you’re using and which configuration you’ve started with to
 be more precise) and modify it to render a hyperlink around
 $doc.getFirstValue(“url”), maybe something like:

   a href=$doc.getFirstValue(“url”)”click here/a

 Does that get you what you need?

 —
 Erik Hatcher, Senior Solutions Architect
 http://www.lucidworks.com




  On Jun 8, 2015, at 4:29 PM, Sznajder ForMailingList 
 bs4mailingl...@gmail.com wrote:
 
  Hi
 
  I would like one of the fields, I display in the results of Velocity UI,
 to
  be a hyperlink.
 
  In my example, I am storing a field url containing the link to the
 online
  page of the indexed document and I would like to have this displayed
 field
  a hyperlink to this page.
 
  Could you please indicate me waht should I change to get that?
 
  thanks!
 
  Benjamin




Re: Velocity UI and hyperlink

2015-06-08 Thread Sznajder ForMailingList
Hi

I am using 5.1

Currently, I defined a directory solr-conf/ .
Under this directory, I have a velocity directory containing my different
*.vm files.

When I create a collection, I am creating via
bin\solr create -c COLL_NAME -d PATH_TO_SOLR_CONF

Your indication was helpful : changing the file copied under solr\server
was the right way!

thanks again!

Ben

On Tue, Jun 9, 2015 at 12:25 AM, Erik Hatcher erik.hatc...@gmail.com
wrote:

 What version of Solr?   And where is the file you’re changing?

 With Solr 5.2, one example of what you’re trying to do is under
 example/files.  In the README we have this:

 bin/solr start
 -Dvelocity.template.base.dir=/full/path/to/example/files/conf/velocity/

 When you create a collection it clones the configuration (in 5x; under
 server/solr/…) so if you wanted to in-place edit you’d edit those files
 rather than the original configuration which would require a collection
 re-create.

 With the above command-line, you can have templates anywhere you like and
 edit them in place, and they override any in the configuration of the Solr
 collection.

 See
 https://cwiki.apache.org/confluence/display/solr/Response+Writers#ResponseWriters-VelocityResponseWriter
 for perhaps some more details.  If there’s any way I can make this easier,
 let me know.

 If the above info doesn’t work or apply because you’re on a different
 version of Solr, provide more details and I’ll help from there.

 —
 Erik Hatcher, Senior Solutions Architect
 http://www.lucidworks.com




  On Jun 8, 2015, at 5:07 PM, Sznajder ForMailingList 
 bs4mailingl...@gmail.com wrote:
 
  Thanks!!
 
  However, each time I change a *.vm file, I do not succeed to see the
 change
  on my browser until, I delete + recreate the collectoin and re-index.
 
  Isn't there a way to immediately see the display change?
 
  Best regards
 
  On Mon, Jun 8, 2015 at 11:46 PM, Erik Hatcher erik.hatc...@gmail.com
  wrote:
 
  Benjamin -
 
  The templates for VelocityResponseWriter (/browse, etc) are under
  conf/velocity.  Find the template that generates the piece you want to
  affect (which may be hit.vm or hit_something.vm? - depends on which
  version of Solr you’re using and which configuration you’ve started
 with to
  be more precise) and modify it to render a hyperlink around
  $doc.getFirstValue(“url”), maybe something like:
 
   a href=$doc.getFirstValue(“url”)”click here/a
 
  Does that get you what you need?
 
  —
  Erik Hatcher, Senior Solutions Architect
  http://www.lucidworks.com
 
 
 
 
  On Jun 8, 2015, at 4:29 PM, Sznajder ForMailingList 
  bs4mailingl...@gmail.com wrote:
 
  Hi
 
  I would like one of the fields, I display in the results of Velocity
 UI,
  to
  be a hyperlink.
 
  In my example, I am storing a field url containing the link to the
  online
  page of the indexed document and I would like to have this displayed
  field
  a hyperlink to this page.
 
  Could you please indicate me waht should I change to get that?
 
  thanks!
 
  Benjamin
 
 




Re: SolrCloud and configuration files on ZooKeeper

2015-06-08 Thread Shalin Shekhar Mangar
Looks like you are using managed-schema (better known as the schemaless
mode). In this case, the schema is inferred/managed by Solr by looking at
the documents that you add. You can also use the Schema API to change this
schema. Editing this schema manually is not recommended. See
https://cwiki.apache.org/confluence/display/solr/Schema+API

The schemaless mode is most helpful when you want to prototype stuff but I
wouldn't recommend it in production. If you want full control of the schema
and you want to manage it yourself then it's best not to choose schemaless
configuration (data_driven_schema_confgs) while setting up solr.

On Tue, Jun 9, 2015 at 1:19 AM, mattia.martine...@gmail.com 
mattia.martine...@gmail.com wrote:

 2015-06-08 21:42 GMT+02:00 Erick Erickson erickerick...@gmail.com:

  See downconfig here:
  https://cwiki.apache.org/confluence/display/solr/Command+Line+Utilities


 Thank you Erick for your answer!
 I've already seen that page, and I was trying with the following command:

 root@index1:/opt/zookeeper/bin# ./zkCli.sh -z zk1 -cmd downconfig -confdir
 /tmp/zkconfig/
 (zk1 is the first node of the Zookeeper's cluster).

 But no files are written in /tmp/zkconfig and I see this output:

 root@index1:/opt/zookeeper/bin# ./zkCli.sh -z zk1 -cmd downconfig -confdir
 /tmp/zkconfig/
 Connecting to localhost:2181
 2015-06-08 15:44:55,952 [myid:] - INFO  [main:Environment@100] - Client
 environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09 GMT
 2015-06-08 15:44:55,955 [myid:] - INFO  [main:Environment@100] - Client
 environment:host.name=index1.dc.ems.network
 2015-06-08 15:44:55,955 [myid:] - INFO  [main:Environment@100] - Client
 environment:java.version=1.8.0_45
 2015-06-08 15:44:55,957 [myid:] - INFO  [main:Environment@100] - Client
 environment:java.vendor=Oracle Corporation
 2015-06-08 15:44:55,957 [myid:] - INFO  [main:Environment@100] - Client
 environment:java.home=/usr/lib/jvm/java-8-oracle/jre
 2015-06-08 15:44:55,958 [myid:] - INFO  [main:Environment@100] - Client

 environment:java.class.path=/opt/zookeeper/bin/../build/classes:/opt/zookeeper/bin/../build/lib/*.jar:/opt/zookeeper/bin/../lib/slf4j-log4j12-1.6.1.jar:/opt/zookeeper/bin/../lib/slf4j-api-1.6.1.jar:/opt/zookeeper/bin/../lib/netty-3.7.0.Final.jar:/opt/zookeeper/bin/../lib/log4j-1.2.16.jar:/opt/zookeeper/bin/../lib/jline-0.9.94.jar:/opt/zookeeper/bin/../zookeeper-3.4.6.jar:/opt/zookeeper/bin/../src/java/lib/*.jar:/opt/zookeeper/bin/../conf:
 2015-06-08 15:44:55,958 [myid:] - INFO  [main:Environment@100] - Client

 environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
 2015-06-08 15:44:55,958 [myid:] - INFO  [main:Environment@100] - Client
 environment:java.io.tmpdir=/tmp
 2015-06-08 15:44:55,958 [myid:] - INFO  [main:Environment@100] - Client
 environment:java.compiler=NA
 2015-06-08 15:44:55,958 [myid:] - INFO  [main:Environment@100] - Client
 environment:os.name=Linux
 2015-06-08 15:44:55,958 [myid:] - INFO  [main:Environment@100] - Client
 environment:os.arch=amd64
 2015-06-08 15:44:55,958 [myid:] - INFO  [main:Environment@100] - Client
 environment:os.version=2.6.32-39-pve
 2015-06-08 15:44:55,958 [myid:] - INFO  [main:Environment@100] - Client
 environment:user.name=root
 2015-06-08 15:44:55,959 [myid:] - INFO  [main:Environment@100] - Client
 environment:user.home=/root
 2015-06-08 15:44:55,959 [myid:] - INFO  [main:Environment@100] - Client
 environment:user.dir=/opt/zookeeper-3.4.6/bin
 2015-06-08 15:44:55,960 [myid:] - INFO  [main:ZooKeeper@438] - Initiating
 client connection, connectString=localhost:2181 sessionTimeout=3
 watcher=org.apache.zookeeper.ZooKeeperMain$MyWatcher@3eb07fd3

 I'm guessing you started your cloud with one of the example (i.e. -e
  cloud). Under the covers,
  it did an upconfig to put the configs up in ZK in the first place,
  this is the inverse.
 

 I created a new collection with the following SOLR command:

 ./solr create_collection -c test -replicationFactor 3

 I also tried to list the configuration in the ZooKeeper's CLI:

 [zk: 127.0.0.1:2181(CONNECTED) 4] ls /configs/test
 [currency.xml, protwords.txt, managed-schema, solrconfig.xml, synonyms.txt,
 elevate.xml, stopwords.txt, params.json, lang]

 But... Where is the schema.xml file?




-- 
Regards,
Shalin Shekhar Mangar.


Re: Velocity UI and hyperlink

2015-06-08 Thread Erik Hatcher
Benjamin -

The templates for VelocityResponseWriter (/browse, etc) are under 
conf/velocity.  Find the template that generates the piece you want to affect 
(which may be hit.vm or hit_something.vm? - depends on which version of Solr 
you’re using and which configuration you’ve started with to be more precise) 
and modify it to render a hyperlink around $doc.getFirstValue(“url”), maybe 
something like:

  a href=$doc.getFirstValue(“url”)”click here/a

Does that get you what you need?

—
Erik Hatcher, Senior Solutions Architect
http://www.lucidworks.com




 On Jun 8, 2015, at 4:29 PM, Sznajder ForMailingList 
 bs4mailingl...@gmail.com wrote:
 
 Hi
 
 I would like one of the fields, I display in the results of Velocity UI, to
 be a hyperlink.
 
 In my example, I am storing a field url containing the link to the online
 page of the indexed document and I would like to have this displayed field
 a hyperlink to this page.
 
 Could you please indicate me waht should I change to get that?
 
 thanks!
 
 Benjamin



Re: YAJar

2015-06-08 Thread TK Solr

Maybe maven shade can help your situation ?
https://maven.apache.org/plugins/maven-shade-plugin/
http://stackoverflow.com/questions/13620281/what-is-the-maven-shade-plugin-used-for-and-why-would-you-want-to-relocate-java

Create a self-contained jar with guava package renamed.
Not very pretty but it should work.

On 5/25/15, 9:14 PM, Robust Links wrote:

I am stuck in Yet Another Jarmagedon of SOLR. this is a basic question. i
noticed solr 5.0 is using guava 14.0.1. My app needs guava 18.0. What is
the pattern to override a jar version uploaded into jetty?

I am using maven, and solr is being started the old way

java -jar start.jar
-Dsolr.solr.home=...
-Djetty.home=...

I tried to edit jetty's start.config (then run java
-DSTART=/my/dir/start.config
-jar start.jar) but got no where...

any help would be much appreciated

Peyman





Re: Complete list of parameters in request handlers

2015-06-08 Thread Jack Krupansky
I did make an effort to fully document all parameters for the request
handlers in my Solr 4.x Deep Dive:
http://www.lulu.com/shop/jack-krupansky/solr-4x-deep-dive-early-access-release-7/ebook/product-21203548.html

-- Jack Krupansky

On Mon, Jun 8, 2015 at 4:05 PM, Shalin Shekhar Mangar 
shalinman...@gmail.com wrote:

 The defaults, appends, invariants apply to request handlers.
 Similarly, each type of Solr plugin has different configuration parameters.
 Unfortunately, there is no single list of all parameters. You will have to
 look at the documentation of the plugin you are trying to configure to find
 out the list of supported parameters.

 On Mon, Jun 8, 2015 at 11:20 PM, Steven White swhite4...@gmail.com
 wrote:

  Hi,
 
  I'm managing my Solr solrconfig.xml data using
  https://cwiki.apache.org/confluence/display/solr/Config+API  In doing
 so,
  I'm write code that will read and update request handlers.  Beside the
 top
  level key / value parameters, I came across defaults, invariants and
  appends as list items.  Are there any others I should be looking for?
  Where can I find the complete list?
 
  Thanks
 
  Steve
 



 --
 Regards,
 Shalin Shekhar Mangar.



Re: SolrCloud and configuration files on ZooKeeper

2015-06-08 Thread Erick Erickson
And when you're _not_ using schemaless (thanks, Shalin, didn't even notice that)
you need to specify the -n option.

But I second Shalin's comment, you shouldn't be manually editing something
a managed schema...

Best,
Erick

On Mon, Jun 8, 2015 at 1:09 PM, Shalin Shekhar Mangar
shalinman...@gmail.com wrote:
 Looks like you are using managed-schema (better known as the schemaless
 mode). In this case, the schema is inferred/managed by Solr by looking at
 the documents that you add. You can also use the Schema API to change this
 schema. Editing this schema manually is not recommended. See
 https://cwiki.apache.org/confluence/display/solr/Schema+API

 The schemaless mode is most helpful when you want to prototype stuff but I
 wouldn't recommend it in production. If you want full control of the schema
 and you want to manage it yourself then it's best not to choose schemaless
 configuration (data_driven_schema_confgs) while setting up solr.

 On Tue, Jun 9, 2015 at 1:19 AM, mattia.martine...@gmail.com 
 mattia.martine...@gmail.com wrote:

 2015-06-08 21:42 GMT+02:00 Erick Erickson erickerick...@gmail.com:

  See downconfig here:
  https://cwiki.apache.org/confluence/display/solr/Command+Line+Utilities


 Thank you Erick for your answer!
 I've already seen that page, and I was trying with the following command:

 root@index1:/opt/zookeeper/bin# ./zkCli.sh -z zk1 -cmd downconfig -confdir
 /tmp/zkconfig/
 (zk1 is the first node of the Zookeeper's cluster).

 But no files are written in /tmp/zkconfig and I see this output:

 root@index1:/opt/zookeeper/bin# ./zkCli.sh -z zk1 -cmd downconfig -confdir
 /tmp/zkconfig/
 Connecting to localhost:2181
 2015-06-08 15:44:55,952 [myid:] - INFO  [main:Environment@100] - Client
 environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09 GMT
 2015-06-08 15:44:55,955 [myid:] - INFO  [main:Environment@100] - Client
 environment:host.name=index1.dc.ems.network
 2015-06-08 15:44:55,955 [myid:] - INFO  [main:Environment@100] - Client
 environment:java.version=1.8.0_45
 2015-06-08 15:44:55,957 [myid:] - INFO  [main:Environment@100] - Client
 environment:java.vendor=Oracle Corporation
 2015-06-08 15:44:55,957 [myid:] - INFO  [main:Environment@100] - Client
 environment:java.home=/usr/lib/jvm/java-8-oracle/jre
 2015-06-08 15:44:55,958 [myid:] - INFO  [main:Environment@100] - Client

 environment:java.class.path=/opt/zookeeper/bin/../build/classes:/opt/zookeeper/bin/../build/lib/*.jar:/opt/zookeeper/bin/../lib/slf4j-log4j12-1.6.1.jar:/opt/zookeeper/bin/../lib/slf4j-api-1.6.1.jar:/opt/zookeeper/bin/../lib/netty-3.7.0.Final.jar:/opt/zookeeper/bin/../lib/log4j-1.2.16.jar:/opt/zookeeper/bin/../lib/jline-0.9.94.jar:/opt/zookeeper/bin/../zookeeper-3.4.6.jar:/opt/zookeeper/bin/../src/java/lib/*.jar:/opt/zookeeper/bin/../conf:
 2015-06-08 15:44:55,958 [myid:] - INFO  [main:Environment@100] - Client

 environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
 2015-06-08 15:44:55,958 [myid:] - INFO  [main:Environment@100] - Client
 environment:java.io.tmpdir=/tmp
 2015-06-08 15:44:55,958 [myid:] - INFO  [main:Environment@100] - Client
 environment:java.compiler=NA
 2015-06-08 15:44:55,958 [myid:] - INFO  [main:Environment@100] - Client
 environment:os.name=Linux
 2015-06-08 15:44:55,958 [myid:] - INFO  [main:Environment@100] - Client
 environment:os.arch=amd64
 2015-06-08 15:44:55,958 [myid:] - INFO  [main:Environment@100] - Client
 environment:os.version=2.6.32-39-pve
 2015-06-08 15:44:55,958 [myid:] - INFO  [main:Environment@100] - Client
 environment:user.name=root
 2015-06-08 15:44:55,959 [myid:] - INFO  [main:Environment@100] - Client
 environment:user.home=/root
 2015-06-08 15:44:55,959 [myid:] - INFO  [main:Environment@100] - Client
 environment:user.dir=/opt/zookeeper-3.4.6/bin
 2015-06-08 15:44:55,960 [myid:] - INFO  [main:ZooKeeper@438] - Initiating
 client connection, connectString=localhost:2181 sessionTimeout=3
 watcher=org.apache.zookeeper.ZooKeeperMain$MyWatcher@3eb07fd3

 I'm guessing you started your cloud with one of the example (i.e. -e
  cloud). Under the covers,
  it did an upconfig to put the configs up in ZK in the first place,
  this is the inverse.
 

 I created a new collection with the following SOLR command:

 ./solr create_collection -c test -replicationFactor 3

 I also tried to list the configuration in the ZooKeeper's CLI:

 [zk: 127.0.0.1:2181(CONNECTED) 4] ls /configs/test
 [currency.xml, protwords.txt, managed-schema, solrconfig.xml, synonyms.txt,
 elevate.xml, stopwords.txt, params.json, lang]

 But... Where is the schema.xml file?




 --
 Regards,
 Shalin Shekhar Mangar.


Re: Velocity UI and hyperlink

2015-06-08 Thread Erik Hatcher
What version of Solr?   And where is the file you’re changing?

With Solr 5.2, one example of what you’re trying to do is under example/files.  
In the README we have this:

bin/solr start 
-Dvelocity.template.base.dir=/full/path/to/example/files/conf/velocity/

When you create a collection it clones the configuration (in 5x; under 
server/solr/…) so if you wanted to in-place edit you’d edit those files rather 
than the original configuration which would require a collection re-create.

With the above command-line, you can have templates anywhere you like and edit 
them in place, and they override any in the configuration of the Solr 
collection.

See 
https://cwiki.apache.org/confluence/display/solr/Response+Writers#ResponseWriters-VelocityResponseWriter
 for perhaps some more details.  If there’s any way I can make this easier, let 
me know.

If the above info doesn’t work or apply because you’re on a different version 
of Solr, provide more details and I’ll help from there.

—
Erik Hatcher, Senior Solutions Architect
http://www.lucidworks.com




 On Jun 8, 2015, at 5:07 PM, Sznajder ForMailingList 
 bs4mailingl...@gmail.com wrote:
 
 Thanks!!
 
 However, each time I change a *.vm file, I do not succeed to see the change
 on my browser until, I delete + recreate the collectoin and re-index.
 
 Isn't there a way to immediately see the display change?
 
 Best regards
 
 On Mon, Jun 8, 2015 at 11:46 PM, Erik Hatcher erik.hatc...@gmail.com
 wrote:
 
 Benjamin -
 
 The templates for VelocityResponseWriter (/browse, etc) are under
 conf/velocity.  Find the template that generates the piece you want to
 affect (which may be hit.vm or hit_something.vm? - depends on which
 version of Solr you’re using and which configuration you’ve started with to
 be more precise) and modify it to render a hyperlink around
 $doc.getFirstValue(“url”), maybe something like:
 
  a href=$doc.getFirstValue(“url”)”click here/a
 
 Does that get you what you need?
 
 —
 Erik Hatcher, Senior Solutions Architect
 http://www.lucidworks.com
 
 
 
 
 On Jun 8, 2015, at 4:29 PM, Sznajder ForMailingList 
 bs4mailingl...@gmail.com wrote:
 
 Hi
 
 I would like one of the fields, I display in the results of Velocity UI,
 to
 be a hyperlink.
 
 In my example, I am storing a field url containing the link to the
 online
 page of the indexed document and I would like to have this displayed
 field
 a hyperlink to this page.
 
 Could you please indicate me waht should I change to get that?
 
 thanks!
 
 Benjamin
 
 



How important is the name of the data collection?

2015-06-08 Thread David Patterson
I'm trying to make two virtual machines, each with one 4.10 SOLR-cloud code
instance, connected to the same external Zookeeper site.

I want to create one data collection with one shard on each of these two
machines.

If I use the start method as described in the Apache Solr Reference Guide
for my release, will the two machines be connected if I declare the same
data collection name for both of them? If not, how do I connect them?

(I know the start method can make two solr-cloud instances on ONE virtual
machine, but I want to make one on each of two virtual machines.)

Thanks

Dave P


Re: Velocity UI and hyperlink

2015-06-08 Thread Erick Erickson
Assuming you're in SolrCloud, you'd have to push the
config set up to Zookeeper and issue a Collections API
RELOAD command on the collection.

But if you've got it worked out, it doesn't matter.

FWIW,
Erick

On Mon, Jun 8, 2015 at 2:37 PM, Sznajder ForMailingList
bs4mailingl...@gmail.com wrote:
 Hi

 I am using 5.1

 Currently, I defined a directory solr-conf/ .
 Under this directory, I have a velocity directory containing my different
 *.vm files.

 When I create a collection, I am creating via
 bin\solr create -c COLL_NAME -d PATH_TO_SOLR_CONF

 Your indication was helpful : changing the file copied under solr\server
 was the right way!

 thanks again!

 Ben

 On Tue, Jun 9, 2015 at 12:25 AM, Erik Hatcher erik.hatc...@gmail.com
 wrote:

 What version of Solr?   And where is the file you’re changing?

 With Solr 5.2, one example of what you’re trying to do is under
 example/files.  In the README we have this:

 bin/solr start
 -Dvelocity.template.base.dir=/full/path/to/example/files/conf/velocity/

 When you create a collection it clones the configuration (in 5x; under
 server/solr/…) so if you wanted to in-place edit you’d edit those files
 rather than the original configuration which would require a collection
 re-create.

 With the above command-line, you can have templates anywhere you like and
 edit them in place, and they override any in the configuration of the Solr
 collection.

 See
 https://cwiki.apache.org/confluence/display/solr/Response+Writers#ResponseWriters-VelocityResponseWriter
 for perhaps some more details.  If there’s any way I can make this easier,
 let me know.

 If the above info doesn’t work or apply because you’re on a different
 version of Solr, provide more details and I’ll help from there.

 —
 Erik Hatcher, Senior Solutions Architect
 http://www.lucidworks.com




  On Jun 8, 2015, at 5:07 PM, Sznajder ForMailingList 
 bs4mailingl...@gmail.com wrote:
 
  Thanks!!
 
  However, each time I change a *.vm file, I do not succeed to see the
 change
  on my browser until, I delete + recreate the collectoin and re-index.
 
  Isn't there a way to immediately see the display change?
 
  Best regards
 
  On Mon, Jun 8, 2015 at 11:46 PM, Erik Hatcher erik.hatc...@gmail.com
  wrote:
 
  Benjamin -
 
  The templates for VelocityResponseWriter (/browse, etc) are under
  conf/velocity.  Find the template that generates the piece you want to
  affect (which may be hit.vm or hit_something.vm? - depends on which
  version of Solr you’re using and which configuration you’ve started
 with to
  be more precise) and modify it to render a hyperlink around
  $doc.getFirstValue(“url”), maybe something like:
 
   a href=$doc.getFirstValue(“url”)”click here/a
 
  Does that get you what you need?
 
  —
  Erik Hatcher, Senior Solutions Architect
  http://www.lucidworks.com
 
 
 
 
  On Jun 8, 2015, at 4:29 PM, Sznajder ForMailingList 
  bs4mailingl...@gmail.com wrote:
 
  Hi
 
  I would like one of the fields, I display in the results of Velocity
 UI,
  to
  be a hyperlink.
 
  In my example, I am storing a field url containing the link to the
  online
  page of the indexed document and I would like to have this displayed
  field
  a hyperlink to this page.
 
  Could you please indicate me waht should I change to get that?
 
  thanks!
 
  Benjamin
 
 




Re: Velocity UI and hyperlink

2015-06-08 Thread Erik Hatcher
Do note that changing the file copied under solr/server is risky, as you may 
delete and recreate the collection and lose your changes.  If you use the 
system property trick mentioned below, you can develop without having to 
recreate the collection but once you do it’ll incorporate the changes.

—
Erik Hatcher, Senior Solutions Architect
http://www.lucidworks.com http://www.lucidworks.com/




 On Jun 8, 2015, at 5:37 PM, Sznajder ForMailingList 
 bs4mailingl...@gmail.com wrote:
 
 Hi
 
 I am using 5.1
 
 Currently, I defined a directory solr-conf/ .
 Under this directory, I have a velocity directory containing my different
 *.vm files.
 
 When I create a collection, I am creating via
 bin\solr create -c COLL_NAME -d PATH_TO_SOLR_CONF
 
 Your indication was helpful : changing the file copied under solr\server
 was the right way!
 
 thanks again!
 
 Ben
 
 On Tue, Jun 9, 2015 at 12:25 AM, Erik Hatcher erik.hatc...@gmail.com
 wrote:
 
 What version of Solr?   And where is the file you’re changing?
 
 With Solr 5.2, one example of what you’re trying to do is under
 example/files.  In the README we have this:
 
bin/solr start
 -Dvelocity.template.base.dir=/full/path/to/example/files/conf/velocity/
 
 When you create a collection it clones the configuration (in 5x; under
 server/solr/…) so if you wanted to in-place edit you’d edit those files
 rather than the original configuration which would require a collection
 re-create.
 
 With the above command-line, you can have templates anywhere you like and
 edit them in place, and they override any in the configuration of the Solr
 collection.
 
 See
 https://cwiki.apache.org/confluence/display/solr/Response+Writers#ResponseWriters-VelocityResponseWriter
 for perhaps some more details.  If there’s any way I can make this easier,
 let me know.
 
 If the above info doesn’t work or apply because you’re on a different
 version of Solr, provide more details and I’ll help from there.
 
 —
 Erik Hatcher, Senior Solutions Architect
 http://www.lucidworks.com
 
 
 
 
 On Jun 8, 2015, at 5:07 PM, Sznajder ForMailingList 
 bs4mailingl...@gmail.com wrote:
 
 Thanks!!
 
 However, each time I change a *.vm file, I do not succeed to see the
 change
 on my browser until, I delete + recreate the collectoin and re-index.
 
 Isn't there a way to immediately see the display change?
 
 Best regards
 
 On Mon, Jun 8, 2015 at 11:46 PM, Erik Hatcher erik.hatc...@gmail.com
 wrote:
 
 Benjamin -
 
 The templates for VelocityResponseWriter (/browse, etc) are under
 conf/velocity.  Find the template that generates the piece you want to
 affect (which may be hit.vm or hit_something.vm? - depends on which
 version of Solr you’re using and which configuration you’ve started
 with to
 be more precise) and modify it to render a hyperlink around
 $doc.getFirstValue(“url”), maybe something like:
 
 a href=$doc.getFirstValue(“url”)”click here/a
 
 Does that get you what you need?
 
 —
 Erik Hatcher, Senior Solutions Architect
 http://www.lucidworks.com
 
 
 
 
 On Jun 8, 2015, at 4:29 PM, Sznajder ForMailingList 
 bs4mailingl...@gmail.com wrote:
 
 Hi
 
 I would like one of the fields, I display in the results of Velocity
 UI,
 to
 be a hyperlink.
 
 In my example, I am storing a field url containing the link to the
 online
 page of the indexed document and I would like to have this displayed
 field
 a hyperlink to this page.
 
 Could you please indicate me waht should I change to get that?
 
 thanks!
 
 Benjamin
 
 
 
 



Re: SolrCloud and configuration files on ZooKeeper

2015-06-08 Thread mattia.martine...@gmail.com
2015-06-08 22:09 GMT+02:00 Shalin Shekhar Mangar shalinman...@gmail.com:

 Looks like you are using managed-schema (better known as the schemaless
 mode).


Thank you very much Shalin and Erick!
I've never used schemaless before.
I am not editing the managed schema, and I uploaded my own custom schema.
Thank you very much again!
Bye


Re: Dataimport failing on SOLR 5.2

2015-06-08 Thread William Bell
https://issues.apache.org/jira/browse/SOLR-7588

On Mon, Jun 8, 2015 at 2:11 AM, William Bell billnb...@gmail.com wrote:

 Uncaught ReferenceError: naturalSort is not defined
 $.ajax.success @ dataimport.js?_=5.2.0:48
 jQuery.Callbacks.fire @ require.js?_=5.2.0:3126
 jQuery.Callbacks.self.fireWith @ require.js?_=5.2.0:3244
 done @ require.js?_=5.2.0:9482
 jQuery.ajaxTransport.send.callback @ require.js?_=5.2.0:10263

 On Mon, Jun 8, 2015 at 2:10 AM, William Bell billnb...@gmail.com wrote:

 Also getting:

 Uncaught ReferenceError: naturalSort is not defined


 On Mon, Jun 8, 2015 at 1:50 AM, William Bell billnb...@gmail.com wrote:


1. When I click DataImport in the UI on any core.. The UI just
spins:
2.
3.

 http://hgsolr2devmstr:8983/solr/autosuggest/admin/mbeans?cat=QUERYHANDLERwt=json_=1433749812067

 Here is the response: 200:

 {responseHeader:{status:0,QTime:1},solr-mbeans:[QUERYHANDLER,{allcondalpha:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},autospecportal:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},autosuggestallpracproc:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},joinhomecondnopt:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},allprocalpha:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},autopayorportal:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},joinhomespec:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},/update/json:{class:org.apache.solr.handler.UpdateRequestHandler,version:5.2.0,description:Add
 documents using XML (with XSLT), CSV, JSON, or
 javabin,src:null},joinhomepracspecnopt:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},autoall2:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},joinhomespeclocation:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},autosuggestallpraccond:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},/admin:{class:org.apache.solr.handler.admin.AdminHandlers,version:5.2.0,description:Register
 Standard Admin
 Handlers,src:null},autocondportal:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},autoeduportal:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},/debug/dump:{class:org.apache.solr.handler.DumpRequestHandler,version:5.2.0,description:Dump
 handler
 (debug),src:null},/admin/mbeans:{class:org.apache.solr.handler.admin.SolrInfoMBeanHandler,version:5.2.0,description:Get
 Info (and statistics) for registered
 SolrInfoMBeans,src:null},exactmatch2:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},/update/json/docs:{class:org.apache.solr.handler.UpdateRequestHandler,version:5.2.0,description:Add
 documents using XML (with XSLT), CSV, JSON, or
 javabin,src:null},autopracall:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},joinautopraccond2:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},joinautopracproc2:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},/admin/properties:{class:org.apache.solr.handler.admin.PropertiesRequestHandler,version:5.2.0,description:Get
 System
 Properties,src:null},autocohort:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},/admin/threads:{class:org.apache.solr.handler.admin.ThreadDumpHandler,version:5.2.0,description:Thread
 Dump,src:null},/query:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},joinhomeprocnopt:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},/update/csv:{class:org.apache.solr.handler.UpdateRequestHandler,version:5.2.0,description:Add
 documents using XML (with XSLT), CSV, JSON, or
 javabin,src:null},joinautopracspecportal:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 

Re: Dataimport failing on SOLR 5.2

2015-06-08 Thread William Bell
Also getting:

Uncaught ReferenceError: naturalSort is not defined


On Mon, Jun 8, 2015 at 1:50 AM, William Bell billnb...@gmail.com wrote:


1. When I click DataImport in the UI on any core.. The UI just spins:
2.
3.

 http://hgsolr2devmstr:8983/solr/autosuggest/admin/mbeans?cat=QUERYHANDLERwt=json_=1433749812067

 Here is the response: 200:

 {responseHeader:{status:0,QTime:1},solr-mbeans:[QUERYHANDLER,{allcondalpha:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},autospecportal:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},autosuggestallpracproc:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},joinhomecondnopt:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},allprocalpha:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},autopayorportal:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},joinhomespec:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},/update/json:{class:org.apache.solr.handler.UpdateRequestHandler,version:5.2.0,description:Add
 documents using XML (with XSLT), CSV, JSON, or
 javabin,src:null},joinhomepracspecnopt:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},autoall2:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},joinhomespeclocation:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},autosuggestallpraccond:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},/admin:{class:org.apache.solr.handler.admin.AdminHandlers,version:5.2.0,description:Register
 Standard Admin
 Handlers,src:null},autocondportal:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},autoeduportal:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},/debug/dump:{class:org.apache.solr.handler.DumpRequestHandler,version:5.2.0,description:Dump
 handler
 (debug),src:null},/admin/mbeans:{class:org.apache.solr.handler.admin.SolrInfoMBeanHandler,version:5.2.0,description:Get
 Info (and statistics) for registered
 SolrInfoMBeans,src:null},exactmatch2:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},/update/json/docs:{class:org.apache.solr.handler.UpdateRequestHandler,version:5.2.0,description:Add
 documents using XML (with XSLT), CSV, JSON, or
 javabin,src:null},autopracall:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},joinautopraccond2:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},joinautopracproc2:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},/admin/properties:{class:org.apache.solr.handler.admin.PropertiesRequestHandler,version:5.2.0,description:Get
 System
 Properties,src:null},autocohort:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},/admin/threads:{class:org.apache.solr.handler.admin.ThreadDumpHandler,version:5.2.0,description:Thread
 Dump,src:null},/query:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},joinhomeprocnopt:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},/update/csv:{class:org.apache.solr.handler.UpdateRequestHandler,version:5.2.0,description:Add
 documents using XML (with XSLT), CSV, JSON, or
 javabin,src:null},joinautopracspecportal:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},autopractall2:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},allspec:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},/replication:{class:org.apache.solr.handler.ReplicationHandler,version:5.2.0,description:ReplicationHandler
 provides replication of index and configuration files from Master to
 Slaves,src:null},autoprocportal:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:

Re: Dataimport failing on SOLR 5.2

2015-06-08 Thread William Bell
Uncaught ReferenceError: naturalSort is not defined
$.ajax.success @ dataimport.js?_=5.2.0:48
jQuery.Callbacks.fire @ require.js?_=5.2.0:3126
jQuery.Callbacks.self.fireWith @ require.js?_=5.2.0:3244
done @ require.js?_=5.2.0:9482
jQuery.ajaxTransport.send.callback @ require.js?_=5.2.0:10263

On Mon, Jun 8, 2015 at 2:10 AM, William Bell billnb...@gmail.com wrote:

 Also getting:

 Uncaught ReferenceError: naturalSort is not defined


 On Mon, Jun 8, 2015 at 1:50 AM, William Bell billnb...@gmail.com wrote:


1. When I click DataImport in the UI on any core.. The UI just
spins:
2.
3.

 http://hgsolr2devmstr:8983/solr/autosuggest/admin/mbeans?cat=QUERYHANDLERwt=json_=1433749812067

 Here is the response: 200:

 {responseHeader:{status:0,QTime:1},solr-mbeans:[QUERYHANDLER,{allcondalpha:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},autospecportal:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},autosuggestallpracproc:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},joinhomecondnopt:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},allprocalpha:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},autopayorportal:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},joinhomespec:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},/update/json:{class:org.apache.solr.handler.UpdateRequestHandler,version:5.2.0,description:Add
 documents using XML (with XSLT), CSV, JSON, or
 javabin,src:null},joinhomepracspecnopt:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},autoall2:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},joinhomespeclocation:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},autosuggestallpraccond:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},/admin:{class:org.apache.solr.handler.admin.AdminHandlers,version:5.2.0,description:Register
 Standard Admin
 Handlers,src:null},autocondportal:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},autoeduportal:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},/debug/dump:{class:org.apache.solr.handler.DumpRequestHandler,version:5.2.0,description:Dump
 handler
 (debug),src:null},/admin/mbeans:{class:org.apache.solr.handler.admin.SolrInfoMBeanHandler,version:5.2.0,description:Get
 Info (and statistics) for registered
 SolrInfoMBeans,src:null},exactmatch2:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},/update/json/docs:{class:org.apache.solr.handler.UpdateRequestHandler,version:5.2.0,description:Add
 documents using XML (with XSLT), CSV, JSON, or
 javabin,src:null},autopracall:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},joinautopraccond2:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},joinautopracproc2:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},/admin/properties:{class:org.apache.solr.handler.admin.PropertiesRequestHandler,version:5.2.0,description:Get
 System
 Properties,src:null},autocohort:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},/admin/threads:{class:org.apache.solr.handler.admin.ThreadDumpHandler,version:5.2.0,description:Thread
 Dump,src:null},/query:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},joinhomeprocnopt:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},/update/csv:{class:org.apache.solr.handler.UpdateRequestHandler,version:5.2.0,description:Add
 documents using XML (with XSLT), CSV, JSON, or
 javabin,src:null},joinautopracspecportal:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 ,src:null},autopractall2:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
 using components:
 

Dataimport failing on SOLR 5.2

2015-06-08 Thread William Bell
   1. When I click DataImport in the UI on any core.. The UI just spins:
   2.
   3.
   
http://hgsolr2devmstr:8983/solr/autosuggest/admin/mbeans?cat=QUERYHANDLERwt=json_=1433749812067

Here is the response: 200:

{responseHeader:{status:0,QTime:1},solr-mbeans:[QUERYHANDLER,{allcondalpha:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
using components:
,src:null},autospecportal:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
using components:
,src:null},autosuggestallpracproc:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
using components:
,src:null},joinhomecondnopt:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
using components:
,src:null},allprocalpha:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
using components:
,src:null},autopayorportal:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
using components:
,src:null},joinhomespec:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
using components:
,src:null},/update/json:{class:org.apache.solr.handler.UpdateRequestHandler,version:5.2.0,description:Add
documents using XML (with XSLT), CSV, JSON, or
javabin,src:null},joinhomepracspecnopt:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
using components:
,src:null},autoall2:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
using components:
,src:null},joinhomespeclocation:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
using components:
,src:null},autosuggestallpraccond:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
using components:
,src:null},/admin:{class:org.apache.solr.handler.admin.AdminHandlers,version:5.2.0,description:Register
Standard Admin
Handlers,src:null},autocondportal:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
using components:
,src:null},autoeduportal:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
using components:
,src:null},/debug/dump:{class:org.apache.solr.handler.DumpRequestHandler,version:5.2.0,description:Dump
handler
(debug),src:null},/admin/mbeans:{class:org.apache.solr.handler.admin.SolrInfoMBeanHandler,version:5.2.0,description:Get
Info (and statistics) for registered
SolrInfoMBeans,src:null},exactmatch2:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
using components:
,src:null},/update/json/docs:{class:org.apache.solr.handler.UpdateRequestHandler,version:5.2.0,description:Add
documents using XML (with XSLT), CSV, JSON, or
javabin,src:null},autopracall:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
using components:
,src:null},joinautopraccond2:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
using components:
,src:null},joinautopracproc2:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
using components:
,src:null},/admin/properties:{class:org.apache.solr.handler.admin.PropertiesRequestHandler,version:5.2.0,description:Get
System
Properties,src:null},autocohort:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
using components:
,src:null},/admin/threads:{class:org.apache.solr.handler.admin.ThreadDumpHandler,version:5.2.0,description:Thread
Dump,src:null},/query:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
using components:
,src:null},joinhomeprocnopt:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
using components:
,src:null},/update/csv:{class:org.apache.solr.handler.UpdateRequestHandler,version:5.2.0,description:Add
documents using XML (with XSLT), CSV, JSON, or
javabin,src:null},joinautopracspecportal:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
using components:
,src:null},autopractall2:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
using components:
,src:null},allspec:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
using components:
,src:null},/replication:{class:org.apache.solr.handler.ReplicationHandler,version:5.2.0,description:ReplicationHandler
provides replication of index and configuration files from Master to
Slaves,src:null},autoprocportal:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
using components:
,src:null},procforprovider:{class:org.apache.solr.handler.component.SearchHandler,version:5.2.0,description:Search
using components:

Re: Solr

2015-06-08 Thread Upayavira
This implies that you are attempting to access Solr direct from
Javascript in the browser. This is a bad idea. Solr doesn't (until 5.2
at least) have any security within, so you will be exposing
functionality to your end users that allows them to delete (or corrupt)
the data in your index.

Normal usage would be to have an intermediate application sitting
between Solr and your end user. That could use templates to lay out the
page based upon the JSON data.

If you really want to do it in the browser (e.g. if it is only for use
by people you trust) then you could use additional Javascript (e.g.
jQuery) to modify the page based upon the results of an Ajax request,
but how to do that is really out of scope of this list.

Upayavira

On Sun, Jun 7, 2015, at 12:33 AM, Tom Running wrote:
 Hello,
 
 I have customized my Solr results so that they display only 3 fields: the
 document ID, name and last_modified date. The results are in JSON.
 
 This is a sample of my Javascript function to execute the query:
 
 var query = ;
 
 //set user input to query
 query = window.document.box.input.value;
 
 //solr URL
 var sol = 
 http://localhost:8983/solr/gettingstarted_shard1_replica1/select?q=;;
 var sol2 =
 wt=jsonfl=title,id,category,last_modifiedrows=1000indent=true;
 
 //redirect
 window.location.href = sol+query+sol2;
 //
 
 The output example would look like:
 
 {
 id:/solr/docs/ISO/Employee Benefits Information/BCN.doc,
 title:[BCN Auto Policy Verbiage:],
 last_modified:[2014-01-07T15:19:00Z]},
 
 
 
 I want to format my Solr results so that the document ID will be
 displayed
 as a link that users can click on and load the BCN.doc file.
 
 Any tips on how to do this? I am a stuck.
 
 All help is appreciated!
 
 Thanks,
 
 T


Adding multiple entities to single core

2015-06-08 Thread Naman Kaushik
Hi Admin,I am a new-bee to SOLR.I want to establish multiple entities within a 
single core so that each entity refers data from two different tables and hence 
indexing the data.Please help me out Attached are my schema.xml and 
data-config.xml files
Looking forward for a positive response
--Namanspan style=font-family: Trebuchet MS, sans-serif;
dataConfig
dataSource type=JdbcDataSource driver=com.mysql.jdbc.Driver url=jdbc:mysql://localhost/db_ipc user=root password= batchSize=1 /
    document name=listing
       entity name=listings_data pk=property_id query=SELECT * FROM member_listing   
field column=l_id template=l_${member_listing.id} template=listing /
field column=id name=id template=listing  /
field column=property_id name=property_id template=listing   /
field column=member_id name=member_id  template=listing  /
field column=property_type_id name=property_type_id template=listing   /
field column=property_for name=property_for template=listing   /
field column=l_location_id name=location_id template=listing  /
field column=l_location name=location template=listing   /
field column=l_city name=city template=listing   /
field column=l_city_other name=city_other template=listing   /
field column=price name=price template=listing   /
field column=area name=area  template=listing  /
field column=area_unit name=area_unit template=listing   /
field column=area_in_sqfeet name=area_in_sqfeet  template=listing  /
field column=is_negotiable name=is_negotiable  template=listing  /
field column=deposit_amount name=deposit_amount template=listing   /
field column=bedrooms name=bedrooms template=listing   /
field column=reposted_date name=reposted_date  template=listing  /
field column=contact_name name=contact_name template=listing   /
field column=contact_phone name=contact_phone  template=listing  /
field column=contact_mobile name=contact_mobile template=listing  /
field column=contact_email name=contact_email template=listing   /
field column=property_address name=property_address template=listing   /
field column=project_society name=project_society template=listing   /
field column=furnished name=furnished template=listing   /
field column=age_of_construction name=age_of_construction template=listing   /
/entity

 entity name=user_data pk=member_id query=SELECT * FROM member  
field column=m_id template=l_${member.member_id}  template=member  / 
field column=member_id name=m_member_id template=member  /
field column=username name=m_username template=member  /
field column=password name=m_password template=member  /
field column=fullname name=m_fullname template=member  /
field column=email name=m_email template=member  /
field column=address name=m_address template=member  /
field column=city name=m_city template=member  /
field column=locality_id name=m_locality_id template=member  /
field column=mobile name=m_mobile template=member  /
field column=member_type name=m_member_typetemplate=member   /
/entity
    /document
/dataConfig
/span

?xml version=1.0 encoding=UTF-8?
!-- Solr managed schema - automatically generated - DO NOT EDIT --
schema name=example-data-driven-schema version=1.5
  uniqueKeyid/uniqueKey
  fieldType name=ancestor_path class=solr.TextField
analyzer type=index
  tokenizer class=solr.KeywordTokenizerFactory/
/analyzer
analyzer type=query
  tokenizer class=solr.PathHierarchyTokenizerFactory delimiter=//
/analyzer
  /fieldType
  fieldType name=binary class=solr.BinaryField/
  fieldType name=boolean class=solr.BoolField sortMissingLast=true/
  fieldType name=booleans class=solr.BoolField multiValued=true sortMissingLast=true/
  fieldType name=currency class=solr.CurrencyField precisionStep=8 currencyConfig=currency.xml defaultCurrency=USD/
  fieldType name=date class=solr.TrieDateField precisionStep=0 positionIncrementGap=0/
  fieldType name=dates class=solr.TrieDateField precisionStep=0 multiValued=true positionIncrementGap=0/
  fieldType name=descendent_path class=solr.TextField
analyzer type=index
  tokenizer class=solr.PathHierarchyTokenizerFactory delimiter=//
/analyzer
analyzer type=query
  tokenizer class=solr.KeywordTokenizerFactory/
/analyzer
  /fieldType
  fieldType name=double class=solr.TrieDoubleField precisionStep=0 positionIncrementGap=0/
  fieldType name=doubles class=solr.TrieDoubleField precisionStep=0 multiValued=true positionIncrementGap=0/
  fieldType name=float class=solr.TrieFloatField precisionStep=0 positionIncrementGap=0/
  fieldType name=floats class=solr.TrieFloatField precisionStep=0 multiValued=true positionIncrementGap=0/
  fieldType name=ignored class=solr.StrField multiValued=true indexed=false stored=false/
  fieldType name=int class=solr.TrieIntField precisionStep=0 positionIncrementGap=0/
  fieldType name=ints class=solr.TrieIntField precisionStep=0 multiValued=true positionIncrementGap=0/
  fieldType name=location class=solr.LatLonType subFieldSuffix=_coordinate/
  fieldType 

AW: Solr OutOfMemory but no heap and dump and oo_solr.sh is not triggered

2015-06-08 Thread Clemens Wyss DEV
Sorry for the delay - https://issues.apache.org/jira/browse/SOLR-7646

-Ursprüngliche Nachricht-
Von: Erick Erickson [mailto:erickerick...@gmail.com] 
Gesendet: Mittwoch, 3. Juni 2015 17:39
An: solr-user@lucene.apache.org
Betreff: Re: Solr OutOfMemory but no heap and dump and oo_solr.sh is not 
triggered

bq: what exactly should I file? What needs to be added/appended to the issue?

Just what Mark said, title it something like OOM exception wrapped in runtime 
exception

Include your original post and that you were asked to open the JIRA after 
discussion on the user's list. Don't worry too much, the title  etc. can be 
changed after as things become clearer.

Best,
Erick

On Wed, Jun 3, 2015 at 5:58 AM, Clemens Wyss DEV clemens...@mysign.ch wrote:
 Hi Mark,
 what exactly should I file? What needs to be added/appended to the issue?

 Regards
 Clemens

 -Ursprüngliche Nachricht-
 Von: Mark Miller [mailto:markrmil...@gmail.com]
 Gesendet: Mittwoch, 3. Juni 2015 14:23
 An: solr-user@lucene.apache.org
 Betreff: Re: Solr OutOfMemory but no heap and dump and oo_solr.sh is 
 not triggered

 We will have to a find a way to deal with this long term. Browsing the code I 
 can see a variety of places where problem exception handling has been 
 introduced since this all was fixed.

 - Mark

 On Wed, Jun 3, 2015 at 8:19 AM Mark Miller markrmil...@gmail.com wrote:

 File a JIRA issue please. That OOM Exception is getting wrapped in a 
 RuntimeException it looks. Bug.

 - Mark


 On Wed, Jun 3, 2015 at 2:20 AM Clemens Wyss DEV 
 clemens...@mysign.ch
 wrote:

 Context: Lucene 5.1, Java 8 on debian. 24G of RAM whereof 16G 
 available for Solr.

 I am seeing the following OOMs:
 ERROR - 2015-06-03 05:17:13.317; [   customer-1-de_CH_1]
 org.apache.solr.common.SolrException; null:java.lang.RuntimeException:
 java.lang.OutOfMemoryError: Java heap space
 at
 org.apache.solr.servlet.SolrDispatchFilter.sendError(SolrDispatchFilter.java:854)
 at
 org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:463)
 at
 org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:220)
 at
 org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
 at
 org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
 at
 org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
 at
 org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557)
 at
 org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231)
 at
 org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1075)
 at
 org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
 at
 org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
 at
 org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
 at
 org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
 at
 org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255)
 at
 org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154)
 at
 org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
 at org.eclipse.jetty.server.Server.handle(Server.java:368)
 at
 org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
 at
 org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:942)
 at
 org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:1004)
 at
 org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:640)
 at
 org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
 at
 org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
 at
 org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
 at
 org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
 at
 org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
 at
 org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
 at java.lang.Thread.run(Thread.java:745)
 Caused by: java.lang.OutOfMemoryError: Java heap space
 WARN  - 2015-06-03 05:17:13.319; [   customer-1-de_CH_1]
 org.eclipse.jetty.servlet.ServletHandler; Error for 
 /solr/customer-1-de_CH_1/suggest_phrase
 java.lang.OutOfMemoryError: Java heap space

 The full commandline is
 /usr/local/java/bin/java -server -Xss256k -Xms16G -Xmx16G
 -XX:NewRatio=3 -XX:SurvivorRatio=4 -XX:TargetSurvivorRatio=90
 -XX:MaxTenuringThreshold=8 -XX:+UseConcMarkSweepGC -XX:+UseParNewGC
 -XX:ConcGCThreads=4 

Re: Escaping special chars when exporting result sets

2015-06-08 Thread Angelo Veltens


Am 20.05.15 um 00:36 schrieb Joel Bernstein:

This should be considered a bug in the /export handler. Please create a
jira ticket for this.



We have created a ticket:
https://issues.apache.org/jira/browse/SOLR-7647

Best regards,
Angelo


Re: BoolField fieldType

2015-06-08 Thread Steven White
Thank you all for helping and updating the doc.  As always, it is greatly
appreciated.

Steve

On Thu, Jun 4, 2015 at 1:53 PM, Chris Hostetter hossman_luc...@fucit.org
wrote:


 : What about at query time?  If I index my Boolean and it has one of the
 : variations of t, T or 1, what should my query be to get a hit on
 : true?  q=MyBoolField:what ?  What should the value of what be when
 I
 : want to check if the field has a true and when I need to check if it
 has
 : a false?

 the string representations are parsed into the logical concepts -- it
 doesn't matter if one doc was added with a value of true and another doc
 was indexed with a value of T in the index they both have a true value.

 likewise at query time it doesn't matter if you query for true or T -
 they are both going to find all docs that have a true value, and querying
 for F or false or BOGUS are going to find you all docs with a false
 value.

 where things get interesting is is when you deal with documents that do
 not have a value in the field at all -- searching for something like
 this...

 q=-MyBoolField:true

 ...won't just return all the docs with a false value, it will also return
 all docs w/o any value.

 if you want to find all documents that don't have any value, you can
 search for this...

 q=-MyBoolField:*

 note that the * is a query parser feature, so it causes the query parser
 to do a docs with value in this field query w/o ever asking the
 BoolField to parse the input string as a true/false value.



 -Hoss
 http://www.lucidworks.com/



Re: Unsubscribe me

2015-06-08 Thread François Schiettecatte
Please follow instructions here: http://lucene.apache.org/solr/resources.html

F.


 On Jun 8, 2015, at 1:06 AM, Dylan dylan.h...@gmail.com wrote:
 
 On 30 May 2015 12:08, Lalit Kumar 4 lkum...@sapient.com wrote:
 
 Please unsubscribe me as well
 
 On May 30, 2015 15:23, Neha Jatav neha.ja...@gmail.com wrote:
 Unsubscribe me
 



Re: List all Collections together with number of records

2015-06-08 Thread Zheng Lin Edwin Yeo
We're thinking of writing a custom request handler to do that, although the
handler will also query all the collections at the backend.

Will this lead to a faster response speed for the user?

Regards,
Edwin


On 8 June 2015 at 00:06, Erick Erickson erickerick...@gmail.com wrote:

 bq: we still need those information to be stored in a separate collection
 for security reasons.

 Not necessarily. I've seen lots of installations where auth tokens are
 embedded in the document (say groups that can see this doc). Then
 the front-end simply attaches fq=auth_field:(groups each user belongs to)
 to every query to restrict access.

 That said, some organizations aren't comfortable with this and demand
 separate collections, in which case you're stuck.

 You've defined an architecture though, and one of the consequences
 of that is if you have many collections, you'll have to fire off many
 queries (perhaps in parallel, but still). There's no magic to get around
 that. And it really doesn't matter, because in what you've described
 what has to happen is one query has to be fired to each collection.
 It doesn't matter whether Solr does that for you or you spawn a bunch
 of threads on the client, the same work has to happen somewhere.

 You also have to figure out how to present the results to the user,
 if it's simple count you're OK. But scores will _not_ be comparable
 across the various collections so the presentation will be challenging.

 Best,
 Erick

 On Sun, Jun 7, 2015 at 6:29 AM, Zheng Lin Edwin Yeo
 edwinye...@gmail.com wrote:
  The reasons we want to have different collections is that each of the
  collections have different fields, and that some collections will contain
  information that are more sensitive than others.
 
  As such, we may need to restrict access to certain collections for some
  users. Although the restriction will be done on the front end client
 side,
  but we still need those information to be stored in a separate collection
  for security reasons..
 
  Regards,
  Edwin
 
 
  On 7 June 2015 at 12:23, Erick Erickson erickerick...@gmail.com wrote:
 
  bq: Yup this information will need to be collected each time the user
  search
  for a query, as we want to show the number of records that matches the
  search query in each of the collections.
 
  You're looking at something akin to federated search. About all you
 can
  do is send out parallel queries to each collection.
 
  This is an interesting requirement, and I really question whether
 it's a
  wise
  thing to insist on. I'd really think about going back to the design.
  For instance,
  could you consolidate all these collections into a single one, with
 perhaps
  a collection_id? Then the problem is relatively simple, use field
  collapsing
  (aka grouping).
 
  Best,
  Erick
 
  On Sat, Jun 6, 2015 at 6:40 PM, Zheng Lin Edwin Yeo
  edwinye...@gmail.com wrote:
   Yup this information will need to be collected each time the user
 search
   for a query, as we want to show the number of records that matches the
   search query in each of the collections.
  
   Currently I only have 6 collections, but it could increase to
 hundreds of
   collections in the future. So I'm worried that it could slow down the
   system a lot if we have to pass hundreds of queries for each search
  request.
  
   Regards,
   Edwin
  
  
   On 5 June 2015 at 21:00, Upayavira u...@odoko.co.uk wrote:
  
   I'm not so sure this is as bad as it sounds. When your collection is
   sharded, no single node knows about the documents in other
 shards/nodes,
   so to find the total number, a query will need to go to every node.
  
   Trying to work out something to do a single request to every node,
   combine their collection statistics and aggregate them into a single
   result sounds very complicated, and likely overkill.
  
   Are you needing to collect this information often? Do you have a lot
 of
   collections?
  
   Upayavira
  
  
   On Fri, Jun 5, 2015, at 06:29 AM, Zheng Lin Edwin Yeo wrote:
I'm trying to write a SolrJ program in Java to read and consolidate
  all
the
information into a JSON file, The client will just need to call
 this
SolrJ
program and read this JSON file to get the details. But the problem
  is we
are still querying the Solr once for each collection, just that
 this
  time
it is done in the SolrJ program in a for-loop, while previously
 it's
  done
on the client side. Not sure will this lead to performance
  improvement?
   
For your suggestion on spawning a bunch of threads, does it mean
 the
  same
thing as I did?
   
Regards,
Edwin
   
   
On 5 June 2015 at 12:03, Erick Erickson erickerick...@gmail.com
  wrote:
   
 Have you considered spawning a bunch of threads, one per
 collection
 and having them all run in parallel?

 Best,
 Erick

 On Thu, Jun 4, 2015 at 4:52 PM, Zheng Lin Edwin Yeo
 edwinye...@gmail.com wrote:
  The reason we wanted to 

Score function

2015-06-08 Thread Slavko Bodvanski
Hello,

Solr schema that I use defines products on a document level where product
has number of predefined and custom fields. For instance, there are fields
like id of a catalog to which product belongs, title, description, price,
category etc.

I'd like to use scale function
(org.apache.lucene.queries.function.valuesource.ScaleFloatFunction.java)
and  inject it into bf parameter in order to scale numeric fields values
down to some base value range like 0..1. On the top of that, some boost
factor would be applied to affect scoring.

By looking at the source code, I've learned that current scale function
implementation traverses all of the field (function) values to obtain the
min and max values, so it can calculate the correct scale. This doesn't
work for me because I need to get the correct scale based on the numeric
field values of documents that match the main query criteria (q and fq
clauses).  For example, if catalog id and category fields restrictions are
used (q=catalog_id:100 AND category:shoes), in order to calculate min and
max,  scale function for price field should take into account only price
values which belong to documents from catalog of id 100 and are under shoes
category.

Is that possible to do out of the box?
is there a way to obtain reference to a document id set (set filtered by
the main query criteria) and use it within the custom function context?


Any kind of help is appreciated!

Thanks,
Slavko


Re: Derive suggestions across multiple fields

2015-06-08 Thread Zheng Lin Edwin Yeo
I've set it to true already.

str name=buildOnStartuptrue/str
str name=buildOnCommittrue/str


I got this error when I tried to run /suggesthandler?suggest.build=true

?xml version=1.0 encoding=UTF-8?

-response


-lst name=responseHeader
int name=status500/int
int name=QTime33/int
/lst


-lst name=error
str name=msglen must be = 32767; got 35578/str

str name=tracejava.lang.IllegalArgumentException: len must be = 32767;
got 35578 at
org.apache.lucene.util.OfflineSorter$ByteSequencesWriter.write(OfflineSorter.java:464)
at
org.apache.lucene.search.suggest.analyzing.AnalyzingSuggester.build(AnalyzingSuggester.java:502)
at org.apache.lucene.search.suggest.Lookup.build(Lookup.java:193) at
org.apache.solr.spelling.suggest.SolrSuggester.build(SolrSuggester.java:163)
at
org.apache.solr.handler.component.SuggestComponent.prepare(SuggestComponent.java:179)
at
org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:196)
at
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:143)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:1984) at
org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:829)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:446)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:220)
at
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
at
org.eclipse.jetty.servlets.UserAgentFilter.doFilter(UserAgentFilter.java:82)
at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:294) at
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
at
org.eclipse.jetty.servlets.UserAgentFilter.doFilter(UserAgentFilter.java:82)
at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:294) at
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
at
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
at
org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557)
at
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231)
at
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1075)
at
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
at
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
at
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
at
org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255)
at
org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154)
at
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
at org.eclipse.jetty.server.Server.handle(Server.java:368) at
org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
at
org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53)
at
org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:942)
at
org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:1004)
at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:640) at
org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235) at
org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)
at
org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264)
at
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
at
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
at java.lang.Thread.run(Unknown Source) /str

int name=code500/int

/lst

/response


Regards,
Edwin


On 8 June 2015 at 01:28, Dhanesh Radhakrishnan dhan...@hifx.co.in wrote:

 Check your solrconfig.xml

 str name=buildOnStartupfalse/str
 str name=buildOnCommitfalse/str

 if you set to false then the Lookup data structure will rebuilt after the
 commit.
 You need to invoke the build command to build data for the suggester using
 the command


 * /suggesthandler?suggest.build=true *

 On Sun, Jun 7, 2015 at 7:49 PM, Zheng Lin Edwin Yeo edwinye...@gmail.com
 wrote:

  I've tried to use, and there's still no suggestions returned even when I
  used suggest.q.
 
  Here is the log:
 
  INFO  - 2015-06-07 22:18:24.195; [collection1 shard1 core_node1
  collection1] org.apache.solr.handler.component.SuggestComponent;
  SuggestComponent prepare with :
 
 suggest.count=10suggest=truesuggest.dictionary=mySuggestersuggest.q=tes
  INFO  - 2015-06-07 22:18:24.195; [collection1 shard1 core_node1
  collection1] org.apache.solr.handler.component.SuggestComponent;
  SuggestComponent process with :