Indexing URLs in Solr?

2013-11-07 Thread Jack Park
Figuring out a google query to gain an answer seems difficult given the ambiguity; I have a field: field name=resourceURL type=string indexed=true stored=true/ into which I store a URL which, when displayed as a result of a query, looks like this in the admin console: resourceURL:

Re: Indexing URLs in Solr?

2013-11-07 Thread Jack Park
Spoke too soon. Hacking rocks! Finally landed on this heuristic, and it works: resourceURL:http://someotherserver.org/; On Thu, Nov 7, 2013 at 9:52 AM, Jack Park jackp...@topicquests.org wrote: Figuring out a google query to gain an answer seems difficult given the ambiguity; I have a field

Cloud issue as an issue with SolrJ?

2013-11-03 Thread Jack Park
I now have a single ZK running standalone on 2121. On the same CPU, I have three nodes. I used a curl to send over two documents, one each to two of the three nodes in the cloud. According to a web query, they are both there. My solrconfig.xml file has a custom update response processor chain

Re: Cloud issue as an issue with SolrJ?

2013-11-03 Thread Jack Park
. On Sun, Nov 3, 2013 at 12:04 PM, Jack Park jackp...@topicquests.org wrote: I now have a single ZK running standalone on 2121. On the same CPU, I have three nodes. I used a curl to send over two documents, one each to two of the three nodes in the cloud. According to a web query

Re: Simple (?) zookeeper question

2013-11-01 Thread Jack Park
, at 04:19, Jack Park wrote: After digging deeper (slow for a *nix newbee), I uncovered issues with the java installation. A step in installation of Oracle Java has it that you -install java with the path to dir/bin/java. That done, zookeeper seems to be running. I booted three cores

Re: Simple (?) zookeeper question

2013-11-01 Thread Jack Park
by peer would suggest something in my code, but my code is a clone of code supplied in a Solr training course. Must be good. Right? I also have no clue what is /127.0.0.1:39065 -- that's not one of my nodes. The quest continues. On Fri, Nov 1, 2013 at 9:21 AM, Jack Park jackp...@topicquests.org wrote

Re: Simple (?) zookeeper question

2013-11-01 Thread Jack Park
, because those servers actually exist, to the test harness, at 10.1.10.178, and if I access any one of them from the browser, /solr/collection1 does not work, but /solr/#/collection1 does work. On Fri, Nov 1, 2013 at 10:34 AM, Jack Park jackp...@topicquests.org wrote: /clusterstate.json seems

Re: Simple (?) zookeeper question

2013-11-01 Thread Jack Park
-cloud mode. Thanks Jack On Fri, Nov 1, 2013 at 11:12 AM, Shawn Heisey s...@elyograg.org wrote: On 11/1/2013 12:07 PM, Jack Park wrote: The top error message at my test harness is this: No live SolrServers available to handle this request: [http://127.0.1.1:8983/solr/collection1, http

Simple (?) zookeeper question

2013-10-31 Thread Jack Park
Latest zookeeper is installed on an Ubuntu server box. Java is 1.7 latest build. whereis points to java just fine. /etc/zookeeper is empty. boot zookeeper from /bin as sudo ./zkServer.sh start Console says Started /etc/zookeeper now has a .pid file In another console, ./zkServer.sh status

Re: Simple (?) zookeeper question

2013-10-31 Thread Jack Park
one-box 3-node cloud test, and used the test code from the Lucidworks course to send over and read some documents. That failed with this: Unknown document router '{name=compositeId}' Lots more research. Closer... On Thu, Oct 31, 2013 at 5:44 PM, Jack Park jackp...@topicquests.org wrote: Latest

Re: First test cloud error question...

2013-10-25 Thread Jack Park
anywhere. I have reason to believe I followed all the instructions in the ZooKeeper Getting Started page accurately. Still, no real cigar... Java on windoz is 1.6.0_31; on ubuntu it is 1.7.0_40 Thanks in advance for any hints. On Thu, Oct 24, 2013 at 6:24 PM, Jack Park jackp...@topicquests.org

Re: [ANNOUNCE] Apache Solr 4.5.1 released.

2013-10-24 Thread Jack Park
Download redirects to 4.5.0 Is there a typo in the server path? On Thu, Oct 24, 2013 at 9:14 AM, Mark Miller markrmil...@apache.org wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 October 2013, Apache Solr™ 4.5.1 available The Lucene PMC is pleased to announce the release of Apache

Re: [ANNOUNCE] Apache Solr 4.5.1 released.

2013-10-24 Thread Jack Park
Use a different server than default gets 4.5.1 On Thu, Oct 24, 2013 at 9:35 AM, Jack Park jackp...@topicquests.org wrote: Download redirects to 4.5.0 Is there a typo in the server path? On Thu, Oct 24, 2013 at 9:14 AM, Mark Miller markrmil...@apache.org wrote: -BEGIN PGP SIGNED MESSAGE

First test cloud error question...

2013-10-24 Thread Jack Park
Background: all testing done on a Win7 platform. This is my first migration from a single Solr server to a simple cloud. Everything is configured exactly as specified in the wiki. I created a simple 3-node client, all localhost with different server URLs, and a lone external zookeeper. The

Re: Question about plug-in update handler failure

2013-10-11 Thread Jack Park
Issue resolved. Not a Solr issue; a really hard to discover missing library in my installation. On Thu, Oct 10, 2013 at 7:10 PM, Jack Park jackp...@topicquests.org wrote: I have an interceptor which grabs SolrDocument instances in the update handler chain. It feeds those documents as a JSON

Question about plug-in update handler failure

2013-10-10 Thread Jack Park
I have an interceptor which grabs SolrDocument instances in the update handler chain. It feeds those documents as a JSON string out to an agent system. That system has been running fine all the way up to Solr 4.3.1 I have discovered that, as of 4.4 and now 4.5, the very same config files, agent

Question about soft commit and updateRequestProcessorChain

2013-08-07 Thread Jack Park
If one allows for a soft commit (rather than a hard commit on each request), when does the updateRequestProcessorChain fire? Does it fire after the commit? Many thanks Jack

Re: Question about soft commit and updateRequestProcessorChain

2013-08-07 Thread Jack Park
update processor chains will be configured with the Run Update processor as the last processor of the chain. That's were the Lucene index update and optional commit would be done. -- Jack Krupansky -Original Message- From: Jack Park Sent: Wednesday, August 07, 2013 1:04 PM To: solr-user

Re: solr.DirectUpdateHandler2 failed to instantiate

2013-06-27 Thread Jack Park
, vs. a proper casting problem, some nested init issue. Was curious what you found? On Mar 13, 2013, at 11:52 AM, Jack Park jackp...@topicquests.org wrote: I can safely say that it is not DirectUpdateHandler2 failing; By commenting out my own handlers, the system boots without error

Re: Varnish

2013-06-21 Thread Jack Park
I presume you mean https://www.varnish-cache.org/ That's the first I'd heard of it. Thanks Jack On Thu, Jun 20, 2013 at 10:48 PM, William Bell billnb...@gmail.com wrote: Who is using varnish in front of SOLR? Anyone have any configs that work with the cache control headers of SOLR? -- Bill

Re: The book: Solr 4.x Deep Dive - Early Access Release #1

2013-06-21 Thread Jack Park
As one of the early reviewers of the manuscript, I always had high hopes for this work. I now have the pdf from lulu; do not have time now to dive deeply, but will comment that it seems, to me at least, well worth owning. Jack On Fri, Jun 21, 2013 at 11:41 AM, Jack Krupansky

Re: Quick SolrJ query how-to question.

2013-05-14 Thread Jack Park
In some sense, if all you want to do is send over a URL, e.g. http://localhost:8993/some stuff, it's not out of the question to use the java url stuff as exemplified at http://www.cafeaulait.org/course/week12/22.html or

Re: Best way to design a story and comments schema.

2013-05-13 Thread Jack Park
Jack, Why are multi-valued fields considered messy? I think I am about to learn something.. Thanks Another Jack On Mon, May 13, 2013 at 5:29 AM, Jack Krupansky j...@basetechnology.com wrote: Try the simplest, cleanest design first (at least on paper), before you start resorting to either

Re: Downloaded Solr 4.2.1 Source: Build Failing

2013-04-14 Thread Jack Park
What I learned is that I needed to upgrade Ant, then needed to install Ivy; the build.xml in the outer subversion directory has an ant target to install Ivy, and one to run-maven-build. I ran that, then switched to /solr and ran ant dist which finished in under 2 minutes. On Sun, Apr 14, 2013 at

Re: Flow Chart of Solr

2013-04-03 Thread Jack Park
There are three books on Solr, two with that in the title, and one, Taming Text, each of which have been very valuable in understanding Solr. Jack On Wed, Apr 3, 2013 at 5:25 AM, Jack Krupansky j...@basetechnology.com wrote: Sure, yes. But... it comes down to what level of detail you want and

Re: Flow Chart of Solr

2013-04-03 Thread Jack Park
. Plenty of diagrams. Lots of examples. -- Jack Krupansky -Original Message- From: Jack Park Sent: Wednesday, April 03, 2013 11:25 AM To: solr-user@lucene.apache.org Subject: Re: Flow Chart of Solr There are three books on Solr, two with that in the title, and one, Taming Text, each

Re: Querying a transitive closure?

2013-03-28 Thread Jack Park
, as a multivalued field, then you could get it in one hit. Am I missing something? Upayavira On Thu, Mar 28, 2013, at 01:59 AM, Jack Park wrote: Hi Otis, That's essentially the answer I was looking for: each shard (are we talking master + replicas?) has the plug-in custom query handler. I

Querying a transitive closure?

2013-03-27 Thread Jack Park
This is a question about isA? We want to know if M isA B isA?(M,B) For some M, one might be able to look into M to see its type or which class(es) for which it is a subClass. We're talking taxonomic queries now. But, for some M, one might need to ripple up the transitive closure, looking at

Re: Querying a transitive closure?

2013-03-27 Thread Jack Park
27, 2013 at 12:53 PM, Jack Park jackp...@topicquests.org wrote: This is a question about isA? We want to know if M isA B isA?(M,B) For some M, one might be able to look into M to see its type or which class(es) for which it is a subClass. We're talking taxonomic queries now. But, for some

Re: Querying a transitive closure?

2013-03-27 Thread Jack Park
shards. Otis -- Solr ElasticSearch Support http://sematext.com/ On Wed, Mar 27, 2013 at 3:11 PM, Jack Park jackp...@topicquests.org wrote: Hi Otis, I fully expect to grow to SolrCloud -- many shards. For now, it's solo. But, my thinking relates to cloud. I look for ways to reduce

Re: SolrCloud with Zookeeper ensemble in production environment: SEVERE problems.

2013-03-15 Thread Jack Park
Is there a document that tells how to create multiple threads? Search returns many hits which orbit this idea, but I haven't spotted one which tells how. Thanks Jack On Fri, Mar 15, 2013 at 1:01 PM, Mark Miller markrmil...@gmail.com wrote: You def have to use multiple threads with it for it to

Re: solr.DirectUpdateHandler2 failed to instantiate

2013-03-13 Thread Jack Park
class=solr.DirectUpdateHandler2 lst name=defaults str name=update.chainharvest/str /lst /requestHandler The problem returns. It simply appears that I cannot declare a named requestHandler using that class. Jack On Tue, Mar 12, 2013 at 12:22 PM, Jack Park

solr.DirectUpdateHandler2 failed to instantiate

2013-03-12 Thread Jack Park
That messages gives great, but terrible google. Zillions of hits, mostly filled with very long log traces, and zero messages (that I could find) about what to do about it. I switched over to using that handler since it has an update log specified, and that's the only place I've found how to use

Re: solr.DirectUpdateHandler2 failed to instantiate

2013-03-12 Thread Jack Park
markrmil...@gmail.com wrote: There should be a stack trace - also, you shouldn't have to do anything special to use this class. It's the default and only truly supported implementation… - Mark On Mar 12, 2013, at 2:53 PM, Jack Park jackp...@topicquests.org wrote: That messages gives great

Re: Custom update handler?

2013-03-11 Thread Jack Park
that, and change the chain it points to. Upayavira On Mon, Mar 11, 2013, at 05:22 AM, Jack Park wrote: With 4.1, not in cloud configuration, I have a custom response handler chain which injects an additional handler for studying the documents as they come in. But, when I do partial updates on those

Re: Custom update handler? Some progress, new issue

2013-03-11 Thread Jack Park
into the bowels of update logs. What am I missing? Many thanks Jack On Mon, Mar 11, 2013 at 9:45 PM, Jack Park jackp...@topicquests.org wrote: Many thanks. Let me record here what I have tried. I have viewed: http://wiki.apache.org/solr/UpdateXmlMessages and this github project which

Custom update handler?

2013-03-10 Thread Jack Park
With 4.1, not in cloud configuration, I have a custom response handler chain which injects an additional handler for studying the documents as they come in. But, when I do partial updates on those documents, I don't want them to be studied again, so I created another version of the same chain, but

Re: Query with whitespace

2013-03-01 Thread Jack Park
I found a tiny notice about just using quotes; tried it in the admin query console and it works. e.g. label:car house would fetch any document for which the label field contained that phrase. Jack On Fri, Mar 1, 2013 at 9:17 AM, Shawn Heisey s...@elyograg.org wrote: On 3/1/2013 8:50 AM, vsl

Re: Document update question

2013-02-24 Thread Jack Park
and getting the query string right works! Many thanks for all the comments. Cheers Jack On Thu, Feb 21, 2013 at 5:45 PM, Shawn Heisey s...@elyograg.org wrote: On 2/21/2013 10:00 AM, Jack Park wrote: Interesting you should say that. Here is my solrj code: public Solr3Client(String

Re: Interesting issue with special characters in a string field value

2013-02-24 Thread Jack Park
Della Bitta Appinions 18 East 41st Street, 2nd Floor New York, NY 10017-6271 www.appinions.com Where Influence Isn’t a Game On Sun, Feb 24, 2013 at 12:29 AM, Jack Park jackp...@topicquests.org wrote: Ok. I have revisited this issue

Re: Interesting issue with special characters in a string field value

2013-02-23 Thread Jack Park
to be helping. Next up entails two issues: more robust testing of escaped characters, and trying to discover what is the best approach to dealing with characters that must be escaped to get past XML, e.g. '', '', and others. Many thanks Jack On Fri, Feb 22, 2013 at 2:44 PM, Jack Park jackp

Re: semantic search questions

2013-02-22 Thread Jack Park
Hi Vinay, Perhaps you could say more about what you are looking for? What use cases, say. Did you see the book _Taming Text_? Thanks Jack On Fri, Feb 22, 2013 at 8:48 AM, Vinay B, vybe3...@gmail.com wrote: Hi, A few questions, some specific to UIMA, others more general. 1. The SOLR/UIMA

Interesting issue with special characters in a string field value

2013-02-22 Thread Jack Park
I have a multi-value stored field called details I've been deliberately sending it values like Something to use as a source node If I fetch a document with that field at the admin query console, using XML, I get: arr name=details strSomething to use as a source node/str /arr If I

Re: Interesting issue with special characters in a string field value

2013-02-22 Thread Jack Park
Michael, I don't think you misunderstood. I will soon give a full response here, but am on the road at the moment. Many thanks Jack On Friday, February 22, 2013, Michael Della Bitta michael.della.bi...@appinions.com wrote: My mistake, I misunderstood the problem. Michael Della Bitta

Re: Document update question

2013-02-21 Thread Jack Park
, There was a bug for this fixed for 4.1 - which version are you on? I remember this b/c I was on 4.0 and had to upgrade for this exact reason. https://issues.apache.org/jira/browse/SOLR-4134 Tim On Wed, Feb 20, 2013 at 9:16 PM, Jack Park jackp...@topicquests.org wrote: From what I can read about

Re: Document update question

2013-02-21 Thread Jack Park
be: arr name=someMultiValuedField strVALU1/str strVALU2/str /arr On Thu, Feb 21, 2013 at 9:44 AM, Jack Park jackp...@topicquests.org wrote: I am using 4.1. I was not aware of that link. In the absence of being able to do partial updates to multi-valued fields, I just punted to delete

Re: If we Open Source our platform, would it be interesting to you?

2013-02-21 Thread Jack Park
Marcelo In some sense, it sounds like you are aiming at building a topic map of all your resources. Jack On Thu, Feb 21, 2013 at 11:54 AM, Marcelo Elias Del Valle marc...@s1mbi0se.com.br wrote: Hello David, First of all, thanks for answering! 2013/2/21 David Quarterman

Document update question

2013-02-20 Thread Jack Park
From what I can read about partial updates, it will only work for singleton fields where you can set them to something else, or multi-valued fields where you can add something. I am testing on 4.1 I ran some tests to prove to me that you cannot do anything else to a multi-valued field, like

Re: Introducing Solrstrap: A blazing fast tool for querying Solr in a Googleish fashion

2013-02-17 Thread Jack Park
Hi Fergus, Would it make sense to you to switch to the Apache 2 license so that your project can play nice in the apache ecosystem? Thanks Jack On Sun, Feb 17, 2013 at 6:25 AM, Fergus McDowall fergusmcdow...@gmail.com wrote: Erik Thanks for the great feedback. It fills me with joy to know

UpdateResponse agents in a cloud?

2013-02-10 Thread Jack Park
Say you have a dozen servers, one core each. Say you wish to add an agent reference inside the solrconfig update response descriptor. Would you do that for every core? Thanks in advance. Jack

Re: Solr and Unicode characters in strings

2013-01-22 Thread Jack Park
ElasticSearch Support http://sematext.com/ On Mon, Jan 21, 2013 at 3:06 PM, Jack Park jackp...@topicquests.org wrote: Here is a situation I now experience: What Solr has: economist and thus …@en What was sent

When a URL is a component of a query string's data?

2013-01-21 Thread Jack Park
There exists in my Solr index a document (several, actually) which harbor http:// URL values. Trying to find documents with a particular URL fails. The query is like this: ResourceURLPropertyType:http://someserver.org/something Fails due to the second : If I substitute %3a into that query, e.g.

Re: When a URL is a component of a query string's data?

2013-01-21 Thread Jack Park
-Original Message- From: Jack Park Sent: Monday, January 21, 2013 1:41 PM To: solr-user@lucene.apache.org Subject: When a URL is a component of a query string's data? There exists in my Solr index a document (several, actually) which harbor http:// URL values. Trying to find documents

Solr and Unicode characters in strings

2013-01-21 Thread Jack Park
Here is a situation I now experience: What Solr has: economist and thus …@en What was sent: economist and thus …@en where those are just snippets from what I sent up -- the ellipsis

Re: URL encoding problems

2013-01-17 Thread Jack Park
Similar thoughts: I used unit tests to explore that issue with SolrJ, originally encoding with ClientUtils; The returned results had | many places in the text, with no clear way to un-encode. I eventually ran some tests with no encoding at all, including strings like taghello goodbye/tag; such

Re: Question about dates and SolrJ

2013-01-13 Thread Jack Park
the zulu string back to a Date object as needed. Seems to be working fine now. Many thanks Jack On Sat, Jan 12, 2013 at 10:52 PM, Shawn Heisey s...@elyograg.org wrote: On 1/12/2013 7:51 PM, Jack Park wrote: My work engages SolrJ, with which I send documents off to Solr 4 which properly store

Question about dates and SolrJ

2013-01-12 Thread Jack Park
My work engages SolrJ, with which I send documents off to Solr 4 which properly store, as viewed in the admin panel, as this example: 2013-02-04T02:11:39.995Z When I retrieve a document with that date, I use the SolrDocument returned as a MapString,Object in which the date now looks like this:

Re: New user: version conflict for ....

2012-12-31 Thread Jack Park
Hi Chris, Your suspicion turned out to be spot on with a code glitch. The history of this has been due to a fairly weak understanding of how partial update works. The first code error was just a simple,stupid one in which I was not working against a current copy of the document. But, when I got

New user: version conflict for ....

2012-12-26 Thread Jack Park
I am running against a networked Solr4 installation -- but not using any of the cloud apparatus. I wish to update a document (Node) with new information. I send back as a partial update using SolrJ's add() command document id the new or updated field version number precisely as it was fetched