[ 
https://issues.apache.org/jira/browse/CONNECTORS-288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13216840#comment-13216840
 ] 

Karl Wright commented on CONNECTORS-288:
----------------------------------------

So when I added a System.out.println of the URL in ElasticSearchAction, I no 
longer get any errors; the check() response is "OK".  (That is wrong, by the 
way; it should return super.check() instead, which is "Connection working".)

The instrumented URL output looks like this:

    [junit] URL is 'http://localhost:9200/index/_optimize'
    [junit] URL is 'http://localhost:9200/index/_status'
   [junit] URL is 'http://localhost:9200/index/_optimize'
   [junit] URL is 'http://localhost:9200/index/_optimize'
   [junit] URL is 'http://localhost:9200/index/_optimize'

... followed by the 120000 ms timeout.

Some conclusions: (1) We should fix the check() method; (2) The fact that 
check() succeeds sometimes and fails others is quite disconcerting; clearly the 
connector is doing something pretty wrong.

I also looked more deeply at the code itself.  The addOrReplaceDocument() 
method uses a synchronizer to permit only one thread to index at a time.  This 
does not seem correct to me, and it is thus probable that the problem stems 
from improper understanding of the ManifoldCF threading model.  Each connector 
instance should be working with its own ElasticSearchIndex object and its own 
HttpClient method so that all of the threads can operate independently without 
collision.

                
> An ElasticSearch connector would be helpful
> -------------------------------------------
>
>                 Key: CONNECTORS-288
>                 URL: https://issues.apache.org/jira/browse/CONNECTORS-288
>             Project: ManifoldCF
>          Issue Type: New Feature
>    Affects Versions: ManifoldCF 0.5
>            Reporter: Piergiorgio Lucidi
>            Assignee: Piergiorgio Lucidi
>              Labels: elasticsearch
>             Fix For: ManifoldCF next
>
>         Attachments: manifold-elasticsearch-patch, 
> manifold-elasticsearch-patch, manifold-elasticsearch-patch, 
> manifold-elasticsearch-patch, manifold-elasticsearch-patch, 
> manifold-elasticsearch-patch, manifold-elasticsearch-patch, 
> manifold-elasticsearch-velocity-patch, manifoldcf-elasticsearch-project-patct
>
>   Original Estimate: 120h
>  Remaining Estimate: 120h
>
> An ElasticSearch connector could be very useful to spread the use of 
> ManifoldCF

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to