GitHub user ryandonglin opened a pull request:

    https://github.com/apache/lucene-solr/pull/170

    ReadTimeOut Exception occurred while building index

    Recently changed our cluster structure into one shard, three replicas, and 
the application is running on physical machine with 8G Xmx and Xms, the gc 
collector is CMS.
    While using HttpSolrClient to update our index, large amount of 
SocketTimeOut exceptions are occurred, and the replication full recovery 
becomes more frequent than ever (about 30 - 40 minutes per time), can any help 
can offered?
    Here is the exception log in my solr :
    ```
    java.net.SocketTimeoutException: Read timed out
        at java.net.SocketInputStream.socketRead0(Native Method)
        at java.net.SocketInputStream.read(SocketInputStream.java:152)
        at java.net.SocketInputStream.read(SocketInputStream.java:122)
        at 
org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
        at 
org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
        at 
org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
        at 
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
        at 
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
        at 
org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
        at 
org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
        at 
org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
        at 
org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
        at 
org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
        at 
org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
        at 
org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
        at 
org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
        at 
org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
        at 
org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.run(ConcurrentUpdateSolrClient.java:243)
        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:148)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
    ```

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/apache/lucene-solr branch_5x

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/lucene-solr/pull/170.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #170
    
----
commit 890497b08184688361d0e9c2dd0725d9117dca12
Author: Noble Paul <noble.p...@gmail.com>
Date:   2016-02-09T23:08:41Z

    SOLR-6594 Mark old schema APIs as deprecated

commit c3cdb84dc60afb265441ca67714685e6bd16ca22
Author: Mikhail Khludnev <m...@apache.org>
Date:   2016-02-09T23:36:31Z

    SOLR-8466: facet.method=uif for UnInvertedField faceting, like it was with 
'fc' earlier.

commit 2b2c516477f25effbd5fab39de4d33e576cb71d1
Author: nknize <nkn...@apache.org>
Date:   2016-02-10T03:51:30Z

    LUCENE-6997: refactor GeoPointField and query classes from lucene.spatial 
to lucene.spatial.geopoint package

commit 24f4025dc13aaaea7e89e349249e8819ba925279
Author: Shai Erera <sh...@apache.org>
Date:   2016-02-10T14:32:27Z

    SOLR-8621: fix solrconfig.xml under contrib and example

commit 0417cc41dc381fd036b0b67565fced3400779f62
Author: markrmiller <markrmil...@apache.org>
Date:   2016-02-10T15:27:43Z

    SOLR-7281: Improve 'best effort', we don't want this best effort method to 
easily throw exceptions.

commit f72c3e3a8ff4bdfc65764a180227c72c43429856
Author: Mark Robert Miller <markrmil...@apache.org>
Date:   2016-01-07T19:43:09Z

    SOLR-8450: Our HttpClient retry policy is too permissive.
    
    git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1723616 
13f79535-47bb-0310-9956-ffa450edef68

commit 42c17d225e2190893227ac6c710effda000afd98
Author: markrmiller <markrmil...@apache.org>
Date:   2016-02-10T15:36:43Z

    SOLR-8450: Add CHANGES entry.

commit 9da8846535bce8793b28a7d8816e10f3b1c5a912
Author: Mark Robert Miller <markrmil...@apache.org>
Date:   2016-01-15T13:53:15Z

    SOLR-8450: Fix debug logging.
    
    git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1724807 
13f79535-47bb-0310-9956-ffa450edef68

commit df004731dd3f2b1cd54af96f1aa1ead27fcf70b2
Author: Mark Robert Miller <markrmil...@apache.org>
Date:   2016-01-15T14:13:36Z

    SOLR-8450: Do not retry admin requests, they are not idempotent.
    
    git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1724813 
13f79535-47bb-0310-9956-ffa450edef68

commit 5d106503e7d4fbb8ac015c4fc723883f4ab7397e
Author: Christine Poerschke <cpoersc...@apache.org>
Date:   2016-02-09T21:13:46Z

    SOLR-8621: add IndexSchema arg to MergePolicyFactory constructor

commit bbbc90f58b2f336c4c51f4844cd0f63121c76ccf
Author: Christine Poerschke <cpoersc...@apache.org>
Date:   2016-02-10T21:22:17Z

    SOLR-8621: fix mergePolicyFacory vs. mergePolicyFactory typos in comments 
in solr/contrib and solr/example solrconfig.xml files.

commit 8b71a1baf5b9c6d16d24134cebeaf7f22333580d
Author: Mike McCandless <mikemcc...@apache.org>
Date:   2016-02-10T22:55:07Z

    LUCENE-6938: switch from svn to git

commit 14bd3c4d3859719f8c0d5d0edebbf17f36531b72
Author: Varun Thacker <varunthacker1...@gmail.com>
Date:   2016-02-11T00:28:13Z

    SOLR-8534: Fix SolrJ APIs to add async support

commit 6301fbb79073dbf06e32fe001d4d7d03e104ca6e
Author: Mike McCandless <mikemcc...@apache.org>
Date:   2016-02-11T08:53:48Z

    bump version for 5.5.0 release

commit bdef478737792afb861dc73ca33cb9a1775af4fe
Author: Christine Poerschke <cpoersc...@apache.org>
Date:   2016-02-10T22:19:06Z

    SOLR-8621: WrapperMergePolicyFactory logic tweaks
    
     * fix so that getMergePolicy() can now be called more than once
     * added WrapperMergePolicyFactoryTest.testUpgradeIndexMergePolicyFactory()
     * account for overlap between wrapping and wrapped setters (and disallow 
it)
    ** illustration:
       <mergePolicyFactory class="UpgradeMergePolicyFactory">
          <int name="noCFSRatio">0.24</int>
          <str name="wrapped.prefix">mergePolicy</str>
                          <str 
name="mergePolicy.class">TieredMergePolicyFactory</str>
                          <int name="mergePolicy.noCFSRatio">0.42</int>
       </mergePolicyFactory>
    ** implementation details: the wrapping MP's setter calls the wrapped MP's 
setter and in the current code the wrapping MP's value prevails i.e. the 0.24 
value in the illustration since the wrapped MP is constructed before the 
wrapping MP. an end-user however might reasonably assume that the wrapped MP's 
0.42 value will prevail. at best configuring the same setter twice within the 
same overall <mergePolicyFactory> element is ambiguous and so the code now 
disallows it.

commit 68ba7a5e5275d4ad10e4e8f70e223f9b61d70b54
Author: markrmiller <markrmil...@apache.org>
Date:   2016-02-11T13:36:30Z

    SOLR-8575: Revert while investigated. (reverted from commit 
482b40f841660820f633267a21e6df44aff55346)

commit a900e5fdf49037fc409f032f8cb2c72f11eb41e9
Author: Steve Rowe <sar...@apache.org>
Date:   2016-02-11T14:21:18Z

    LUCENE-6997: Maven config: build a spatial module test-jar, and add a test 
dependency on it to the sandbox module

commit 144ab5b107aeb7cf79d7e5fd97b8ff5d2ba2ba2f
Author: Mike McCandless <mikemcc...@apache.org>
Date:   2016-02-11T14:52:48Z

    LUCENE-6938: switch from svn to git

commit 3989732f70df3981ad0533929f64af3a8d30b92d
Author: Mike McCandless <mikemcc...@apache.org>
Date:   2016-02-11T14:59:13Z

    LUCENE-6938: fix buggy detection of dirty git checkout

commit 9fe6a8f20a8e6ff1fded6379a096db2e390c9675
Author: Mike McCandless <mikemcc...@apache.org>
Date:   2016-02-11T15:07:05Z

    LUCENE-6938: add TODO that we should also detect unpushed commits

commit af08166b91c901ea30256abe899e1dfcf00c7d75
Author: Mike McCandless <mikemcc...@apache.org>
Date:   2016-02-11T15:08:29Z

    fix usage line

commit 383c3ca976a3f216afbfdfbff02619a21dbd2d9c
Author: Mike McCandless <mikemcc...@apache.org>
Date:   2016-02-11T20:19:43Z

    LUCENE-6938: fix some places in smoke tester to accept git commit hash 
instead of svn revison

commit b2e83b6788b5b3c9ee6cf13be1cddec7f21014f4
Author: Christine Poerschke <cpoersc...@apache.org>
Date:   2016-02-11T17:05:17Z

    SOLR-8621: factor out protected abstract 
WrapperMergePolicyFactory.getMergePolicyInstance method
    
    Here in SOLR-8621:
     * UpgradeIndexMergePolicyFactory extends WrapperMergePolicyFactory
     * (WrapperMergePolicyFactoryTest's) DefaultingWrapperMergePolicyFactory 
extends WrapperMergePolicyFactory
    
    Elsewhere in SOLR-5730:
     * SortingMergePolicyFactory will extend WrapperMergePolicyFactory

commit d76be85a42e58ff906342c1283b3d4608d59df36
Author: Christine Poerschke <cpoersc...@apache.org>
Date:   2016-02-11T17:29:34Z

    SOLR-8621: add (test-framework) RandomForceMergePolicyFactory for existing 
(test-framework) RandomForceMergePolicy

commit a267fa729bc62267173760ca5a05e912f7089fa9
Author: Christine Poerschke <cpoersc...@apache.org>
Date:   2016-02-11T20:41:35Z

    SOLR-8621: solrconfig.xml in solr/server/solr/configsets and 
test-files/solr/configsets/bad-mergepolicy now also use <mergePolicyFactory> 
instead of <mergePolicy>

commit 8488cc7ba2188a0d8212af3b876090541cc9fb0a
Author: Christine Poerschke <cpoersc...@apache.org>
Date:   2016-02-12T19:04:45Z

    SOLR-8621: SolrIndexConfig.toMap() fix to distinguish mergePolicyInfo and 
mergePolicyFactoryInfo, associated SolrIndexConfigTest and TestConfig tweaks.

commit 805eeb932a872205cd6b43ab1a158c75ca939ea7
Author: Christine Poerschke <cpoersc...@apache.org>
Date:   2016-02-12T20:16:02Z

    SOLR-5730: Make Lucene's SortingMergePolicy and 
EarlyTerminatingSortingCollector configurable in Solr.
    
    Cherry-picked commit 6777790 from master and resolved merge conflicts for
    solr/core/src/java/org/apache/solr/search/Query(Command|Result).java and 
SolrIndexSearcher.java
    (the former had previously been factored out from the latter in master but 
not branch_5x).

commit a48d85fdc7d62011c2514748b963accc3c102f1c
Author: Christine Poerschke <cpoersc...@apache.org>
Date:   2016-02-12T23:41:30Z

    SOLR-5730: rename TestSegmentTerminateEarlyState to 
SegmentTerminateEarlyTestState

commit b4811f63bc2f1af174886b379a628391fbcf2012
Author: Uwe Schindler <uschind...@apache.org>
Date:   2016-02-13T12:53:17Z

    SOLR-5730: Workaround non-working javadocs link (cannot refer to classes 
from packages in other modules that already exist in lucene-core.jar)

commit 7abc0c6de6ae51f0b3b805c8d9d83185e78bff69
Author: Uwe Schindler <uschind...@apache.org>
Date:   2016-02-13T17:02:57Z

    LUCENE-7027: Fixed NumericTermAttribute to not throw 
IllegalArgumentException after NumericTokenStream was exhausted
    
    # Conflicts:
    #   lucene/core/src/java/org/apache/lucene/analysis/NumericTokenStream.java
    #   
lucene/core/src/test/org/apache/lucene/analysis/TestNumericTokenStream.java

----


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to