[
https://issues.apache.org/jira/browse/GORA-426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14633091#comment-14633091
]
ASF GitHub Bot commented on GORA-426:
-------------------------------------
Github user AlexanderYastrebov commented on the pull request:
https://github.com/apache/gora/pull/27#issuecomment-122774999
Hello @drazzib
My point is following:
1. If you have mean page parse time (in nutch) greater than 6 seconds, you
will end up with closed cursor and failed parse run (because of default 100
batchSize and 10 min cursor timeout).
2. There is no evidence at all (neither in API, not in docs) for lib user
that cursor may be closed unexpectedly while reading result.
3. (MongoDB)Result has close() method and with proper use there will leak
no cursors.
4. One more option to configure is worse than no option at all.
> MongoDB cursor timeout on long running parse job
> ------------------------------------------------
>
> Key: GORA-426
> URL: https://issues.apache.org/jira/browse/GORA-426
> Project: Apache Gora
> Issue Type: Bug
> Components: gora-mongodb
> Affects Versions: 0.6
> Reporter: Alexander Yastrebov
> Assignee: Damien Raude-Morvan
> Labels: performance
>
> On long running parse job mongodb server may kill cursor by timeout (10
> minutes default).
> We propose to disable server cursor timeout.
> See pull request
> https://github.com/apache/gora/pull/27
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
