[jira] [Commented] (SOLR-14385) Add shard name and collection name to split histogram logs

2020-04-07 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17077719#comment-17077719 ] Yonik Seeley commented on SOLR-14385: - Seems like? I just tried running SplitByPrefixTest on master,

[jira] [Commented] (SOLR-14391) Remove getDocSet's manual doc collection logic; remove ScoreFilter

2020-04-06 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17076469#comment-17076469 ] Yonik Seeley commented on SOLR-14391: - bq. Why? Given that this dates back to Lucene 3.2 or so, it

[jira] [Updated] (SOLR-14275) Policy calculations are very slow for large clusters and large operations

2020-03-25 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yonik Seeley updated SOLR-14275: Labels: scaling (was: ) > Policy calculations are very slow for large clusters and large

[jira] [Updated] (SOLR-13951) Avoid replica state updates to state.json

2020-03-25 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-13951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yonik Seeley updated SOLR-13951: Issue Type: Improvement (was: Bug) Labels: scaling (was: ) > Avoid replica state

[jira] [Updated] (SOLR-13951) Avoid replica state updates to state.json

2020-03-25 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-13951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yonik Seeley updated SOLR-13951: Component/s: SolrCloud > Avoid replica state updates to state.json >

[jira] [Commented] (SOLR-14007) Difference response format for percentile aggregation

2020-03-09 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055476#comment-17055476 ] Yonik Seeley commented on SOLR-14007: - .bq Even if JSON percentile doesn't use NamedList, response

[jira] [Commented] (SOLR-11725) json.facet's stddev() function should be changed to use the "Corrected sample stddev" formula

2020-03-06 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-11725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17053842#comment-17053842 ] Yonik Seeley commented on SOLR-11725: - +1 to commit > json.facet's stddev() function should be

[jira] [Commented] (SOLR-14278) data loss during live shard split if leader dies

2020-02-28 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17048007#comment-17048007 ] Yonik Seeley commented on SOLR-14278: - I'm going to keep this issue open since I looped this test for

[jira] [Updated] (SOLR-13813) Shared storage online split support

2020-02-28 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-13813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yonik Seeley updated SOLR-13813: Attachment: SOLR-13813.patch Status: Open (was: Open) Attaching updated patch with fixed

[jira] [Commented] (SOLR-14278) data loss during live shard split if leader dies

2020-02-26 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17045774#comment-17045774 ] Yonik Seeley commented on SOLR-14278: - Unfortunately (or fortunately, depending on how you look at

[jira] [Commented] (SOLR-14278) data loss during live shard split if leader dies

2020-02-24 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043780#comment-17043780 ] Yonik Seeley commented on SOLR-14278: - Testing update: I let the test loop overnight with split shard

[jira] [Created] (SOLR-14278) data loss during live shard split if leader dies

2020-02-22 Thread Yonik Seeley (Jira)
Yonik Seeley created SOLR-14278: --- Summary: data loss during live shard split if leader dies Key: SOLR-14278 URL: https://issues.apache.org/jira/browse/SOLR-14278 Project: Solr Issue Type: Bug

[jira] [Updated] (SOLR-13813) Shared storage online split support

2020-02-19 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-13813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yonik Seeley updated SOLR-13813: Attachment: SOLR-13813.patch Status: Open (was: Open) > Shared storage online split

[jira] [Commented] (SOLR-13813) Shared storage online split support

2020-02-19 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-13813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17040279#comment-17040279 ] Yonik Seeley commented on SOLR-13813: - Attaching test in progress for live shard splitting with a

[jira] [Resolved] (SOLR-14058) IOOBE in PeerSync

2020-02-11 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yonik Seeley resolved SOLR-14058. - Fix Version/s: 8.5 Resolution: Fixed > IOOBE in PeerSync > - > >

[jira] [Updated] (SOLR-14058) IOOBE in PeerSync

2020-02-11 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yonik Seeley updated SOLR-14058: Affects Version/s: 6.2 > IOOBE in PeerSync > - > > Key: SOLR-14058

[jira] [Commented] (SOLR-14058) IOOBE in PeerSync

2020-02-11 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17034722#comment-17034722 ] Yonik Seeley commented on SOLR-14058: - After some manual git bisecting, I think this bug entered the

[jira] [Commented] (SOLR-11725) json.facet's stddev() function should be changed to use the "Corrected sample stddev" formula

2020-02-05 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-11725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031026#comment-17031026 ] Yonik Seeley commented on SOLR-11725: - bq. No changes have been done with regards to sample size of 1

[jira] [Updated] (SOLR-14058) IOOBE in PeerSync

2020-02-05 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yonik Seeley updated SOLR-14058: Summary: IOOBE in PeerSync (was: AIOOBE in PeerSync) > IOOBE in PeerSync > - > >

[jira] [Updated] (SOLR-14058) AIOOBE in PeerSync

2020-02-05 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yonik Seeley updated SOLR-14058: Attachment: SOLR-14058.patch Affects Version/s: master (9.0) Assignee:

[jira] [Resolved] (SOLR-14134) Clear shared core's concurrency cache

2020-01-10 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yonik Seeley resolved SOLR-14134. - Resolution: Fixed > Clear shared core's concurrency cache >

[jira] [Resolved] (SOLR-13932) Review directory locking and Blob interactions

2020-01-10 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-13932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yonik Seeley resolved SOLR-13932. - Resolution: Fixed > Review directory locking and Blob interactions >

[jira] [Commented] (SOLR-13101) Shared storage support in SolrCloud

2019-12-22 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-13101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17001982#comment-17001982 ] Yonik Seeley commented on SOLR-13101: - bq. Is there any reason why wee can't release this as a third

[jira] [Commented] (SOLR-14098) inconsistent replica state treatment in RequestApplyUpdatesOp

2019-12-16 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16997464#comment-16997464 ] Yonik Seeley commented on SOLR-14098: - Tracing it back, it looks like this bug has been around since

[jira] [Created] (SOLR-14098) inconsistent replica state treatment in RequestApplyUpdatesOp

2019-12-16 Thread Yonik Seeley (Jira)
Yonik Seeley created SOLR-14098: --- Summary: inconsistent replica state treatment in RequestApplyUpdatesOp Key: SOLR-14098 URL: https://issues.apache.org/jira/browse/SOLR-14098 Project: Solr

[jira] [Commented] (SOLR-13884) Concurrent collection creation leads to multiple replicas placed on same node

2019-12-14 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-13884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16996436#comment-16996436 ] Yonik Seeley commented on SOLR-13884: - Gah... apologies, these commits were just lying around in my

[jira] [Resolved] (SOLR-14079) SPLITSHARD splitByPrefix doesn't work in async mode

2019-12-13 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yonik Seeley resolved SOLR-14079. - Resolution: Fixed > SPLITSHARD splitByPrefix doesn't work in async mode >

[jira] [Commented] (SOLR-14079) SPLITSHARD splitByPrefix doesn't work in async mode

2019-12-13 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16995589#comment-16995589 ] Yonik Seeley commented on SOLR-14079: - bq. The patch is using different but constant async id's for

[jira] [Commented] (SOLR-14079) SPLITSHARD splitByPrefix doesn't work in async mode

2019-12-12 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16995262#comment-16995262 ] Yonik Seeley commented on SOLR-14079: - Fix attached, targeted for 8.4.  Thanks to my colleagues who

[jira] [Updated] (SOLR-14079) SPLITSHARD splitByPrefix doesn't work in async mode

2019-12-12 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yonik Seeley updated SOLR-14079: Attachment: SOLR-14079.patch Status: Open (was: Open) > SPLITSHARD splitByPrefix doesn't

[jira] [Updated] (SOLR-14079) SPLITSHARD splitByPrefix doesn't work in async mode

2019-12-12 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yonik Seeley updated SOLR-14079: Assignee: Yonik Seeley Status: Open (was: Open) > SPLITSHARD splitByPrefix doesn't work in

[jira] [Updated] (SOLR-14079) SPLITSHARD splitByPrefix doesn't work in async mode

2019-12-12 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yonik Seeley updated SOLR-14079: Fix Version/s: 8.4 Affects Version/s: 8.3 > SPLITSHARD splitByPrefix doesn't work in async

[jira] [Created] (SOLR-14079) SPLITSHARD splitByPrefix doesn't work in async mode

2019-12-12 Thread Yonik Seeley (Jira)
Yonik Seeley created SOLR-14079: --- Summary: SPLITSHARD splitByPrefix doesn't work in async mode Key: SOLR-14079 URL: https://issues.apache.org/jira/browse/SOLR-14079 Project: Solr Issue Type:

[jira] [Commented] (SOLR-14058) AIOOBE in PeerSync

2019-12-11 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16993852#comment-16993852 ] Yonik Seeley commented on SOLR-14058: - Here's our stacktrace: {code} 2019-12-11 19:16:35.028 ERROR

[jira] [Created] (SOLR-14058) AIOOBE in PeerSync

2019-12-11 Thread Yonik Seeley (Jira)
Yonik Seeley created SOLR-14058: --- Summary: AIOOBE in PeerSync Key: SOLR-14058 URL: https://issues.apache.org/jira/browse/SOLR-14058 Project: Solr Issue Type: Bug Security Level: Public

[jira] [Commented] (SOLR-13978) Remove bloat from default configset

2019-12-10 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-13978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16993201#comment-16993201 ] Yonik Seeley commented on SOLR-13978: - bq. I can fix this, if we agree to remove /query. /query has

[jira] [Commented] (SOLR-14039) SOLR-13987 may have broken /select handler?

2019-12-09 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16991941#comment-16991941 ] Yonik Seeley commented on SOLR-14039: - If it's truly that commit, then it has to be the jetty.xml

[jira] [Commented] (SOLR-14013) javabin performance regressions

2019-12-08 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16991041#comment-16991041 ] Yonik Seeley commented on SOLR-14013: - Please don't commit that huge JSON file... a doc matching that

[jira] [Updated] (SOLR-14013) javabin performance regressions

2019-12-08 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yonik Seeley updated SOLR-14013: Attachment: TestQuerySpeed.java Status: Open (was: Open) Here's the "benchmark" program I

[jira] [Updated] (SOLR-14013) javabin performance regressions

2019-12-08 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yonik Seeley updated SOLR-14013: Status: Open (was: Open) > javabin performance regressions > --- > >

[jira] [Commented] (SOLR-14013) javabin performance regressions

2019-12-08 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16991014#comment-16991014 ] Yonik Seeley commented on SOLR-14013: - I worked up a quick-n-dirty patch to disable the charseq

[jira] [Comment Edited] (SOLR-14013) javabin performance regressions

2019-12-08 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990926#comment-16990926 ] Yonik Seeley edited comment on SOLR-14013 at 12/8/19 5:26 PM: -- Those

[jira] [Commented] (SOLR-14013) javabin performance regressions

2019-12-08 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990926#comment-16990926 ] Yonik Seeley commented on SOLR-14013: - Those benchmarks look like they are testing different

[jira] [Commented] (SOLR-14013) javabin performance regressions

2019-12-07 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990579#comment-16990579 ] Yonik Seeley commented on SOLR-14013: - Even without the O(N^2) bug, which would be that hard to work

[jira] [Commented] (SOLR-14013) javabin performance regressions

2019-12-07 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990572#comment-16990572 ] Yonik Seeley commented on SOLR-14013: - OK, found the primary issue it's an N^2 bug. h3.

[jira] [Commented] (SOLR-13990) Switch out woodstox-core-asl with aalto-xml and upgrade woodstox stax-2 API

2019-12-06 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-13990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990209#comment-16990209 ] Yonik Seeley commented on SOLR-13990: - We would also need to understand what behavior we actually

[jira] [Commented] (SOLR-12983) JavabinLoader should avoid creating String Objects and create UTF8CharSequence fields from byte[]

2019-12-06 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-12983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989972#comment-16989972 ] Yonik Seeley commented on SOLR-12983: - Folks, in the future we really need more description about

[jira] [Commented] (SOLR-14013) javabin performance regressions

2019-12-06 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989860#comment-16989860 ] Yonik Seeley commented on SOLR-14013: - Just an update... I tried speeding things up by skipping most

[jira] [Comment Edited] (SOLR-14013) javabin performance regressions

2019-12-05 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989121#comment-16989121 ] Yonik Seeley edited comment on SOLR-14013 at 12/5/19 8:07 PM: -- I did some

[jira] [Commented] (SOLR-14013) javabin performance regressions

2019-12-05 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989121#comment-16989121 ] Yonik Seeley commented on SOLR-14013: - I did some digging... the current code is certainly more

[jira] [Comment Edited] (SOLR-13963) JavaBinCodec has concurrent modification of CharArr resulting in corrupt intranode updates

2019-12-04 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-13963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987980#comment-16987980 ] Yonik Seeley edited comment on SOLR-13963 at 12/4/19 7:19 PM: -- Thank you for

[jira] [Commented] (SOLR-13990) Switch out woodstox-core-asl with aalto-xml and upgrade woodstox stax-2 API

2019-12-04 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-13990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16988000#comment-16988000 ] Yonik Seeley commented on SOLR-13990: - Hopefully the issues pointed at have been resolved? FWIW, the

[jira] [Assigned] (SOLR-14013) javabin performance regressions

2019-12-04 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yonik Seeley reassigned SOLR-14013: --- Assignee: Yonik Seeley > javabin performance regressions > ---

[jira] [Commented] (SOLR-14013) javabin performance regressions

2019-12-04 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987986#comment-16987986 ] Yonik Seeley commented on SOLR-14013: - The original reporter suspects that this may be caused by

[jira] [Created] (SOLR-14013) javabin performance regressions

2019-12-04 Thread Yonik Seeley (Jira)
Yonik Seeley created SOLR-14013: --- Summary: javabin performance regressions Key: SOLR-14013 URL: https://issues.apache.org/jira/browse/SOLR-14013 Project: Solr Issue Type: Bug Security

[jira] [Commented] (SOLR-13963) JavaBinCodec has concurrent modification of CharArr resulting in corrupt intranode updates

2019-12-04 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-13963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987980#comment-16987980 ] Yonik Seeley commented on SOLR-13963: - Thank you for bringing this to our attention [~rrockenbaugh],

[jira] [Updated] (SOLR-13963) JavaBinCodec has concurrent modification of CharArr resulting in corrupt intranode updates

2019-11-26 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-13963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yonik Seeley updated SOLR-13963: Affects Version/s: (was: 8.3) 8.1 > JavaBinCodec has concurrent

[jira] [Commented] (SOLR-13963) JavaBinCodec has concurrent modification of CharArr resulting in corrupt intranode updates

2019-11-26 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-13963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16982440#comment-16982440 ] Yonik Seeley commented on SOLR-13963: - Folks, when we know what releases are affected (esp for a bug

[jira] [Resolved] (SOLR-13955) SHARED replicas can recover on clean disk

2019-11-22 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-13955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yonik Seeley resolved SOLR-13955. - Resolution: Fixed Thanks Bilal! Context for others: I committed this one quickly to the feature

[jira] [Commented] (SOLR-13813) Shared storage online split support

2019-11-22 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-13813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16980307#comment-16980307 ] Yonik Seeley commented on SOLR-13813: - If I ignore indexing failures during the split, then the test

[jira] [Commented] (SOLR-13945) SPLITSHARD data loss due to "rollback"

2019-11-20 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-13945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16978520#comment-16978520 ] Yonik Seeley commented on SOLR-13945: - It would be great if we could capture what is currently

[jira] [Commented] (SOLR-13932) Review directory locking for Blob interactions

2019-11-19 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-13932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16977571#comment-16977571 ] Yonik Seeley commented on SOLR-13932: - Yep, sounds right. > Review directory locking for Blob

[jira] [Commented] (LUCENE-9027) SIMD-based decoding of postings lists

2019-11-13 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16973707#comment-16973707 ] Yonik Seeley commented on LUCENE-9027: -- Yep, going little-endian is the right choice. big-endian

[jira] [Commented] (SOLR-13898) Non-atomic use of SolrCache get / put

2019-11-12 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-13898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16972688#comment-16972688 ] Yonik Seeley commented on SOLR-13898: - Using computeIfAbsent makes total sense for something like

[jira] [Commented] (SOLR-13813) Shared storage online split support

2019-11-10 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-13813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16971240#comment-16971240 ] Yonik Seeley commented on SOLR-13813: - OK, so I re-added the live split test, updated to reflect the

[jira] [Comment Edited] (SOLR-13884) Concurrent collection creation leads to multiple replicas placed on same node

2019-11-04 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-13884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16966805#comment-16966805 ] Yonik Seeley edited comment on SOLR-13884 at 11/4/19 4:56 PM: -- OK, I updated

[jira] [Updated] (SOLR-13884) Concurrent collection creation leads to multiple replicas placed on same node

2019-11-04 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-13884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yonik Seeley updated SOLR-13884: Description: When multiple collection creations are done concurrently with a collection-level

[jira] [Updated] (SOLR-13891) Default replica placement is random

2019-11-04 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-13891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yonik Seeley updated SOLR-13891: Environment: (was: By default, our current replica placement is effectively random instead of

[jira] [Updated] (SOLR-13891) Default replica placement is random

2019-11-04 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-13891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yonik Seeley updated SOLR-13891: Description: By default, our current replica placement is effectively random instead of spreading

[jira] [Created] (SOLR-13891) Default replica placement is random

2019-11-04 Thread Yonik Seeley (Jira)
Yonik Seeley created SOLR-13891: --- Summary: Default replica placement is random Key: SOLR-13891 URL: https://issues.apache.org/jira/browse/SOLR-13891 Project: Solr Issue Type: Bug

[jira] [Comment Edited] (SOLR-13884) Concurrent collection creation leads to unbalanced cluster

2019-11-04 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-13884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16966805#comment-16966805 ] Yonik Seeley edited comment on SOLR-13884 at 11/4/19 4:34 PM: -- OK, I updated

[jira] [Commented] (SOLR-13884) Concurrent collection creation leads to unbalanced cluster

2019-11-04 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-13884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16966805#comment-16966805 ] Yonik Seeley commented on SOLR-13884: - OK, I updated the test to reproduce another serious bug with

[jira] [Commented] (SOLR-13884) Concurrent collection creation leads to unbalanced cluster

2019-10-31 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-13884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964155#comment-16964155 ] Yonik Seeley commented on SOLR-13884: - Just an update on this... when I use an explicit

[jira] [Commented] (SOLR-13101) Shared storage support in SolrCloud

2019-10-30 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-13101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16963450#comment-16963450 ] Yonik Seeley commented on SOLR-13101: - The branch

[jira] [Commented] (SOLR-13884) Concurrent collection creation leads to unbalanced cluster

2019-10-30 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-13884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16963368#comment-16963368 ] Yonik Seeley commented on SOLR-13884: - This may not be a concurrency issue I just tried

[jira] [Commented] (SOLR-13884) Concurrent collection creation leads to unbalanced cluster

2019-10-30 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-13884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16963353#comment-16963353 ] Yonik Seeley commented on SOLR-13884: - See #987 for a test. When I run 20 concurrent single replica

[jira] [Issue Comment Deleted] (SOLR-13884) Concurrent collection creation leads to unbalanced cluster

2019-10-30 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-13884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yonik Seeley updated SOLR-13884: Comment: was deleted (was: As [~dsmiley] noted, it seems like this issue should have been fixed by

[jira] [Commented] (SOLR-13884) Concurrent collection creation leads to unbalanced cluster

2019-10-30 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-13884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16963346#comment-16963346 ] Yonik Seeley commented on SOLR-13884: - As [~dsmiley] noted, it seems like this issue should have been

[jira] [Created] (SOLR-13884) Concurrent collection creation leads to unbalanced cluster

2019-10-30 Thread Yonik Seeley (Jira)
Yonik Seeley created SOLR-13884: --- Summary: Concurrent collection creation leads to unbalanced cluster Key: SOLR-13884 URL: https://issues.apache.org/jira/browse/SOLR-13884 Project: Solr Issue

[jira] [Resolved] (SOLR-13815) Live split can lose data

2019-10-13 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-13815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yonik Seeley resolved SOLR-13815. - Resolution: Fixed > Live split can lose data > > > Key:

[jira] [Assigned] (SOLR-13815) Live split can lose data

2019-10-13 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-13815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yonik Seeley reassigned SOLR-13815: --- Assignee: Yonik Seeley > Live split can lose data > > >

[jira] [Commented] (SOLR-13815) Live split can lose data

2019-10-12 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-13815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950132#comment-16950132 ] Yonik Seeley commented on SOLR-13815: - bq. the shard state is coming from the clusterstate which is

[jira] [Updated] (SOLR-13815) Live split can lose data

2019-10-11 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-13815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yonik Seeley updated SOLR-13815: Fix Version/s: 8.3 > Live split can lose data > > > Key:

[jira] [Created] (SOLR-13833) setupRequest normally called twice

2019-10-09 Thread Yonik Seeley (Jira)
Yonik Seeley created SOLR-13833: --- Summary: setupRequest normally called twice Key: SOLR-13833 URL: https://issues.apache.org/jira/browse/SOLR-13833 Project: Solr Issue Type: Bug Security

[jira] [Commented] (SOLR-13815) Live split can lose data

2019-10-09 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-13815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16947933#comment-16947933 ] Yonik Seeley commented on SOLR-13815: - OK, I've verified what the race is (or rather what this test

[jira] [Commented] (SOLR-13815) Live split can lose data

2019-10-09 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-13815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16947902#comment-16947902 ] Yonik Seeley commented on SOLR-13815: - Actually, doc_38 and doc_40 don't look the same. When

[jira] [Commented] (SOLR-13815) Live split can lose data

2019-10-08 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-13815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16946917#comment-16946917 ] Yonik Seeley commented on SOLR-13815: - I dug into

[jira] [Updated] (SOLR-13815) Live split can lose data

2019-10-08 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-13815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yonik Seeley updated SOLR-13815: Attachment: fail.191004_053129 > Live split can lose data > > >

[jira] [Commented] (SOLR-13815) Live split can lose data

2019-10-04 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-13815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944569#comment-16944569 ] Yonik Seeley commented on SOLR-13815: - OK, I updated the PR with code to show what document is

[jira] [Updated] (SOLR-13815) Live split can lose data

2019-10-04 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-13815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yonik Seeley updated SOLR-13815: Attachment: fail.191004_093307 > Live split can lose data > > >

[jira] [Commented] (SOLR-13815) Live split can lose data

2019-10-03 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-13815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943695#comment-16943695 ] Yonik Seeley commented on SOLR-13815: - OK, I've confirmed that this test sometimes fails on master

[jira] [Created] (SOLR-13815) Live split can lose data

2019-10-03 Thread Yonik Seeley (Jira)
Yonik Seeley created SOLR-13815: --- Summary: Live split can lose data Key: SOLR-13815 URL: https://issues.apache.org/jira/browse/SOLR-13815 Project: Solr Issue Type: Bug Security Level:

[jira] [Commented] (SOLR-13813) Shared storage online split support

2019-10-02 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-13813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943070#comment-16943070 ] Yonik Seeley commented on SOLR-13813: - The other notable thing is that I *thought* the test was solid

[jira] [Commented] (SOLR-13813) Shared storage online split support

2019-10-02 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-13813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943057#comment-16943057 ] Yonik Seeley commented on SOLR-13813: - This PR ( https://github.com/apache/lucene-solr/pull/918 )

[jira] [Created] (SOLR-13813) Shared storage online split support

2019-10-02 Thread Yonik Seeley (Jira)
Yonik Seeley created SOLR-13813: --- Summary: Shared storage online split support Key: SOLR-13813 URL: https://issues.apache.org/jira/browse/SOLR-13813 Project: Solr Issue Type: Sub-task

[jira] [Comment Edited] (SOLR-13101) Shared storage support in SolrCloud

2019-10-02 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-13101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16942890#comment-16942890 ] Yonik Seeley edited comment on SOLR-13101 at 10/2/19 3:10 PM: -- bq. How far

[jira] [Commented] (SOLR-13101) Shared storage support in SolrCloud

2019-10-02 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-13101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16942890#comment-16942890 ] Yonik Seeley commented on SOLR-13101: - bq. How far do you think is it complete? Do you forsee a lot

[jira] [Comment Edited] (SOLR-13101) Shared storage support in SolrCloud

2019-09-30 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-13101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16939809#comment-16939809 ] Yonik Seeley edited comment on SOLR-13101 at 9/30/19 5:21 PM: -- I plan on

[jira] [Commented] (SOLR-13101) Shared storage support in SolrCloud

2019-09-27 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-13101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16939809#comment-16939809 ] Yonik Seeley commented on SOLR-13101: - I plan on creating a branch jira/SOLR-13101 soon for future

[jira] [Resolved] (SOLR-13399) compositeId support for shard splitting

2019-09-27 Thread Yonik Seeley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-13399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yonik Seeley resolved SOLR-13399. - Resolution: Fixed > compositeId support for shard splitting >

  1   2   >