RE: Policeman Jenkins lost it's "/view/Lucene-Solr/"
: it seem to got lost on last Update. I was on vacation last week, so missed your mail. : : I added it back, thanks! ... also: based on the recent jenkins emails it looks like your disk is full? (welcome back!) : Uwe : : - : Uwe Schindler : Achterdiek 19, D-28357 Bremen : https://www.thetaphi.de : eMail: u...@thetaphi.de : : > -Original Message- : > From: Chris Hostetter : > Sent: Monday, July 13, 2020 6:05 PM : > To: Uwe Schindler : > Cc: Lucene Dev : > Subject: Re: Policeman Jenkins lost it's "/view/Lucene-Solr/" : > : > : > Uwe? ... you around? can you please re-add this jenkins view? : > : > : Date: Thu, 2 Jul 2020 17:36:25 -0700 (MST) : > : From: Chris Hostetter : > : To: Uwe Schindler : > : Cc: Lucene Dev : > : Subject: Policeman Jenkins lost it's "/view/Lucene-Solr/" : > : : > : : > : Uwe: the "/view/Lucene-Solr/" View that my reports were using to restrict the : > : jobs it checked on your jenkins server (to only lucene/solr jobs) seems to : > : have been removed... : > : : > : https://jenkins.thetaphi.de/view/Lucene-Solr/ : > : : > : ...as a result, my reports evidently haven't detected any failures (or : > : successes) from your jenkins jobs in a while... : > : : > : http://fucit.org/solr-jenkins-reports/ : > : : > : ...can you please add that view back? : > : : > : : > : -Hoss : > : http://www.lucidworks.com/ : > : : > : > -Hoss : > http://www.lucidworks.com/ : : -Hoss http://www.lucidworks.com/ - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
RE: Policeman Jenkins lost it's "/view/Lucene-Solr/"
Hi, it seem to got lost on last Update. I was on vacation last week, so missed your mail. I added it back, Uwe - Uwe Schindler Achterdiek 19, D-28357 Bremen https://www.thetaphi.de eMail: u...@thetaphi.de > -Original Message- > From: Chris Hostetter > Sent: Monday, July 13, 2020 6:05 PM > To: Uwe Schindler > Cc: Lucene Dev > Subject: Re: Policeman Jenkins lost it's "/view/Lucene-Solr/" > > > Uwe? ... you around? can you please re-add this jenkins view? > > : Date: Thu, 2 Jul 2020 17:36:25 -0700 (MST) > : From: Chris Hostetter > : To: Uwe Schindler > : Cc: Lucene Dev > : Subject: Policeman Jenkins lost it's "/view/Lucene-Solr/" > : > : > : Uwe: the "/view/Lucene-Solr/" View that my reports were using to restrict > the > : jobs it checked on your jenkins server (to only lucene/solr jobs) seems to > : have been removed... > : > : https://jenkins.thetaphi.de/view/Lucene-Solr/ > : > : ...as a result, my reports evidently haven't detected any failures (or > : successes) from your jenkins jobs in a while... > : > : http://fucit.org/solr-jenkins-reports/ > : > : ...can you please add that view back? > : > : > : -Hoss > : http://www.lucidworks.com/ > : > > -Hoss > http://www.lucidworks.com/ - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
Re: Policeman Jenkins lost it's "/view/Lucene-Solr/"
Uwe? ... you around? can you please re-add this jenkins view? : Date: Thu, 2 Jul 2020 17:36:25 -0700 (MST) : From: Chris Hostetter : To: Uwe Schindler : Cc: Lucene Dev : Subject: Policeman Jenkins lost it's "/view/Lucene-Solr/" : : : Uwe: the "/view/Lucene-Solr/" View that my reports were using to restrict the : jobs it checked on your jenkins server (to only lucene/solr jobs) seems to : have been removed... : : https://jenkins.thetaphi.de/view/Lucene-Solr/ : : ...as a result, my reports evidently haven't detected any failures (or : successes) from your jenkins jobs in a while... : : http://fucit.org/solr-jenkins-reports/ : : ...can you please add that view back? : : : -Hoss : http://www.lucidworks.com/ : -Hoss http://www.lucidworks.com/ - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
Re: [Data Import Handler] proposal: make FileListEntityProcessor streaming
Thank you very much. I opened PRs to both projects. Regards, Marco Il giorno ven 10 lug 2020 alle ore 05:04 Noble Paul ha scritto: > The project will go live anytime from now. It means a user can use it > on any release newer than Solr 8.6 . Even if you provide a fix in the > current 8.x branch, it will not be available before Solr 8.7 release. > OTOH, DIH plugin will have bug fix releases independent of Solr > releases and every user will be able to upgrade their plugin without > upgrading their Solr. > > So, please give PRs to both the external plugin and to Solr > > On Fri, Jul 10, 2020 at 2:58 AM Marco Bolis wrote: > > > > I see. > > How is the transition going to work Eric? > > I understand the community supported project is going to take over from > Solr 9.0, is that correct? Is DIH code on the Lucene side going to freeze > soon? > > Thank you for the heads up. > > > > Regards, > > Marco > > > > > > Il giorno gio 9 lug 2020 alle ore 18:49 Eric Pugh < > ep...@opensourceconnections.com> ha scritto: > >> > >> Another thought…. > >> > >> Since DIH is moving to a community supported ( > https://github.com/rohitbemax/dataimporthandler) plugin for Solr, maybe > you want to focus your efforts on that project? > >> > >> One of the reasons for moving DIH into it’s own plugin it to open the > door to more contributions from the community, and this is a good example! > >> > >> > >> > >> On Jul 9, 2020, at 12:09 PM, Erick Erickson > wrote: > >> > >> If you’ve created a JIRA login, there should be a button on the JIRA > about “attach files”. It’s perfectly OK to attach a diff file to the JIRA. > It’s preferred to just label it SOLR-#.patch. Successive versions of > the patch should have the exact same name, the old ones are grayed out > making it easy to know what the most recent one is without losing the old > versions. No big deal though. > >> > >> If you’re familiar with GIT and have your own fork somewhere, it’s just > the usual process of creating a Pull Request from your GitHub repo. If you > mention the JIRA when you create the PR by starting the title with > “SOLR-#: any comments you want to make”, it’ll automagically be linked > to the JIRA you created. I’ve personally found this a bit confusing because > the title you edit is not the first screen when you hit the “create PR” > button. If the automagic linking doesn’t work, just paste a link to the PR > in the comments. > >> > >> Don’t stress over it, if making a PR is bothersome, just attach a diff > file. Either one is fine. Code reviews are easier with a PR, but depending > on the size of the patch the utility of easy reviews may be only marginally > beneficial. > >> > >> Best, > >> Erick > >> > >> On Jul 9, 2020, at 11:23 AM, Marco Bolis wrote: > >> > >> Thanks for the answers. > >> > >> Excuse me, I'm new to this: how am I supposed to attach the patch / PR > to the issue? > >> Is it ok to add a diff as attachment? > >> Should I open the PR and link to it from the issue? > >> > >> Thank you very much, regards, > >> Marco > >> > >> Il giorno gio 9 lug 2020 alle ore 17:06 Erick Erickson < > erickerick...@gmail.com> ha scritto: > >> Marco: > >> > >> Thanks for volunteering your fix! > >> > >> The best way is to raise a JIRA, see: > https://cwiki.apache.org/confluence/display/solr/HowToContribute#HowToContribute-JIRAtips(ourissue/bugtracker) > and attach a patch or pull request. From there we can discuss/give > feedback/add to the repo, etc. > >> > >> Best, > >> Erick > >> > >> On Jul 9, 2020, at 9:56 AM, Marco Bolis wrote: > >> > >> Hello, > >> > >> I just wrote a patch to make FileListEntityProcessor work by streaming, > using Java 8 Stream and NIO2, instead of buffering the entire file list in > memory. > >> I had to do it because I had a very large list of files (upwards of 1M) > and kept going OOM. > >> > >> I wish I could contribute this patch, if it is deemed useful. > >> > >> Regards, > >> Marco > >> > >> > >> > >> - > >> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org > >> For additional commands, e-mail: dev-h...@lucene.apache.org > >> > >> > >> > >> - > >> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org > >> For additional commands, e-mail: dev-h...@lucene.apache.org > >> > >> > >> ___ > >> Eric Pugh | Founder & CEO | OpenSource Connections, LLC | 434.466.1467 > | http://www.opensourceconnections.com | My Free/Busy > >> Co-Author: Apache Solr Enterprise Search Server, 3rd Ed > >> This e-mail and all contents, including attachments, is considered to > be Company Confidential unless explicitly stated otherwise, regardless of > whether attachments are marked as such. > >> > > > -- > - > Noble Paul > > - > To unsubscribe, e-mail:
SOLR-13939 and PR # 1668
I just attached a PR to SOLR-13939 for the second of three sets of changes. These changes are, I guess, trying to avoid bogus thread leak failures. Or at least thread leaks we can’t do anything about. Lots of them are in HDFS-related classes for instance. If anybody has some bandwidth to take a glance at them please do. I haven’t examined the details _at all_. I wanted this group of changes to be available to pass a judgement on whether it’s worth pursuing ASAP. I’ll look at the code in the next day or two in more detail myself; in the mean time any additional eyes welcome. Erick - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
BadApple report
Actaully, pretty good. The attached file has a lot of noise in it that’s a listing of the files that have more or less SuppressWarnings annotations than last week, the delta is -19. It’s a crude measure, I can replace N SuppressWarnings in a class with one for the entire class, but it’s also easy to count. Down is the right direction though. NamedList accounts for a huge number of SuppressWarnings. I do wonder if we can figure out better ways to avoid warnings with that class. Other than replace it. Wholesale surgery to replace it just to avoid warnings is a pretty bad idea of course…. SuppressWarnings count: last week: 5,372, this week: 5,353, delta -19 Processing file (History bit 3): HOSS-2020-07-13.csv Processing file (History bit 2): HOSS-2020-07-06.csv Processing file (History bit 1): HOSS-2020-06-29.csv Processing file (History bit 0): HOSS-2020-06-22.csv Number of AwaitsFix: 46 Number of BadApples: 4 **Annotated tests that didn't fail in the last 4 weeks. **Tests removed from the next two lists because they were specified in 'doNotEnable' in the properties file MoveReplicaHDFSTest.testNormalFailedMove **Annotations can be removed from the following tests because they haven't failed in the last 4 rollups. **Methods: 0 Raw fail count by week totals, most recent week first (corresponds to bits): Week: 0 had 19 failures Week: 1 had 24 failures Week: 2 had 26 failures Week: 3 had 26 failures Failures in Hoss' reports for the last 4 rollups. There were 71 unannotated tests that failed in Hoss' rollups. Ordered by the date I downloaded the rollup file, newest->oldest. See above for the dates the files were collected These tests were NOT BadApple'd or AwaitsFix'd Failures in the last 4 reports.. Report Pct runsfails test 0123 0.9 447 5 TestInPlaceUpdatesDistrib.test DO NOT ENABLE LIST: MoveReplicaHDFSTest.testFailedMove MoveReplicaHDFSTest.testNormalFailedMove TestControlledRealTimeReopenThread.testCRTReopen TestICUNormalizer2CharFilter.testRandomStrings TestICUTokenizerCJK TestImpersonationWithHadoopAuth.testForwarding TestLTRReRankingPipeline.testDifferentTopN TestRandomChains DO NOT ANNOTATE LIST CdcrBidirectionalTest.testBiDir IndexSizeTriggerTest.testMergeIntegration IndexSizeTriggerTest.testMixedBounds IndexSizeTriggerTest.testSplitIntegration IndexSizeTriggerTest.testTrigger InfixSuggestersTest.testShutdownDuringBuild ShardSplitTest.test ShardSplitTest.testSplitMixedReplicaTypes ShardSplitTest.testSplitWithChaosMonkey Test2BPostings.test TestLatLonShapeQueries.testRandomBig TestPackedInts.testPackedLongValues TestRandomChains.testRandomChainsWithLargeStrings TestTriggerIntegration.testSearchRate SuppressWarnings count: last week: 5,372, this week: 5,353, delta -19 *** Files with increased @SuppressWarnings annotations: Suppress count increase in: solr/core/src/java/org/apache/solr/search/facet/SlotAcc.java. Was: 3, now: 5 Suppress count increase in: solr/core/src/test/org/apache/solr/search/facet/TestCloudJSONFacetSKGEquiv.java. Was: 5, now: 11 Suppress count increase in: solr/solrj/src/java/org/apache/solr/client/solrj/impl/Http2SolrClient.java. Was: 12, now: 13 *** Files with decreased @SuppressWarnings annotations: Suppress count decrease in: solr/contrib/dataimporthandler/src/java/org/apache/solr/handler/dataimport/ContextImpl.java. Was: 5, now: 4 Suppress count decrease in: solr/contrib/dataimporthandler/src/java/org/apache/solr/handler/dataimport/XPathEntityProcessor.java. Was: 8, now: 7 Suppress count decrease in: solr/core/src/java/org/apache/solr/handler/IndexFetcher.java. Was: 19, now: 13 Suppress count decrease in: solr/core/src/java/org/apache/solr/handler/ReplicationHandler.java. Was: 14, now: 13 Suppress count decrease in: solr/core/src/java/org/apache/solr/handler/component/HttpShardHandler.java. Was: 1, now: 0 Suppress count decrease in: solr/core/src/java/org/apache/solr/handler/component/HttpShardHandlerFactory.java. Was: 7, now: 6 Suppress count decrease in: solr/core/src/java/org/apache/solr/search/function/distance/GeoDistValueSourceParser.java. Was: 2, now: 1 Suppress count decrease in: solr/core/src/java/org/apache/solr/security/AuthorizationContext.java. Was: 1, now: 0 Suppress count decrease in: solr/core/src/java/org/apache/solr/security/KerberosPlugin.java. Was: 1, now: 0 Suppress count decrease in: solr/core/src/java/org/apache/solr/security/RuleBasedAuthorizationPluginBase.java. Was: 4, now: 3 Suppress count decrease in: solr/core/src/java/org/apache/solr/servlet/HttpSolrCall.java. Was: 5, now: 4 Suppress count decrease in: solr/core/src/test/org/apache/solr/cloud/api/collections/CollectionsAPIDistributedZkTest.java. Was: 4, now: 3 Suppress count decrease in:
