BadApple report

2020-03-30 Thread Erick Erickson
There are a couple of tests that can have BadApple removed, 
   MultiThreadedOCPTest.test
   SolrZkClientTest.testSimpleUpdateACLs

I’ll take care of those today or tomorrow.

Raw fail count by week totals, most recent week first (corresponds to bits):
Week: 0  had  69 failures
Week: 1  had  65 failures
Week: 2  had  129 failures
Week: 3  had  87 failures


Failures in Hoss' reports for the last 4 rollups.

There were 251 unannotated tests that failed in Hoss' rollups. Ordered by the 
date I downloaded the rollup file, newest->oldest. See above for the dates the 
files were collected 
These tests were NOT BadApple'd or AwaitsFix'd

Failures in the last 4 reports..
   Report   Pct runsfails   test
 0123  40.0  160 73  HdfsSyncSliceTest.test
 0123   0.5 1680  8  HttpPartitionWithTlogReplicasTest.test
 0123   1.0 1685 12  SyncSliceTest.test
 0123   2.2 1857113  SystemCollectionCompatTest.testBackCompat
 0123   0.5 1691 21  TestPackages.testPluginLoading
 0123   0.3 1681  6  TestSolrConfigHandlerCloud.test


File attached.
DO NOT ENABLE LIST:
MoveReplicaHDFSTest.testFailedMove
MoveReplicaHDFSTest.testNormalFailedMove
TestControlledRealTimeReopenThread.testCRTReopen
TestICUNormalizer2CharFilter.testRandomStrings
TestICUTokenizerCJK
TestImpersonationWithHadoopAuth.testForwarding
TestLTRReRankingPipeline.testDifferentTopN
TestRandomChains


DO NOT ANNOTATE LIST
CdcrBidirectionalTest.testBiDir
IndexSizeTriggerTest.testMergeIntegration
IndexSizeTriggerTest.testMixedBounds
IndexSizeTriggerTest.testSplitIntegration
IndexSizeTriggerTest.testTrigger
InfixSuggestersTest.testShutdownDuringBuild
ShardSplitTest.test
ShardSplitTest.testSplitMixedReplicaTypes
ShardSplitTest.testSplitWithChaosMonkey
Test2BPostings.test
TestLatLonShapeQueries.testRandomBig
TestPackedInts.testPackedLongValues
TestRandomChains.testRandomChainsWithLargeStrings
TestTriggerIntegration.testSearchRate

Processing file (History bit 3): HOSS-2020-03-30.csv
Processing file (History bit 2): HOSS-2020-03-24.csv
Processing file (History bit 1): HOSS-2020-03-16.csv
Processing file (History bit 0): HOSS-2020-02-10.csv


Number of AwaitsFix: 41 Number of BadApples: 6


**Annotated tests that didn't fail in the last 4 weeks.

  **Tests removed from the next two lists because they were specified in 
'doNotEnable' in the properties file
 MoveReplicaHDFSTest.testNormalFailedMove

  **Annotations can be removed from the following tests because they haven't 
failed in the last 4 rollups.

  **Methods: 2
   MultiThreadedOCPTest.test
   SolrZkClientTest.testSimpleUpdateACLs


Raw fail count by week totals, most recent week first (corresponds to bits):
Week: 0  had  69 failures
Week: 1  had  65 failures
Week: 2  had  129 failures
Week: 3  had  87 failures


Failures in Hoss' reports for the last 4 rollups.

There were 251 unannotated tests that failed in Hoss' rollups. Ordered by the 
date I downloaded the rollup file, newest->oldest. See above for the dates the 
files were collected 
These tests were NOT BadApple'd or AwaitsFix'd

Failures in the last 4 reports..
   Report   Pct runsfails   test
 0123  40.0  160 73  HdfsSyncSliceTest.test
 0123   0.5 1680  8  HttpPartitionWithTlogReplicasTest.test
 0123   1.0 1685 12  SyncSliceTest.test
 0123   2.2 1857113  SystemCollectionCompatTest.testBackCompat
 0123   0.5 1691 21  TestPackages.testPluginLoading
 0123   0.3 1681  6  TestSolrConfigHandlerCloud.test


Failures over the last 4 weeks, but not every week. Ordered most-recent first:



 012   11.8   97 10  ShardSplitTest.testSplitWithChaosMonkey
 0127.7  196 26  TestFactories.test
 01 3   0.3 1223  3  TestCloudJSONFacetSKG.testRandom
 01 3  30.6   90 24  
TestXYMultiPolygonShapeQueries.testRandomBig
 01 4.0   50  2  
CdcrReplicationHandlerTest.testReplicationWithBufferedUpdates
 01 0.3  799  2  
ConnectionManagerTest.testReconnectWhenZkDisappeared
 0 23   4.2   62  4  HdfsBasicDistributedZkTest.test
 0 23   8.3   73  6  Test2BPostings.test
 0 23   0.5 1289  9  
TestQueryingOnDownCollection.testQueryToDownCollectionShouldFailFast
 0 23   0.3 1268  3  
TestSolrCloudWithDelegationTokens.testDelegationTokenRenew
 0 23   0.5 1274  7  TestStressLiveNodes.testStress
 0 20.3  837  2  
CdcrVersionReplicationTest.testCdcrDocVersions
 0 20.5  844  3  
DocValuesNotIndexedTest.testGroupingDVOnlySortFirst
 0 20.2  844  3  

Re: Welcome Alessandro Benedetti as a Lucene/Solr committer

2020-03-30 Thread Bruno Roustant
Welcome Alessandro!

Le ven. 27 mars 2020 à 17:02, Christine Poerschke (BLOOMBERG/ LONDON) <
cpoersc...@bloomberg.net> a écrit :

> Welcome Alessandro!
>
> Christine
>
> From: dev@lucene.apache.org At: 03/18/20 19:25:48
> Cc: dev@lucene.apache.org
> Subject: Re: Welcome Alessandro Benedetti as a Lucene/Solr committer
>
> Thanks everyone for the warm welcome!
> I already know most of you but for all the others here's my brief bio :)
>
> I am Italian (possibly the only other italian in addition to Tommaso) and
> I have been living in the UK for the last 7 years.
> I am currently based in London.
> I started working with Apache Solr back in 2010 (and a few months later
> with Apache Lucene), my first project was a search API that translated the
> Verity query language to Lucene syntax, at the time I was a junior software
> engineer with a background in Information Retrieval research at Roma3
> university.
> Since then I have explored a lot of different use cases for Apache
> Lucene/Solr and I spent more and more time studying and working with the
> internals, across various companies and positions.
> My favourite projects in my career have been the design and implementation
> of a Semantic Search engine called Sensify (when I was working in a small
> and cohesive R team in Zaizi, with spanish friends and colleagues from
> Seville), the Apache Solr Learning To Rank plugin from Bloomberg (and
> integrations/applications) and the Rated Ranking Evaluator project (an Open
> Source library for Search Quality Evaluation we contributed back to the
> community).
> In 2016 I founded my own company, Sease where we try to build a bridge
> between Academia and the industry through Open Source software in the
> domain of Information Retrieval.
>
> As David mentioned my main areas of contribution in Apache Lucene/Solr
> have been the More Like This, the Learning To Rank plugin, Synonyms
> expansion and the Suggester component.
> I have a lot of ideas in my to do list, so stay tuned, we'll have a lot to
> discuss and innovate !
>
> It is a pleasure to join this group and I am sure we'll do great things
> together :)
>
> Cheers
>
>
> --
> Alessandro Benedetti
> Search Consultant, R Software Engineer, Director
> www.sease.io
>
>
> On Wed, 18 Mar 2020 at 13:00, David Smiley 
> wrote:
>
>> Hi all,
>>
>> Please join me in welcoming Alessandro Benedetti as the latest
>> Lucene/Solr committer!
>>
>> Alessandro has been contributing to Lucene and Solr in areas such as More
>> Like This, Synonym boosting, and Suggesters, and other areas for years.
>> Furthermore he's been a help to many users on the solr-user mailing list
>> and has helped others through his blog posts and presentations about
>> search.  We look forward to his future contributions.
>>
>> Congratulations and welcome!  It is a tradition to introduce yourself
>> with a brief bio, Alessandro.
>>
>> ~ David Smiley
>> Apache Lucene/Solr Search Developer
>> http://www.linkedin.com/in/davidwsmiley
>>
>
>