[jira] [Created] (SOLR-12336) Remove or refactor Filter

2018-05-09 Thread David Smiley (JIRA)
David Smiley created SOLR-12336:
---

 Summary: Remove or refactor Filter
 Key: SOLR-12336
 URL: https://issues.apache.org/jira/browse/SOLR-12336
 Project: Solr
  Issue Type: Improvement
  Security Level: Public (Default Security Level. Issues are Public)
  Components: search
Reporter: David Smiley


Over a series of Lucene releases, the old Filter was made to extend Query 
(LUCENE-1518) and then was removed from Lucene (moved to Solr in LUCENE-6583); 
BooleanClause.Occur.FILTER (LUCENE-6227) with some other API enhancements 
including TwoPhaseIterator replaced the need for the old Filter.  Filter is now 
a Solr thing, and there are various related classes like QueryWrapperFilter and 
SolrConstantScoreQuery that depend on it.  We should remove some of this 
technical-debt / bit-rot, making refactorings as needed to retain 
functionality.  Leaving things as-is is needless complexity and can impede 
performance when there is needless wrapping/layers.
CC @yonik



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Resolved] (LUCENE-8298) Allow DocValues updates to reset a value

2018-05-09 Thread Simon Willnauer (JIRA)

 [ 
https://issues.apache.org/jira/browse/LUCENE-8298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Simon Willnauer resolved LUCENE-8298.
-
Resolution: Fixed

> Allow DocValues updates to reset a value
> 
>
> Key: LUCENE-8298
> URL: https://issues.apache.org/jira/browse/LUCENE-8298
> Project: Lucene - Core
>  Issue Type: Improvement
>Affects Versions: 7.4, master (8.0)
>Reporter: Simon Willnauer
>Priority: Major
> Fix For: 7.4, master (8.0)
>
> Attachments: LUCENE-8298.patch, LUCENE-8298.patch, LUCENE-8298.patch, 
> LUCENE-8298.patch, LUCENE-8298.patch
>
>
>  Today once a document has a value in a certain DV field this values
> can only be changed but not removed. While resetting / removing a value
> from a field is certainly a corner case it can be used to undelete a
> soft-deleted document unless it's merged away.
> This allows to rollback changes without rolling back to another 
> commitpoint
> or trashing all uncommitted changes. In certain cenarios it can be used to
> "repair" history of documents in distributed systems.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[GitHub] lucene-solr issue #374: [SOLR-12334] Improve detection of recreated lockfile...

2018-05-09 Thread rmuir
Github user rmuir commented on the issue:

https://github.com/apache/lucene-solr/pull/374
  
right it has FileKey but its not used for keyFile, just locking and stuff :)

I don't think its more useful to use an unreliable method, as opposed to 
using simple filesystem metadata that is supported everywhere. Your problem is 
really not the method we use, its that gluster filesystem metadata is 
completely broken and inconsistent across replicas. file keys (when they work 
at all) are still imperfect (inode numbers can be recycled) and harder to 
reason about. It would add additional paths to the code to worry about as we 
still need to fall back to the current code for windows anyway, I really see it 
as just trying to shove glusterfs's broken design under the rug.


---

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-12280) Ref-Guide: Add Digital Signal Processing documentation

2018-05-09 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-12280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469139#comment-16469139
 ] 

ASF subversion and git services commented on SOLR-12280:


Commit 144f00a1e315541a28f526f4cdf1e55eb60c862b in lucene-solr's branch 
refs/heads/master from [~joel.bernstein]
[ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=144f00a ]

Squashed commit of the following:

commit e5074c3223e394af17f686294a67a1dd3ecdd147
Author: Joel Bernstein 
Date:   Wed May 9 13:16:34 2018 -0400

SOLR-12280: WIP

commit 69cdeccf161177d10f4d2407542392aaee3fcfe8
Author: Joel Bernstein 
Date:   Wed May 9 13:08:02 2018 -0400

SOLR-12280: WIP

commit c94f0c87c3e57c023d622ad2411e522c4aac491c
Author: Joel Bernstein 
Date:   Wed May 9 11:54:58 2018 -0400

SOLR-12280: WIP

commit 68dd1e73355cb84410f2d0ff3a51797ed6194a10
Author: Joel Bernstein 
Date:   Wed May 9 10:54:32 2018 -0400

SOLR-12280: WIP

commit 04a010543418a469100fa299c606a7b1eed452e1
Author: Joel Bernstein 
Date:   Wed May 9 10:47:27 2018 -0400

SOLR-12280: WIP

commit a6bbfbadaafe33fcdf93d5c72755e30dadadf017
Author: Joel Bernstein 
Date:   Wed May 9 09:40:08 2018 -0400

SOLR-12280: WIP

commit 5d27961aa291bcd71527337632981bcdf62369b4
Author: Joel Bernstein 
Date:   Tue May 8 20:43:33 2018 -0400

SOLR-12280: WIP

commit e982cf939f429c05b736f6292c68dd96d7ebc027
Author: Joel Bernstein 
Date:   Tue May 8 13:27:29 2018 -0400

SOLR-12280: WIP

commit aae78ab6f387c28a080021bc919ef51864540be2
Author: Joel Bernstein 
Date:   Tue May 8 12:23:52 2018 -0400

SOLR-12280: WIP

commit 0787ad76f0f4c62c860784b15490d8a988939997
Author: Joel Bernstein 
Date:   Tue May 8 12:20:38 2018 -0400

SOLR-12280: WIP

commit 4df098376ba05188702cca8582959c3fe18066f5
Author: Joel Bernstein 
Date:   Tue May 8 12:12:11 2018 -0400

SOLR-12280: WIP

commit 5c0be5136bbab7e0c33b3b8a7b0395b1b330e96d
Author: Joel Bernstein 
Date:   Tue May 8 12:04:57 2018 -0400

SOLR-12280: WIP

commit 6c6feac4c2e5a49a5eab87a228713d1b93c8fc70
Author: Joel Bernstein 
Date:   Tue May 8 11:57:49 2018 -0400

SOLR-12280: WIP

commit 7d46d11c9dd3a51b68600c2c889f586147545294
Author: Joel Bernstein 
Date:   Tue May 8 11:50:51 2018 -0400

SOLR-12280: WIP

commit 8b6bf19d0091203ed63b39d070dd02a9bece6a61
Author: Joel Bernstein 
Date:   Mon May 7 10:53:14 2018 -0400

SOLR-12280: WIP

commit 5466591999816eaacde6ce18d824d7688e5f4fe8
Author: Joel Bernstein 
Date:   Fri May 4 15:12:43 2018 -0400

SOLR-12280: WIP

commit d7fff7d557a7fd26011c21445b7969b2cd81036f
Author: Joel Bernstein 
Date:   Fri Apr 27 12:50:27 2018 -0400

SOLR-12280: Initial commit


> Ref-Guide: Add Digital Signal Processing documentation
> --
>
> Key: SOLR-12280
> URL: https://issues.apache.org/jira/browse/SOLR-12280
> Project: Solr
>  Issue Type: New Feature
>  Security Level: Public(Default Security Level. Issues are Public) 
>Reporter: Joel Bernstein
>Assignee: Joel Bernstein
>Priority: Major
> Fix For: 7.4
>
>
> This ticket will add a new section of documentation in the Math Expressions 
> docs covering the Digital Signal Processing functions. The main areas of 
> documentation coverage will include:
>  * Dot product
>  * Convolution
>  * Cross-correlation
>  * Find Delay
>  * Auto-correlation
>  * Fast Fourier Transform



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-12280) Ref-Guide: Add Digital Signal Processing documentation

2018-05-09 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-12280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469137#comment-16469137
 ] 

ASF subversion and git services commented on SOLR-12280:


Commit 144f00a1e315541a28f526f4cdf1e55eb60c862b in lucene-solr's branch 
refs/heads/master from [~joel.bernstein]
[ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=144f00a ]

Squashed commit of the following:

commit e5074c3223e394af17f686294a67a1dd3ecdd147
Author: Joel Bernstein 
Date:   Wed May 9 13:16:34 2018 -0400

SOLR-12280: WIP

commit 69cdeccf161177d10f4d2407542392aaee3fcfe8
Author: Joel Bernstein 
Date:   Wed May 9 13:08:02 2018 -0400

SOLR-12280: WIP

commit c94f0c87c3e57c023d622ad2411e522c4aac491c
Author: Joel Bernstein 
Date:   Wed May 9 11:54:58 2018 -0400

SOLR-12280: WIP

commit 68dd1e73355cb84410f2d0ff3a51797ed6194a10
Author: Joel Bernstein 
Date:   Wed May 9 10:54:32 2018 -0400

SOLR-12280: WIP

commit 04a010543418a469100fa299c606a7b1eed452e1
Author: Joel Bernstein 
Date:   Wed May 9 10:47:27 2018 -0400

SOLR-12280: WIP

commit a6bbfbadaafe33fcdf93d5c72755e30dadadf017
Author: Joel Bernstein 
Date:   Wed May 9 09:40:08 2018 -0400

SOLR-12280: WIP

commit 5d27961aa291bcd71527337632981bcdf62369b4
Author: Joel Bernstein 
Date:   Tue May 8 20:43:33 2018 -0400

SOLR-12280: WIP

commit e982cf939f429c05b736f6292c68dd96d7ebc027
Author: Joel Bernstein 
Date:   Tue May 8 13:27:29 2018 -0400

SOLR-12280: WIP

commit aae78ab6f387c28a080021bc919ef51864540be2
Author: Joel Bernstein 
Date:   Tue May 8 12:23:52 2018 -0400

SOLR-12280: WIP

commit 0787ad76f0f4c62c860784b15490d8a988939997
Author: Joel Bernstein 
Date:   Tue May 8 12:20:38 2018 -0400

SOLR-12280: WIP

commit 4df098376ba05188702cca8582959c3fe18066f5
Author: Joel Bernstein 
Date:   Tue May 8 12:12:11 2018 -0400

SOLR-12280: WIP

commit 5c0be5136bbab7e0c33b3b8a7b0395b1b330e96d
Author: Joel Bernstein 
Date:   Tue May 8 12:04:57 2018 -0400

SOLR-12280: WIP

commit 6c6feac4c2e5a49a5eab87a228713d1b93c8fc70
Author: Joel Bernstein 
Date:   Tue May 8 11:57:49 2018 -0400

SOLR-12280: WIP

commit 7d46d11c9dd3a51b68600c2c889f586147545294
Author: Joel Bernstein 
Date:   Tue May 8 11:50:51 2018 -0400

SOLR-12280: WIP

commit 8b6bf19d0091203ed63b39d070dd02a9bece6a61
Author: Joel Bernstein 
Date:   Mon May 7 10:53:14 2018 -0400

SOLR-12280: WIP

commit 5466591999816eaacde6ce18d824d7688e5f4fe8
Author: Joel Bernstein 
Date:   Fri May 4 15:12:43 2018 -0400

SOLR-12280: WIP

commit d7fff7d557a7fd26011c21445b7969b2cd81036f
Author: Joel Bernstein 
Date:   Fri Apr 27 12:50:27 2018 -0400

SOLR-12280: Initial commit


> Ref-Guide: Add Digital Signal Processing documentation
> --
>
> Key: SOLR-12280
> URL: https://issues.apache.org/jira/browse/SOLR-12280
> Project: Solr
>  Issue Type: New Feature
>  Security Level: Public(Default Security Level. Issues are Public) 
>Reporter: Joel Bernstein
>Assignee: Joel Bernstein
>Priority: Major
> Fix For: 7.4
>
>
> This ticket will add a new section of documentation in the Math Expressions 
> docs covering the Digital Signal Processing functions. The main areas of 
> documentation coverage will include:
>  * Dot product
>  * Convolution
>  * Cross-correlation
>  * Find Delay
>  * Auto-correlation
>  * Fast Fourier Transform



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-12280) Ref-Guide: Add Digital Signal Processing documentation

2018-05-09 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-12280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469143#comment-16469143
 ] 

ASF subversion and git services commented on SOLR-12280:


Commit 144f00a1e315541a28f526f4cdf1e55eb60c862b in lucene-solr's branch 
refs/heads/master from [~joel.bernstein]
[ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=144f00a ]

Squashed commit of the following:

commit e5074c3223e394af17f686294a67a1dd3ecdd147
Author: Joel Bernstein 
Date:   Wed May 9 13:16:34 2018 -0400

SOLR-12280: WIP

commit 69cdeccf161177d10f4d2407542392aaee3fcfe8
Author: Joel Bernstein 
Date:   Wed May 9 13:08:02 2018 -0400

SOLR-12280: WIP

commit c94f0c87c3e57c023d622ad2411e522c4aac491c
Author: Joel Bernstein 
Date:   Wed May 9 11:54:58 2018 -0400

SOLR-12280: WIP

commit 68dd1e73355cb84410f2d0ff3a51797ed6194a10
Author: Joel Bernstein 
Date:   Wed May 9 10:54:32 2018 -0400

SOLR-12280: WIP

commit 04a010543418a469100fa299c606a7b1eed452e1
Author: Joel Bernstein 
Date:   Wed May 9 10:47:27 2018 -0400

SOLR-12280: WIP

commit a6bbfbadaafe33fcdf93d5c72755e30dadadf017
Author: Joel Bernstein 
Date:   Wed May 9 09:40:08 2018 -0400

SOLR-12280: WIP

commit 5d27961aa291bcd71527337632981bcdf62369b4
Author: Joel Bernstein 
Date:   Tue May 8 20:43:33 2018 -0400

SOLR-12280: WIP

commit e982cf939f429c05b736f6292c68dd96d7ebc027
Author: Joel Bernstein 
Date:   Tue May 8 13:27:29 2018 -0400

SOLR-12280: WIP

commit aae78ab6f387c28a080021bc919ef51864540be2
Author: Joel Bernstein 
Date:   Tue May 8 12:23:52 2018 -0400

SOLR-12280: WIP

commit 0787ad76f0f4c62c860784b15490d8a988939997
Author: Joel Bernstein 
Date:   Tue May 8 12:20:38 2018 -0400

SOLR-12280: WIP

commit 4df098376ba05188702cca8582959c3fe18066f5
Author: Joel Bernstein 
Date:   Tue May 8 12:12:11 2018 -0400

SOLR-12280: WIP

commit 5c0be5136bbab7e0c33b3b8a7b0395b1b330e96d
Author: Joel Bernstein 
Date:   Tue May 8 12:04:57 2018 -0400

SOLR-12280: WIP

commit 6c6feac4c2e5a49a5eab87a228713d1b93c8fc70
Author: Joel Bernstein 
Date:   Tue May 8 11:57:49 2018 -0400

SOLR-12280: WIP

commit 7d46d11c9dd3a51b68600c2c889f586147545294
Author: Joel Bernstein 
Date:   Tue May 8 11:50:51 2018 -0400

SOLR-12280: WIP

commit 8b6bf19d0091203ed63b39d070dd02a9bece6a61
Author: Joel Bernstein 
Date:   Mon May 7 10:53:14 2018 -0400

SOLR-12280: WIP

commit 5466591999816eaacde6ce18d824d7688e5f4fe8
Author: Joel Bernstein 
Date:   Fri May 4 15:12:43 2018 -0400

SOLR-12280: WIP

commit d7fff7d557a7fd26011c21445b7969b2cd81036f
Author: Joel Bernstein 
Date:   Fri Apr 27 12:50:27 2018 -0400

SOLR-12280: Initial commit


> Ref-Guide: Add Digital Signal Processing documentation
> --
>
> Key: SOLR-12280
> URL: https://issues.apache.org/jira/browse/SOLR-12280
> Project: Solr
>  Issue Type: New Feature
>  Security Level: Public(Default Security Level. Issues are Public) 
>Reporter: Joel Bernstein
>Assignee: Joel Bernstein
>Priority: Major
> Fix For: 7.4
>
>
> This ticket will add a new section of documentation in the Math Expressions 
> docs covering the Digital Signal Processing functions. The main areas of 
> documentation coverage will include:
>  * Dot product
>  * Convolution
>  * Cross-correlation
>  * Find Delay
>  * Auto-correlation
>  * Fast Fourier Transform



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-12280) Ref-Guide: Add Digital Signal Processing documentation

2018-05-09 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-12280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469141#comment-16469141
 ] 

ASF subversion and git services commented on SOLR-12280:


Commit 144f00a1e315541a28f526f4cdf1e55eb60c862b in lucene-solr's branch 
refs/heads/master from [~joel.bernstein]
[ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=144f00a ]

Squashed commit of the following:

commit e5074c3223e394af17f686294a67a1dd3ecdd147
Author: Joel Bernstein 
Date:   Wed May 9 13:16:34 2018 -0400

SOLR-12280: WIP

commit 69cdeccf161177d10f4d2407542392aaee3fcfe8
Author: Joel Bernstein 
Date:   Wed May 9 13:08:02 2018 -0400

SOLR-12280: WIP

commit c94f0c87c3e57c023d622ad2411e522c4aac491c
Author: Joel Bernstein 
Date:   Wed May 9 11:54:58 2018 -0400

SOLR-12280: WIP

commit 68dd1e73355cb84410f2d0ff3a51797ed6194a10
Author: Joel Bernstein 
Date:   Wed May 9 10:54:32 2018 -0400

SOLR-12280: WIP

commit 04a010543418a469100fa299c606a7b1eed452e1
Author: Joel Bernstein 
Date:   Wed May 9 10:47:27 2018 -0400

SOLR-12280: WIP

commit a6bbfbadaafe33fcdf93d5c72755e30dadadf017
Author: Joel Bernstein 
Date:   Wed May 9 09:40:08 2018 -0400

SOLR-12280: WIP

commit 5d27961aa291bcd71527337632981bcdf62369b4
Author: Joel Bernstein 
Date:   Tue May 8 20:43:33 2018 -0400

SOLR-12280: WIP

commit e982cf939f429c05b736f6292c68dd96d7ebc027
Author: Joel Bernstein 
Date:   Tue May 8 13:27:29 2018 -0400

SOLR-12280: WIP

commit aae78ab6f387c28a080021bc919ef51864540be2
Author: Joel Bernstein 
Date:   Tue May 8 12:23:52 2018 -0400

SOLR-12280: WIP

commit 0787ad76f0f4c62c860784b15490d8a988939997
Author: Joel Bernstein 
Date:   Tue May 8 12:20:38 2018 -0400

SOLR-12280: WIP

commit 4df098376ba05188702cca8582959c3fe18066f5
Author: Joel Bernstein 
Date:   Tue May 8 12:12:11 2018 -0400

SOLR-12280: WIP

commit 5c0be5136bbab7e0c33b3b8a7b0395b1b330e96d
Author: Joel Bernstein 
Date:   Tue May 8 12:04:57 2018 -0400

SOLR-12280: WIP

commit 6c6feac4c2e5a49a5eab87a228713d1b93c8fc70
Author: Joel Bernstein 
Date:   Tue May 8 11:57:49 2018 -0400

SOLR-12280: WIP

commit 7d46d11c9dd3a51b68600c2c889f586147545294
Author: Joel Bernstein 
Date:   Tue May 8 11:50:51 2018 -0400

SOLR-12280: WIP

commit 8b6bf19d0091203ed63b39d070dd02a9bece6a61
Author: Joel Bernstein 
Date:   Mon May 7 10:53:14 2018 -0400

SOLR-12280: WIP

commit 5466591999816eaacde6ce18d824d7688e5f4fe8
Author: Joel Bernstein 
Date:   Fri May 4 15:12:43 2018 -0400

SOLR-12280: WIP

commit d7fff7d557a7fd26011c21445b7969b2cd81036f
Author: Joel Bernstein 
Date:   Fri Apr 27 12:50:27 2018 -0400

SOLR-12280: Initial commit


> Ref-Guide: Add Digital Signal Processing documentation
> --
>
> Key: SOLR-12280
> URL: https://issues.apache.org/jira/browse/SOLR-12280
> Project: Solr
>  Issue Type: New Feature
>  Security Level: Public(Default Security Level. Issues are Public) 
>Reporter: Joel Bernstein
>Assignee: Joel Bernstein
>Priority: Major
> Fix For: 7.4
>
>
> This ticket will add a new section of documentation in the Math Expressions 
> docs covering the Digital Signal Processing functions. The main areas of 
> documentation coverage will include:
>  * Dot product
>  * Convolution
>  * Cross-correlation
>  * Find Delay
>  * Auto-correlation
>  * Fast Fourier Transform



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-12280) Ref-Guide: Add Digital Signal Processing documentation

2018-05-09 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-12280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469136#comment-16469136
 ] 

ASF subversion and git services commented on SOLR-12280:


Commit 144f00a1e315541a28f526f4cdf1e55eb60c862b in lucene-solr's branch 
refs/heads/master from [~joel.bernstein]
[ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=144f00a ]

Squashed commit of the following:

commit e5074c3223e394af17f686294a67a1dd3ecdd147
Author: Joel Bernstein 
Date:   Wed May 9 13:16:34 2018 -0400

SOLR-12280: WIP

commit 69cdeccf161177d10f4d2407542392aaee3fcfe8
Author: Joel Bernstein 
Date:   Wed May 9 13:08:02 2018 -0400

SOLR-12280: WIP

commit c94f0c87c3e57c023d622ad2411e522c4aac491c
Author: Joel Bernstein 
Date:   Wed May 9 11:54:58 2018 -0400

SOLR-12280: WIP

commit 68dd1e73355cb84410f2d0ff3a51797ed6194a10
Author: Joel Bernstein 
Date:   Wed May 9 10:54:32 2018 -0400

SOLR-12280: WIP

commit 04a010543418a469100fa299c606a7b1eed452e1
Author: Joel Bernstein 
Date:   Wed May 9 10:47:27 2018 -0400

SOLR-12280: WIP

commit a6bbfbadaafe33fcdf93d5c72755e30dadadf017
Author: Joel Bernstein 
Date:   Wed May 9 09:40:08 2018 -0400

SOLR-12280: WIP

commit 5d27961aa291bcd71527337632981bcdf62369b4
Author: Joel Bernstein 
Date:   Tue May 8 20:43:33 2018 -0400

SOLR-12280: WIP

commit e982cf939f429c05b736f6292c68dd96d7ebc027
Author: Joel Bernstein 
Date:   Tue May 8 13:27:29 2018 -0400

SOLR-12280: WIP

commit aae78ab6f387c28a080021bc919ef51864540be2
Author: Joel Bernstein 
Date:   Tue May 8 12:23:52 2018 -0400

SOLR-12280: WIP

commit 0787ad76f0f4c62c860784b15490d8a988939997
Author: Joel Bernstein 
Date:   Tue May 8 12:20:38 2018 -0400

SOLR-12280: WIP

commit 4df098376ba05188702cca8582959c3fe18066f5
Author: Joel Bernstein 
Date:   Tue May 8 12:12:11 2018 -0400

SOLR-12280: WIP

commit 5c0be5136bbab7e0c33b3b8a7b0395b1b330e96d
Author: Joel Bernstein 
Date:   Tue May 8 12:04:57 2018 -0400

SOLR-12280: WIP

commit 6c6feac4c2e5a49a5eab87a228713d1b93c8fc70
Author: Joel Bernstein 
Date:   Tue May 8 11:57:49 2018 -0400

SOLR-12280: WIP

commit 7d46d11c9dd3a51b68600c2c889f586147545294
Author: Joel Bernstein 
Date:   Tue May 8 11:50:51 2018 -0400

SOLR-12280: WIP

commit 8b6bf19d0091203ed63b39d070dd02a9bece6a61
Author: Joel Bernstein 
Date:   Mon May 7 10:53:14 2018 -0400

SOLR-12280: WIP

commit 5466591999816eaacde6ce18d824d7688e5f4fe8
Author: Joel Bernstein 
Date:   Fri May 4 15:12:43 2018 -0400

SOLR-12280: WIP

commit d7fff7d557a7fd26011c21445b7969b2cd81036f
Author: Joel Bernstein 
Date:   Fri Apr 27 12:50:27 2018 -0400

SOLR-12280: Initial commit


> Ref-Guide: Add Digital Signal Processing documentation
> --
>
> Key: SOLR-12280
> URL: https://issues.apache.org/jira/browse/SOLR-12280
> Project: Solr
>  Issue Type: New Feature
>  Security Level: Public(Default Security Level. Issues are Public) 
>Reporter: Joel Bernstein
>Assignee: Joel Bernstein
>Priority: Major
> Fix For: 7.4
>
>
> This ticket will add a new section of documentation in the Math Expressions 
> docs covering the Digital Signal Processing functions. The main areas of 
> documentation coverage will include:
>  * Dot product
>  * Convolution
>  * Cross-correlation
>  * Find Delay
>  * Auto-correlation
>  * Fast Fourier Transform



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-12280) Ref-Guide: Add Digital Signal Processing documentation

2018-05-09 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-12280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469138#comment-16469138
 ] 

ASF subversion and git services commented on SOLR-12280:


Commit 144f00a1e315541a28f526f4cdf1e55eb60c862b in lucene-solr's branch 
refs/heads/master from [~joel.bernstein]
[ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=144f00a ]

Squashed commit of the following:

commit e5074c3223e394af17f686294a67a1dd3ecdd147
Author: Joel Bernstein 
Date:   Wed May 9 13:16:34 2018 -0400

SOLR-12280: WIP

commit 69cdeccf161177d10f4d2407542392aaee3fcfe8
Author: Joel Bernstein 
Date:   Wed May 9 13:08:02 2018 -0400

SOLR-12280: WIP

commit c94f0c87c3e57c023d622ad2411e522c4aac491c
Author: Joel Bernstein 
Date:   Wed May 9 11:54:58 2018 -0400

SOLR-12280: WIP

commit 68dd1e73355cb84410f2d0ff3a51797ed6194a10
Author: Joel Bernstein 
Date:   Wed May 9 10:54:32 2018 -0400

SOLR-12280: WIP

commit 04a010543418a469100fa299c606a7b1eed452e1
Author: Joel Bernstein 
Date:   Wed May 9 10:47:27 2018 -0400

SOLR-12280: WIP

commit a6bbfbadaafe33fcdf93d5c72755e30dadadf017
Author: Joel Bernstein 
Date:   Wed May 9 09:40:08 2018 -0400

SOLR-12280: WIP

commit 5d27961aa291bcd71527337632981bcdf62369b4
Author: Joel Bernstein 
Date:   Tue May 8 20:43:33 2018 -0400

SOLR-12280: WIP

commit e982cf939f429c05b736f6292c68dd96d7ebc027
Author: Joel Bernstein 
Date:   Tue May 8 13:27:29 2018 -0400

SOLR-12280: WIP

commit aae78ab6f387c28a080021bc919ef51864540be2
Author: Joel Bernstein 
Date:   Tue May 8 12:23:52 2018 -0400

SOLR-12280: WIP

commit 0787ad76f0f4c62c860784b15490d8a988939997
Author: Joel Bernstein 
Date:   Tue May 8 12:20:38 2018 -0400

SOLR-12280: WIP

commit 4df098376ba05188702cca8582959c3fe18066f5
Author: Joel Bernstein 
Date:   Tue May 8 12:12:11 2018 -0400

SOLR-12280: WIP

commit 5c0be5136bbab7e0c33b3b8a7b0395b1b330e96d
Author: Joel Bernstein 
Date:   Tue May 8 12:04:57 2018 -0400

SOLR-12280: WIP

commit 6c6feac4c2e5a49a5eab87a228713d1b93c8fc70
Author: Joel Bernstein 
Date:   Tue May 8 11:57:49 2018 -0400

SOLR-12280: WIP

commit 7d46d11c9dd3a51b68600c2c889f586147545294
Author: Joel Bernstein 
Date:   Tue May 8 11:50:51 2018 -0400

SOLR-12280: WIP

commit 8b6bf19d0091203ed63b39d070dd02a9bece6a61
Author: Joel Bernstein 
Date:   Mon May 7 10:53:14 2018 -0400

SOLR-12280: WIP

commit 5466591999816eaacde6ce18d824d7688e5f4fe8
Author: Joel Bernstein 
Date:   Fri May 4 15:12:43 2018 -0400

SOLR-12280: WIP

commit d7fff7d557a7fd26011c21445b7969b2cd81036f
Author: Joel Bernstein 
Date:   Fri Apr 27 12:50:27 2018 -0400

SOLR-12280: Initial commit


> Ref-Guide: Add Digital Signal Processing documentation
> --
>
> Key: SOLR-12280
> URL: https://issues.apache.org/jira/browse/SOLR-12280
> Project: Solr
>  Issue Type: New Feature
>  Security Level: Public(Default Security Level. Issues are Public) 
>Reporter: Joel Bernstein
>Assignee: Joel Bernstein
>Priority: Major
> Fix For: 7.4
>
>
> This ticket will add a new section of documentation in the Math Expressions 
> docs covering the Digital Signal Processing functions. The main areas of 
> documentation coverage will include:
>  * Dot product
>  * Convolution
>  * Cross-correlation
>  * Find Delay
>  * Auto-correlation
>  * Fast Fourier Transform



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-12280) Ref-Guide: Add Digital Signal Processing documentation

2018-05-09 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-12280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469134#comment-16469134
 ] 

ASF subversion and git services commented on SOLR-12280:


Commit 144f00a1e315541a28f526f4cdf1e55eb60c862b in lucene-solr's branch 
refs/heads/master from [~joel.bernstein]
[ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=144f00a ]

Squashed commit of the following:

commit e5074c3223e394af17f686294a67a1dd3ecdd147
Author: Joel Bernstein 
Date:   Wed May 9 13:16:34 2018 -0400

SOLR-12280: WIP

commit 69cdeccf161177d10f4d2407542392aaee3fcfe8
Author: Joel Bernstein 
Date:   Wed May 9 13:08:02 2018 -0400

SOLR-12280: WIP

commit c94f0c87c3e57c023d622ad2411e522c4aac491c
Author: Joel Bernstein 
Date:   Wed May 9 11:54:58 2018 -0400

SOLR-12280: WIP

commit 68dd1e73355cb84410f2d0ff3a51797ed6194a10
Author: Joel Bernstein 
Date:   Wed May 9 10:54:32 2018 -0400

SOLR-12280: WIP

commit 04a010543418a469100fa299c606a7b1eed452e1
Author: Joel Bernstein 
Date:   Wed May 9 10:47:27 2018 -0400

SOLR-12280: WIP

commit a6bbfbadaafe33fcdf93d5c72755e30dadadf017
Author: Joel Bernstein 
Date:   Wed May 9 09:40:08 2018 -0400

SOLR-12280: WIP

commit 5d27961aa291bcd71527337632981bcdf62369b4
Author: Joel Bernstein 
Date:   Tue May 8 20:43:33 2018 -0400

SOLR-12280: WIP

commit e982cf939f429c05b736f6292c68dd96d7ebc027
Author: Joel Bernstein 
Date:   Tue May 8 13:27:29 2018 -0400

SOLR-12280: WIP

commit aae78ab6f387c28a080021bc919ef51864540be2
Author: Joel Bernstein 
Date:   Tue May 8 12:23:52 2018 -0400

SOLR-12280: WIP

commit 0787ad76f0f4c62c860784b15490d8a988939997
Author: Joel Bernstein 
Date:   Tue May 8 12:20:38 2018 -0400

SOLR-12280: WIP

commit 4df098376ba05188702cca8582959c3fe18066f5
Author: Joel Bernstein 
Date:   Tue May 8 12:12:11 2018 -0400

SOLR-12280: WIP

commit 5c0be5136bbab7e0c33b3b8a7b0395b1b330e96d
Author: Joel Bernstein 
Date:   Tue May 8 12:04:57 2018 -0400

SOLR-12280: WIP

commit 6c6feac4c2e5a49a5eab87a228713d1b93c8fc70
Author: Joel Bernstein 
Date:   Tue May 8 11:57:49 2018 -0400

SOLR-12280: WIP

commit 7d46d11c9dd3a51b68600c2c889f586147545294
Author: Joel Bernstein 
Date:   Tue May 8 11:50:51 2018 -0400

SOLR-12280: WIP

commit 8b6bf19d0091203ed63b39d070dd02a9bece6a61
Author: Joel Bernstein 
Date:   Mon May 7 10:53:14 2018 -0400

SOLR-12280: WIP

commit 5466591999816eaacde6ce18d824d7688e5f4fe8
Author: Joel Bernstein 
Date:   Fri May 4 15:12:43 2018 -0400

SOLR-12280: WIP

commit d7fff7d557a7fd26011c21445b7969b2cd81036f
Author: Joel Bernstein 
Date:   Fri Apr 27 12:50:27 2018 -0400

SOLR-12280: Initial commit


> Ref-Guide: Add Digital Signal Processing documentation
> --
>
> Key: SOLR-12280
> URL: https://issues.apache.org/jira/browse/SOLR-12280
> Project: Solr
>  Issue Type: New Feature
>  Security Level: Public(Default Security Level. Issues are Public) 
>Reporter: Joel Bernstein
>Assignee: Joel Bernstein
>Priority: Major
> Fix For: 7.4
>
>
> This ticket will add a new section of documentation in the Math Expressions 
> docs covering the Digital Signal Processing functions. The main areas of 
> documentation coverage will include:
>  * Dot product
>  * Convolution
>  * Cross-correlation
>  * Find Delay
>  * Auto-correlation
>  * Fast Fourier Transform



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-12280) Ref-Guide: Add Digital Signal Processing documentation

2018-05-09 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-12280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469140#comment-16469140
 ] 

ASF subversion and git services commented on SOLR-12280:


Commit 144f00a1e315541a28f526f4cdf1e55eb60c862b in lucene-solr's branch 
refs/heads/master from [~joel.bernstein]
[ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=144f00a ]

Squashed commit of the following:

commit e5074c3223e394af17f686294a67a1dd3ecdd147
Author: Joel Bernstein 
Date:   Wed May 9 13:16:34 2018 -0400

SOLR-12280: WIP

commit 69cdeccf161177d10f4d2407542392aaee3fcfe8
Author: Joel Bernstein 
Date:   Wed May 9 13:08:02 2018 -0400

SOLR-12280: WIP

commit c94f0c87c3e57c023d622ad2411e522c4aac491c
Author: Joel Bernstein 
Date:   Wed May 9 11:54:58 2018 -0400

SOLR-12280: WIP

commit 68dd1e73355cb84410f2d0ff3a51797ed6194a10
Author: Joel Bernstein 
Date:   Wed May 9 10:54:32 2018 -0400

SOLR-12280: WIP

commit 04a010543418a469100fa299c606a7b1eed452e1
Author: Joel Bernstein 
Date:   Wed May 9 10:47:27 2018 -0400

SOLR-12280: WIP

commit a6bbfbadaafe33fcdf93d5c72755e30dadadf017
Author: Joel Bernstein 
Date:   Wed May 9 09:40:08 2018 -0400

SOLR-12280: WIP

commit 5d27961aa291bcd71527337632981bcdf62369b4
Author: Joel Bernstein 
Date:   Tue May 8 20:43:33 2018 -0400

SOLR-12280: WIP

commit e982cf939f429c05b736f6292c68dd96d7ebc027
Author: Joel Bernstein 
Date:   Tue May 8 13:27:29 2018 -0400

SOLR-12280: WIP

commit aae78ab6f387c28a080021bc919ef51864540be2
Author: Joel Bernstein 
Date:   Tue May 8 12:23:52 2018 -0400

SOLR-12280: WIP

commit 0787ad76f0f4c62c860784b15490d8a988939997
Author: Joel Bernstein 
Date:   Tue May 8 12:20:38 2018 -0400

SOLR-12280: WIP

commit 4df098376ba05188702cca8582959c3fe18066f5
Author: Joel Bernstein 
Date:   Tue May 8 12:12:11 2018 -0400

SOLR-12280: WIP

commit 5c0be5136bbab7e0c33b3b8a7b0395b1b330e96d
Author: Joel Bernstein 
Date:   Tue May 8 12:04:57 2018 -0400

SOLR-12280: WIP

commit 6c6feac4c2e5a49a5eab87a228713d1b93c8fc70
Author: Joel Bernstein 
Date:   Tue May 8 11:57:49 2018 -0400

SOLR-12280: WIP

commit 7d46d11c9dd3a51b68600c2c889f586147545294
Author: Joel Bernstein 
Date:   Tue May 8 11:50:51 2018 -0400

SOLR-12280: WIP

commit 8b6bf19d0091203ed63b39d070dd02a9bece6a61
Author: Joel Bernstein 
Date:   Mon May 7 10:53:14 2018 -0400

SOLR-12280: WIP

commit 5466591999816eaacde6ce18d824d7688e5f4fe8
Author: Joel Bernstein 
Date:   Fri May 4 15:12:43 2018 -0400

SOLR-12280: WIP

commit d7fff7d557a7fd26011c21445b7969b2cd81036f
Author: Joel Bernstein 
Date:   Fri Apr 27 12:50:27 2018 -0400

SOLR-12280: Initial commit


> Ref-Guide: Add Digital Signal Processing documentation
> --
>
> Key: SOLR-12280
> URL: https://issues.apache.org/jira/browse/SOLR-12280
> Project: Solr
>  Issue Type: New Feature
>  Security Level: Public(Default Security Level. Issues are Public) 
>Reporter: Joel Bernstein
>Assignee: Joel Bernstein
>Priority: Major
> Fix For: 7.4
>
>
> This ticket will add a new section of documentation in the Math Expressions 
> docs covering the Digital Signal Processing functions. The main areas of 
> documentation coverage will include:
>  * Dot product
>  * Convolution
>  * Cross-correlation
>  * Find Delay
>  * Auto-correlation
>  * Fast Fourier Transform



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-12280) Ref-Guide: Add Digital Signal Processing documentation

2018-05-09 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-12280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469135#comment-16469135
 ] 

ASF subversion and git services commented on SOLR-12280:


Commit 144f00a1e315541a28f526f4cdf1e55eb60c862b in lucene-solr's branch 
refs/heads/master from [~joel.bernstein]
[ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=144f00a ]

Squashed commit of the following:

commit e5074c3223e394af17f686294a67a1dd3ecdd147
Author: Joel Bernstein 
Date:   Wed May 9 13:16:34 2018 -0400

SOLR-12280: WIP

commit 69cdeccf161177d10f4d2407542392aaee3fcfe8
Author: Joel Bernstein 
Date:   Wed May 9 13:08:02 2018 -0400

SOLR-12280: WIP

commit c94f0c87c3e57c023d622ad2411e522c4aac491c
Author: Joel Bernstein 
Date:   Wed May 9 11:54:58 2018 -0400

SOLR-12280: WIP

commit 68dd1e73355cb84410f2d0ff3a51797ed6194a10
Author: Joel Bernstein 
Date:   Wed May 9 10:54:32 2018 -0400

SOLR-12280: WIP

commit 04a010543418a469100fa299c606a7b1eed452e1
Author: Joel Bernstein 
Date:   Wed May 9 10:47:27 2018 -0400

SOLR-12280: WIP

commit a6bbfbadaafe33fcdf93d5c72755e30dadadf017
Author: Joel Bernstein 
Date:   Wed May 9 09:40:08 2018 -0400

SOLR-12280: WIP

commit 5d27961aa291bcd71527337632981bcdf62369b4
Author: Joel Bernstein 
Date:   Tue May 8 20:43:33 2018 -0400

SOLR-12280: WIP

commit e982cf939f429c05b736f6292c68dd96d7ebc027
Author: Joel Bernstein 
Date:   Tue May 8 13:27:29 2018 -0400

SOLR-12280: WIP

commit aae78ab6f387c28a080021bc919ef51864540be2
Author: Joel Bernstein 
Date:   Tue May 8 12:23:52 2018 -0400

SOLR-12280: WIP

commit 0787ad76f0f4c62c860784b15490d8a988939997
Author: Joel Bernstein 
Date:   Tue May 8 12:20:38 2018 -0400

SOLR-12280: WIP

commit 4df098376ba05188702cca8582959c3fe18066f5
Author: Joel Bernstein 
Date:   Tue May 8 12:12:11 2018 -0400

SOLR-12280: WIP

commit 5c0be5136bbab7e0c33b3b8a7b0395b1b330e96d
Author: Joel Bernstein 
Date:   Tue May 8 12:04:57 2018 -0400

SOLR-12280: WIP

commit 6c6feac4c2e5a49a5eab87a228713d1b93c8fc70
Author: Joel Bernstein 
Date:   Tue May 8 11:57:49 2018 -0400

SOLR-12280: WIP

commit 7d46d11c9dd3a51b68600c2c889f586147545294
Author: Joel Bernstein 
Date:   Tue May 8 11:50:51 2018 -0400

SOLR-12280: WIP

commit 8b6bf19d0091203ed63b39d070dd02a9bece6a61
Author: Joel Bernstein 
Date:   Mon May 7 10:53:14 2018 -0400

SOLR-12280: WIP

commit 5466591999816eaacde6ce18d824d7688e5f4fe8
Author: Joel Bernstein 
Date:   Fri May 4 15:12:43 2018 -0400

SOLR-12280: WIP

commit d7fff7d557a7fd26011c21445b7969b2cd81036f
Author: Joel Bernstein 
Date:   Fri Apr 27 12:50:27 2018 -0400

SOLR-12280: Initial commit


> Ref-Guide: Add Digital Signal Processing documentation
> --
>
> Key: SOLR-12280
> URL: https://issues.apache.org/jira/browse/SOLR-12280
> Project: Solr
>  Issue Type: New Feature
>  Security Level: Public(Default Security Level. Issues are Public) 
>Reporter: Joel Bernstein
>Assignee: Joel Bernstein
>Priority: Major
> Fix For: 7.4
>
>
> This ticket will add a new section of documentation in the Math Expressions 
> docs covering the Digital Signal Processing functions. The main areas of 
> documentation coverage will include:
>  * Dot product
>  * Convolution
>  * Cross-correlation
>  * Find Delay
>  * Auto-correlation
>  * Fast Fourier Transform



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-12280) Ref-Guide: Add Digital Signal Processing documentation

2018-05-09 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-12280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469142#comment-16469142
 ] 

ASF subversion and git services commented on SOLR-12280:


Commit 144f00a1e315541a28f526f4cdf1e55eb60c862b in lucene-solr's branch 
refs/heads/master from [~joel.bernstein]
[ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=144f00a ]

Squashed commit of the following:

commit e5074c3223e394af17f686294a67a1dd3ecdd147
Author: Joel Bernstein 
Date:   Wed May 9 13:16:34 2018 -0400

SOLR-12280: WIP

commit 69cdeccf161177d10f4d2407542392aaee3fcfe8
Author: Joel Bernstein 
Date:   Wed May 9 13:08:02 2018 -0400

SOLR-12280: WIP

commit c94f0c87c3e57c023d622ad2411e522c4aac491c
Author: Joel Bernstein 
Date:   Wed May 9 11:54:58 2018 -0400

SOLR-12280: WIP

commit 68dd1e73355cb84410f2d0ff3a51797ed6194a10
Author: Joel Bernstein 
Date:   Wed May 9 10:54:32 2018 -0400

SOLR-12280: WIP

commit 04a010543418a469100fa299c606a7b1eed452e1
Author: Joel Bernstein 
Date:   Wed May 9 10:47:27 2018 -0400

SOLR-12280: WIP

commit a6bbfbadaafe33fcdf93d5c72755e30dadadf017
Author: Joel Bernstein 
Date:   Wed May 9 09:40:08 2018 -0400

SOLR-12280: WIP

commit 5d27961aa291bcd71527337632981bcdf62369b4
Author: Joel Bernstein 
Date:   Tue May 8 20:43:33 2018 -0400

SOLR-12280: WIP

commit e982cf939f429c05b736f6292c68dd96d7ebc027
Author: Joel Bernstein 
Date:   Tue May 8 13:27:29 2018 -0400

SOLR-12280: WIP

commit aae78ab6f387c28a080021bc919ef51864540be2
Author: Joel Bernstein 
Date:   Tue May 8 12:23:52 2018 -0400

SOLR-12280: WIP

commit 0787ad76f0f4c62c860784b15490d8a988939997
Author: Joel Bernstein 
Date:   Tue May 8 12:20:38 2018 -0400

SOLR-12280: WIP

commit 4df098376ba05188702cca8582959c3fe18066f5
Author: Joel Bernstein 
Date:   Tue May 8 12:12:11 2018 -0400

SOLR-12280: WIP

commit 5c0be5136bbab7e0c33b3b8a7b0395b1b330e96d
Author: Joel Bernstein 
Date:   Tue May 8 12:04:57 2018 -0400

SOLR-12280: WIP

commit 6c6feac4c2e5a49a5eab87a228713d1b93c8fc70
Author: Joel Bernstein 
Date:   Tue May 8 11:57:49 2018 -0400

SOLR-12280: WIP

commit 7d46d11c9dd3a51b68600c2c889f586147545294
Author: Joel Bernstein 
Date:   Tue May 8 11:50:51 2018 -0400

SOLR-12280: WIP

commit 8b6bf19d0091203ed63b39d070dd02a9bece6a61
Author: Joel Bernstein 
Date:   Mon May 7 10:53:14 2018 -0400

SOLR-12280: WIP

commit 5466591999816eaacde6ce18d824d7688e5f4fe8
Author: Joel Bernstein 
Date:   Fri May 4 15:12:43 2018 -0400

SOLR-12280: WIP

commit d7fff7d557a7fd26011c21445b7969b2cd81036f
Author: Joel Bernstein 
Date:   Fri Apr 27 12:50:27 2018 -0400

SOLR-12280: Initial commit


> Ref-Guide: Add Digital Signal Processing documentation
> --
>
> Key: SOLR-12280
> URL: https://issues.apache.org/jira/browse/SOLR-12280
> Project: Solr
>  Issue Type: New Feature
>  Security Level: Public(Default Security Level. Issues are Public) 
>Reporter: Joel Bernstein
>Assignee: Joel Bernstein
>Priority: Major
> Fix For: 7.4
>
>
> This ticket will add a new section of documentation in the Math Expressions 
> docs covering the Digital Signal Processing functions. The main areas of 
> documentation coverage will include:
>  * Dot product
>  * Convolution
>  * Cross-correlation
>  * Find Delay
>  * Auto-correlation
>  * Fast Fourier Transform



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Created] (SOLR-12337) Remove QueryWrapperFilter

2018-05-09 Thread David Smiley (JIRA)
David Smiley created SOLR-12337:
---

 Summary: Remove QueryWrapperFilter
 Key: SOLR-12337
 URL: https://issues.apache.org/jira/browse/SOLR-12337
 Project: Solr
  Issue Type: Sub-task
  Security Level: Public (Default Security Level. Issues are Public)
Reporter: David Smiley
Assignee: David Smiley


QueryWrapperFilter has not been needed ever since Filter was changed to extend 
Query -- LUCENE-1518.  It was retained because there was at least one place in 
Lucene that had a Filter/Query distinction, but it was forgotten when Filter 
moved to Solr.  It contains some code that creates a temporary IndexSearcher 
but forgets to null out the cache on it, and so QueryWrapperFilter can add 
non-trivial overhead.  We should simply remove it altogether.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-12337) Remove QueryWrapperFilter

2018-05-09 Thread David Smiley (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-12337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469220#comment-16469220
 ] 

David Smiley commented on SOLR-12337:
-

Patch:  {{Removed SolrConstantScoreQuery(new QueryWrapperFilter(}} wrappings 
around queries that were in fact already constant scoring Queries :-)
_shaking my head_ how did we get to this mess?_

TODO unrelated: SolrIndexSearcher.getProcessedFilter passes ScoreMode.COMPLETE 
instead of COMPLETE_NO_SCORE

I didn't yet remove QueryWrapperFilter; that can be done in another patch.  
Some tests will need to be removed/adjusted if it is eliminated.

Tests pass.
Could you please take a look [~ysee...@gmail.com]

> Remove QueryWrapperFilter
> -
>
> Key: SOLR-12337
> URL: https://issues.apache.org/jira/browse/SOLR-12337
> Project: Solr
>  Issue Type: Sub-task
>  Security Level: Public(Default Security Level. Issues are Public) 
>Reporter: David Smiley
>Assignee: David Smiley
>Priority: Major
> Attachments: SOLR-12337.patch
>
>
> QueryWrapperFilter has not been needed ever since Filter was changed to 
> extend Query -- LUCENE-1518.  It was retained because there was at least one 
> place in Lucene that had a Filter/Query distinction, but it was forgotten 
> when Filter moved to Solr.  It contains some code that creates a temporary 
> IndexSearcher but forgets to null out the cache on it, and so 
> QueryWrapperFilter can add non-trivial overhead.  We should simply remove it 
> altogether.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-8207) Modernise cloud tab on Admin UI

2018-05-09 Thread JIRA

[ 
https://issues.apache.org/jira/browse/SOLR-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469286#comment-16469286
 ] 

Jan Høydahl commented on SOLR-8207:
---

A question: Should we keep the "Tree" (collections) view as default when the 
Cluster/Cloud tab is opened, or should this new "Nodes" tab be the default to 
show like currently in the patch?

> Modernise cloud tab on Admin UI
> ---
>
> Key: SOLR-8207
> URL: https://issues.apache.org/jira/browse/SOLR-8207
> Project: Solr
>  Issue Type: Improvement
>  Components: Admin UI
>Affects Versions: 5.3
>Reporter: Upayavira
>Assignee: Jan Høydahl
>Priority: Major
> Attachments: node-compact.png, node-details.png, node-hostcolumn.png, 
> node-toggle-row-numdocs.png, nodes-tab-real.png, nodes-tab.png
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> The various sub-tabs of the "Cloud tab" were designed before anyone was 
> making real use of SolrCloud, and when we didn't really know the use-cases we 
> would need to support. I would argue that, whilst they are pretty (and 
> clever) they aren't really fit for purpose (with the exception of tree view).
> Issues:
> * Radial view doesn't scale beyond a small number of nodes/collections
> * Paging on the graph view is based on collections - so a collection with 
> many replicas won't be subject to pagination
> * The Dump feature is kinda redundant and should be removed
> * There is now a major overlap in functionality with the new Collections tab
> What I'd propose is that we:
>  * promote the tree tab to top level
>  * remove the graph views and the dump tab
>  * add a new Nodes tab
> This nodes tab would complement the collections tab - showing nodes, and 
> their associated replicas/collections. From this view, it would be possible 
> to add/remove replicas and to see the status of nodes. It would also be 
> possible to filter nodes by status: "show me only up nodes", "show me nodes 
> that are in trouble", "show me nodes that have leaders on them", etc.
> Presumably, if we have APIs to support it, we might have a "decommission 
> node" option, that would ensure that no replicas on this node are leaders, 
> and then remove all replicas from the node, ready for it to be removed from 
> the cluster.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-8207) Modernise cloud tab on Admin UI

2018-05-09 Thread Upayavira (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469296#comment-16469296
 ] 

Upayavira commented on SOLR-8207:
-

How about making it default for Solr 8.0? It is definitely a better panel than 
the graph one, but perhaps good to maintain consistency through minor versions?

 

> Modernise cloud tab on Admin UI
> ---
>
> Key: SOLR-8207
> URL: https://issues.apache.org/jira/browse/SOLR-8207
> Project: Solr
>  Issue Type: Improvement
>  Components: Admin UI
>Affects Versions: 5.3
>Reporter: Upayavira
>Assignee: Jan Høydahl
>Priority: Major
> Attachments: node-compact.png, node-details.png, node-hostcolumn.png, 
> node-toggle-row-numdocs.png, nodes-tab-real.png, nodes-tab.png
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> The various sub-tabs of the "Cloud tab" were designed before anyone was 
> making real use of SolrCloud, and when we didn't really know the use-cases we 
> would need to support. I would argue that, whilst they are pretty (and 
> clever) they aren't really fit for purpose (with the exception of tree view).
> Issues:
> * Radial view doesn't scale beyond a small number of nodes/collections
> * Paging on the graph view is based on collections - so a collection with 
> many replicas won't be subject to pagination
> * The Dump feature is kinda redundant and should be removed
> * There is now a major overlap in functionality with the new Collections tab
> What I'd propose is that we:
>  * promote the tree tab to top level
>  * remove the graph views and the dump tab
>  * add a new Nodes tab
> This nodes tab would complement the collections tab - showing nodes, and 
> their associated replicas/collections. From this view, it would be possible 
> to add/remove replicas and to see the status of nodes. It would also be 
> possible to filter nodes by status: "show me only up nodes", "show me nodes 
> that are in trouble", "show me nodes that have leaders on them", etc.
> Presumably, if we have APIs to support it, we might have a "decommission 
> node" option, that would ensure that no replicas on this node are leaders, 
> and then remove all replicas from the node, ready for it to be removed from 
> the cluster.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-8207) Modernise cloud tab on Admin UI

2018-05-09 Thread Varun Thacker (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469321#comment-16469321
 ] 

Varun Thacker commented on SOLR-8207:
-

{quote}A question: Should we keep the "Tree" (collections) view as default when 
the Cluster/Cloud tab is opened, or should this new "Nodes" tab be the default 
to show like currently in the patch?
{quote}
+1 to change the default to the "nodes" tab. Can we change the key name from 
"Cores" to "Replicas" maybe? 

> Modernise cloud tab on Admin UI
> ---
>
> Key: SOLR-8207
> URL: https://issues.apache.org/jira/browse/SOLR-8207
> Project: Solr
>  Issue Type: Improvement
>  Components: Admin UI
>Affects Versions: 5.3
>Reporter: Upayavira
>Assignee: Jan Høydahl
>Priority: Major
> Attachments: node-compact.png, node-details.png, node-hostcolumn.png, 
> node-toggle-row-numdocs.png, nodes-tab-real.png, nodes-tab.png
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> The various sub-tabs of the "Cloud tab" were designed before anyone was 
> making real use of SolrCloud, and when we didn't really know the use-cases we 
> would need to support. I would argue that, whilst they are pretty (and 
> clever) they aren't really fit for purpose (with the exception of tree view).
> Issues:
> * Radial view doesn't scale beyond a small number of nodes/collections
> * Paging on the graph view is based on collections - so a collection with 
> many replicas won't be subject to pagination
> * The Dump feature is kinda redundant and should be removed
> * There is now a major overlap in functionality with the new Collections tab
> What I'd propose is that we:
>  * promote the tree tab to top level
>  * remove the graph views and the dump tab
>  * add a new Nodes tab
> This nodes tab would complement the collections tab - showing nodes, and 
> their associated replicas/collections. From this view, it would be possible 
> to add/remove replicas and to see the status of nodes. It would also be 
> possible to filter nodes by status: "show me only up nodes", "show me nodes 
> that are in trouble", "show me nodes that have leaders on them", etc.
> Presumably, if we have APIs to support it, we might have a "decommission 
> node" option, that would ensure that no replicas on this node are leaders, 
> and then remove all replicas from the node, ready for it to be removed from 
> the cluster.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: Note in Jira directing users to other resources for support

2018-05-09 Thread Jan Høydahl
+1

Sendt fra min iPhone

> 9. mai 2018 kl. 18:48 skrev Cassandra Targett :
> 
> +1. Good idea, thanks.
> 
>> On Wed, May 9, 2018 at 11:29 AM Shawn Heisey  wrote:
>> I opened the following issue with Infra:
>> 
>> https://issues.apache.org/jira/browse/INFRA-16507
>> 
>> This is a request to have Jira display a note to users who create issues
>> on our projects, asking them to discuss their problem via appropriate
>> support channels before they create a ticket.
>> 
>> Just after I clicked the "create" button I realized that I probably
>> should have discussed it with the group first.  I do see the irony!  I
>> hope it's an idea everyone can get behind.
>> 
>> Thanks,
>> Shawn
>> 
>> 
>> -
>> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
>> For additional commands, e-mail: dev-h...@lucene.apache.org
>> 


[JENKINS] Solr-reference-guide-master - Build # 7365 - Failure

2018-05-09 Thread Apache Jenkins Server
Build: https://builds.apache.org/job/Solr-reference-guide-master/7365/

Log: 
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on websites1 (git-websites svn-websites) in workspace 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master
 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url git://git.apache.org/lucene-solr.git # 
 > timeout=10
Cleaning workspace
 > git rev-parse --verify HEAD # timeout=10
Resetting working tree
 > git reset --hard # timeout=10
 > git clean -fdx # timeout=10
Fetching upstream changes from git://git.apache.org/lucene-solr.git
 > git --version # timeout=10
 > git fetch --tags --progress git://git.apache.org/lucene-solr.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
Checking out Revision 144f00a1e315541a28f526f4cdf1e55eb60c862b 
(refs/remotes/origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 144f00a1e315541a28f526f4cdf1e55eb60c862b
Commit message: "Squashed commit of the following:"
 > git rev-list --no-walk 4177252a10fc1cc82e507cc34841814af7fb1ec6 # timeout=10
No emails were triggered.
[Solr-reference-guide-master] $ /usr/bin/env bash 
/tmp/jenkins5198893356883734364.sh
+ set -e
+ RVM_PATH=/home/jenkins/.rvm
+ RUBY_VERSION=ruby-2.3.3
+ GEMSET=solr-refguide-gemset
+ curl -sSL https://get.rvm.io
+ bash -s -- --ignore-dotfiles stable
Turning on ignore dotfiles mode.
Downloading https://github.com/rvm/rvm/archive/1.29.3.tar.gz
Downloading 
https://github.com/rvm/rvm/releases/download/1.29.3/1.29.3.tar.gz.asc
gpg: Signature made Sun 10 Sep 2017 08:59:21 PM UTC using RSA key ID BF04FF17
gpg: Good signature from "Michal Papis (RVM signing) "
gpg: aka "Michal Papis "
gpg: aka "[jpeg image of size 5015]"
gpg: WARNING: This key is not certified with a trusted signature!
gpg:  There is no indication that the signature belongs to the owner.
Primary key fingerprint: 409B 6B17 96C2 7546 2A17  0311 3804 BB82 D39D C0E3
 Subkey fingerprint: 62C9 E5F4 DA30 0D94 AC36  166B E206 C29F BF04 FF17
GPG verified '/home/jenkins/.rvm/archives/rvm-1.29.3.tgz'

Upgrading the RVM installation in /home/jenkins/.rvm/
Upgrade of RVM in /home/jenkins/.rvm/ is complete.

Upgrade Notes:

  * No new notes to display.

+ set +x
Running 'source /home/jenkins/.rvm/scripts/rvm'
Running 'rvm autolibs disable'
Running 'rvm install ruby-2.3.3'
Already installed ruby-2.3.3.
To reinstall use:

rvm reinstall ruby-2.3.3

Running 'rvm gemset create solr-refguide-gemset'
ruby-2.3.3 - #gemset created 
/home/jenkins/.rvm/gems/ruby-2.3.3@solr-refguide-gemset
ruby-2.3.3 - #generating solr-refguide-gemset 
wrappers|/-\|/-\|.-\|/-\|/-.|/-\|/-\|.-\|/-\|/-.|/-\|/-\|.-\|/-\|/-.|/-\|/-\|.-\|/-.
Running 'rvm ruby-2.3.3@solr-refguide-gemset'
Using /home/jenkins/.rvm/gems/ruby-2.3.3 with gemset solr-refguide-gemset
Running 'gem install --force --version 3.5.0 jekyll'
Successfully installed jekyll-3.5.0
Parsing documentation for jekyll-3.5.0
Done installing documentation for jekyll after 1 seconds
1 gem installed
Running 'gem install --force --version 2.1.0 jekyll-asciidoc'
Successfully installed jekyll-asciidoc-2.1.0
Parsing documentation for jekyll-asciidoc-2.1.0
Done installing documentation for jekyll-asciidoc after 0 seconds
1 gem installed
Running 'gem install --force --version 1.1.2 pygments.rb'
Successfully installed pygments.rb-1.1.2
Parsing documentation for pygments.rb-1.1.2
Done installing documentation for pygments.rb after 0 seconds
1 gem installed
Running 'ant ivy-bootstrap'
Buildfile: 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master/build.xml

-ivy-bootstrap1:
 [echo] installing ivy 2.4.0 to /home/jenkins/.ant/lib
  [get] Getting: 
http://repo1.maven.org/maven2/org/apache/ivy/ivy/2.4.0/ivy-2.4.0.jar
  [get] To: /home/jenkins/.ant/lib/ivy-2.4.0.jar
  [get] Not modified - so not downloaded

-ivy-bootstrap2:

-ivy-checksum:

-ivy-remove-old-versions:

ivy-bootstrap:

BUILD SUCCESSFUL
Total time: 0 seconds
+ ant clean build-site build-pdf
Buildfile: 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master/solr/solr-ref-guide/build.xml

clean:

build-init:
[mkdir] Created dir: 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master/solr/build/solr-ref-guide/content
 [echo] Copying all non template files from src ...
 [copy] Copying 420 files to 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master/solr/build/solr-ref-guide/content
 [echo] Copy (w/prop replacement) any template files from src...
 [copy] Copying 1 file to 

[jira] [Commented] (SOLR-11453) Create separate logger for slow requests

2018-05-09 Thread Varun Thacker (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-11453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469332#comment-16469332
 ] 

Varun Thacker commented on SOLR-11453:
--

Hi [~elyograg]

Just wanted to know what's the plan here? Your slowlog-informational.patch 
patch looks good to me!

I'm thinking let's commit slowlog-informational.patch + add log2j2 appenders on 
by default.

Personally I don't think we should expose turning it off via a sysprop but If 
you think it's a good idea then I am not opposed to it. Only thought would be : 
can we do that as a separate Jira ? 

I will be off for 1 week starting Friday FYI so won't be active on jira

> Create separate logger for slow requests
> 
>
> Key: SOLR-11453
> URL: https://issues.apache.org/jira/browse/SOLR-11453
> Project: Solr
>  Issue Type: Improvement
>  Components: logging
>Affects Versions: 7.0.1
>Reporter: Shawn Heisey
>Assignee: Shawn Heisey
>Priority: Minor
> Attachments: SOLR-11453.patch, SOLR-11453.patch, SOLR-11453.patch, 
> SOLR-11453.patch, slowlog-informational.patch, slowlog-informational.patch, 
> slowlog-informational.patch
>
>
> There is some desire on the mailing list to create a separate logfile for 
> slow queries.  Currently it is not possible to do this cleanly, because the 
> WARN level used by slow query logging within the SolrCore class is also used 
> for other events that SolrCore can log.  Those messages would be out of place 
> in a slow query log.  They should typically stay in main solr logfile.
> I propose creating a custom logger for slow queries, similar to what has been 
> set up for request logging.  In the SolrCore class, which is 
> org.apache.solr.core.SolrCore, there is a special logger at 
> org.apache.solr.core.SolrCore.Request.  This is not a real class, just a 
> logger which makes it possible to handle those log messages differently than 
> the rest of Solr's logging.  I propose setting up another custom logger 
> within SolrCore which could be org.apache.solr.core.SolrCore.SlowRequest.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (SOLR-12337) Remove QueryWrapperFilter

2018-05-09 Thread David Smiley (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-12337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

David Smiley updated SOLR-12337:

Attachment: SOLR-12337.patch

> Remove QueryWrapperFilter
> -
>
> Key: SOLR-12337
> URL: https://issues.apache.org/jira/browse/SOLR-12337
> Project: Solr
>  Issue Type: Sub-task
>  Security Level: Public(Default Security Level. Issues are Public) 
>Reporter: David Smiley
>Assignee: David Smiley
>Priority: Major
> Attachments: SOLR-12337.patch
>
>
> QueryWrapperFilter has not been needed ever since Filter was changed to 
> extend Query -- LUCENE-1518.  It was retained because there was at least one 
> place in Lucene that had a Filter/Query distinction, but it was forgotten 
> when Filter moved to Solr.  It contains some code that creates a temporary 
> IndexSearcher but forgets to null out the cache on it, and so 
> QueryWrapperFilter can add non-trivial overhead.  We should simply remove it 
> altogether.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[JENKINS] Lucene-Solr-7.x-MacOSX (64bit/jdk1.8.0) - Build # 627 - Unstable!

2018-05-09 Thread Policeman Jenkins Server
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-MacOSX/627/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseG1GC

6 tests failed.
FAILED:  
org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testSplitIntegration

Error Message:
last state: 
DocCollection(testSplitIntegration_collection//clusterstate.json/69)={   
"replicationFactor":"2",   "pullReplicas":"0",   
"router":{"name":"compositeId"},   "maxShardsPerNode":"2",   
"autoAddReplicas":"false",   "nrtReplicas":"2",   "tlogReplicas":"0",   
"autoCreated":"true",   "shards":{ "shard2":{   "replicas":{ 
"core_node3":{   
"core":"testSplitIntegration_collection_shard2_replica_n3",   
"leader":"true",   "SEARCHER.searcher.maxDoc":11,   
"SEARCHER.searcher.deletedDocs":0,   "INDEX.sizeInBytes":1,   
"node_name":"127.0.0.1:10002_solr",   "state":"active",   
"type":"NRT",   "SEARCHER.searcher.numDocs":11}, "core_node4":{ 
  "core":"testSplitIntegration_collection_shard2_replica_n4",   
"SEARCHER.searcher.maxDoc":11,   "SEARCHER.searcher.deletedDocs":0, 
  "INDEX.sizeInBytes":1,   "node_name":"127.0.0.1:10003_solr",  
 "state":"active",   "type":"NRT",   
"SEARCHER.searcher.numDocs":11}},   "range":"0-7fff",   
"state":"active"}, "shard1":{   "stateTimestamp":"1525891964524271250", 
  "replicas":{ "core_node1":{   
"core":"testSplitIntegration_collection_shard1_replica_n1",   
"leader":"true",   "SEARCHER.searcher.maxDoc":14,   
"SEARCHER.searcher.deletedDocs":0,   "INDEX.sizeInBytes":1,   
"node_name":"127.0.0.1:10002_solr",   "state":"active",   
"type":"NRT",   "SEARCHER.searcher.numDocs":14}, "core_node2":{ 
  "core":"testSplitIntegration_collection_shard1_replica_n2",   
"SEARCHER.searcher.maxDoc":14,   "SEARCHER.searcher.deletedDocs":0, 
  "INDEX.sizeInBytes":1,   "node_name":"127.0.0.1:10003_solr",  
 "state":"active",   "type":"NRT",   
"SEARCHER.searcher.numDocs":14}},   "range":"8000-",   
"state":"inactive"}, "shard1_1":{   "parent":"shard1",   
"stateTimestamp":"1525891964524934600",   "range":"c000-",  
 "state":"active",   "replicas":{ "core_node10":{   
"leader":"true",   
"core":"testSplitIntegration_collection_shard1_1_replica1",   
"SEARCHER.searcher.maxDoc":7,   "SEARCHER.searcher.deletedDocs":0,  
 "INDEX.sizeInBytes":1,   "node_name":"127.0.0.1:10002_solr",   
"base_url":"http://127.0.0.1:10002/solr;,   "state":"active",   
"type":"NRT",   "SEARCHER.searcher.numDocs":7}, 
"core_node9":{   
"core":"testSplitIntegration_collection_shard1_1_replica0",   
"SEARCHER.searcher.maxDoc":7,   "SEARCHER.searcher.deletedDocs":0,  
 "INDEX.sizeInBytes":1,   "node_name":"127.0.0.1:10003_solr",   
"base_url":"http://127.0.0.1:10003/solr;,   "state":"active",   
"type":"NRT",   "SEARCHER.searcher.numDocs":7}}}, "shard1_0":{  
 "parent":"shard1",   "stateTimestamp":"1525891964524764850",   
"range":"8000-bfff",   "state":"active",   "replicas":{ 
"core_node7":{   "leader":"true",   
"core":"testSplitIntegration_collection_shard1_0_replica0",   
"SEARCHER.searcher.maxDoc":7,   "SEARCHER.searcher.deletedDocs":0,  
 "INDEX.sizeInBytes":1,   "node_name":"127.0.0.1:10003_solr",   
"base_url":"http://127.0.0.1:10003/solr;,   "state":"active",   
"type":"NRT",   "SEARCHER.searcher.numDocs":7}, 
"core_node8":{   
"core":"testSplitIntegration_collection_shard1_0_replica1",   
"SEARCHER.searcher.maxDoc":7,   "SEARCHER.searcher.deletedDocs":0,  
 "INDEX.sizeInBytes":1,   "node_name":"127.0.0.1:10002_solr",   
"base_url":"http://127.0.0.1:10002/solr;,   "state":"active",   
"type":"NRT",   "SEARCHER.searcher.numDocs":7}

Stack Trace:
java.util.concurrent.TimeoutException: last state: 
DocCollection(testSplitIntegration_collection//clusterstate.json/69)={
  "replicationFactor":"2",
  "pullReplicas":"0",
  "router":{"name":"compositeId"},
  "maxShardsPerNode":"2",
  "autoAddReplicas":"false",
  "nrtReplicas":"2",
  "tlogReplicas":"0",
  "autoCreated":"true",
  "shards":{
"shard2":{
  "replicas":{
"core_node3":{
  "core":"testSplitIntegration_collection_shard2_replica_n3",
  "leader":"true",
  "SEARCHER.searcher.maxDoc":11,
  "SEARCHER.searcher.deletedDocs":0,
  "INDEX.sizeInBytes":1,
  "node_name":"127.0.0.1:10002_solr",
  

Solr RefGuide Errata page wrong link

2018-05-09 Thread Jan Høydahl
See https://lucene.apache.org/solr/guide/7_3/errata.html
The link on that page says /7.3/… but should be /7_3/… so it is a 404 now, and 
probably also in the PDF.

PS: The Apache Comments section is not active

--
Jan Høydahl, search solution architect
Cominvent AS - www.cominvent.com


-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-12235) Incomplete debugQuery info when using edismax and boost param

2018-05-09 Thread Christine Poerschke (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-12235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469422#comment-16469422
 ] 

Christine Poerschke commented on SOLR-12235:


Thanks [~bogdanstoik] and [~stefan.langenmaier] for reporting this issue here 
and in SOLR-12323 with how-to-reproduce steps.

I've done a quick scan through {{solr/CHANGES.txt}} and nothing jumped out to 
me as obvious point to start looking into.

Slightly more systematically, a next investigative step could be to build a 
small exploratory test case - e.g. based upon 
https://github.com/apache/lucene-solr/blob/master/solr/core/src/test/org/apache/solr/HelloWorldSolrCloudTestCase.java
 - which passes at 
https://github.com/apache/lucene-solr/tree/releases/lucene-solr/7.2.1 commit 
point but fails on 
https://github.com/apache/lucene-solr/tree/releases/lucene-solr/7.3.0 commit 
point and then to 'zoom in' towards the unknown commit point(s) in between at 
which the info went missing.

> Incomplete debugQuery info when using edismax and boost param
> -
>
> Key: SOLR-12235
> URL: https://issues.apache.org/jira/browse/SOLR-12235
> Project: Solr
>  Issue Type: Bug
>  Security Level: Public(Default Security Level. Issues are Public) 
>  Components: query parsers, search
>Affects Versions: 7.3
> Environment: Solr 7.3.0, Java 1.8.0_162
>Reporter: Bogdan Stoica
>Priority: Minor
>
> There is an issue with the way SOLR 7.3 outputs explain information when 
> using edismax and 
> boost param.
>  
> Example query: 
> /select?boost=results=on=edismax=word=text
>  
> Solr 7.3 outputs:
>  
> {code:java}
>  
> 31349.63 = product of: 1.0 = boost 31349.63 = boost(double(results)) 
> {code}
>  
>  
> In comparrison, Solr 7.2.1 returns the following:
>  
> {code:java}
>  
> 31349.63 = boost(text:word,double(results)), product of: 14.400382 = 
> weight(text:word in 18142) [SchemaSimilarity], result of: 14.400382 = 
> score(doc=18142,freq=1.0 = termFreq=1.0 ), product of: 10.677335 = idf, 
> computed as log(1 + (docCount - docFreq + 0.5) / (docFreq + 0.5)) from: 6.0 = 
> docFreq 281851.0 = docCount 1.3486869 = tfNorm, computed as (freq * (k1 + 1)) 
> / (freq + k1 * (1 - b + b * fieldLength / avgFieldLength)) from: 1.0 = 
> termFreq=1.0 1.2 = parameter k1 0.75 = parameter b 2.7172585 = avgFieldLength 
> 1.0 = fieldLength 2177.0 = double(results)=2177.0 
> {code}
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[JENKINS] Lucene-Solr-master-Solaris (64bit/jdk1.8.0) - Build # 1852 - Failure!

2018-05-09 Thread Policeman Jenkins Server
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Solaris/1852/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC

All tests passed

Build Log:
[...truncated 65376 lines...]
 [java] ERROR: Orphan page: 
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-ref-guide/content/dsp.adoc
 [java] Exception in thread "main" java.lang.RuntimeException: Found 1 
orphan pages (which are not in the 'page-children' attribute of any other pages)
 [java] at BuildNavAndPDFBody.main(BuildNavAndPDFBody.java:82)

BUILD FAILED
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/build.xml:633: The 
following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/build.xml:101: The 
following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build.xml:670: 
The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build.xml:192: 
The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/solr-ref-guide/build.xml:176:
 Java returned: 1

Total time: 88 minutes 34 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Setting 
ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Setting 
ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Setting 
ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting 
ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting 
ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting 
ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

[JENKINS] Solr-reference-guide-master - Build # 7366 - Still Failing

2018-05-09 Thread Apache Jenkins Server
Build: https://builds.apache.org/job/Solr-reference-guide-master/7366/

Log: 
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on websites1 (git-websites svn-websites) in workspace 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master
 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url git://git.apache.org/lucene-solr.git # 
 > timeout=10
Cleaning workspace
 > git rev-parse --verify HEAD # timeout=10
Resetting working tree
 > git reset --hard # timeout=10
 > git clean -fdx # timeout=10
Fetching upstream changes from git://git.apache.org/lucene-solr.git
 > git --version # timeout=10
 > git fetch --tags --progress git://git.apache.org/lucene-solr.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
Checking out Revision 144f00a1e315541a28f526f4cdf1e55eb60c862b 
(refs/remotes/origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 144f00a1e315541a28f526f4cdf1e55eb60c862b
Commit message: "Squashed commit of the following:"
 > git rev-list --no-walk 144f00a1e315541a28f526f4cdf1e55eb60c862b # timeout=10
No emails were triggered.
[Solr-reference-guide-master] $ /usr/bin/env bash 
/tmp/jenkins5452915336889024737.sh
+ set -e
+ RVM_PATH=/home/jenkins/.rvm
+ RUBY_VERSION=ruby-2.3.3
+ GEMSET=solr-refguide-gemset
+ curl -sSL https://get.rvm.io
+ bash -s -- --ignore-dotfiles stable
Turning on ignore dotfiles mode.
Downloading https://github.com/rvm/rvm/archive/1.29.3.tar.gz
Downloading 
https://github.com/rvm/rvm/releases/download/1.29.3/1.29.3.tar.gz.asc
gpg: Signature made Sun 10 Sep 2017 08:59:21 PM UTC using RSA key ID BF04FF17
gpg: Good signature from "Michal Papis (RVM signing) "
gpg: aka "Michal Papis "
gpg: aka "[jpeg image of size 5015]"
gpg: WARNING: This key is not certified with a trusted signature!
gpg:  There is no indication that the signature belongs to the owner.
Primary key fingerprint: 409B 6B17 96C2 7546 2A17  0311 3804 BB82 D39D C0E3
 Subkey fingerprint: 62C9 E5F4 DA30 0D94 AC36  166B E206 C29F BF04 FF17
GPG verified '/home/jenkins/.rvm/archives/rvm-1.29.3.tgz'

Upgrading the RVM installation in /home/jenkins/.rvm/
Upgrade of RVM in /home/jenkins/.rvm/ is complete.

Upgrade Notes:

  * No new notes to display.

+ set +x
Running 'source /home/jenkins/.rvm/scripts/rvm'
Running 'rvm autolibs disable'
Running 'rvm install ruby-2.3.3'
Already installed ruby-2.3.3.
To reinstall use:

rvm reinstall ruby-2.3.3

Running 'rvm gemset create solr-refguide-gemset'
ruby-2.3.3 - #gemset created 
/home/jenkins/.rvm/gems/ruby-2.3.3@solr-refguide-gemset
ruby-2.3.3 - #generating solr-refguide-gemset 
wrappers|/-\|/-\|.-\|/-\|/-.|/-\|/-\|.-\|/-\|/-.|/-\|/-\|.-\|/-\|/-.|/-\|/-\|.-\|/-.
Running 'rvm ruby-2.3.3@solr-refguide-gemset'
Using /home/jenkins/.rvm/gems/ruby-2.3.3 with gemset solr-refguide-gemset
Running 'gem install --force --version 3.5.0 jekyll'
Successfully installed jekyll-3.5.0
Parsing documentation for jekyll-3.5.0
Done installing documentation for jekyll after 1 seconds
1 gem installed
Running 'gem install --force --version 2.1.0 jekyll-asciidoc'
Successfully installed jekyll-asciidoc-2.1.0
Parsing documentation for jekyll-asciidoc-2.1.0
Done installing documentation for jekyll-asciidoc after 0 seconds
1 gem installed
Running 'gem install --force --version 1.1.2 pygments.rb'
Successfully installed pygments.rb-1.1.2
Parsing documentation for pygments.rb-1.1.2
Done installing documentation for pygments.rb after 0 seconds
1 gem installed
Running 'ant ivy-bootstrap'
Buildfile: 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master/build.xml

-ivy-bootstrap1:
 [echo] installing ivy 2.4.0 to /home/jenkins/.ant/lib
  [get] Getting: 
http://repo1.maven.org/maven2/org/apache/ivy/ivy/2.4.0/ivy-2.4.0.jar
  [get] To: /home/jenkins/.ant/lib/ivy-2.4.0.jar
  [get] Not modified - so not downloaded

-ivy-bootstrap2:

-ivy-checksum:

-ivy-remove-old-versions:

ivy-bootstrap:

BUILD SUCCESSFUL
Total time: 0 seconds
+ ant clean build-site build-pdf
Buildfile: 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master/solr/solr-ref-guide/build.xml

clean:

build-init:
[mkdir] Created dir: 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master/solr/build/solr-ref-guide/content
 [echo] Copying all non template files from src ...
 [copy] Copying 420 files to 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master/solr/build/solr-ref-guide/content
 [echo] Copy (w/prop replacement) any template files from src...
 [copy] Copying 1 file to 

[jira] [Commented] (SOLR-8207) Modernise cloud tab on Admin UI

2018-05-09 Thread Varun Thacker (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469362#comment-16469362
 ] 

Varun Thacker commented on SOLR-8207:
-

Hi Jan,

Under the heap section we have 

Used: 125.6Mb
Total: 245.4Mb
Free: 119.8Mb

Instead of displaying "Free" would displaying "Max" be more useful ? 

>From the metrics API the max of this JVM is "memory.heap.max":257294336 .  
>This would help indicate to the user he's running pretty close to the limit?

 

Under the Host tab, showing RAM used might bring more pain than gain? I can 
imagine people going like "oh i'm running out of memory" , but then we'll have 
to point them to Uwe's MMap blog? 

> Modernise cloud tab on Admin UI
> ---
>
> Key: SOLR-8207
> URL: https://issues.apache.org/jira/browse/SOLR-8207
> Project: Solr
>  Issue Type: Improvement
>  Components: Admin UI
>Affects Versions: 5.3
>Reporter: Upayavira
>Assignee: Jan Høydahl
>Priority: Major
> Attachments: node-compact.png, node-details.png, node-hostcolumn.png, 
> node-toggle-row-numdocs.png, nodes-tab-real.png, nodes-tab.png
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> The various sub-tabs of the "Cloud tab" were designed before anyone was 
> making real use of SolrCloud, and when we didn't really know the use-cases we 
> would need to support. I would argue that, whilst they are pretty (and 
> clever) they aren't really fit for purpose (with the exception of tree view).
> Issues:
> * Radial view doesn't scale beyond a small number of nodes/collections
> * Paging on the graph view is based on collections - so a collection with 
> many replicas won't be subject to pagination
> * The Dump feature is kinda redundant and should be removed
> * There is now a major overlap in functionality with the new Collections tab
> What I'd propose is that we:
>  * promote the tree tab to top level
>  * remove the graph views and the dump tab
>  * add a new Nodes tab
> This nodes tab would complement the collections tab - showing nodes, and 
> their associated replicas/collections. From this view, it would be possible 
> to add/remove replicas and to see the status of nodes. It would also be 
> possible to filter nodes by status: "show me only up nodes", "show me nodes 
> that are in trouble", "show me nodes that have leaders on them", etc.
> Presumably, if we have APIs to support it, we might have a "decommission 
> node" option, that would ensure that no replicas on this node are leaders, 
> and then remove all replicas from the node, ready for it to be removed from 
> the cluster.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-11709) JSON "Stats" Facets should support directly specifying a domain change (for filters/blockjoin/etc...)

2018-05-09 Thread Mikhail Khludnev (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-11709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469364#comment-16469364
 ] 

Mikhail Khludnev commented on SOLR-11709:
-

How several stats will looks like? eg how to add {{min(popularity)}} right 
there? 

> JSON "Stats" Facets should support directly specifying a domain change (for 
> filters/blockjoin/etc...)
> -
>
> Key: SOLR-11709
> URL: https://issues.apache.org/jira/browse/SOLR-11709
> Project: Solr
>  Issue Type: Improvement
>  Security Level: Public(Default Security Level. Issues are Public) 
>  Components: Facet Module
>Reporter: Hoss Man
>Priority: Major
>
> AFAICT, the simple string syntax of JSON Facet Modules "statistic facets" 
> (ex: {{foo:"min(fieldA)"}} ) means there is no way to request a statistic 
> with a domain change applied -- stats are always computed relative to it's 
> immediate parent (ie: the baseset matching the {{q}} for a top level stat, or 
> the constrained set if a stat is a subfacet of something else)
> This means that things like the simple "fq exclusion" in StatsComponent have 
> no straight forward equivalent in JSON faceting. 
> The work around appears to be to use a {{type:"query", q:"*:*, domain:...}} 
> parent and specify the stats you are interested in as sub-facets...
> {code}
> $ curl 'http://localhost:8983/solr/techproducts/query' -d 
> 'q=*:*=true={!tag=boo}id:hoss=true={!max=true 
> ex=boo}popularity=0={
> bar: { type:"query", q:"*:*", domain:{excludeTags:boo}, facet: { 
> foo:"max(popularity)" } } }'
> {
>   "response":{"numFound":0,"start":0,"docs":[]
>   },
>   "facets":{
> "count":0,
> "bar":{
>   "count":32,
>   "foo":10}},
>   "stats":{
> "stats_fields":{
>   "popularity":{
> "max":10.0
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-12170) terms facet on a date field can fail

2018-05-09 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-12170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469376#comment-16469376
 ] 

ASF subversion and git services commented on SOLR-12170:


Commit 1067cabc192020db01e5e0ebc039f712e2f1c8ff in lucene-solr's branch 
refs/heads/master from [~yo...@apache.org]
[ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=1067cab ]

SOLR-12170: fix date format exceptions for terms facet on date field


> terms facet on a date field can fail
> 
>
> Key: SOLR-12170
> URL: https://issues.apache.org/jira/browse/SOLR-12170
> Project: Solr
>  Issue Type: Bug
>  Security Level: Public(Default Security Level. Issues are Public) 
>  Components: Facet Module
>Affects Versions: 6.6
>Reporter: Yonik Seeley
>Priority: Major
> Fix For: 7.4
>
> Attachments: SOLR-12170.patch
>
>
> There are still some modes of failures when doing a terms facet on a date 
> field.  This issue picks up from SOLR-12020 since the fixes likely won't make 
> it in time for the 7.3 release.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-12298) Index Full nested document Hierarchy For Queries (umbrella issue)

2018-05-09 Thread David Smiley (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-12298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469375#comment-16469375
 ] 

David Smiley commented on SOLR-12298:
-

Quoting [~hossman] here inline (hoping for his input):
{quote}Are you suggesting we model child documents as objects 
(SolrInputDocuments i guess?) in a special field?
{quote}
Yes.  Not as a special field, although _anonymous_ children (those that don't 
have any particular label (no named relationship)) could use the 
_childDocuments_ key as it's consistent with existing use of this label.
  
{quote}... what if i put child documents in multiple fields? would that signify 
the different types of child?
{quote}
Yes indeed.  This is largely the point of this approach, since the current 
anonymous relationship has a loss of semantics in the relationship.

 
{quote}how would solr model that in the (lucene) Documents when giving them to 
the InddexWriter?
{quote}
In this issue, Moshe has proposed a labeled path field, e.g. "post.comment".  
This path would be added in an URP, or perhaps it would be done by 
\{{AddUpdateCommand.flatten/recUnwrap}} right when the URP chain is done.
{quote}How would solr know how to order the children in from multiple 
fields/lists when creating the block?
{quote}
Ah, I think that's a non-issue as they are indexed in the order given 
(notwistanding the hierarchy flattening with parent last).  If you meant how 
might the order be reconstituted later at retrieval time then we can rely on 
the docID order since they are kept in order and never broken up.  
{quote}Wouldn't the "type of child" information be better living in the child 
documents itself? (particularly since that "type" information needs to be in 
the child documents anyway so that the filter query for a BJQ can be specified.)
{quote}
_Ultimately_ it does in the generated Lucene Document.  
{quote}It also seems like it would require code that wants to know what 
children exist in a document to do a lot of work to find that out (need to 
iterate ever field in the SolrInputDocument and do reflection to see if they 
are child-documents or not)
{quote}
I looked at this; it's AddSchemaFieldsUpdateProcessorFactory and 
AddUpdateCommand.flatten/recUnwrap.  I'm not concerned about the former as it's 
for schema-guessing; only the latter.  Perhaps this is no big deal; it's only 
the number of distinct field names in the average document?  Also if the schema 
contained special "ChildDoc" fields or some-such, then the schema could guide 
these code paths to know which field names to lookup in the incoming document.
{quote}Another concern off the top of my head is that a lot of existing code 
(including any custom update processors people might have) would assume those 
child documents are multivaluved field values and would probably break – hence 
a new method on SolrInputDocument seems wiser (code that doens't know about may 
not do what you want, but at least it won't break it)
{quote}
Fixable on a case by case basis.  If this is worse than I imagine it is, then 
what URP would be the worst offender?

In summary, the current approach doesn't retain the semantic information of 
relationships, and I believe removing SolrInputFields.childDocuments will 
result in something _simpler_.  It also allows a cleaner separation between the 
format-specific input (JSON vs XML vs ...) and logic that should be ignorant to 
that.

The next-best alternative I can think of that doesn't disturb 
SolrInputDocument._childDocuments would be if hypothetically SolrInputDocument 
had overloaded addChildDocument to accept a relationship string.  And the impl 
would add the child document along with mutating it to have the fields moshe 
has spoken of.  But this seems trappy to me since some methods would do this 
and the existing ones wouldn't, and so the format loader would need to be 
careful to always use or or the other.

> Index Full nested document Hierarchy For Queries (umbrella issue)
> -
>
> Key: SOLR-12298
> URL: https://issues.apache.org/jira/browse/SOLR-12298
> Project: Solr
>  Issue Type: Improvement
>  Security Level: Public(Default Security Level. Issues are Public) 
>Reporter: mosh
>Priority: Major
>
> Solr ought to have the ability to index deeply nested objects, while storing 
> the original document hierarchy.
>  Currently the client has to index the child document's full path and level 
> to manually reconstruct the original document structure, since the children 
> are flattened and returned in the reserved "__childDocuments__" key.
> Ideally you could index a nested document, having Solr transparently add the 
> required fields while providing a document transformer to rebuild the 
> original document's hierarchy.
>  
> This issue is an umbrella issue for the 

Re: lucene-solr:master: Squashed commit of the following:

2018-05-09 Thread Alan Woodward
I think this has broken precommit?


build-nav-data-files:
 [java] Building up tree of all known pages
 [java] ERROR: Orphan page: 
/Users/romseygeek/projects/lucene-solr/solr/build/solr-ref-guide/content/dsp.adoc
 [java] Exception in thread "main" java.lang.RuntimeException: Found 1 
orphan pages (which are not in the 'page-children' attribute of any other pages)
 [java] at BuildNavAndPDFBody.main(BuildNavAndPDFBody.java:82)

> On 9 May 2018, at 18:24, jbern...@apache.org wrote:
> 
> Repository: lucene-solr
> Updated Branches:
>  refs/heads/master 4177252a1 -> 144f00a1e
> 
> 
> Squashed commit of the following:
> 
> commit e5074c3223e394af17f686294a67a1dd3ecdd147
> Author: Joel Bernstein 
> Date:   Wed May 9 13:16:34 2018 -0400
> 
>SOLR-12280: WIP
> 
> commit 69cdeccf161177d10f4d2407542392aaee3fcfe8
> Author: Joel Bernstein 
> Date:   Wed May 9 13:08:02 2018 -0400
> 
>SOLR-12280: WIP
> 
> commit c94f0c87c3e57c023d622ad2411e522c4aac491c
> Author: Joel Bernstein 
> Date:   Wed May 9 11:54:58 2018 -0400
> 
>SOLR-12280: WIP
> 
> commit 68dd1e73355cb84410f2d0ff3a51797ed6194a10
> Author: Joel Bernstein 
> Date:   Wed May 9 10:54:32 2018 -0400
> 
>SOLR-12280: WIP
> 
> commit 04a010543418a469100fa299c606a7b1eed452e1
> Author: Joel Bernstein 
> Date:   Wed May 9 10:47:27 2018 -0400
> 
>SOLR-12280: WIP
> 
> commit a6bbfbadaafe33fcdf93d5c72755e30dadadf017
> Author: Joel Bernstein 
> Date:   Wed May 9 09:40:08 2018 -0400
> 
>SOLR-12280: WIP
> 
> commit 5d27961aa291bcd71527337632981bcdf62369b4
> Author: Joel Bernstein 
> Date:   Tue May 8 20:43:33 2018 -0400
> 
>SOLR-12280: WIP
> 
> commit e982cf939f429c05b736f6292c68dd96d7ebc027
> Author: Joel Bernstein 
> Date:   Tue May 8 13:27:29 2018 -0400
> 
>SOLR-12280: WIP
> 
> commit aae78ab6f387c28a080021bc919ef51864540be2
> Author: Joel Bernstein 
> Date:   Tue May 8 12:23:52 2018 -0400
> 
>SOLR-12280: WIP
> 
> commit 0787ad76f0f4c62c860784b15490d8a988939997
> Author: Joel Bernstein 
> Date:   Tue May 8 12:20:38 2018 -0400
> 
>SOLR-12280: WIP
> 
> commit 4df098376ba05188702cca8582959c3fe18066f5
> Author: Joel Bernstein 
> Date:   Tue May 8 12:12:11 2018 -0400
> 
>SOLR-12280: WIP
> 
> commit 5c0be5136bbab7e0c33b3b8a7b0395b1b330e96d
> Author: Joel Bernstein 
> Date:   Tue May 8 12:04:57 2018 -0400
> 
>SOLR-12280: WIP
> 
> commit 6c6feac4c2e5a49a5eab87a228713d1b93c8fc70
> Author: Joel Bernstein 
> Date:   Tue May 8 11:57:49 2018 -0400
> 
>SOLR-12280: WIP
> 
> commit 7d46d11c9dd3a51b68600c2c889f586147545294
> Author: Joel Bernstein 
> Date:   Tue May 8 11:50:51 2018 -0400
> 
>SOLR-12280: WIP
> 
> commit 8b6bf19d0091203ed63b39d070dd02a9bece6a61
> Author: Joel Bernstein 
> Date:   Mon May 7 10:53:14 2018 -0400
> 
>SOLR-12280: WIP
> 
> commit 5466591999816eaacde6ce18d824d7688e5f4fe8
> Author: Joel Bernstein 
> Date:   Fri May 4 15:12:43 2018 -0400
> 
>SOLR-12280: WIP
> 
> commit d7fff7d557a7fd26011c21445b7969b2cd81036f
> Author: Joel Bernstein 
> Date:   Fri Apr 27 12:50:27 2018 -0400
> 
>SOLR-12280: Initial commit
> 
> 
> Project: http://git-wip-us.apache.org/repos/asf/lucene-solr/repo
> Commit: http://git-wip-us.apache.org/repos/asf/lucene-solr/commit/144f00a1
> Tree: http://git-wip-us.apache.org/repos/asf/lucene-solr/tree/144f00a1
> Diff: http://git-wip-us.apache.org/repos/asf/lucene-solr/diff/144f00a1
> 
> Branch: refs/heads/master
> Commit: 144f00a1e315541a28f526f4cdf1e55eb60c862b
> Parents: 4177252
> Author: Joel Bernstein 
> Authored: Wed May 9 13:24:08 2018 -0400
> Committer: Joel Bernstein 
> Committed: Wed May 9 13:24:08 2018 -0400
> 
> --
> solr/solr-ref-guide/src/dsp.adoc| 719 +++
> .../hidden-signal-autocorrelation.png   | Bin 0 -> 258831 bytes
> .../math-expressions/hidden-signal-fft.png  | Bin 0 -> 215981 bytes
> .../images/math-expressions/hidden-signal.png   | Bin 0 -> 319100 bytes
> .../math-expressions/noise-autocorrelation.png  | Bin 0 -> 204511 bytes
> .../src/images/math-expressions/noise-fft.png   | Bin 0 -> 319551 bytes
> .../src/images/math-expressions/noise.png   | Bin 0 -> 375565 bytes
> .../math-expressions/signal-autocorrelation.png | Bin 0 -> 322164 bytes
> .../src/images/math-expressions/signal-fft.png  | Bin 0 -> 140111 bytes
> .../src/images/math-expressions/signal.png  | Bin 0 -> 365018 bytes
> solr/solr-ref-guide/src/math-expressions.adoc   |   2 +
> 11 files changed, 721 insertions(+)
> 

[jira] [Commented] (SOLR-12170) terms facet on a date field can fail

2018-05-09 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-12170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469406#comment-16469406
 ] 

ASF subversion and git services commented on SOLR-12170:


Commit e260f923ba3d9d93772291b0994b00011af978b0 in lucene-solr's branch 
refs/heads/branch_7x from [~yo...@apache.org]
[ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=e260f92 ]

SOLR-12170: fix date format exceptions for terms facet on date field


> terms facet on a date field can fail
> 
>
> Key: SOLR-12170
> URL: https://issues.apache.org/jira/browse/SOLR-12170
> Project: Solr
>  Issue Type: Bug
>  Security Level: Public(Default Security Level. Issues are Public) 
>  Components: Facet Module
>Affects Versions: 6.6
>Reporter: Yonik Seeley
>Priority: Major
> Fix For: 7.4
>
> Attachments: SOLR-12170.patch
>
>
> There are still some modes of failures when doing a terms facet on a date 
> field.  This issue picks up from SOLR-12020 since the fixes likely won't make 
> it in time for the 7.3 release.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: [JENKINS] Solr-reference-guide-master - Build # 7366 - Still Failing

2018-05-09 Thread Joel Bernstein
Fixing this

Joel Bernstein
http://joelsolr.blogspot.com/

On Wed, May 9, 2018 at 3:25 PM, Apache Jenkins Server <
jenk...@builds.apache.org> wrote:

> Build: https://builds.apache.org/job/Solr-reference-guide-master/7366/
>
> Log:
> Started by timer
> [EnvInject] - Loading node environment variables.
> Building remotely on websites1 (git-websites svn-websites) in workspace
> /home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master
>  > git rev-parse --is-inside-work-tree # timeout=10
> Fetching changes from the remote Git repository
>  > git config remote.origin.url git://git.apache.org/lucene-solr.git #
> timeout=10
> Cleaning workspace
>  > git rev-parse --verify HEAD # timeout=10
> Resetting working tree
>  > git reset --hard # timeout=10
>  > git clean -fdx # timeout=10
> Fetching upstream changes from git://git.apache.org/lucene-solr.git
>  > git --version # timeout=10
>  > git fetch --tags --progress git://git.apache.org/lucene-solr.git
> +refs/heads/*:refs/remotes/origin/*
>  > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
>  > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
> Checking out Revision 144f00a1e315541a28f526f4cdf1e55eb60c862b
> (refs/remotes/origin/master)
>  > git config core.sparsecheckout # timeout=10
>  > git checkout -f 144f00a1e315541a28f526f4cdf1e55eb60c862b
> Commit message: "Squashed commit of the following:"
>  > git rev-list --no-walk 144f00a1e315541a28f526f4cdf1e55eb60c862b #
> timeout=10
> No emails were triggered.
> [Solr-reference-guide-master] $ /usr/bin/env bash /tmp/
> jenkins5452915336889024737.sh
> + set -e
> + RVM_PATH=/home/jenkins/.rvm
> + RUBY_VERSION=ruby-2.3.3
> + GEMSET=solr-refguide-gemset
> + curl -sSL https://get.rvm.io
> + bash -s -- --ignore-dotfiles stable
> Turning on ignore dotfiles mode.
> Downloading https://github.com/rvm/rvm/archive/1.29.3.tar.gz
> Downloading https://github.com/rvm/rvm/releases/download/1.29.3/1.29.
> 3.tar.gz.asc
> gpg: Signature made Sun 10 Sep 2017 08:59:21 PM UTC using RSA key ID
> BF04FF17
> gpg: Good signature from "Michal Papis (RVM signing) "
> gpg: aka "Michal Papis "
> gpg: aka "[jpeg image of size 5015]"
> gpg: WARNING: This key is not certified with a trusted signature!
> gpg:  There is no indication that the signature belongs to the
> owner.
> Primary key fingerprint: 409B 6B17 96C2 7546 2A17  0311 3804 BB82 D39D C0E3
>  Subkey fingerprint: 62C9 E5F4 DA30 0D94 AC36  166B E206 C29F BF04 FF17
> GPG verified '/home/jenkins/.rvm/archives/rvm-1.29.3.tgz'
>
> Upgrading the RVM installation in /home/jenkins/.rvm/
> Upgrade of RVM in /home/jenkins/.rvm/ is complete.
>
> Upgrade Notes:
>
>   * No new notes to display.
>
> + set +x
> Running 'source /home/jenkins/.rvm/scripts/rvm'
> Running 'rvm autolibs disable'
> Running 'rvm install ruby-2.3.3'
> Already installed ruby-2.3.3.
> To reinstall use:
>
> rvm reinstall ruby-2.3.3
>
> Running 'rvm gemset create solr-refguide-gemset'
> ruby-2.3.3 - #gemset created /home/jenkins/.rvm/gems/ruby-
> 2.3.3@solr-refguide-gemset
>  [32mruby-2.3.3 - #generating solr-refguide-gemset wrappers [0m| / - \ | /
> - \ | .- \ | / - \ | / - .| / - \ | / - \ | .- \ | / - \ | / - .| / - \ | /
> - \ | .- \ | / - \ | / - .| / - \ | / - \ | .- \ | / - .
> Running 'rvm ruby-2.3.3@solr-refguide-gemset'
> Using /home/jenkins/.rvm/gems/ruby-2.3.3 with gemset solr-refguide-gemset
> Running 'gem install --force --version 3.5.0 jekyll'
> Successfully installed jekyll-3.5.0
> Parsing documentation for jekyll-3.5.0
> Done installing documentation for jekyll after 1 seconds
> 1 gem installed
> Running 'gem install --force --version 2.1.0 jekyll-asciidoc'
> Successfully installed jekyll-asciidoc-2.1.0
> Parsing documentation for jekyll-asciidoc-2.1.0
> Done installing documentation for jekyll-asciidoc after 0 seconds
> 1 gem installed
> Running 'gem install --force --version 1.1.2 pygments.rb'
> Successfully installed pygments.rb-1.1.2
> Parsing documentation for pygments.rb-1.1.2
> Done installing documentation for pygments.rb after 0 seconds
> 1 gem installed
> Running 'ant ivy-bootstrap'
> Buildfile: /home/jenkins/jenkins-slave/workspace/Solr-reference-
> guide-master/build.xml
>
> -ivy-bootstrap1:
>  [echo] installing ivy 2.4.0 to /home/jenkins/.ant/lib
>   [get] Getting: http://repo1.maven.org/maven2/
> org/apache/ivy/ivy/2.4.0/ivy-2.4.0.jar
>   [get] To: /home/jenkins/.ant/lib/ivy-2.4.0.jar
>   [get] Not modified - so not downloaded
>
> -ivy-bootstrap2:
>
> -ivy-checksum:
>
> -ivy-remove-old-versions:
>
> ivy-bootstrap:
>
> BUILD SUCCESSFUL
> Total time: 0 seconds
> + ant clean build-site build-pdf
> Buildfile: /home/jenkins/jenkins-slave/workspace/Solr-reference-
> guide-master/solr/solr-ref-guide/build.xml
>
> clean:
>
> build-init:
> [mkdir] Created dir: /home/jenkins/jenkins-slave/
> 

Re: Note in Jira directing users to other resources for support

2018-05-09 Thread David Smiley
+1 nice

On Wed, May 9, 2018 at 3:09 PM Jan Høydahl  wrote:

> +1
>
> Sendt fra min iPhone
>
> 9. mai 2018 kl. 18:48 skrev Cassandra Targett :
>
> +1. Good idea, thanks.
>
> On Wed, May 9, 2018 at 11:29 AM Shawn Heisey  wrote:
>
>> I opened the following issue with Infra:
>>
>> https://issues.apache.org/jira/browse/INFRA-16507
>>
>> This is a request to have Jira display a note to users who create issues
>> on our projects, asking them to discuss their problem via appropriate
>> support channels before they create a ticket.
>>
>> Just after I clicked the "create" button I realized that I probably
>> should have discussed it with the group first.  I do see the irony!  I
>> hope it's an idea everyone can get behind.
>>
>> Thanks,
>> Shawn
>>
>>
>> -
>> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
>> For additional commands, e-mail: dev-h...@lucene.apache.org
>>
>> --
Lucene/Solr Search Committer, Consultant, Developer, Author, Speaker
LinkedIn: http://linkedin.com/in/davidwsmiley | Book:
http://www.solrenterprisesearchserver.com


[jira] [Commented] (SOLR-12280) Ref-Guide: Add Digital Signal Processing documentation

2018-05-09 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-12280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469447#comment-16469447
 ] 

ASF subversion and git services commented on SOLR-12280:


Commit c2819930d7a1ef675e1721242ac03ccc5d43b0b3 in lucene-solr's branch 
refs/heads/master from [~joel.bernstein]
[ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=c281993 ]

SOLR-12280: Add dsp to math-expression children


> Ref-Guide: Add Digital Signal Processing documentation
> --
>
> Key: SOLR-12280
> URL: https://issues.apache.org/jira/browse/SOLR-12280
> Project: Solr
>  Issue Type: New Feature
>  Security Level: Public(Default Security Level. Issues are Public) 
>Reporter: Joel Bernstein
>Assignee: Joel Bernstein
>Priority: Major
> Fix For: 7.4
>
>
> This ticket will add a new section of documentation in the Math Expressions 
> docs covering the Digital Signal Processing functions. The main areas of 
> documentation coverage will include:
>  * Dot product
>  * Convolution
>  * Cross-correlation
>  * Find Delay
>  * Auto-correlation
>  * Fast Fourier Transform



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-12298) Index Full nested document Hierarchy For Queries (umbrella issue)

2018-05-09 Thread Hoss Man (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-12298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469560#comment-16469560
 ] 

Hoss Man commented on SOLR-12298:
-

bq. Quoting Hoss Man here inline (hoping for his input):

I don't have a lot of input / opinions on this general topic of childDocs at 
the moment...

>From skimming the issue description & last few comments I gather the push here 
>is to make the "arbitrary nested documents of different types" experience/API 
>for *external clients* simpler/easier/cleaner/sexier ... and to then have 
>rules/conventions enforced by Solr (either via URPs or the underlying DUH, ... 
>not certain which exactly is being suggested at the moment) handle the mapping 
>of those "external relationships" into the *internal* nested childDocs w/new 
>fields based on the original hierarchy.

Ie: an external client could psueod-code  documents that look like via 
{{parentDoc[ ...normalfields..., someFieldName => childDoc1[...], 
someOtherFieldName => childDoc2[...] ]}} and then something in solr would 
translate that into the _internal_  representation of nested documents by 
moving that relationship info into fields of the child documents ala... 
{{parentDoc[ ...normalfields..., \_childDocuments\_=>[ childDoc1[ ..., 
typeField => someFieldName], childDoc2[ ..., typeField => 
someOtherFieldName]]}} .  (And i guess, also add some ohter standard metadata 
fields to every doc like what the type of the ancestors are?)

Or to put it another way: give solr the power to do _internally_ what clients 
currently have to do _externally_ to model this information.

is that about right?

This approach seems fine in general ... off the top of my head the biggest 
concern i can think of is how how you make something like the JSON 
ContentLoader smart enough to tell the differnece between a "child document 
expressed as JSON object/map (in a field)" from "atomic update (of a field) as 
a JSON object/map" (not an issue with the XML ContentLoader since the 
{{}} tag is distinct from the {{}}

FWIW: i don't particularly remember making those ~6year old comments/questions 
fromSOLR-3535 cited here, but i'm guessing my concerns at the time where just 
that these questions all needed answered in order to take that leap, and that 
until/unless we had those answers it seemed simplest to move forward with 
exposing a "lower level" modeling of child documents so users could take 
advantage of it ... if we're ready to answer those questions to support a 
cleaner/simpler API then by all means let's support it)

> Index Full nested document Hierarchy For Queries (umbrella issue)
> -
>
> Key: SOLR-12298
> URL: https://issues.apache.org/jira/browse/SOLR-12298
> Project: Solr
>  Issue Type: Improvement
>  Security Level: Public(Default Security Level. Issues are Public) 
>Reporter: mosh
>Priority: Major
>
> Solr ought to have the ability to index deeply nested objects, while storing 
> the original document hierarchy.
>  Currently the client has to index the child document's full path and level 
> to manually reconstruct the original document structure, since the children 
> are flattened and returned in the reserved "__childDocuments__" key.
> Ideally you could index a nested document, having Solr transparently add the 
> required fields while providing a document transformer to rebuild the 
> original document's hierarchy.
>  
> This issue is an umbrella issue for the particular tasks that will make it 
> all happen – either subtasks or issue linking.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[JENKINS] Lucene-Solr-7.x-Solaris (64bit/jdk1.8.0) - Build # 608 - Unstable!

2018-05-09 Thread Policeman Jenkins Server
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Solaris/608/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseSerialGC

15 tests failed.
FAILED:  
org.apache.lucene.index.TestMixedDocValuesUpdates.testResetValueMultipleDocs

Error Message:
expected:<5> but was:<4>

Stack Trace:
java.lang.AssertionError: expected:<5> but was:<4>
at 
__randomizedtesting.SeedInfo.seed([4B0DC4FC1E794274:6F7FD6662C674F48]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at 
org.apache.lucene.index.TestMixedDocValuesUpdates.testResetValueMultipleDocs(TestMixedDocValuesUpdates.java:622)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)


FAILED:  
org.apache.lucene.index.TestMixedDocValuesUpdates.testResetValueMultipleDocs

Error Message:
expected:<5> but was:<4>

Stack Trace:
java.lang.AssertionError: expected:<5> but was:<4>
at 
__randomizedtesting.SeedInfo.seed([4B0DC4FC1E794274:6F7FD6662C674F48]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)

[jira] [Comment Edited] (SOLR-8207) Modernise cloud tab on Admin UI

2018-05-09 Thread Shawn Heisey (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469774#comment-16469774
 ] 

Shawn Heisey edited comment on SOLR-8207 at 5/10/18 12:49 AM:
--

Comparing that information to the main dashboard in the admin UI, here are my 
thoughts:

I think that physical RAM usage should not be shown in the Solr admin UI, 
unless it comes with a note saying that it is usually completely normal for 
total RAM usage to be near 100 percent.  Some users *do* panic when they see 
the physical memory usage.

The numbers that are most useful for heap are the numbers shown on the main 
dashboard.  Free is NOT one of those numbers.  It shows how much heap is 
actually used, the current size of the heap, and the max size of the heap.  The 
current and max heap sizes are typically the same, unless the user has 
explicitly configured both -Xms and -Xmx.

Side note, possibly for a new issue: Running a 7.3 example, I noticed that 
there is mouseover text for the three numbers on the "JVM-Memory" dashboard 
graph.  Two the mouseovers are shown in bytes, but the third is shown as MB.  I 
think they should all use the same scale.



was (Author: elyograg):
Comparing that information to the main dashboard in the admin UI, here are my 
thoughts:

I think that physical RAM usage should not be shown in the Solr admin UI, 
unless it comes with a note saying that it is usually completely normal for 
total RAM usage to be near 100 percent.  Some users *do* panic when they see 
the physical memory usage.

The numbers that are most useful for heap are the numbers shown on the main 
dashboard.  Free is NOT one of those numbers.  It shows how much heap is 
actually used, the current size of the heap, and the max size of the heap.  The 
current and max heap sizes are typically the same, unless the user has 
explicitly configured both -Xms and -Xmx.

Side note, possibly for a new issue: Running a 7.3 example, I noticed that 
there is mouseover text for the three numbers on the "JVM-Memory" dashboard 
graph.  Two the mouseovers are shown in bytes, but the third is shown as GB.  I 
think they should all use the same scale.


> Modernise cloud tab on Admin UI
> ---
>
> Key: SOLR-8207
> URL: https://issues.apache.org/jira/browse/SOLR-8207
> Project: Solr
>  Issue Type: Improvement
>  Components: Admin UI
>Affects Versions: 5.3
>Reporter: Upayavira
>Assignee: Jan Høydahl
>Priority: Major
> Attachments: node-compact.png, node-details.png, node-hostcolumn.png, 
> node-toggle-row-numdocs.png, nodes-tab-real.png, nodes-tab.png
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> The various sub-tabs of the "Cloud tab" were designed before anyone was 
> making real use of SolrCloud, and when we didn't really know the use-cases we 
> would need to support. I would argue that, whilst they are pretty (and 
> clever) they aren't really fit for purpose (with the exception of tree view).
> Issues:
> * Radial view doesn't scale beyond a small number of nodes/collections
> * Paging on the graph view is based on collections - so a collection with 
> many replicas won't be subject to pagination
> * The Dump feature is kinda redundant and should be removed
> * There is now a major overlap in functionality with the new Collections tab
> What I'd propose is that we:
>  * promote the tree tab to top level
>  * remove the graph views and the dump tab
>  * add a new Nodes tab
> This nodes tab would complement the collections tab - showing nodes, and 
> their associated replicas/collections. From this view, it would be possible 
> to add/remove replicas and to see the status of nodes. It would also be 
> possible to filter nodes by status: "show me only up nodes", "show me nodes 
> that are in trouble", "show me nodes that have leaders on them", etc.
> Presumably, if we have APIs to support it, we might have a "decommission 
> node" option, that would ensure that no replicas on this node are leaders, 
> and then remove all replicas from the node, ready for it to be removed from 
> the cluster.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Assigned] (SOLR-10078) Highlighter error: Unknown query type:org.apache.lucene.search.MatchNoDocsQuery

2018-05-09 Thread David Smiley (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-10078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

David Smiley reassigned SOLR-10078:
---

Assignee: David Smiley

> Highlighter error: Unknown query 
> type:org.apache.lucene.search.MatchNoDocsQuery
> ---
>
> Key: SOLR-10078
> URL: https://issues.apache.org/jira/browse/SOLR-10078
> Project: Solr
>  Issue Type: Bug
>  Security Level: Public(Default Security Level. Issues are Public) 
>  Components: highlighter
>Affects Versions: 6.3
>Reporter: Andy Tran
>Assignee: David Smiley
>Priority: Minor
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> With Solr v6.3, when I issue this query:
> http://localhost:8983/solr/BestBuy/select?wt=json=10={!complexphrase%20inOrder=false}_text_:%22maytag~%20(refri~%20OR%20refri*)%20%22=id=true=false=60=nameX,shortDescription,longDescription,artistName,type,manufacturer,department
> I get this error in the JSON response:
> *
> {
>   "responseHeader": {
> "zkConnected": true,
> "status": 500,
> "QTime": 8,
> "params": {
>   "q": "{!complexphrase inOrder=false}_text_:\"maytag~ (refri~ OR refri*) 
> \"",
>   "hl": "true",
>   "hl.preserveMulti": "false",
>   "fl": "id",
>   "hl.fragsize": "60",
>   "hl.fl": 
> "nameX,shortDescription,longDescription,artistName,type,manufacturer,department",
>   "rows": "10",
>   "wt": "json"
> }
>   },
>   "response": {
> "numFound": 2,
> "start": 0,
> "docs": [
>   {
> "id": "5411379"
>   },
>   {
> "id": "5411404"
>   }
> ]
>   },
>   "error": {
> "msg": "Unknown query type:org.apache.lucene.search.MatchNoDocsQuery",
> "trace": "java.lang.IllegalArgumentException: Unknown query 
> type:org.apache.lucene.search.MatchNoDocsQuery\n\tat 
> org.apache.lucene.queryparser.complexPhrase.ComplexPhraseQueryParser$ComplexPhraseQuery.addComplexPhraseClause(ComplexPhraseQueryParser.java:388)\n\tat
>  
> org.apache.lucene.queryparser.complexPhrase.ComplexPhraseQueryParser$ComplexPhraseQuery.rewrite(ComplexPhraseQueryParser.java:289)\n\tat
>  
> org.apache.lucene.search.highlight.WeightedSpanTermExtractor.extract(WeightedSpanTermExtractor.java:230)\n\tat
>  
> org.apache.lucene.search.highlight.WeightedSpanTermExtractor.getWeightedSpanTerms(WeightedSpanTermExtractor.java:522)\n\tat
>  
> org.apache.lucene.search.highlight.QueryScorer.initExtractor(QueryScorer.java:218)\n\tat
>  
> org.apache.lucene.search.highlight.QueryScorer.init(QueryScorer.java:186)\n\tat
>  
> org.apache.lucene.search.highlight.Highlighter.getBestTextFragments(Highlighter.java:195)\n\tat
>  
> org.apache.solr.highlight.DefaultSolrHighlighter.doHighlightingByHighlighter(DefaultSolrHighlighter.java:602)\n\tat
>  
> org.apache.solr.highlight.DefaultSolrHighlighter.doHighlightingOfField(DefaultSolrHighlighter.java:448)\n\tat
>  
> org.apache.solr.highlight.DefaultSolrHighlighter.doHighlighting(DefaultSolrHighlighter.java:410)\n\tat
>  
> org.apache.solr.handler.component.HighlightComponent.process(HighlightComponent.java:141)\n\tat
>  
> org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:295)\n\tat
>  
> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:153)\n\tat
>  org.apache.solr.core.SolrCore.execute(SolrCore.java:2213)\n\tat 
> org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:654)\n\tat 
> org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:460)\n\tat 
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:303)\n\tat
>  
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:254)\n\tat
>  
> org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1668)\n\tat
>  
> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:581)\n\tat
>  
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)\n\tat
>  
> org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548)\n\tat
>  
> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:226)\n\tat
>  
> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1160)\n\tat
>  
> org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:511)\n\tat
>  
> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)\n\tat
>  
> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1092)\n\tat
>  
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)\n\tat
>  
> org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:213)\n\tat

[jira] [Commented] (SOLR-10335) Upgrade to Tika 1.16 when available

2018-05-09 Thread Ishan Chattopadhyaya (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-10335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469794#comment-16469794
 ] 

Ishan Chattopadhyaya commented on SOLR-10335:
-

I just realized that this change was ported to branch_6_6, but not branch_6x. 
Is that fine?

> Upgrade to Tika 1.16 when available
> ---
>
> Key: SOLR-10335
> URL: https://issues.apache.org/jira/browse/SOLR-10335
> Project: Solr
>  Issue Type: Improvement
>  Security Level: Public(Default Security Level. Issues are Public) 
>Reporter: Tim Allison
>Assignee: Shalin Shekhar Mangar
>Priority: Critical
> Fix For: 5.5.5, 6.6.2, 7.1
>
>
> Once POI 3.16-beta3 is out (early/mid April?), we'll push for a release of 
> Tika 1.15.
> Please let us know if you have any requests.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[JENKINS] Lucene-Solr-BadApples-Tests-7.x - Build # 56 - Still Unstable

2018-05-09 Thread Apache Jenkins Server
Build: https://builds.apache.org/job/Lucene-Solr-BadApples-Tests-7.x/56/

8 tests failed.
FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.TestLeaderElectionZkExpiry

Error Message:
ObjectTracker found 1 object(s) that were not released!!! [Overseer] 
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: 
org.apache.solr.cloud.Overseer  at 
org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
  at org.apache.solr.cloud.Overseer.start(Overseer.java:545)  at 
org.apache.solr.cloud.OverseerElectionContext.runLeaderProcess(ElectionContext.java:851)
  at 
org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:170) 
 at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:135)  
at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:307)  at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:393)  at 
org.apache.solr.cloud.ZkController.rejoinOverseerElection(ZkController.java:2081)
  at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:331)
  at java.lang.Thread.run(Thread.java:748)  

Stack Trace:
java.lang.AssertionError: ObjectTracker found 1 object(s) that were not 
released!!! [Overseer]
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: 
org.apache.solr.cloud.Overseer
at 
org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.cloud.Overseer.start(Overseer.java:545)
at 
org.apache.solr.cloud.OverseerElectionContext.runLeaderProcess(ElectionContext.java:851)
at 
org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:170)
at 
org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:135)
at 
org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:307)
at 
org.apache.solr.cloud.LeaderElector.retryElection(LeaderElector.java:393)
at 
org.apache.solr.cloud.ZkController.rejoinOverseerElection(ZkController.java:2081)
at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:331)
at java.lang.Thread.run(Thread.java:748)


at __randomizedtesting.SeedInfo.seed([B501811370D20380]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNull(Assert.java:551)
at 
org.apache.solr.SolrTestCaseJ4.teardownTestCases(SolrTestCaseJ4.java:303)
at sun.reflect.GeneratedMethodAccessor58.invoke(Unknown Source)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:897)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.TestLeaderElectionZkExpiry

Error Message:
1 thread leaked from SUITE scope at 

[jira] [Commented] (SOLR-12314) ConcurrentUpdateSolrClient doesn't respect the timeout's defined in the solr.xml file

2018-05-09 Thread Mark Miller (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-12314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469807#comment-16469807
 ] 

Mark Miller commented on SOLR-12314:


Cool, yeah that looks good to me.

> ConcurrentUpdateSolrClient doesn't respect the timeout's defined in the 
> solr.xml file
> -
>
> Key: SOLR-12314
> URL: https://issues.apache.org/jira/browse/SOLR-12314
> Project: Solr
>  Issue Type: Bug
>  Security Level: Public(Default Security Level. Issues are Public) 
>Reporter: Varun Thacker
>Assignee: Varun Thacker
>Priority: Major
> Attachments: SOLR-12314.patch, SOLR-12314.patch, SOLR-12314.patch
>
>
> In ConcurrentUpdateSolrClient we create an HttpPost Request which allows you 
> to set a request config. If the request config is not provided httpclient 
> will use the default request config. 
>  
> {code:java}
> org.apache.http.client.config.RequestConfig.Builder requestConfigBuilder = 
> HttpClientUtil.createDefaultRequestConfigBuilder();
> if (soTimeout != null) {
>   requestConfigBuilder.setSocketTimeout(soTimeout);
> }
> if (connectionTimeout != null) {
>   requestConfigBuilder.setConnectTimeout(connectionTimeout);
> }
> method.setConfig(requestConfigBuilder.build());{code}
> While creating the httpclient object we ensure that the default request is 
> set with the properties we care about.  This happens in 
> HttpClientUtils#setupBuilder
> {code:java}
> RequestConfig requestConfig = requestConfigBuilder.build();
> HttpClientBuilder retBuilder = 
> builder.setDefaultRequestConfig(requestConfig);{code}
> So there is no need to set a per request config 
>  
> Here is where the httpclient picks the request config is provided on the 
> request itself : 
> [https://github.com/apache/httpcomponents-client/blob/4.5.3/httpclient/src/main/java/org/apache/http/impl/client/InternalHttpClient.java#L168]
>  
> And if it's not provided it uses the default here : 
> https://github.com/apache/httpcomponents-client/blob/4.5.3/httpclient/src/main/java/org/apache/http/impl/client/InternalHttpClient.java#L148



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[JENKINS] Lucene-Solr-master-Linux (32bit/jdk1.8.0_162) - Build # 21983 - Still Unstable!

2018-05-09 Thread Policeman Jenkins Server
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21983/
Java: 32bit/jdk1.8.0_162 -client -XX:+UseConcMarkSweepGC

4 tests failed.
FAILED:  org.apache.solr.cloud.autoscaling.NodeAddedTriggerTest.testRestoreState

Error Message:
Did not expect the processor to fire on first run! event={   
"id":"4253111b8f305Tawwmdzrrpohyssrv3j43cjsl3",   
"source":"node_added_trigger",   "eventTime":1166792587801349,   
"eventType":"NODEADDED",   "properties":{ "eventTimes":[1166792587801349],  
   "nodeNames":["127.0.0.1:43657_solr"]}}

Stack Trace:
java.lang.AssertionError: Did not expect the processor to fire on first run! 
event={
  "id":"4253111b8f305Tawwmdzrrpohyssrv3j43cjsl3",
  "source":"node_added_trigger",
  "eventTime":1166792587801349,
  "eventType":"NODEADDED",
  "properties":{
"eventTimes":[1166792587801349],
"nodeNames":["127.0.0.1:43657_solr"]}}
at 
__randomizedtesting.SeedInfo.seed([64A1796B6961123E:AA0FDDF891586A28]:0)
at org.junit.Assert.fail(Assert.java:93)
at 
org.apache.solr.cloud.autoscaling.NodeAddedTriggerTest.lambda$new$0(NodeAddedTriggerTest.java:49)
at 
org.apache.solr.cloud.autoscaling.NodeAddedTrigger.run(NodeAddedTrigger.java:161)
at 
org.apache.solr.cloud.autoscaling.NodeAddedTriggerTest.testRestoreState(NodeAddedTriggerTest.java:257)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at 

Re: [JENKINS] Solr-reference-guide-master - Build # 7367 - Still Failing

2018-05-09 Thread Cassandra Targett
Joel are you looking into these? Looks like there's some duplicate section
IDs (section names) and a link using a section ID that doesn't exist in the
target.

On Wed, May 9, 2018 at 4:12 PM Apache Jenkins Server <
jenk...@builds.apache.org> wrote:

> Build: https://builds.apache.org/job/Solr-reference-guide-master/7367/
>
> Log:
> Started by timer
> [EnvInject] - Loading node environment variables.
> Building remotely on websites1 (git-websites svn-websites) in workspace
> /home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master
>  > git rev-parse --is-inside-work-tree # timeout=10
> Fetching changes from the remote Git repository
>  > git config remote.origin.url git://git.apache.org/lucene-solr.git #
> timeout=10
> Cleaning workspace
>  > git rev-parse --verify HEAD # timeout=10
> Resetting working tree
>  > git reset --hard # timeout=10
>  > git clean -fdx # timeout=10
> Fetching upstream changes from git://git.apache.org/lucene-solr.git
>  > git --version # timeout=10
>  > git fetch --tags --progress git://git.apache.org/lucene-solr.git
> +refs/heads/*:refs/remotes/origin/*
>  > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
>  > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
> Checking out Revision c2819930d7a1ef675e1721242ac03ccc5d43b0b3
> (refs/remotes/origin/master)
>  > git config core.sparsecheckout # timeout=10
>  > git checkout -f c2819930d7a1ef675e1721242ac03ccc5d43b0b3
> Commit message: "SOLR-12280: Add dsp to math-expression children"
>  > git rev-list --no-walk 144f00a1e315541a28f526f4cdf1e55eb60c862b #
> timeout=10
> No emails were triggered.
> [Solr-reference-guide-master] $ /usr/bin/env bash
> /tmp/jenkins7070859384396587989.sh
> + set -e
> + RVM_PATH=/home/jenkins/.rvm
> + RUBY_VERSION=ruby-2.3.3
> + GEMSET=solr-refguide-gemset
> + curl -sSL https://get.rvm.io
> + bash -s -- --ignore-dotfiles stable
> Turning on ignore dotfiles mode.
> Downloading https://github.com/rvm/rvm/archive/1.29.3.tar.gz
> Downloading
> https://github.com/rvm/rvm/releases/download/1.29.3/1.29.3.tar.gz.asc
> gpg: Signature made Sun 10 Sep 2017 08:59:21 PM UTC using RSA key ID
> BF04FF17
> gpg: Good signature from "Michal Papis (RVM signing) "
> gpg: aka "Michal Papis "
> gpg: aka "[jpeg image of size 5015]"
> gpg: WARNING: This key is not certified with a trusted signature!
> gpg:  There is no indication that the signature belongs to the
> owner.
> Primary key fingerprint: 409B 6B17 96C2 7546 2A17  0311 3804 BB82 D39D C0E3
>  Subkey fingerprint: 62C9 E5F4 DA30 0D94 AC36  166B E206 C29F BF04 FF17
> GPG verified '/home/jenkins/.rvm/archives/rvm-1.29.3.tgz'
>
> Upgrading the RVM installation in /home/jenkins/.rvm/
> Upgrade of RVM in /home/jenkins/.rvm/ is complete.
>
> Upgrade Notes:
>
>   * No new notes to display.
>
> + set +x
> Running 'source /home/jenkins/.rvm/scripts/rvm'
> Running 'rvm autolibs disable'
> Running 'rvm install ruby-2.3.3'
> Already installed ruby-2.3.3.
> To reinstall use:
>
> rvm reinstall ruby-2.3.3
>
> Running 'rvm gemset create solr-refguide-gemset'
> ruby-2.3.3 - #gemset created
> /home/jenkins/.rvm/gems/ruby-2.3.3@solr-refguide-gemset
>  [32mruby-2.3.3 - #generating solr-refguide-gemset wrappers [0m| / - \ | /
> - \ | .- \ | / - \ | / - .| / - \ | / - \ | .- \ | / - \ | / - .| / - \ | /
> - \ | .- \ | / - \ | / - .| / - \ | / - \ | .- \ | / - .
> Running 'rvm ruby-2.3.3@solr-refguide-gemset'
> Using /home/jenkins/.rvm/gems/ruby-2.3.3 with gemset solr-refguide-gemset
> Running 'gem install --force --version 3.5.0 jekyll'
> Successfully installed jekyll-3.5.0
> Parsing documentation for jekyll-3.5.0
> Done installing documentation for jekyll after 1 seconds
> 1 gem installed
> Running 'gem install --force --version 2.1.0 jekyll-asciidoc'
> Successfully installed jekyll-asciidoc-2.1.0
> Parsing documentation for jekyll-asciidoc-2.1.0
> Done installing documentation for jekyll-asciidoc after 0 seconds
> 1 gem installed
> Running 'gem install --force --version 1.1.2 pygments.rb'
> Successfully installed pygments.rb-1.1.2
> Parsing documentation for pygments.rb-1.1.2
> Done installing documentation for pygments.rb after 0 seconds
> 1 gem installed
> Running 'ant ivy-bootstrap'
> Buildfile:
> /home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master/build.xml
>
> -ivy-bootstrap1:
>  [echo] installing ivy 2.4.0 to /home/jenkins/.ant/lib
>   [get] Getting:
> http://repo1.maven.org/maven2/org/apache/ivy/ivy/2.4.0/ivy-2.4.0.jar
>   [get] To: /home/jenkins/.ant/lib/ivy-2.4.0.jar
>   [get] Not modified - so not downloaded
>
> -ivy-bootstrap2:
>
> -ivy-checksum:
>
> -ivy-remove-old-versions:
>
> ivy-bootstrap:
>
> BUILD SUCCESSFUL
> Total time: 0 seconds
> + ant clean build-site build-pdf
> Buildfile:
> /home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master/solr/solr-ref-guide/build.xml
>
> clean:
>
> build-init:
> [mkdir] 

[jira] [Commented] (SOLR-9638) SolrCloud restore of backup fails

2018-05-09 Thread JIRA

[ 
https://issues.apache.org/jira/browse/SOLR-9638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469648#comment-16469648
 ] 

Jan Høydahl commented on SOLR-9638:
---

[~meltingrobot] did you solve your restore problem?

> SolrCloud restore of backup fails
> -
>
> Key: SOLR-9638
> URL: https://issues.apache.org/jira/browse/SOLR-9638
> Project: Solr
>  Issue Type: Bug
>  Security Level: Public(Default Security Level. Issues are Public) 
>  Components: SolrCloud
>Reporter: Håvar Nøvik
>Priority: Minor
>  Labels: SolrCloud
>
> Steps to reproduce:
> * create backup with the following api call: 
> /admin/collections?action=BACKUP=myBackupName=myCollectionName=/path/to/my/shared/drive
> * restore to from backup with the following api call: 
> /admin/collections?action=RESTORE=myBackupName=/path/to/my/shared/drive=myRestoredCollectionName
> Expected result:
> * a new collection with the data from the 'myCollectionName' collection is 
> created
> Actual result:
> * the api call fails with a 500 http status code and the following stacktrace:
> {code}
> org.apache.solr.common.SolrException: Couldn't restore since doesn't exist: 
> file:///path/to/my/shared/drive/myBackupName
>   at 
> org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:284)
>   at 
> org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:215)
>   at 
> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:154)
>   at 
> org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:658)
>   at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:440)
>   at 
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:257)
>   at 
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:208)
>   at 
> org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1668)
>   at 
> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:581)
>   at 
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
>   at 
> org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548)
>   at 
> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:226)
>   at 
> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1160)
>   at 
> org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:511)
>   at 
> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
>   at 
> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1092)
>   at 
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
>   at 
> org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:213)
>   at 
> org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:119)
>   at 
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
>   at org.eclipse.jetty.server.Server.handle(Server.java:518)
>   at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:308)
>   at 
> org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:244)
>   at 
> org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273)
>   at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)
>   at 
> org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
>   at 
> org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceAndRun(ExecuteProduceConsume.java:246)
>   at 
> org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:156)
>   at 
> org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:654)
>   at 
> org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572)
>   at java.lang.Thread.run(Thread.java:745)
> {code}
> More info:
> It seems like a bug in the [LocalFileSystemRepository | 
> https://github.com/apache/lucene-solr/blob/master/solr/core/src/java/org/apache/solr/core/backup/repository/LocalFileSystemRepository.java#L114]
>  where it checks if the backup exists. The bug is that it check if a file 
> with that name exists, but the BACKUP command creates a directory.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Assigned] (SOLR-12170) terms facet on a date field can fail

2018-05-09 Thread Yonik Seeley (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-12170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yonik Seeley reassigned SOLR-12170:
---

Assignee: Yonik Seeley

> terms facet on a date field can fail
> 
>
> Key: SOLR-12170
> URL: https://issues.apache.org/jira/browse/SOLR-12170
> Project: Solr
>  Issue Type: Bug
>  Security Level: Public(Default Security Level. Issues are Public) 
>  Components: Facet Module
>Affects Versions: 6.6
>Reporter: Yonik Seeley
>Assignee: Yonik Seeley
>Priority: Major
> Fix For: 7.4
>
> Attachments: SOLR-12170.patch
>
>
> There are still some modes of failures when doing a terms facet on a date 
> field.  This issue picks up from SOLR-12020 since the fixes likely won't make 
> it in time for the 7.3 release.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Resolved] (SOLR-12170) terms facet on a date field can fail

2018-05-09 Thread Yonik Seeley (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-12170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yonik Seeley resolved SOLR-12170.
-
Resolution: Fixed

> terms facet on a date field can fail
> 
>
> Key: SOLR-12170
> URL: https://issues.apache.org/jira/browse/SOLR-12170
> Project: Solr
>  Issue Type: Bug
>  Security Level: Public(Default Security Level. Issues are Public) 
>  Components: Facet Module
>Affects Versions: 6.6
>Reporter: Yonik Seeley
>Assignee: Yonik Seeley
>Priority: Major
> Fix For: 7.4
>
> Attachments: SOLR-12170.patch
>
>
> There are still some modes of failures when doing a terms facet on a date 
> field.  This issue picks up from SOLR-12020 since the fixes likely won't make 
> it in time for the 7.3 release.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[JENKINS] Lucene-Solr-7.x-Windows (32bit/jdk1.8.0_144) - Build # 583 - Still Unstable!

2018-05-09 Thread Policeman Jenkins Server
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Windows/583/
Java: 32bit/jdk1.8.0_144 -server -XX:+UseSerialGC

26 tests failed.
FAILED:  
org.apache.solr.handler.component.SpellCheckComponentTest.testNumericQuery

Error Message:
List size mismatch @ spellcheck/suggestions

Stack Trace:
java.lang.RuntimeException: List size mismatch @ spellcheck/suggestions
at 
__randomizedtesting.SeedInfo.seed([DE8C01AAEC20AB8B:D5A0566A73E91724]:0)
at org.apache.solr.SolrTestCaseJ4.assertJQ(SolrTestCaseJ4.java:1004)
at org.apache.solr.SolrTestCaseJ4.assertJQ(SolrTestCaseJ4.java:951)
at 
org.apache.solr.handler.component.SpellCheckComponentTest.testNumericQuery(SpellCheckComponentTest.java:154)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)


FAILED:  
org.apache.solr.handler.component.SpellCheckComponentTest.testNumericQuery

Error Message:
List size mismatch @ spellcheck/suggestions

Stack Trace:
java.lang.RuntimeException: List 

[jira] [Reopened] (SOLR-12265) Upgrade Jetty to 9.4.10

2018-05-09 Thread Varun Thacker (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-12265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Varun Thacker reopened SOLR-12265:
--

Reopening the Jira.

 

Tomas pointed out that when you run bin/solr -f we get this error
{code:java}
[master] ~/apache-work/lucene-solr/solr$ ./bin/solr start -f

*** [WARN] *** Your open file limit is currently 256. 

It should be set to 65000 to avoid operational disruption.

If you no longer wish to see this warning, set SOLR_ULIMIT_CHECKS to false in 
your profile or solr.in.sh

*** [WARN] ***  Your Max Processes Limit is currently 1418.

It should be set to 65000 to avoid operational disruption.

If you no longer wish to see this warning, set SOLR_ULIMIT_CHECKS to false in 
your profile or solr.in.sh

ERROR : org/eclipse/jetty/util/JavaVersion

java.lang.NoClassDefFoundError: org/eclipse/jetty/util/JavaVersion

at org.eclipse.jetty.start.StartArgs.setProperty(StartArgs.java:1273)

at org.eclipse.jetty.start.Modules.(Modules.java:65)

at org.eclipse.jetty.start.Main.processCommandLine(Main.java:312)

at org.eclipse.jetty.start.Main.main(Main.java:75)

Caused by: java.lang.ClassNotFoundException: org.eclipse.jetty.util.JavaVersion

at java.net.URLClassLoader.findClass(URLClassLoader.java:381)

at java.lang.ClassLoader.loadClass(ClassLoader.java:424)

at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)

at java.lang.ClassLoader.loadClass(ClassLoader.java:357)

... 4 more



Usage: java -jar $JETTY_HOME/start.jar [options] [properties] [configs]

       java -jar $JETTY_HOME/start.jar --help  # for more information{code}
 

Also the CHANGES entry mentions the wrong Jira

> Upgrade Jetty to 9.4.10
> ---
>
> Key: SOLR-12265
> URL: https://issues.apache.org/jira/browse/SOLR-12265
> Project: Solr
>  Issue Type: Improvement
>  Security Level: Public(Default Security Level. Issues are Public) 
>Reporter: Varun Thacker
>Assignee: Varun Thacker
>Priority: Major
> Fix For: 7.4, master (8.0)
>
> Attachments: SOLR-12265.patch
>
>
> Solr 7.3 upgraded to Jetty 9.4.8 
> We're seeing this WARN very sporadically ( maybe one in every 100k requests ) 
> on the replica when indexing.
> {code:java}
> date time WARN [qtp768306356-580185] ? (:) - 
> java.nio.channels.ReadPendingException: null
> at org.eclipse.jetty.io.FillInterest.register(FillInterest.java:58) 
> ~[jetty-io-9.4.8.v20171121.jar:9.4.8.v20171121]
> at 
> org.eclipse.jetty.io.AbstractEndPoint.fillInterested(AbstractEndPoint.java:353)
>  ~[jetty-io-9.4.8.v20171121.jar:9.4.8.v20171121]
> at 
> org.eclipse.jetty.io.AbstractConnection.fillInterested(AbstractConnection.java:134)
>  ~[jetty-io-9.4.8.v20171121.jar:9.4.8.v20171121]
> at 
> org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:267) 
> ~[jetty-server-9.4.8.v20171121.jar:9.4.8.v20171121]
> at 
> org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:279)
>  ~[jetty-io-9.4.8.v20171121.jar:9.4.8.v20171121]
> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) 
> ~[jetty-io-9.4.8.v20171121.jar:9.4.8.v20171121]
> at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:289) 
> ~[jetty-io-9.4.8.v20171121.jar:9.4.8.v20171121]
> at org.eclipse.jetty.io.ssl.SslConnection$3.succeeded(SslConnection.java:149) 
> ~[jetty-io-9.4.8.v20171121.jar:9.4.8.v20171121]
> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) 
> ~[jetty-io-9.4.8.v20171121.jar:9.4.8.v20171121]
> at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:124) 
> ~[jetty-io-9.4.8.v20171121.jar:9.4.8.v20171121]
> at 
> org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:247)
>  ~[jetty-util-9.4.8.v20171121.jar:9.4.8.v20171121]
> at 
> org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:140)
>  ~[jetty-util-9.4.8.v20171121.jar:9.4.8.v20171121]
> at 
> org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)
>  ~[jetty-util-9.4.8.v20171121.jar:9.4.8.v20171121]
> at 
> org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:382)
>  ~[jetty-util-9.4.8.v20171121.jar:9.4.8.v20171121]
> at 
> org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
>  ~[jetty-util-9.4.8.v20171121.jar:9.4.8.v20171121]
> at 
> org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
>  ~[jetty-util-9.4.8.v20171121.jar:9.4.8.v20171121]
> at java.lang.Thread.run(Thread.java:748) [?:1.8.0-zing_17.11.0.0]
> date time WARN [qtp768306356-580185] ? (:) - Read pending for 
> org.eclipse.jetty.server.HttpConnection$BlockingReadCallback@2e98df28 
> prevented AC.ReadCB@424271f8{HttpConnection@424271f8[p=HttpParser{s=START,0 
> of 
> 

[JENKINS] Solr-reference-guide-master - Build # 7372 - Still Failing

2018-05-09 Thread Apache Jenkins Server
Build: https://builds.apache.org/job/Solr-reference-guide-master/7372/

Log: 
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on websites1 (git-websites svn-websites) in workspace 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master
 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url git://git.apache.org/lucene-solr.git # 
 > timeout=10
Cleaning workspace
 > git rev-parse --verify HEAD # timeout=10
Resetting working tree
 > git reset --hard # timeout=10
 > git clean -fdx # timeout=10
Fetching upstream changes from git://git.apache.org/lucene-solr.git
 > git --version # timeout=10
 > git fetch --tags --progress git://git.apache.org/lucene-solr.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
Checking out Revision c2819930d7a1ef675e1721242ac03ccc5d43b0b3 
(refs/remotes/origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f c2819930d7a1ef675e1721242ac03ccc5d43b0b3
Commit message: "SOLR-12280: Add dsp to math-expression children"
 > git rev-list --no-walk c2819930d7a1ef675e1721242ac03ccc5d43b0b3 # timeout=10
No emails were triggered.
[Solr-reference-guide-master] $ /usr/bin/env bash 
/tmp/jenkins2890341047732218543.sh
+ set -e
+ RVM_PATH=/home/jenkins/.rvm
+ RUBY_VERSION=ruby-2.3.3
+ GEMSET=solr-refguide-gemset
+ curl -sSL https://get.rvm.io
+ bash -s -- --ignore-dotfiles stable
Turning on ignore dotfiles mode.
Downloading https://github.com/rvm/rvm/archive/1.29.3.tar.gz
Downloading 
https://github.com/rvm/rvm/releases/download/1.29.3/1.29.3.tar.gz.asc
gpg: Signature made Sun 10 Sep 2017 08:59:21 PM UTC using RSA key ID BF04FF17
gpg: Good signature from "Michal Papis (RVM signing) "
gpg: aka "Michal Papis "
gpg: aka "[jpeg image of size 5015]"
gpg: WARNING: This key is not certified with a trusted signature!
gpg:  There is no indication that the signature belongs to the owner.
Primary key fingerprint: 409B 6B17 96C2 7546 2A17  0311 3804 BB82 D39D C0E3
 Subkey fingerprint: 62C9 E5F4 DA30 0D94 AC36  166B E206 C29F BF04 FF17
GPG verified '/home/jenkins/.rvm/archives/rvm-1.29.3.tgz'

Upgrading the RVM installation in /home/jenkins/.rvm/
Upgrade of RVM in /home/jenkins/.rvm/ is complete.

Upgrade Notes:

  * No new notes to display.

+ set +x
Running 'source /home/jenkins/.rvm/scripts/rvm'
Running 'rvm autolibs disable'
Running 'rvm install ruby-2.3.3'
Already installed ruby-2.3.3.
To reinstall use:

rvm reinstall ruby-2.3.3

Running 'rvm gemset create solr-refguide-gemset'
ruby-2.3.3 - #gemset created 
/home/jenkins/.rvm/gems/ruby-2.3.3@solr-refguide-gemset
ruby-2.3.3 - #generating solr-refguide-gemset 
wrappers|/-\|/-\|.-\|/-\|/-.|/-\|/-\|.-\|/-\|/-.|/-\|/-\|.-\|/-\|/-.|/-\|/-\|.-\|/-.
Running 'rvm ruby-2.3.3@solr-refguide-gemset'
Using /home/jenkins/.rvm/gems/ruby-2.3.3 with gemset solr-refguide-gemset
Running 'gem install --force --version 3.5.0 jekyll'
Successfully installed jekyll-3.5.0
Parsing documentation for jekyll-3.5.0
Done installing documentation for jekyll after 1 seconds
1 gem installed
Running 'gem install --force --version 2.1.0 jekyll-asciidoc'
Successfully installed jekyll-asciidoc-2.1.0
Parsing documentation for jekyll-asciidoc-2.1.0
Done installing documentation for jekyll-asciidoc after 0 seconds
1 gem installed
Running 'gem install --force --version 1.1.2 pygments.rb'
Successfully installed pygments.rb-1.1.2
Parsing documentation for pygments.rb-1.1.2
Done installing documentation for pygments.rb after 0 seconds
1 gem installed
Running 'ant ivy-bootstrap'
Buildfile: 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master/build.xml

-ivy-bootstrap1:
 [echo] installing ivy 2.4.0 to /home/jenkins/.ant/lib
  [get] Getting: 
http://repo1.maven.org/maven2/org/apache/ivy/ivy/2.4.0/ivy-2.4.0.jar
  [get] To: /home/jenkins/.ant/lib/ivy-2.4.0.jar
  [get] Not modified - so not downloaded

-ivy-bootstrap2:

-ivy-checksum:

-ivy-remove-old-versions:

ivy-bootstrap:

BUILD SUCCESSFUL
Total time: 0 seconds
+ ant clean build-site build-pdf
Buildfile: 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master/solr/solr-ref-guide/build.xml

clean:

build-init:
[mkdir] Created dir: 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master/solr/build/solr-ref-guide/content
 [echo] Copying all non template files from src ...
 [copy] Copying 420 files to 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master/solr/build/solr-ref-guide/content
 [echo] Copy (w/prop replacement) any template files from src...
 [copy] Copying 1 file to 

[jira] [Comment Edited] (SOLR-11453) Create separate logger for slow requests

2018-05-09 Thread Shawn Heisey (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-11453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469732#comment-16469732
 ] 

Shawn Heisey edited comment on SOLR-11453 at 5/10/18 1:03 AM:
--

A separate issue for sysprop usage would be a good idea.

Also a separate issue:  Eventually, as part of the overall drive to reduce log 
verbosity, I think we should have an option to send things from 
o.a.s.SolrCore.Request to a separate logfile.  Not sure that we want that 
enabled by default, but perhaps we can poll the user list for opinions about 
whether it should be enabled by default in 8.0.  There might be a significant 
chunk of the userbase that wants it.  The only drawback in my mind to a 
separate request log is that it's more difficult to put the requests in context 
with everything in solr.log.

For the log4j2.xml config, are you thinking of disabling additivity so that the 
slow requests are ONLY logged to the separate file?  I think that's a good idea.



was (Author: elyograg):
A separate issue for sysprop usage would be a good idea.

Also a separate issue:  Eventually, as part of the overall drive to reduce log 
verbosity, I think we should have an option to send things from 
o.a.s.SolrCore.RequestLog to a separate logfile.  Not sure that we want that 
enabled by default, but perhaps we can poll the user list for opinions about 
whether it should be enabled by default in 8.0.  There might be a significant 
chunk of the userbase that wants it.  The only drawback in my mind to a 
separate request log is that it's more difficult to put the requests in context 
with everything in solr.log.

For the log4j2.xml config, are you thinking of disabling additivity so that the 
slow requests are ONLY logged to the separate file?  I think that's a good idea.


> Create separate logger for slow requests
> 
>
> Key: SOLR-11453
> URL: https://issues.apache.org/jira/browse/SOLR-11453
> Project: Solr
>  Issue Type: Improvement
>  Components: logging
>Affects Versions: 7.0.1
>Reporter: Shawn Heisey
>Assignee: Shawn Heisey
>Priority: Minor
> Attachments: SOLR-11453.patch, SOLR-11453.patch, SOLR-11453.patch, 
> SOLR-11453.patch, slowlog-informational.patch, slowlog-informational.patch, 
> slowlog-informational.patch
>
>
> There is some desire on the mailing list to create a separate logfile for 
> slow queries.  Currently it is not possible to do this cleanly, because the 
> WARN level used by slow query logging within the SolrCore class is also used 
> for other events that SolrCore can log.  Those messages would be out of place 
> in a slow query log.  They should typically stay in main solr logfile.
> I propose creating a custom logger for slow queries, similar to what has been 
> set up for request logging.  In the SolrCore class, which is 
> org.apache.solr.core.SolrCore, there is a special logger at 
> org.apache.solr.core.SolrCore.Request.  This is not a real class, just a 
> logger which makes it possible to handle those log messages differently than 
> the rest of Solr's logging.  I propose setting up another custom logger 
> within SolrCore which could be org.apache.solr.core.SolrCore.SlowRequest.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[JENKINS] Solr-reference-guide-master - Build # 7368 - Still Failing

2018-05-09 Thread Apache Jenkins Server
Build: https://builds.apache.org/job/Solr-reference-guide-master/7368/

Log: 
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on websites1 (git-websites svn-websites) in workspace 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master
 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url git://git.apache.org/lucene-solr.git # 
 > timeout=10
Cleaning workspace
 > git rev-parse --verify HEAD # timeout=10
Resetting working tree
 > git reset --hard # timeout=10
 > git clean -fdx # timeout=10
Fetching upstream changes from git://git.apache.org/lucene-solr.git
 > git --version # timeout=10
 > git fetch --tags --progress git://git.apache.org/lucene-solr.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
Checking out Revision c2819930d7a1ef675e1721242ac03ccc5d43b0b3 
(refs/remotes/origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f c2819930d7a1ef675e1721242ac03ccc5d43b0b3
Commit message: "SOLR-12280: Add dsp to math-expression children"
 > git rev-list --no-walk c2819930d7a1ef675e1721242ac03ccc5d43b0b3 # timeout=10
No emails were triggered.
[Solr-reference-guide-master] $ /usr/bin/env bash 
/tmp/jenkins7991678808348017723.sh
+ set -e
+ RVM_PATH=/home/jenkins/.rvm
+ RUBY_VERSION=ruby-2.3.3
+ GEMSET=solr-refguide-gemset
+ curl -sSL https://get.rvm.io
+ bash -s -- --ignore-dotfiles stable
Turning on ignore dotfiles mode.
Downloading https://github.com/rvm/rvm/archive/1.29.3.tar.gz
Downloading 
https://github.com/rvm/rvm/releases/download/1.29.3/1.29.3.tar.gz.asc
gpg: Signature made Sun 10 Sep 2017 08:59:21 PM UTC using RSA key ID BF04FF17
gpg: Good signature from "Michal Papis (RVM signing) "
gpg: aka "Michal Papis "
gpg: aka "[jpeg image of size 5015]"
gpg: WARNING: This key is not certified with a trusted signature!
gpg:  There is no indication that the signature belongs to the owner.
Primary key fingerprint: 409B 6B17 96C2 7546 2A17  0311 3804 BB82 D39D C0E3
 Subkey fingerprint: 62C9 E5F4 DA30 0D94 AC36  166B E206 C29F BF04 FF17
GPG verified '/home/jenkins/.rvm/archives/rvm-1.29.3.tgz'

Upgrading the RVM installation in /home/jenkins/.rvm/
Upgrade of RVM in /home/jenkins/.rvm/ is complete.

Upgrade Notes:

  * No new notes to display.

+ set +x
Running 'source /home/jenkins/.rvm/scripts/rvm'
Running 'rvm autolibs disable'
Running 'rvm install ruby-2.3.3'
Already installed ruby-2.3.3.
To reinstall use:

rvm reinstall ruby-2.3.3

Running 'rvm gemset create solr-refguide-gemset'
ruby-2.3.3 - #gemset created 
/home/jenkins/.rvm/gems/ruby-2.3.3@solr-refguide-gemset
ruby-2.3.3 - #generating solr-refguide-gemset 
wrappers|/-\|/-\|.-\|/-\|/-.|/-\|/-\|.-\|/-\|/-.|/-\|/-\|.-\|/-\|/-.|/-\|/-\|.-\|/-.
Running 'rvm ruby-2.3.3@solr-refguide-gemset'
Using /home/jenkins/.rvm/gems/ruby-2.3.3 with gemset solr-refguide-gemset
Running 'gem install --force --version 3.5.0 jekyll'
Successfully installed jekyll-3.5.0
Parsing documentation for jekyll-3.5.0
Done installing documentation for jekyll after 1 seconds
1 gem installed
Running 'gem install --force --version 2.1.0 jekyll-asciidoc'
Successfully installed jekyll-asciidoc-2.1.0
Parsing documentation for jekyll-asciidoc-2.1.0
Done installing documentation for jekyll-asciidoc after 0 seconds
1 gem installed
Running 'gem install --force --version 1.1.2 pygments.rb'
Successfully installed pygments.rb-1.1.2
Parsing documentation for pygments.rb-1.1.2
Done installing documentation for pygments.rb after 0 seconds
1 gem installed
Running 'ant ivy-bootstrap'
Buildfile: 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master/build.xml

-ivy-bootstrap1:
 [echo] installing ivy 2.4.0 to /home/jenkins/.ant/lib
  [get] Getting: 
http://repo1.maven.org/maven2/org/apache/ivy/ivy/2.4.0/ivy-2.4.0.jar
  [get] To: /home/jenkins/.ant/lib/ivy-2.4.0.jar
  [get] Not modified - so not downloaded

-ivy-bootstrap2:

-ivy-checksum:

-ivy-remove-old-versions:

ivy-bootstrap:

BUILD SUCCESSFUL
Total time: 0 seconds
+ ant clean build-site build-pdf
Buildfile: 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master/solr/solr-ref-guide/build.xml

clean:

build-init:
[mkdir] Created dir: 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master/solr/build/solr-ref-guide/content
 [echo] Copying all non template files from src ...
 [copy] Copying 420 files to 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master/solr/build/solr-ref-guide/content
 [echo] Copy (w/prop replacement) any template files from src...
 [copy] Copying 1 file to 

[JENKINS-EA] Lucene-Solr-master-Linux (64bit/jdk-11-ea+5) - Build # 21984 - Still Unstable!

2018-05-09 Thread Policeman Jenkins Server
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21984/
Java: 64bit/jdk-11-ea+5 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC

2 tests failed.
FAILED:  org.apache.solr.update.MaxSizeAutoCommitTest.deleteTest

Error Message:
Tlog size exceeds the max size bound. Tlog path: 
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.update.MaxSizeAutoCommitTest_2D2E153AF68C619C-001/init-core-data-001/tlog/tlog.002,
 tlog size: 1302

Stack Trace:
java.lang.AssertionError: Tlog size exceeds the max size bound. Tlog path: 
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.update.MaxSizeAutoCommitTest_2D2E153AF68C619C-001/init-core-data-001/tlog/tlog.002,
 tlog size: 1302
at 
__randomizedtesting.SeedInfo.seed([2D2E153AF68C619C:3D60F0C58D22586D]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at 
org.apache.solr.update.MaxSizeAutoCommitTest.getTlogFileSizes(MaxSizeAutoCommitTest.java:379)
at 
org.apache.solr.update.MaxSizeAutoCommitTest.deleteTest(MaxSizeAutoCommitTest.java:200)
at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at 

[JENKINS] Solr-reference-guide-master - Build # 7373 - Still Failing

2018-05-09 Thread Apache Jenkins Server
Build: https://builds.apache.org/job/Solr-reference-guide-master/7373/

Log: 
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on websites1 (git-websites svn-websites) in workspace 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master
 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url git://git.apache.org/lucene-solr.git # 
 > timeout=10
Cleaning workspace
 > git rev-parse --verify HEAD # timeout=10
Resetting working tree
 > git reset --hard # timeout=10
 > git clean -fdx # timeout=10
Fetching upstream changes from git://git.apache.org/lucene-solr.git
 > git --version # timeout=10
 > git fetch --tags --progress git://git.apache.org/lucene-solr.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
Checking out Revision c2819930d7a1ef675e1721242ac03ccc5d43b0b3 
(refs/remotes/origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f c2819930d7a1ef675e1721242ac03ccc5d43b0b3
Commit message: "SOLR-12280: Add dsp to math-expression children"
 > git rev-list --no-walk c2819930d7a1ef675e1721242ac03ccc5d43b0b3 # timeout=10
No emails were triggered.
[Solr-reference-guide-master] $ /usr/bin/env bash 
/tmp/jenkins8133290463866770821.sh
+ set -e
+ RVM_PATH=/home/jenkins/.rvm
+ RUBY_VERSION=ruby-2.3.3
+ GEMSET=solr-refguide-gemset
+ curl -sSL https://get.rvm.io
+ bash -s -- --ignore-dotfiles stable
Turning on ignore dotfiles mode.
Downloading https://github.com/rvm/rvm/archive/1.29.3.tar.gz
Downloading 
https://github.com/rvm/rvm/releases/download/1.29.3/1.29.3.tar.gz.asc
gpg: Signature made Sun 10 Sep 2017 08:59:21 PM UTC using RSA key ID BF04FF17
gpg: Good signature from "Michal Papis (RVM signing) "
gpg: aka "Michal Papis "
gpg: aka "[jpeg image of size 5015]"
gpg: WARNING: This key is not certified with a trusted signature!
gpg:  There is no indication that the signature belongs to the owner.
Primary key fingerprint: 409B 6B17 96C2 7546 2A17  0311 3804 BB82 D39D C0E3
 Subkey fingerprint: 62C9 E5F4 DA30 0D94 AC36  166B E206 C29F BF04 FF17
GPG verified '/home/jenkins/.rvm/archives/rvm-1.29.3.tgz'

Upgrading the RVM installation in /home/jenkins/.rvm/
Upgrade of RVM in /home/jenkins/.rvm/ is complete.

Upgrade Notes:

  * No new notes to display.

+ set +x
Running 'source /home/jenkins/.rvm/scripts/rvm'
Running 'rvm autolibs disable'
Running 'rvm install ruby-2.3.3'
Already installed ruby-2.3.3.
To reinstall use:

rvm reinstall ruby-2.3.3

Running 'rvm gemset create solr-refguide-gemset'
ruby-2.3.3 - #gemset created 
/home/jenkins/.rvm/gems/ruby-2.3.3@solr-refguide-gemset
ruby-2.3.3 - #generating solr-refguide-gemset 
wrappers|/-\|/-\|.-\|/-\|/-.|/-\|/-\|.-\|/-\|/-.|/-\|/-\|.-\|/-\|/-.|/-\|/-\|.-\|/-.
Running 'rvm ruby-2.3.3@solr-refguide-gemset'
Using /home/jenkins/.rvm/gems/ruby-2.3.3 with gemset solr-refguide-gemset
Running 'gem install --force --version 3.5.0 jekyll'
Successfully installed jekyll-3.5.0
Parsing documentation for jekyll-3.5.0
Done installing documentation for jekyll after 1 seconds
1 gem installed
Running 'gem install --force --version 2.1.0 jekyll-asciidoc'
Successfully installed jekyll-asciidoc-2.1.0
Parsing documentation for jekyll-asciidoc-2.1.0
Done installing documentation for jekyll-asciidoc after 0 seconds
1 gem installed
Running 'gem install --force --version 1.1.2 pygments.rb'
Successfully installed pygments.rb-1.1.2
Parsing documentation for pygments.rb-1.1.2
Done installing documentation for pygments.rb after 0 seconds
1 gem installed
Running 'ant ivy-bootstrap'
Buildfile: 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master/build.xml

-ivy-bootstrap1:
 [echo] installing ivy 2.4.0 to /home/jenkins/.ant/lib
  [get] Getting: 
http://repo1.maven.org/maven2/org/apache/ivy/ivy/2.4.0/ivy-2.4.0.jar
  [get] To: /home/jenkins/.ant/lib/ivy-2.4.0.jar
  [get] Not modified - so not downloaded

-ivy-bootstrap2:

-ivy-checksum:

-ivy-remove-old-versions:

ivy-bootstrap:

BUILD SUCCESSFUL
Total time: 0 seconds
+ ant clean build-site build-pdf
Buildfile: 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master/solr/solr-ref-guide/build.xml

clean:

build-init:
[mkdir] Created dir: 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master/solr/build/solr-ref-guide/content
 [echo] Copying all non template files from src ...
 [copy] Copying 420 files to 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master/solr/build/solr-ref-guide/content
 [echo] Copy (w/prop replacement) any template files from src...
 [copy] Copying 1 file to 

[jira] [Commented] (SOLR-8207) Modernise cloud tab on Admin UI

2018-05-09 Thread Shawn Heisey (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469774#comment-16469774
 ] 

Shawn Heisey commented on SOLR-8207:


Comparing that information to the main dashboard in the admin UI, here are my 
thoughts:

I think that physical RAM usage should not be shown in the Solr admin UI, 
unless it comes with a note saying that it is usually completely normal for 
total RAM usage to be near 100 percent.  Some users *do* panic when they see 
the physical memory usage.

The numbers that are most useful for heap are the numbers shown on the main 
dashboard.  Free is NOT one of those numbers.  It shows how much heap is 
actually used, the current size of the heap, and the max size of the heap.  The 
current and max heap sizes are typically the same, unless the user has 
explicitly configured both -Xms and -Xmx.

Side note, possibly for a new issue: Running a 7.3 example, I noticed that 
there is mouseover text for the three numbers on the "JVM-Memory" dashboard 
graph.  Two the mouseovers are shown in bytes, but the third is shown as GB.  I 
think they should all use the same scale.


> Modernise cloud tab on Admin UI
> ---
>
> Key: SOLR-8207
> URL: https://issues.apache.org/jira/browse/SOLR-8207
> Project: Solr
>  Issue Type: Improvement
>  Components: Admin UI
>Affects Versions: 5.3
>Reporter: Upayavira
>Assignee: Jan Høydahl
>Priority: Major
> Attachments: node-compact.png, node-details.png, node-hostcolumn.png, 
> node-toggle-row-numdocs.png, nodes-tab-real.png, nodes-tab.png
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> The various sub-tabs of the "Cloud tab" were designed before anyone was 
> making real use of SolrCloud, and when we didn't really know the use-cases we 
> would need to support. I would argue that, whilst they are pretty (and 
> clever) they aren't really fit for purpose (with the exception of tree view).
> Issues:
> * Radial view doesn't scale beyond a small number of nodes/collections
> * Paging on the graph view is based on collections - so a collection with 
> many replicas won't be subject to pagination
> * The Dump feature is kinda redundant and should be removed
> * There is now a major overlap in functionality with the new Collections tab
> What I'd propose is that we:
>  * promote the tree tab to top level
>  * remove the graph views and the dump tab
>  * add a new Nodes tab
> This nodes tab would complement the collections tab - showing nodes, and 
> their associated replicas/collections. From this view, it would be possible 
> to add/remove replicas and to see the status of nodes. It would also be 
> possible to filter nodes by status: "show me only up nodes", "show me nodes 
> that are in trouble", "show me nodes that have leaders on them", etc.
> Presumably, if we have APIs to support it, we might have a "decommission 
> node" option, that would ensure that no replicas on this node are leaders, 
> and then remove all replicas from the node, ready for it to be removed from 
> the cluster.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-12298) Index Full nested document Hierarchy For Queries (umbrella issue)

2018-05-09 Thread David Smiley (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-12298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469779#comment-16469779
 ] 

David Smiley commented on SOLR-12298:
-

bq. is that about right?

Yes; well put Hossman.

One other variation on an approach is to keep the \_childDocuments member of 
SolrInputDocument but have it be a Map to 
capture the relationship name.  It would probably be less work, although some 
of the existing logic I spoke of would not "melt away" as I said.  Shrug.

> Index Full nested document Hierarchy For Queries (umbrella issue)
> -
>
> Key: SOLR-12298
> URL: https://issues.apache.org/jira/browse/SOLR-12298
> Project: Solr
>  Issue Type: Improvement
>  Security Level: Public(Default Security Level. Issues are Public) 
>Reporter: mosh
>Priority: Major
>
> Solr ought to have the ability to index deeply nested objects, while storing 
> the original document hierarchy.
>  Currently the client has to index the child document's full path and level 
> to manually reconstruct the original document structure, since the children 
> are flattened and returned in the reserved "__childDocuments__" key.
> Ideally you could index a nested document, having Solr transparently add the 
> required fields while providing a document transformer to rebuild the 
> original document's hierarchy.
>  
> This issue is an umbrella issue for the particular tasks that will make it 
> all happen – either subtasks or issue linking.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-11453) Create separate logger for slow requests

2018-05-09 Thread Shawn Heisey (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-11453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469780#comment-16469780
 ] 

Shawn Heisey commented on SOLR-11453:
-

Having a separate logfile for slow requests turned on by default doesn't have 
the same drawback as a separate log for all requests that is enabled by 
default.  Every entry logged by .SlowRequest is logged by .Request as well.

> Create separate logger for slow requests
> 
>
> Key: SOLR-11453
> URL: https://issues.apache.org/jira/browse/SOLR-11453
> Project: Solr
>  Issue Type: Improvement
>  Components: logging
>Affects Versions: 7.0.1
>Reporter: Shawn Heisey
>Assignee: Shawn Heisey
>Priority: Minor
> Attachments: SOLR-11453.patch, SOLR-11453.patch, SOLR-11453.patch, 
> SOLR-11453.patch, slowlog-informational.patch, slowlog-informational.patch, 
> slowlog-informational.patch
>
>
> There is some desire on the mailing list to create a separate logfile for 
> slow queries.  Currently it is not possible to do this cleanly, because the 
> WARN level used by slow query logging within the SolrCore class is also used 
> for other events that SolrCore can log.  Those messages would be out of place 
> in a slow query log.  They should typically stay in main solr logfile.
> I propose creating a custom logger for slow queries, similar to what has been 
> set up for request logging.  In the SolrCore class, which is 
> org.apache.solr.core.SolrCore, there is a special logger at 
> org.apache.solr.core.SolrCore.Request.  This is not a real class, just a 
> logger which makes it possible to handle those log messages differently than 
> the rest of Solr's logging.  I propose setting up another custom logger 
> within SolrCore which could be org.apache.solr.core.SolrCore.SlowRequest.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: Solr RefGuide Errata page wrong link

2018-05-09 Thread Jan Høydahl
One candidate for an errata entry could be 
https://issues.apache.org/jira/browse/SOLR-12321 
 do document that 7.3 broke 
back compat with 7.2. This should normally have been documented in CHANGES 
Upgrade Notes. 

Perhaps there should be a link to the errata page from the top of CHANGES.txt, 
and from the beginning of the reference guide such as "About This Guide"?

--
Jan Høydahl, search solution architect
Cominvent AS - www.cominvent.com

> 9. mai 2018 kl. 23:54 skrev Cassandra Targett :
> 
> Yeah, you're right - it's parameterized using a bad parameter. I've often 
> thought, though, that it should go away - we never update it and having a 
> page that refers to itself online is weird. Thoughts? Anyone really want this 
> page and intend to update it? I likely won't ever unless I get a ton of extra 
> time somehow.
> 
> As for the comments, I filed https://issues.apache.org/jira/browse/SOLR-12018 
>  months ago.
> 
> On Wed, May 9, 2018 at 2:51 PM Jan Høydahl  > wrote:
> See https://lucene.apache.org/solr/guide/7_3/errata.html 
> 
> The link on that page says /7.3/… but should be /7_3/… so it is a 404 now, 
> and probably also in the PDF.
> 
> PS: The Apache Comments section is not active
> 
> --
> Jan Høydahl, search solution architect
> Cominvent AS - www.cominvent.com 
> 
> 
> -
> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org 
> 
> For additional commands, e-mail: dev-h...@lucene.apache.org 
> 
> 



[jira] [Commented] (SOLR-12331) How to backup solr collection

2018-05-09 Thread Paul Williams (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-12331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469640#comment-16469640
 ] 

Paul Williams commented on SOLR-12331:
--

Ah I see, sorry Shawn it was my first post here on Jira. Thank you for
answering.

Kind regards,
Paul.



-- 


CAUTION: This email, links and files included in its transmission by 
Woolworths Group Limited ABN 88 000 014 675 and its group of companies 
(Woolworths Group) are solely intended for the use of the addressee(s) and 
may contain information that is confidential and privileged. If you receive 
this email in error, please advise us immediately and delete it without 
reading or copying the contents contained within. Woolworths Group does not 
accept liability for the views expressed within or the consequences of any 
computer malware that may be transmitted with this email. The contents are 
also subject to copyright. No part of it should be reproduced, adapted or 
transmitted without the written consent of the copyright owner.


> How to backup solr collection
> -
>
> Key: SOLR-12331
> URL: https://issues.apache.org/jira/browse/SOLR-12331
> Project: Solr
>  Issue Type: Task
>  Security Level: Public(Default Security Level. Issues are Public) 
>  Components: Backup/Restore
>Affects Versions: 7.3.1
>Reporter: Paul Williams
>Priority: Critical
>  Labels: Backup/Restore, backup, collection, location, newbie, 
> restore
>
> Hello Solr experts,
> I am new to solr and have a lot to learn, but I have been tasked with writing 
> a backup and restore demo. I have a question regarding the location of the 
> backup when taking a backup.
> In my address box I have the following URL to get my backup started...
> [http://IPADDRESS:8983/solr/#/collections?action=BACKUP=test_catalog=|http://ipaddress:8983/solr/#/collections?action=BACKUP=test_catalog=]
> ...so the documentation says I should back up to a shared drive, but shared 
> drive where? Is the shared drive on the zookeeper, or on my local machine? If 
> on the zookeeper, do I need to create a backup directory first? And if on my 
> local machine, what do I need to type in?
> I am also interested to know if it is possible to backup to an Azure blob?
> What is the difference between the location and repository?
> I would really appreciate any guidance, there appears to be no step by step 
> on the internet (hard to believe I know), but if there is I cannot find it. 
> If I end up creating one from help received here, I will be only too happy to 
> share it to the greater community.
>  
> Thank you.
> Kind Regards,
> Paul.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: Solr RefGuide Errata page wrong link

2018-05-09 Thread Cassandra Targett
Yeah, you're right - it's parameterized using a bad parameter. I've often
thought, though, that it should go away - we never update it and having a
page that refers to itself online is weird. Thoughts? Anyone really want
this page and intend to update it? I likely won't ever unless I get a ton
of extra time somehow.

As for the comments, I filed
https://issues.apache.org/jira/browse/SOLR-12018 months ago.

On Wed, May 9, 2018 at 2:51 PM Jan Høydahl  wrote:

> See https://lucene.apache.org/solr/guide/7_3/errata.html
> The link on that page says /7.3/… but should be /7_3/… so it is a 404 now,
> and probably also in the PDF.
>
> PS: The Apache Comments section is not active
>
> --
> Jan Høydahl, search solution architect
> Cominvent AS - www.cominvent.com
>
>
> -
> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
> For additional commands, e-mail: dev-h...@lucene.apache.org
>
>


[JENKINS] Solr-reference-guide-master - Build # 7369 - Still Failing

2018-05-09 Thread Apache Jenkins Server
Build: https://builds.apache.org/job/Solr-reference-guide-master/7369/

Log: 
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on websites1 (git-websites svn-websites) in workspace 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master
 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url git://git.apache.org/lucene-solr.git # 
 > timeout=10
Cleaning workspace
 > git rev-parse --verify HEAD # timeout=10
Resetting working tree
 > git reset --hard # timeout=10
 > git clean -fdx # timeout=10
Fetching upstream changes from git://git.apache.org/lucene-solr.git
 > git --version # timeout=10
 > git fetch --tags --progress git://git.apache.org/lucene-solr.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
Checking out Revision c2819930d7a1ef675e1721242ac03ccc5d43b0b3 
(refs/remotes/origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f c2819930d7a1ef675e1721242ac03ccc5d43b0b3
Commit message: "SOLR-12280: Add dsp to math-expression children"
 > git rev-list --no-walk c2819930d7a1ef675e1721242ac03ccc5d43b0b3 # timeout=10
No emails were triggered.
[Solr-reference-guide-master] $ /usr/bin/env bash 
/tmp/jenkins2460531264899772841.sh
+ set -e
+ RVM_PATH=/home/jenkins/.rvm
+ RUBY_VERSION=ruby-2.3.3
+ GEMSET=solr-refguide-gemset
+ curl -sSL https://get.rvm.io
+ bash -s -- --ignore-dotfiles stable
Turning on ignore dotfiles mode.
Downloading https://github.com/rvm/rvm/archive/1.29.3.tar.gz
Downloading 
https://github.com/rvm/rvm/releases/download/1.29.3/1.29.3.tar.gz.asc
gpg: Signature made Sun 10 Sep 2017 08:59:21 PM UTC using RSA key ID BF04FF17
gpg: Good signature from "Michal Papis (RVM signing) "
gpg: aka "Michal Papis "
gpg: aka "[jpeg image of size 5015]"
gpg: WARNING: This key is not certified with a trusted signature!
gpg:  There is no indication that the signature belongs to the owner.
Primary key fingerprint: 409B 6B17 96C2 7546 2A17  0311 3804 BB82 D39D C0E3
 Subkey fingerprint: 62C9 E5F4 DA30 0D94 AC36  166B E206 C29F BF04 FF17
GPG verified '/home/jenkins/.rvm/archives/rvm-1.29.3.tgz'

Upgrading the RVM installation in /home/jenkins/.rvm/
Upgrade of RVM in /home/jenkins/.rvm/ is complete.

Upgrade Notes:

  * No new notes to display.

+ set +x
Running 'source /home/jenkins/.rvm/scripts/rvm'
Running 'rvm autolibs disable'
Running 'rvm install ruby-2.3.3'
Already installed ruby-2.3.3.
To reinstall use:

rvm reinstall ruby-2.3.3

Running 'rvm gemset create solr-refguide-gemset'
ruby-2.3.3 - #gemset created 
/home/jenkins/.rvm/gems/ruby-2.3.3@solr-refguide-gemset
ruby-2.3.3 - #generating solr-refguide-gemset 
wrappers|/-\|/-\|.-\|/-\|/-.|/-\|/-\|.-\|/-\|/-.|/-\|/-\|.-\|/-\|/-.|/-\|/-\|.-\|/-.
Running 'rvm ruby-2.3.3@solr-refguide-gemset'
Using /home/jenkins/.rvm/gems/ruby-2.3.3 with gemset solr-refguide-gemset
Running 'gem install --force --version 3.5.0 jekyll'
Successfully installed jekyll-3.5.0
Parsing documentation for jekyll-3.5.0
Done installing documentation for jekyll after 1 seconds
1 gem installed
Running 'gem install --force --version 2.1.0 jekyll-asciidoc'
Successfully installed jekyll-asciidoc-2.1.0
Parsing documentation for jekyll-asciidoc-2.1.0
Done installing documentation for jekyll-asciidoc after 0 seconds
1 gem installed
Running 'gem install --force --version 1.1.2 pygments.rb'
Successfully installed pygments.rb-1.1.2
Parsing documentation for pygments.rb-1.1.2
Done installing documentation for pygments.rb after 0 seconds
1 gem installed
Running 'ant ivy-bootstrap'
Buildfile: 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master/build.xml

-ivy-bootstrap1:
 [echo] installing ivy 2.4.0 to /home/jenkins/.ant/lib
  [get] Getting: 
http://repo1.maven.org/maven2/org/apache/ivy/ivy/2.4.0/ivy-2.4.0.jar
  [get] To: /home/jenkins/.ant/lib/ivy-2.4.0.jar
  [get] Not modified - so not downloaded

-ivy-bootstrap2:

-ivy-checksum:

-ivy-remove-old-versions:

ivy-bootstrap:

BUILD SUCCESSFUL
Total time: 0 seconds
+ ant clean build-site build-pdf
Buildfile: 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master/solr/solr-ref-guide/build.xml

clean:

build-init:
[mkdir] Created dir: 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master/solr/build/solr-ref-guide/content
 [echo] Copying all non template files from src ...
 [copy] Copying 420 files to 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master/solr/build/solr-ref-guide/content
 [echo] Copy (w/prop replacement) any template files from src...
 [copy] Copying 1 file to 

[jira] [Commented] (SOLR-10209) UI: Convert all Collections api calls to async requests, add new features/buttons

2018-05-09 Thread JIRA

[ 
https://issues.apache.org/jira/browse/SOLR-10209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469655#comment-16469655
 ] 

Jan Høydahl commented on SOLR-10209:


Looking forward to this, seeing such behaviour with thousands of request when 
developing for the Admin UI.

> UI: Convert all Collections api calls to async requests, add new 
> features/buttons
> -
>
> Key: SOLR-10209
> URL: https://issues.apache.org/jira/browse/SOLR-10209
> Project: Solr
>  Issue Type: Improvement
>  Security Level: Public(Default Security Level. Issues are Public) 
>  Components: Admin UI
>Reporter: Amrit Sarkar
>Priority: Major
> Attachments: SOLR-10209-v1.patch, SOLR-10209.patch, SOLR-10209.patch, 
> SOLR-10209.patch
>
>
> We are having discussion on multiple jiras for requests for Collections apis 
> from UI and how to improve them:
> -SOLR-9818: Solr admin UI rapidly retries any request(s) if it loses 
> connection with the server-
> -SOLR-10146: Admin UI: Button to delete a shard-
> SOLR-10201: Add Collection "creates collection", "Connection to Solr lost", 
> when replicationFactor>1
> Proposal =>
> *Phase 1:*
> Convert all Collections api calls to async requests and utilise REQUESTSTATUS 
> to fetch the information. There will be performance hit, but the requests 
> will be safe and sound. A progress bar will be added for request status.
> {noformat}
> > submit the async request
> if (the initial call failed or there was no status to be found)
> { report an error and suggest the user look check their system before 
> resubmitting the request. Bail out in this case, no retries, no attempt to 
> drive on. }
> else
> { put up a progress indicator while periodically checking the status, 
> Continue spinning until we can report the final status. }
> {noformat}
> *Phase 2:*
> Add new buttons/features to collections.html
> a) "Split" shard
> -b) "Delete" shard-
> c) "Backup" collection
> d) "Restore" collection
> Open to suggestions and feedbacks on this.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-12314) ConcurrentUpdateSolrClient doesn't respect the timeout's defined in the solr.xml file

2018-05-09 Thread Mark Miller (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-12314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469715#comment-16469715
 ] 

Mark Miller commented on SOLR-12314:


Did you attach latest patch?

> ConcurrentUpdateSolrClient doesn't respect the timeout's defined in the 
> solr.xml file
> -
>
> Key: SOLR-12314
> URL: https://issues.apache.org/jira/browse/SOLR-12314
> Project: Solr
>  Issue Type: Bug
>  Security Level: Public(Default Security Level. Issues are Public) 
>Reporter: Varun Thacker
>Assignee: Varun Thacker
>Priority: Major
> Attachments: SOLR-12314.patch, SOLR-12314.patch
>
>
> In ConcurrentUpdateSolrClient we create an HttpPost Request which allows you 
> to set a request config. If the request config is not provided httpclient 
> will use the default request config. 
>  
> {code:java}
> org.apache.http.client.config.RequestConfig.Builder requestConfigBuilder = 
> HttpClientUtil.createDefaultRequestConfigBuilder();
> if (soTimeout != null) {
>   requestConfigBuilder.setSocketTimeout(soTimeout);
> }
> if (connectionTimeout != null) {
>   requestConfigBuilder.setConnectTimeout(connectionTimeout);
> }
> method.setConfig(requestConfigBuilder.build());{code}
> While creating the httpclient object we ensure that the default request is 
> set with the properties we care about.  This happens in 
> HttpClientUtils#setupBuilder
> {code:java}
> RequestConfig requestConfig = requestConfigBuilder.build();
> HttpClientBuilder retBuilder = 
> builder.setDefaultRequestConfig(requestConfig);{code}
> So there is no need to set a per request config 
>  
> Here is where the httpclient picks the request config is provided on the 
> request itself : 
> [https://github.com/apache/httpcomponents-client/blob/4.5.3/httpclient/src/main/java/org/apache/http/impl/client/InternalHttpClient.java#L168]
>  
> And if it's not provided it uses the default here : 
> https://github.com/apache/httpcomponents-client/blob/4.5.3/httpclient/src/main/java/org/apache/http/impl/client/InternalHttpClient.java#L148



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (SOLR-12314) ConcurrentUpdateSolrClient doesn't respect the timeout's defined in the solr.xml file

2018-05-09 Thread Varun Thacker (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-12314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Varun Thacker updated SOLR-12314:
-
Attachment: SOLR-12314.patch

> ConcurrentUpdateSolrClient doesn't respect the timeout's defined in the 
> solr.xml file
> -
>
> Key: SOLR-12314
> URL: https://issues.apache.org/jira/browse/SOLR-12314
> Project: Solr
>  Issue Type: Bug
>  Security Level: Public(Default Security Level. Issues are Public) 
>Reporter: Varun Thacker
>Assignee: Varun Thacker
>Priority: Major
> Attachments: SOLR-12314.patch, SOLR-12314.patch, SOLR-12314.patch
>
>
> In ConcurrentUpdateSolrClient we create an HttpPost Request which allows you 
> to set a request config. If the request config is not provided httpclient 
> will use the default request config. 
>  
> {code:java}
> org.apache.http.client.config.RequestConfig.Builder requestConfigBuilder = 
> HttpClientUtil.createDefaultRequestConfigBuilder();
> if (soTimeout != null) {
>   requestConfigBuilder.setSocketTimeout(soTimeout);
> }
> if (connectionTimeout != null) {
>   requestConfigBuilder.setConnectTimeout(connectionTimeout);
> }
> method.setConfig(requestConfigBuilder.build());{code}
> While creating the httpclient object we ensure that the default request is 
> set with the properties we care about.  This happens in 
> HttpClientUtils#setupBuilder
> {code:java}
> RequestConfig requestConfig = requestConfigBuilder.build();
> HttpClientBuilder retBuilder = 
> builder.setDefaultRequestConfig(requestConfig);{code}
> So there is no need to set a per request config 
>  
> Here is where the httpclient picks the request config is provided on the 
> request itself : 
> [https://github.com/apache/httpcomponents-client/blob/4.5.3/httpclient/src/main/java/org/apache/http/impl/client/InternalHttpClient.java#L168]
>  
> And if it's not provided it uses the default here : 
> https://github.com/apache/httpcomponents-client/blob/4.5.3/httpclient/src/main/java/org/apache/http/impl/client/InternalHttpClient.java#L148



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-12314) ConcurrentUpdateSolrClient doesn't respect the timeout's defined in the solr.xml file

2018-05-09 Thread Varun Thacker (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-12314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469720#comment-16469720
 ] 

Varun Thacker commented on SOLR-12314:
--

I thought I had.. My bad.. It's uploaded now

> ConcurrentUpdateSolrClient doesn't respect the timeout's defined in the 
> solr.xml file
> -
>
> Key: SOLR-12314
> URL: https://issues.apache.org/jira/browse/SOLR-12314
> Project: Solr
>  Issue Type: Bug
>  Security Level: Public(Default Security Level. Issues are Public) 
>Reporter: Varun Thacker
>Assignee: Varun Thacker
>Priority: Major
> Attachments: SOLR-12314.patch, SOLR-12314.patch, SOLR-12314.patch
>
>
> In ConcurrentUpdateSolrClient we create an HttpPost Request which allows you 
> to set a request config. If the request config is not provided httpclient 
> will use the default request config. 
>  
> {code:java}
> org.apache.http.client.config.RequestConfig.Builder requestConfigBuilder = 
> HttpClientUtil.createDefaultRequestConfigBuilder();
> if (soTimeout != null) {
>   requestConfigBuilder.setSocketTimeout(soTimeout);
> }
> if (connectionTimeout != null) {
>   requestConfigBuilder.setConnectTimeout(connectionTimeout);
> }
> method.setConfig(requestConfigBuilder.build());{code}
> While creating the httpclient object we ensure that the default request is 
> set with the properties we care about.  This happens in 
> HttpClientUtils#setupBuilder
> {code:java}
> RequestConfig requestConfig = requestConfigBuilder.build();
> HttpClientBuilder retBuilder = 
> builder.setDefaultRequestConfig(requestConfig);{code}
> So there is no need to set a per request config 
>  
> Here is where the httpclient picks the request config is provided on the 
> request itself : 
> [https://github.com/apache/httpcomponents-client/blob/4.5.3/httpclient/src/main/java/org/apache/http/impl/client/InternalHttpClient.java#L168]
>  
> And if it's not provided it uses the default here : 
> https://github.com/apache/httpcomponents-client/blob/4.5.3/httpclient/src/main/java/org/apache/http/impl/client/InternalHttpClient.java#L148



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-12235) Incomplete debugQuery info when using edismax and boost param

2018-05-09 Thread Cassandra Targett (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-12235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469565#comment-16469565
 ] 

Cassandra Targett commented on SOLR-12235:
--

bq. then to 'zoom in' towards the unknown commit point(s) in between at which 
the info went missing

If you can write such a test, {{git bisect}} could help you a lot with that to 
find the commit where your test breaks (just in case you didn't know about it 
already).

> Incomplete debugQuery info when using edismax and boost param
> -
>
> Key: SOLR-12235
> URL: https://issues.apache.org/jira/browse/SOLR-12235
> Project: Solr
>  Issue Type: Bug
>  Security Level: Public(Default Security Level. Issues are Public) 
>  Components: query parsers, search
>Affects Versions: 7.3
> Environment: Solr 7.3.0, Java 1.8.0_162
>Reporter: Bogdan Stoica
>Priority: Minor
>
> There is an issue with the way SOLR 7.3 outputs explain information when 
> using edismax and 
> boost param.
>  
> Example query: 
> /select?boost=results=on=edismax=word=text
>  
> Solr 7.3 outputs:
>  
> {code:java}
>  
> 31349.63 = product of: 1.0 = boost 31349.63 = boost(double(results)) 
> {code}
>  
>  
> In comparrison, Solr 7.2.1 returns the following:
>  
> {code:java}
>  
> 31349.63 = boost(text:word,double(results)), product of: 14.400382 = 
> weight(text:word in 18142) [SchemaSimilarity], result of: 14.400382 = 
> score(doc=18142,freq=1.0 = termFreq=1.0 ), product of: 10.677335 = idf, 
> computed as log(1 + (docCount - docFreq + 0.5) / (docFreq + 0.5)) from: 6.0 = 
> docFreq 281851.0 = docCount 1.3486869 = tfNorm, computed as (freq * (k1 + 1)) 
> / (freq + k1 * (1 - b + b * fieldLength / avgFieldLength)) from: 1.0 = 
> termFreq=1.0 1.2 = parameter k1 0.75 = parameter b 2.7172585 = avgFieldLength 
> 1.0 = fieldLength 2177.0 = double(results)=2177.0 
> {code}
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-12314) ConcurrentUpdateSolrClient doesn't respect the timeout's defined in the solr.xml file

2018-05-09 Thread Varun Thacker (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-12314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469645#comment-16469645
 ] 

Varun Thacker commented on SOLR-12314:
--

Updated patch with a test case. 

[~mark.mil...@oblivion.ch]  What do you think of this approach?

> ConcurrentUpdateSolrClient doesn't respect the timeout's defined in the 
> solr.xml file
> -
>
> Key: SOLR-12314
> URL: https://issues.apache.org/jira/browse/SOLR-12314
> Project: Solr
>  Issue Type: Bug
>  Security Level: Public(Default Security Level. Issues are Public) 
>Reporter: Varun Thacker
>Assignee: Varun Thacker
>Priority: Major
> Attachments: SOLR-12314.patch, SOLR-12314.patch
>
>
> In ConcurrentUpdateSolrClient we create an HttpPost Request which allows you 
> to set a request config. If the request config is not provided httpclient 
> will use the default request config. 
>  
> {code:java}
> org.apache.http.client.config.RequestConfig.Builder requestConfigBuilder = 
> HttpClientUtil.createDefaultRequestConfigBuilder();
> if (soTimeout != null) {
>   requestConfigBuilder.setSocketTimeout(soTimeout);
> }
> if (connectionTimeout != null) {
>   requestConfigBuilder.setConnectTimeout(connectionTimeout);
> }
> method.setConfig(requestConfigBuilder.build());{code}
> While creating the httpclient object we ensure that the default request is 
> set with the properties we care about.  This happens in 
> HttpClientUtils#setupBuilder
> {code:java}
> RequestConfig requestConfig = requestConfigBuilder.build();
> HttpClientBuilder retBuilder = 
> builder.setDefaultRequestConfig(requestConfig);{code}
> So there is no need to set a per request config 
>  
> Here is where the httpclient picks the request config is provided on the 
> request itself : 
> [https://github.com/apache/httpcomponents-client/blob/4.5.3/httpclient/src/main/java/org/apache/http/impl/client/InternalHttpClient.java#L168]
>  
> And if it's not provided it uses the default here : 
> https://github.com/apache/httpcomponents-client/blob/4.5.3/httpclient/src/main/java/org/apache/http/impl/client/InternalHttpClient.java#L148



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-11453) Create separate logger for slow requests

2018-05-09 Thread Shawn Heisey (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-11453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469732#comment-16469732
 ] 

Shawn Heisey commented on SOLR-11453:
-

A separate issue for sysprop usage would be a good idea.

Also a separate issue:  Eventually, as part of the overall drive to reduce log 
verbosity, I think we should have an option to send things from 
o.a.s.SolrCore.RequestLog to a separate logfile.  Not sure that we want that 
enabled by default, but perhaps we can poll the user list for opinions about 
whether it should be enabled by default in 8.0.  There might be a significant 
chunk of the userbase that wants it.  The only drawback in my mind to a 
separate request log is that it's more difficult to put the requests in context 
with everything in solr.log.

For the log4j2.xml config, are you thinking of disabling additivity so that the 
slow requests are ONLY logged to the separate file?  I think that's a good idea.


> Create separate logger for slow requests
> 
>
> Key: SOLR-11453
> URL: https://issues.apache.org/jira/browse/SOLR-11453
> Project: Solr
>  Issue Type: Improvement
>  Components: logging
>Affects Versions: 7.0.1
>Reporter: Shawn Heisey
>Assignee: Shawn Heisey
>Priority: Minor
> Attachments: SOLR-11453.patch, SOLR-11453.patch, SOLR-11453.patch, 
> SOLR-11453.patch, slowlog-informational.patch, slowlog-informational.patch, 
> slowlog-informational.patch
>
>
> There is some desire on the mailing list to create a separate logfile for 
> slow queries.  Currently it is not possible to do this cleanly, because the 
> WARN level used by slow query logging within the SolrCore class is also used 
> for other events that SolrCore can log.  Those messages would be out of place 
> in a slow query log.  They should typically stay in main solr logfile.
> I propose creating a custom logger for slow queries, similar to what has been 
> set up for request logging.  In the SolrCore class, which is 
> org.apache.solr.core.SolrCore, there is a special logger at 
> org.apache.solr.core.SolrCore.Request.  This is not a real class, just a 
> logger which makes it possible to handle those log messages differently than 
> the rest of Solr's logging.  I propose setting up another custom logger 
> within SolrCore which could be org.apache.solr.core.SolrCore.SlowRequest.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-10335) Upgrade to Tika 1.16 when available

2018-05-09 Thread Erick Erickson (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-10335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469827#comment-16469827
 ] 

Erick Erickson commented on SOLR-10335:
---

If it went to 6.6.2, it should go to 6x. While there are no plans (and I would 
be surprised if it ever happened), if for any reason 6.7 were released this 
should be in it...

> Upgrade to Tika 1.16 when available
> ---
>
> Key: SOLR-10335
> URL: https://issues.apache.org/jira/browse/SOLR-10335
> Project: Solr
>  Issue Type: Improvement
>  Security Level: Public(Default Security Level. Issues are Public) 
>Reporter: Tim Allison
>Assignee: Shalin Shekhar Mangar
>Priority: Critical
> Fix For: 5.5.5, 6.6.2, 7.1
>
>
> Once POI 3.16-beta3 is out (early/mid April?), we'll push for a release of 
> Tika 1.15.
> Please let us know if you have any requests.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-9638) SolrCloud restore of backup fails

2018-05-09 Thread Roy Perkins (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-9638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469649#comment-16469649
 ] 

Roy Perkins commented on SOLR-9638:
---

[~janhoy] Not really, I gave up and just do snapshots of each shard.  Not 
exactly ideal, but it is working for now.

> SolrCloud restore of backup fails
> -
>
> Key: SOLR-9638
> URL: https://issues.apache.org/jira/browse/SOLR-9638
> Project: Solr
>  Issue Type: Bug
>  Security Level: Public(Default Security Level. Issues are Public) 
>  Components: SolrCloud
>Reporter: Håvar Nøvik
>Priority: Minor
>  Labels: SolrCloud
>
> Steps to reproduce:
> * create backup with the following api call: 
> /admin/collections?action=BACKUP=myBackupName=myCollectionName=/path/to/my/shared/drive
> * restore to from backup with the following api call: 
> /admin/collections?action=RESTORE=myBackupName=/path/to/my/shared/drive=myRestoredCollectionName
> Expected result:
> * a new collection with the data from the 'myCollectionName' collection is 
> created
> Actual result:
> * the api call fails with a 500 http status code and the following stacktrace:
> {code}
> org.apache.solr.common.SolrException: Couldn't restore since doesn't exist: 
> file:///path/to/my/shared/drive/myBackupName
>   at 
> org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:284)
>   at 
> org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:215)
>   at 
> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:154)
>   at 
> org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:658)
>   at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:440)
>   at 
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:257)
>   at 
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:208)
>   at 
> org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1668)
>   at 
> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:581)
>   at 
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
>   at 
> org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548)
>   at 
> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:226)
>   at 
> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1160)
>   at 
> org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:511)
>   at 
> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
>   at 
> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1092)
>   at 
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
>   at 
> org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:213)
>   at 
> org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:119)
>   at 
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
>   at org.eclipse.jetty.server.Server.handle(Server.java:518)
>   at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:308)
>   at 
> org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:244)
>   at 
> org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273)
>   at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)
>   at 
> org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
>   at 
> org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceAndRun(ExecuteProduceConsume.java:246)
>   at 
> org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:156)
>   at 
> org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:654)
>   at 
> org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572)
>   at java.lang.Thread.run(Thread.java:745)
> {code}
> More info:
> It seems like a bug in the [LocalFileSystemRepository | 
> https://github.com/apache/lucene-solr/blob/master/solr/core/src/java/org/apache/solr/core/backup/repository/LocalFileSystemRepository.java#L114]
>  where it checks if the backup exists. The bug is that it check if a file 
> with that name exists, but the BACKUP command creates a directory.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[JENKINS] Solr-reference-guide-master - Build # 7370 - Still Failing

2018-05-09 Thread Apache Jenkins Server
Build: https://builds.apache.org/job/Solr-reference-guide-master/7370/

Log: 
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on websites1 (git-websites svn-websites) in workspace 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master
 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url git://git.apache.org/lucene-solr.git # 
 > timeout=10
Cleaning workspace
 > git rev-parse --verify HEAD # timeout=10
Resetting working tree
 > git reset --hard # timeout=10
 > git clean -fdx # timeout=10
Fetching upstream changes from git://git.apache.org/lucene-solr.git
 > git --version # timeout=10
 > git fetch --tags --progress git://git.apache.org/lucene-solr.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
Checking out Revision c2819930d7a1ef675e1721242ac03ccc5d43b0b3 
(refs/remotes/origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f c2819930d7a1ef675e1721242ac03ccc5d43b0b3
Commit message: "SOLR-12280: Add dsp to math-expression children"
 > git rev-list --no-walk c2819930d7a1ef675e1721242ac03ccc5d43b0b3 # timeout=10
No emails were triggered.
[Solr-reference-guide-master] $ /usr/bin/env bash 
/tmp/jenkins6965075681846596332.sh
+ set -e
+ RVM_PATH=/home/jenkins/.rvm
+ RUBY_VERSION=ruby-2.3.3
+ GEMSET=solr-refguide-gemset
+ curl -sSL https://get.rvm.io
+ bash -s -- --ignore-dotfiles stable
Turning on ignore dotfiles mode.
Downloading https://github.com/rvm/rvm/archive/1.29.3.tar.gz
Downloading 
https://github.com/rvm/rvm/releases/download/1.29.3/1.29.3.tar.gz.asc
gpg: Signature made Sun 10 Sep 2017 08:59:21 PM UTC using RSA key ID BF04FF17
gpg: Good signature from "Michal Papis (RVM signing) "
gpg: aka "Michal Papis "
gpg: aka "[jpeg image of size 5015]"
gpg: WARNING: This key is not certified with a trusted signature!
gpg:  There is no indication that the signature belongs to the owner.
Primary key fingerprint: 409B 6B17 96C2 7546 2A17  0311 3804 BB82 D39D C0E3
 Subkey fingerprint: 62C9 E5F4 DA30 0D94 AC36  166B E206 C29F BF04 FF17
GPG verified '/home/jenkins/.rvm/archives/rvm-1.29.3.tgz'

Upgrading the RVM installation in /home/jenkins/.rvm/
Upgrade of RVM in /home/jenkins/.rvm/ is complete.

Upgrade Notes:

  * No new notes to display.

+ set +x
Running 'source /home/jenkins/.rvm/scripts/rvm'
Running 'rvm autolibs disable'
Running 'rvm install ruby-2.3.3'
Already installed ruby-2.3.3.
To reinstall use:

rvm reinstall ruby-2.3.3

Running 'rvm gemset create solr-refguide-gemset'
ruby-2.3.3 - #gemset created 
/home/jenkins/.rvm/gems/ruby-2.3.3@solr-refguide-gemset
ruby-2.3.3 - #generating solr-refguide-gemset 
wrappers|/-\|/-\|.-\|/-\|/-.|/-\|/-\|.-\|/-\|/-.|/-\|/-\|.-\|/-\|/-.|/-\|/-\|.-\|/-.
Running 'rvm ruby-2.3.3@solr-refguide-gemset'
Using /home/jenkins/.rvm/gems/ruby-2.3.3 with gemset solr-refguide-gemset
Running 'gem install --force --version 3.5.0 jekyll'
Successfully installed jekyll-3.5.0
Parsing documentation for jekyll-3.5.0
Done installing documentation for jekyll after 1 seconds
1 gem installed
Running 'gem install --force --version 2.1.0 jekyll-asciidoc'
Successfully installed jekyll-asciidoc-2.1.0
Parsing documentation for jekyll-asciidoc-2.1.0
Done installing documentation for jekyll-asciidoc after 0 seconds
1 gem installed
Running 'gem install --force --version 1.1.2 pygments.rb'
Successfully installed pygments.rb-1.1.2
Parsing documentation for pygments.rb-1.1.2
Done installing documentation for pygments.rb after 0 seconds
1 gem installed
Running 'ant ivy-bootstrap'
Buildfile: 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master/build.xml

-ivy-bootstrap1:
 [echo] installing ivy 2.4.0 to /home/jenkins/.ant/lib
  [get] Getting: 
http://repo1.maven.org/maven2/org/apache/ivy/ivy/2.4.0/ivy-2.4.0.jar
  [get] To: /home/jenkins/.ant/lib/ivy-2.4.0.jar
  [get] Not modified - so not downloaded

-ivy-bootstrap2:

-ivy-checksum:

-ivy-remove-old-versions:

ivy-bootstrap:

BUILD SUCCESSFUL
Total time: 0 seconds
+ ant clean build-site build-pdf
Buildfile: 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master/solr/solr-ref-guide/build.xml

clean:

build-init:
[mkdir] Created dir: 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master/solr/build/solr-ref-guide/content
 [echo] Copying all non template files from src ...
 [copy] Copying 420 files to 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master/solr/build/solr-ref-guide/content
 [echo] Copy (w/prop replacement) any template files from src...
 [copy] Copying 1 file to 

[JENKINS] Lucene-Solr-BadApples-NightlyTests-7.x - Build # 9 - Failure

2018-05-09 Thread Apache Jenkins Server
Build: https://builds.apache.org/job/Lucene-Solr-BadApples-NightlyTests-7.x/9/

20 tests failed.
FAILED:  
org.apache.lucene.codecs.simpletext.TestSimpleTextLiveDocsFormat.testOverflow

Error Message:
Java heap space

Stack Trace:
java.lang.OutOfMemoryError: Java heap space
at 
__randomizedtesting.SeedInfo.seed([84B2D01F5935B264:BF1AF8F05A043352]:0)
at org.apache.lucene.store.RAMFile.newBuffer(RAMFile.java:78)
at org.apache.lucene.store.RAMFile.addBuffer(RAMFile.java:51)
at 
org.apache.lucene.store.RAMOutputStream.switchCurrentBuffer(RAMOutputStream.java:164)
at 
org.apache.lucene.store.RAMOutputStream.writeBytes(RAMOutputStream.java:150)
at 
org.apache.lucene.store.MockIndexOutputWrapper.writeBytes(MockIndexOutputWrapper.java:141)
at 
org.apache.lucene.store.MockIndexOutputWrapper.writeByte(MockIndexOutputWrapper.java:126)
at 
org.apache.lucene.codecs.simpletext.SimpleTextUtil.write(SimpleTextUtil.java:48)
at 
org.apache.lucene.codecs.simpletext.SimpleTextLiveDocsFormat.writeLiveDocs(SimpleTextLiveDocsFormat.java:113)
at 
org.apache.lucene.index.BaseLiveDocsFormatTestCase.testSerialization(BaseLiveDocsFormatTestCase.java:129)
at 
org.apache.lucene.index.BaseLiveDocsFormatTestCase.testOverflow(BaseLiveDocsFormatTestCase.java:78)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)


FAILED:  
org.apache.lucene.codecs.lucene50.TestLucene50LiveDocsFormat.testOverflow

Error Message:
Java heap space

Stack Trace:
java.lang.OutOfMemoryError: Java heap space
at 
__randomizedtesting.SeedInfo.seed([ECD9E68EE67C6B0B:D771CE61E54DEA3D]:0)
at org.apache.lucene.store.RAMFile.newBuffer(RAMFile.java:78)
at org.apache.lucene.store.RAMFile.addBuffer(RAMFile.java:51)
at 
org.apache.lucene.store.RAMOutputStream.switchCurrentBuffer(RAMOutputStream.java:164)
at 
org.apache.lucene.store.RAMOutputStream.writeBytes(RAMOutputStream.java:150)
at 
org.apache.lucene.store.MockIndexOutputWrapper.writeBytes(MockIndexOutputWrapper.java:141)
at 
org.apache.lucene.store.MockIndexOutputWrapper.writeByte(MockIndexOutputWrapper.java:126)
at org.apache.lucene.store.DataOutput.writeInt(DataOutput.java:71)
at org.apache.lucene.store.DataOutput.writeLong(DataOutput.java:213)
at 
org.apache.lucene.codecs.lucene50.Lucene50LiveDocsFormat.writeLiveDocs(Lucene50LiveDocsFormat.java:110)
at 
org.apache.lucene.index.BaseLiveDocsFormatTestCase.testSerialization(BaseLiveDocsFormatTestCase.java:129)
at 
org.apache.lucene.index.BaseLiveDocsFormatTestCase.testOverflow(BaseLiveDocsFormatTestCase.java:78)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  

[JENKINS] Solr-reference-guide-master - Build # 7371 - Still Failing

2018-05-09 Thread Apache Jenkins Server
Build: https://builds.apache.org/job/Solr-reference-guide-master/7371/

Log: 
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on websites1 (git-websites svn-websites) in workspace 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master
 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url git://git.apache.org/lucene-solr.git # 
 > timeout=10
Cleaning workspace
 > git rev-parse --verify HEAD # timeout=10
Resetting working tree
 > git reset --hard # timeout=10
 > git clean -fdx # timeout=10
Fetching upstream changes from git://git.apache.org/lucene-solr.git
 > git --version # timeout=10
 > git fetch --tags --progress git://git.apache.org/lucene-solr.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
Checking out Revision c2819930d7a1ef675e1721242ac03ccc5d43b0b3 
(refs/remotes/origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f c2819930d7a1ef675e1721242ac03ccc5d43b0b3
Commit message: "SOLR-12280: Add dsp to math-expression children"
 > git rev-list --no-walk c2819930d7a1ef675e1721242ac03ccc5d43b0b3 # timeout=10
No emails were triggered.
[Solr-reference-guide-master] $ /usr/bin/env bash 
/tmp/jenkins8138578794843693364.sh
+ set -e
+ RVM_PATH=/home/jenkins/.rvm
+ RUBY_VERSION=ruby-2.3.3
+ GEMSET=solr-refguide-gemset
+ curl -sSL https://get.rvm.io
+ bash -s -- --ignore-dotfiles stable
Turning on ignore dotfiles mode.
Downloading https://github.com/rvm/rvm/archive/1.29.3.tar.gz
Downloading 
https://github.com/rvm/rvm/releases/download/1.29.3/1.29.3.tar.gz.asc
gpg: Signature made Sun 10 Sep 2017 08:59:21 PM UTC using RSA key ID BF04FF17
gpg: Good signature from "Michal Papis (RVM signing) "
gpg: aka "Michal Papis "
gpg: aka "[jpeg image of size 5015]"
gpg: WARNING: This key is not certified with a trusted signature!
gpg:  There is no indication that the signature belongs to the owner.
Primary key fingerprint: 409B 6B17 96C2 7546 2A17  0311 3804 BB82 D39D C0E3
 Subkey fingerprint: 62C9 E5F4 DA30 0D94 AC36  166B E206 C29F BF04 FF17
GPG verified '/home/jenkins/.rvm/archives/rvm-1.29.3.tgz'

Upgrading the RVM installation in /home/jenkins/.rvm/
Upgrade of RVM in /home/jenkins/.rvm/ is complete.

Upgrade Notes:

  * No new notes to display.

+ set +x
Running 'source /home/jenkins/.rvm/scripts/rvm'
Running 'rvm autolibs disable'
Running 'rvm install ruby-2.3.3'
Already installed ruby-2.3.3.
To reinstall use:

rvm reinstall ruby-2.3.3

Running 'rvm gemset create solr-refguide-gemset'
ruby-2.3.3 - #gemset created 
/home/jenkins/.rvm/gems/ruby-2.3.3@solr-refguide-gemset
ruby-2.3.3 - #generating solr-refguide-gemset 
wrappers|/-\|/-\|.-\|/-\|/-.|/-\|/-\|.-\|/-\|/-.|/-\|/-\|.-\|/-\|/-.|/-\|/-\|.-\|/-.
Running 'rvm ruby-2.3.3@solr-refguide-gemset'
Using /home/jenkins/.rvm/gems/ruby-2.3.3 with gemset solr-refguide-gemset
Running 'gem install --force --version 3.5.0 jekyll'
Successfully installed jekyll-3.5.0
Parsing documentation for jekyll-3.5.0
Done installing documentation for jekyll after 1 seconds
1 gem installed
Running 'gem install --force --version 2.1.0 jekyll-asciidoc'
Successfully installed jekyll-asciidoc-2.1.0
Parsing documentation for jekyll-asciidoc-2.1.0
Done installing documentation for jekyll-asciidoc after 0 seconds
1 gem installed
Running 'gem install --force --version 1.1.2 pygments.rb'
Successfully installed pygments.rb-1.1.2
Parsing documentation for pygments.rb-1.1.2
Done installing documentation for pygments.rb after 0 seconds
1 gem installed
Running 'ant ivy-bootstrap'
Buildfile: 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master/build.xml

-ivy-bootstrap1:
 [echo] installing ivy 2.4.0 to /home/jenkins/.ant/lib
  [get] Getting: 
http://repo1.maven.org/maven2/org/apache/ivy/ivy/2.4.0/ivy-2.4.0.jar
  [get] To: /home/jenkins/.ant/lib/ivy-2.4.0.jar
  [get] Not modified - so not downloaded

-ivy-bootstrap2:

-ivy-checksum:

-ivy-remove-old-versions:

ivy-bootstrap:

BUILD SUCCESSFUL
Total time: 0 seconds
+ ant clean build-site build-pdf
Buildfile: 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master/solr/solr-ref-guide/build.xml

clean:

build-init:
[mkdir] Created dir: 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master/solr/build/solr-ref-guide/content
 [echo] Copying all non template files from src ...
 [copy] Copying 420 files to 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master/solr/build/solr-ref-guide/content
 [echo] Copy (w/prop replacement) any template files from src...
 [copy] Copying 1 file to 

[jira] [Updated] (SOLR-12338) Replay buffering tlog in parallel

2018-05-09 Thread Cao Manh Dat (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-12338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Cao Manh Dat updated SOLR-12338:

Attachment: SOLR-12338.patch

> Replay buffering tlog in parallel
> -
>
> Key: SOLR-12338
> URL: https://issues.apache.org/jira/browse/SOLR-12338
> Project: Solr
>  Issue Type: Improvement
>  Security Level: Public(Default Security Level. Issues are Public) 
>Reporter: Cao Manh Dat
>Assignee: Cao Manh Dat
>Priority: Major
> Attachments: SOLR-12338.patch
>
>
> Since updates with different id are independent, therefore it is safe to 
> replay them in parallel. This will significantly reduce recovering time of 
> replicas in high load indexing environment. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-8264) Allow an option to rewrite all segments

2018-05-09 Thread Erick Erickson (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-8264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469894#comment-16469894
 ] 

Erick Erickson commented on LUCENE-8264:


See comment 9-May.

> Allow an option to rewrite all segments
> ---
>
> Key: LUCENE-8264
> URL: https://issues.apache.org/jira/browse/LUCENE-8264
> Project: Lucene - Core
>  Issue Type: Improvement
>Reporter: Erick Erickson
>Assignee: Erick Erickson
>Priority: Major
>
> For the background, see SOLR-12259.
> There are several use-cases that would be much easier, especially during 
> upgrades, if we could specify that all segments get rewritten. 
> One example: Upgrading 5x->6x->7x. When segments are merged, they're 
> rewritten into the current format. However, there's no guarantee that a 
> particular segment _ever_ gets merged so the 6x-7x upgrade won't necessarily 
> be successful.
> How many merge policies support this is an open question. I propose to start 
> with TMP and raise other JIRAs as necessary for other merge policies.
> So far the usual response has been "re-index from scratch", but that's 
> increasingly difficult as systems get larger.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[JENKINS] Solr-reference-guide-master - Build # 7376 - Still Failing

2018-05-09 Thread Apache Jenkins Server
Build: https://builds.apache.org/job/Solr-reference-guide-master/7376/

Log: 
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on websites1 (git-websites svn-websites) in workspace 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master
 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url git://git.apache.org/lucene-solr.git # 
 > timeout=10
Cleaning workspace
 > git rev-parse --verify HEAD # timeout=10
Resetting working tree
 > git reset --hard # timeout=10
 > git clean -fdx # timeout=10
Fetching upstream changes from git://git.apache.org/lucene-solr.git
 > git --version # timeout=10
 > git fetch --tags --progress git://git.apache.org/lucene-solr.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
Checking out Revision e91d120999d0e92523aed5b1ced1513538c3c05e 
(refs/remotes/origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f e91d120999d0e92523aed5b1ced1513538c3c05e
Commit message: "LUCENE-8305: ComplexPhraseQuery.rewrite now handles an 
embedded MultiTermQuery that rewrites to a MatchNoDocsQuery instead of throwing 
an exception. Fixes #258 Fixes #327"
 > git rev-list --no-walk e91d120999d0e92523aed5b1ced1513538c3c05e # timeout=10
No emails were triggered.
[Solr-reference-guide-master] $ /usr/bin/env bash 
/tmp/jenkins7271050560491739976.sh
+ set -e
+ RVM_PATH=/home/jenkins/.rvm
+ RUBY_VERSION=ruby-2.3.3
+ GEMSET=solr-refguide-gemset
+ curl -sSL https://get.rvm.io
+ bash -s -- --ignore-dotfiles stable
Turning on ignore dotfiles mode.
Downloading https://github.com/rvm/rvm/archive/1.29.3.tar.gz
Downloading 
https://github.com/rvm/rvm/releases/download/1.29.3/1.29.3.tar.gz.asc
gpg: Signature made Sun 10 Sep 2017 08:59:21 PM UTC using RSA key ID BF04FF17
gpg: Good signature from "Michal Papis (RVM signing) "
gpg: aka "Michal Papis "
gpg: aka "[jpeg image of size 5015]"
gpg: WARNING: This key is not certified with a trusted signature!
gpg:  There is no indication that the signature belongs to the owner.
Primary key fingerprint: 409B 6B17 96C2 7546 2A17  0311 3804 BB82 D39D C0E3
 Subkey fingerprint: 62C9 E5F4 DA30 0D94 AC36  166B E206 C29F BF04 FF17
GPG verified '/home/jenkins/.rvm/archives/rvm-1.29.3.tgz'

Upgrading the RVM installation in /home/jenkins/.rvm/
Upgrade of RVM in /home/jenkins/.rvm/ is complete.

Upgrade Notes:

  * No new notes to display.

+ set +x
Running 'source /home/jenkins/.rvm/scripts/rvm'
Running 'rvm autolibs disable'
Running 'rvm install ruby-2.3.3'
Already installed ruby-2.3.3.
To reinstall use:

rvm reinstall ruby-2.3.3

Running 'rvm gemset create solr-refguide-gemset'
ruby-2.3.3 - #gemset created 
/home/jenkins/.rvm/gems/ruby-2.3.3@solr-refguide-gemset
ruby-2.3.3 - #generating solr-refguide-gemset 
wrappers|/-\|/-\|.-\|/-\|/-.|/-\|/-\|.-\|/-\|/-.|/-\|/-\|.-\|/-\|/-.|/-\|/-\|.-\|/-.
Running 'rvm ruby-2.3.3@solr-refguide-gemset'
Using /home/jenkins/.rvm/gems/ruby-2.3.3 with gemset solr-refguide-gemset
Running 'gem install --force --version 3.5.0 jekyll'
Successfully installed jekyll-3.5.0
Parsing documentation for jekyll-3.5.0
Done installing documentation for jekyll after 1 seconds
1 gem installed
Running 'gem install --force --version 2.1.0 jekyll-asciidoc'
Successfully installed jekyll-asciidoc-2.1.0
Parsing documentation for jekyll-asciidoc-2.1.0
Done installing documentation for jekyll-asciidoc after 0 seconds
1 gem installed
Running 'gem install --force --version 1.1.2 pygments.rb'
Successfully installed pygments.rb-1.1.2
Parsing documentation for pygments.rb-1.1.2
Done installing documentation for pygments.rb after 0 seconds
1 gem installed
Running 'ant ivy-bootstrap'
Buildfile: 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master/build.xml

-ivy-bootstrap1:
 [echo] installing ivy 2.4.0 to /home/jenkins/.ant/lib
  [get] Getting: 
http://repo1.maven.org/maven2/org/apache/ivy/ivy/2.4.0/ivy-2.4.0.jar
  [get] To: /home/jenkins/.ant/lib/ivy-2.4.0.jar
  [get] Not modified - so not downloaded

-ivy-bootstrap2:

-ivy-checksum:

-ivy-remove-old-versions:

ivy-bootstrap:

BUILD SUCCESSFUL
Total time: 0 seconds
+ ant clean build-site build-pdf
Buildfile: 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master/solr/solr-ref-guide/build.xml

clean:

build-init:
[mkdir] Created dir: 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master/solr/build/solr-ref-guide/content
 [echo] Copying all non template files from src ...
 [copy] Copying 420 files to 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master/solr/build/solr-ref-guide/content
 [echo] Copy (w/prop 

[JENKINS] Lucene-Solr-7.3-Linux (64bit/jdk-9.0.4) - Build # 201 - Unstable!

2018-05-09 Thread Policeman Jenkins Server
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.3-Linux/201/
Java: 64bit/jdk-9.0.4 -XX:+UseCompressedOops -XX:+UseParallelGC

4 tests failed.
FAILED:  
junit.framework.TestSuite.org.apache.solr.analytics.legacy.facet.LegacyQueryFacetCloudTest

Error Message:
Could not find collection:collection1

Stack Trace:
java.lang.AssertionError: Could not find collection:collection1
at __randomizedtesting.SeedInfo.seed([347EF7E43E3B83A3]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNotNull(Assert.java:526)
at 
org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:155)
at 
org.apache.solr.analytics.legacy.LegacyAbstractAnalyticsCloudTest.setupCollection(LegacyAbstractAnalyticsCloudTest.java:51)
at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:874)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  
org.apache.solr.analytics.legacy.facet.LegacyQueryFacetCloudTest.queryTest

Error Message:
{responseHeader={zkConnected=true,status=0,QTime=92,params={o.fr.s.sum=sum(float_fd),indent=true,o.ir.s.sum=sum(int_id),o.lr.qf.string.q=[string_sd:abc1,
 string_sd:abc2],o.fr.qf.lad.q=[long_ld:[20 TO *], long_ld:[30 TO *], 
double_dd:[* TO 
50]],o.ir.s.median=median(int_id),o.lr.qf=string,o.ir.s.mean=mean(int_id),o.ir.qf.float1.q=float_fd:[*
 TO 50],o.lr.s.sum=sum(long_ld),o.ir.qf.float2.q=float_fd:[* TO 
30],o.fr.s.percentile_8=percentile(8,float_fd),o.ir.s.percentile_8=percentile(8,int_id),o.fr.s.median=median(float_fd),o.fr.qf=lad,wt=javabin,o.lr.s.mean=mean(long_ld),_stateVer_=collection1:4,o.lr.s.percentile_8=percentile(8,long_ld),rows=0,version=2,q=*:*,o.ir.qf=[float1,
 
float2],o.lr.s.median=median(long_ld),olap=true,o.fr.s.mean=mean(float_fd)}},response={numFound=100,start=0,maxScore=1.0,docs=[]},stats={lr={median=16.0,mean=16.38,percentile_8=2,sum=1638.0,queryFacets={string={string_sd:abc1={median=15.0,mean=16.4,percentile_8=1,sum=246.0},string_sd:abc2={median=14.5,mean=14.071428571428571,percentile_8=1,sum=197.0,ir={median=24.5,mean=28.91,percentile_8=4,sum=2891.0,queryFacets={float1={float_fd:[*
 TO 50]={median=25.0,mean=25.0,percentile_8=4,sum=1450.0}},float2={float_fd:[* 
TO 
30]={median=18.5,mean=16.842105263157894,percentile_8=3,sum=640.0,fr={median=42.5,mean=42.99,percentile_8=4.0,sum=4299.0,queryFacets={lad={long_ld:[30
 TO *]={median=50.5,mean=50.5,percentile_8=30.0,sum=606.0},double_dd:[* TO 
50]={median=42.5,mean=42.99,percentile_8=4.0,sum=4299.0},long_ld:[20 TO 
*]={median=32.5,mean=39.225,percentile_8=3.0,sum=1569.0}} 

[JENKINS] Lucene-Solr-master-Solaris (64bit/jdk1.8.0) - Build # 1853 - Still Failing!

2018-05-09 Thread Policeman Jenkins Server
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Solaris/1853/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseParallelGC

2 tests failed.
FAILED:  
org.apache.solr.cloud.api.collections.ShardSplitTest.testSplitStaticIndexReplication

Error Message:
Shard shard1_0 replicas do not have same number of documents expected:<26> but 
was:<0>

Stack Trace:
java.lang.AssertionError: Shard shard1_0 replicas do not have same number of 
documents expected:<26> but was:<0>
at 
__randomizedtesting.SeedInfo.seed([17753F74FC7B7E05:5D3FAB746DD35100]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at 
org.apache.solr.cloud.api.collections.ShardSplitTest.assertConsistentReplicas(ShardSplitTest.java:247)
at 
org.apache.solr.cloud.api.collections.ShardSplitTest.testSplitStaticIndexReplication(ShardSplitTest.java:221)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at 

[JENKINS] Lucene-Solr-Tests-7.3 - Build # 66 - Still Unstable

2018-05-09 Thread Apache Jenkins Server
Build: https://builds.apache.org/job/Lucene-Solr-Tests-7.3/66/

2 tests failed.
FAILED:  org.apache.solr.cloud.AddReplicaTest.test

Error Message:
core_node6:{"core":"addreplicatest_coll_shard1_replica_n5","base_url":"https://127.0.0.1:44520/solr","node_name":"127.0.0.1:44520_solr","state":"active","type":"NRT"}

Stack Trace:
java.lang.AssertionError: 
core_node6:{"core":"addreplicatest_coll_shard1_replica_n5","base_url":"https://127.0.0.1:44520/solr","node_name":"127.0.0.1:44520_solr","state":"active","type":"NRT"}
at 
__randomizedtesting.SeedInfo.seed([89D0A0941F0A2663:1849F4EB1F64B9B]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.AddReplicaTest.test(AddReplicaTest.java:84)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.OverseerRolesTest.testOverseerRole

Error Message:
Timed out waiting for overseer state change

Stack 

[JENKINS] Lucene-Solr-repro - Build # 599 - Still Unstable

2018-05-09 Thread Apache Jenkins Server
Build: https://builds.apache.org/job/Lucene-Solr-repro/599/

[...truncated 28 lines...]
[repro] Jenkins log URL: 
https://builds.apache.org/job/Lucene-Solr-SmokeRelease-master/1020/consoleText

[repro] Revision: 85c00e77efdf53f30da6eaffd38c2b016a7805bc

[repro] Ant options: -DsmokeTestRelease.java9=/home/jenkins/tools/java/latest1.9
[repro] Repro line:  ant test  -Dtestcase=IndexSizeTriggerTest 
-Dtests.method=testTrigger -Dtests.seed=879781B722955F82 -Dtests.multiplier=2 
-Dtests.locale=zh -Dtests.timezone=Pacific/Efate -Dtests.asserts=true 
-Dtests.file.encoding=ISO-8859-1

[repro] git rev-parse --abbrev-ref HEAD
[repro] git rev-parse HEAD
[repro] Initial local git branch/revision: 
e91d120999d0e92523aed5b1ced1513538c3c05e
[repro] git fetch

[...truncated 2 lines...]
[repro] git checkout 85c00e77efdf53f30da6eaffd38c2b016a7805bc

[...truncated 2 lines...]
[repro] git merge --ff-only

[...truncated 1 lines...]
[repro] ant clean

[...truncated 6 lines...]
[repro] Test suites by module:
[repro]solr/core
[repro]   IndexSizeTriggerTest
[repro] ant compile-test

[...truncated 3298 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 
-Dtests.class="*.IndexSizeTriggerTest" -Dtests.showOutput=onerror 
-DsmokeTestRelease.java9=/home/jenkins/tools/java/latest1.9 
-Dtests.seed=879781B722955F82 -Dtests.multiplier=2 -Dtests.locale=zh 
-Dtests.timezone=Pacific/Efate -Dtests.asserts=true 
-Dtests.file.encoding=ISO-8859-1

[...truncated 7491 lines...]
[repro] Setting last failure code to 256

[repro] Failures:
[repro]   5/5 failed: org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest

[repro] Re-testing 100% failures at the tip of master
[repro] ant clean

[...truncated 8 lines...]
[repro] Test suites by module:
[repro]solr/core
[repro]   IndexSizeTriggerTest
[repro] ant compile-test

[...truncated 3298 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 
-Dtests.class="*.IndexSizeTriggerTest" -Dtests.showOutput=onerror 
-DsmokeTestRelease.java9=/home/jenkins/tools/java/latest1.9 
-Dtests.seed=879781B722955F82 -Dtests.multiplier=2 -Dtests.locale=zh 
-Dtests.timezone=Pacific/Efate -Dtests.asserts=true 
-Dtests.file.encoding=ISO-8859-1

[...truncated 7414 lines...]
[repro] Setting last failure code to 256

[repro] Failures at the tip of master:
[repro]   5/5 failed: org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest

[repro] Re-testing 100% failures at the tip of master without a seed
[repro] ant clean

[...truncated 8 lines...]
[repro] Test suites by module:
[repro]solr/core
[repro]   IndexSizeTriggerTest
[repro] ant compile-test

[...truncated 3298 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 
-Dtests.class="*.IndexSizeTriggerTest" -Dtests.showOutput=onerror 
-DsmokeTestRelease.java9=/home/jenkins/tools/java/latest1.9 
-Dtests.multiplier=2 -Dtests.locale=zh -Dtests.timezone=Pacific/Efate 
-Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1

[...truncated 6979 lines...]
[repro] Setting last failure code to 256

[repro] Failures at the tip of master without a seed:
[repro]   5/5 failed: org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest
[repro] git checkout e91d120999d0e92523aed5b1ced1513538c3c05e

[...truncated 2 lines...]
[repro] Exiting with code 256

[...truncated 5 lines...]

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

[jira] [Moved] (LUCENE-8305) Highlighter error: Unknown query type:org.apache.lucene.search.MatchNoDocsQuery

2018-05-09 Thread David Smiley (JIRA)

 [ 
https://issues.apache.org/jira/browse/LUCENE-8305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

David Smiley moved SOLR-10078 to LUCENE-8305:
-

Affects Version/s: (was: 6.3)
   6.3
 Security: (was: Public)
  Component/s: (was: highlighter)
   modules/queryparser
Lucene Fields: New
  Key: LUCENE-8305  (was: SOLR-10078)
  Project: Lucene - Core  (was: Solr)

> Highlighter error: Unknown query 
> type:org.apache.lucene.search.MatchNoDocsQuery
> ---
>
> Key: LUCENE-8305
> URL: https://issues.apache.org/jira/browse/LUCENE-8305
> Project: Lucene - Core
>  Issue Type: Bug
>  Components: modules/queryparser
>Affects Versions: 6.3
>Reporter: Andy Tran
>Assignee: David Smiley
>Priority: Minor
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> With Solr v6.3, when I issue this query:
> http://localhost:8983/solr/BestBuy/select?wt=json=10={!complexphrase%20inOrder=false}_text_:%22maytag~%20(refri~%20OR%20refri*)%20%22=id=true=false=60=nameX,shortDescription,longDescription,artistName,type,manufacturer,department
> I get this error in the JSON response:
> *
> {
>   "responseHeader": {
> "zkConnected": true,
> "status": 500,
> "QTime": 8,
> "params": {
>   "q": "{!complexphrase inOrder=false}_text_:\"maytag~ (refri~ OR refri*) 
> \"",
>   "hl": "true",
>   "hl.preserveMulti": "false",
>   "fl": "id",
>   "hl.fragsize": "60",
>   "hl.fl": 
> "nameX,shortDescription,longDescription,artistName,type,manufacturer,department",
>   "rows": "10",
>   "wt": "json"
> }
>   },
>   "response": {
> "numFound": 2,
> "start": 0,
> "docs": [
>   {
> "id": "5411379"
>   },
>   {
> "id": "5411404"
>   }
> ]
>   },
>   "error": {
> "msg": "Unknown query type:org.apache.lucene.search.MatchNoDocsQuery",
> "trace": "java.lang.IllegalArgumentException: Unknown query 
> type:org.apache.lucene.search.MatchNoDocsQuery\n\tat 
> org.apache.lucene.queryparser.complexPhrase.ComplexPhraseQueryParser$ComplexPhraseQuery.addComplexPhraseClause(ComplexPhraseQueryParser.java:388)\n\tat
>  
> org.apache.lucene.queryparser.complexPhrase.ComplexPhraseQueryParser$ComplexPhraseQuery.rewrite(ComplexPhraseQueryParser.java:289)\n\tat
>  
> org.apache.lucene.search.highlight.WeightedSpanTermExtractor.extract(WeightedSpanTermExtractor.java:230)\n\tat
>  
> org.apache.lucene.search.highlight.WeightedSpanTermExtractor.getWeightedSpanTerms(WeightedSpanTermExtractor.java:522)\n\tat
>  
> org.apache.lucene.search.highlight.QueryScorer.initExtractor(QueryScorer.java:218)\n\tat
>  
> org.apache.lucene.search.highlight.QueryScorer.init(QueryScorer.java:186)\n\tat
>  
> org.apache.lucene.search.highlight.Highlighter.getBestTextFragments(Highlighter.java:195)\n\tat
>  
> org.apache.solr.highlight.DefaultSolrHighlighter.doHighlightingByHighlighter(DefaultSolrHighlighter.java:602)\n\tat
>  
> org.apache.solr.highlight.DefaultSolrHighlighter.doHighlightingOfField(DefaultSolrHighlighter.java:448)\n\tat
>  
> org.apache.solr.highlight.DefaultSolrHighlighter.doHighlighting(DefaultSolrHighlighter.java:410)\n\tat
>  
> org.apache.solr.handler.component.HighlightComponent.process(HighlightComponent.java:141)\n\tat
>  
> org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:295)\n\tat
>  
> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:153)\n\tat
>  org.apache.solr.core.SolrCore.execute(SolrCore.java:2213)\n\tat 
> org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:654)\n\tat 
> org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:460)\n\tat 
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:303)\n\tat
>  
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:254)\n\tat
>  
> org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1668)\n\tat
>  
> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:581)\n\tat
>  
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)\n\tat
>  
> org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548)\n\tat
>  
> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:226)\n\tat
>  
> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1160)\n\tat
>  
> org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:511)\n\tat
>  
> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)\n\tat
>  
> 

[jira] [Commented] (SOLR-12338) Replay buffering tlog in parallel

2018-05-09 Thread Ishan Chattopadhyaya (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-12338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469869#comment-16469869
 ] 

Ishan Chattopadhyaya commented on SOLR-12338:
-

There are some situations where if in-place updates and DBQs are re-ordered, 
then the entire document needs to be fetched from the leader. This is fine when 
we have an active leader, but in case of tlog replay, we would need to apply 
those updates in the same order.

I think if DBQs are executed in the right order (i.e. all updates before a DBQ 
was updated before the DBQ, and all updates after the DBQ are executed after 
the DBQ), then we can run the other updates in parallel.

Example:
{code:java}
add1
add2
add3
dbq1
add4
add5
add6
..
add20
dbq2
{code}
Here, add# are either full document updates or in-place updates. I suggest: we 
run updates add1-add3 in parallel, and then wait till they are done before 
executing db1, and then add4-add20 parallely and then wait and execute dbq2. 
This should be fine, I think. (CC [~hossman], wdyt?)

> Replay buffering tlog in parallel
> -
>
> Key: SOLR-12338
> URL: https://issues.apache.org/jira/browse/SOLR-12338
> Project: Solr
>  Issue Type: Improvement
>  Security Level: Public(Default Security Level. Issues are Public) 
>Reporter: Cao Manh Dat
>Assignee: Cao Manh Dat
>Priority: Major
> Attachments: SOLR-12338.patch
>
>
> Since updates with different id are independent, therefore it is safe to 
> replay them in parallel. This will significantly reduce recovering time of 
> replicas in high load indexing environment. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Created] (SOLR-12339) java.lang.OutOfMemoryError: Java heap space

2018-05-09 Thread JiafengLi (JIRA)
JiafengLi created SOLR-12339:


 Summary: java.lang.OutOfMemoryError: Java heap space
 Key: SOLR-12339
 URL: https://issues.apache.org/jira/browse/SOLR-12339
 Project: Solr
  Issue Type: Bug
  Security Level: Public (Default Security Level. Issues are Public)
  Components: clients - java
Affects Versions: 5.5.3
 Environment: query :

start=0=10=453c5a15e01fc6d17b76c45313e208df+desc=solrtableid:"825a64a07ace4843825506bcff605fc6"AND(453c5a15e01fc6d17b76c45313e208df:[*
 TO *])

 

 




Reporter: JiafengLi


2018-05-09 10:54:22.968 ERROR (qtp429313384-240) [ x:dmsystem] 
o.a.s.s.HttpSolrCall null:java.lang.RuntimeException: 
java.lang.OutOfMemoryError: Java heap space
 at org.apache.solr.servlet.HttpSolrCall.sendError(HttpSolrCall.java:607)
 at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:475)
 at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:257)
 at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:208)
 at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
 at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585)
 at 
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
 at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:553)
 at 
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:223)
 at 
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127)
 at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515)
 at 
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
 at 
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061)
 at 
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
 at 
org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:215)
 at 
org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:110)
 at 
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
 at org.eclipse.jetty.server.Server.handle(Server.java:499)
 at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:310)
 at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257)
 at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540)
 at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
 at 
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
 at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.OutOfMemoryError: Java heap space

2018-05-09 10:54:22.969 WARN (qtp429313384-240) [ x:dmsystem] 
o.e.j.s.ServletHandler Error for /solr/dmsystem/select
java.lang.OutOfMemoryError: Java heap space



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (SOLR-12339) java.lang.OutOfMemoryError: Java heap space

2018-05-09 Thread JiafengLi (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-12339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

JiafengLi updated SOLR-12339:
-
Environment: (was: query :

start=0=10=453c5a15e01fc6d17b76c45313e208df+desc=solrtableid:"825a64a07ace4843825506bcff605fc6"AND(453c5a15e01fc6d17b76c45313e208df:[*
 TO *])

 

 



)
Description: 
When I query the data, the following error is reported. The query parameters 
are used as follows. Note that I do not have this problem when I do not have a 
sort field, and once I add a sort, I will report a memory overflow error.

QUERY Parameters:

start=0=10=453c5a15e01fc6d17b76c45313e208df+desc=solrtableid:"825a64a07ace4843825506bcff605fc6"AND(453c5a15e01fc6d17b76c45313e208df:[*
 TO *])

 

CONFIG INFO:





 

 

ERROR:

2018-05-09 10:54:22.968 ERROR (qtp429313384-240) [ x:dmsystem] 
o.a.s.s.HttpSolrCall null:java.lang.RuntimeException: 
java.lang.OutOfMemoryError: Java heap space
 at org.apache.solr.servlet.HttpSolrCall.sendError(HttpSolrCall.java:607)
 at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:475)
 at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:257)
 at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:208)
 at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
 at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585)
 at 
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
 at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:553)
 at 
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:223)
 at 
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127)
 at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515)
 at 
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
 at 
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061)
 at 
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
 at 
org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:215)
 at 
org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:110)
 at 
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
 at org.eclipse.jetty.server.Server.handle(Server.java:499)
 at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:310)
 at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257)
 at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540)
 at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
 at 
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
 at java.lang.Thread.run(Thread.java:745)
 Caused by: java.lang.OutOfMemoryError: Java heap space

2018-05-09 10:54:22.969 WARN (qtp429313384-240) [ x:dmsystem] 
o.e.j.s.ServletHandler Error for /solr/dmsystem/select
 java.lang.OutOfMemoryError: Java heap space

  was:
2018-05-09 10:54:22.968 ERROR (qtp429313384-240) [ x:dmsystem] 
o.a.s.s.HttpSolrCall null:java.lang.RuntimeException: 
java.lang.OutOfMemoryError: Java heap space
 at org.apache.solr.servlet.HttpSolrCall.sendError(HttpSolrCall.java:607)
 at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:475)
 at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:257)
 at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:208)
 at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
 at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585)
 at 
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
 at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:553)
 at 
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:223)
 at 
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127)
 at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515)
 at 
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
 at 
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061)
 at 
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
 at 
org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:215)
 at 
org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:110)
 at 
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
 at org.eclipse.jetty.server.Server.handle(Server.java:499)
 at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:310)
 at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257)
 at 

[jira] [Commented] (LUCENE-8305) ComplexPhraseQuery.rewrite can throw exception RE MatchNoDocsQuery if MTQ sub-clause matches no terms

2018-05-09 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-8305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469862#comment-16469862
 ] 

ASF subversion and git services commented on LUCENE-8305:
-

Commit 9eea96ac053cd115da6373ba9d2ec0a1d2319781 in lucene-solr's branch 
refs/heads/branch_7x from [~dsmiley]
[ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=9eea96a ]

LUCENE-8305: ComplexPhraseQuery.rewrite now handles an embedded MultiTermQuery
that rewrites to a MatchNoDocsQuery instead of throwing an exception.
Fixes #258
Fixes #327

(cherry picked from commit e91d120)


> ComplexPhraseQuery.rewrite can throw exception RE MatchNoDocsQuery if MTQ 
> sub-clause matches no terms
> -
>
> Key: LUCENE-8305
> URL: https://issues.apache.org/jira/browse/LUCENE-8305
> Project: Lucene - Core
>  Issue Type: Bug
>  Components: modules/queryparser
>Affects Versions: 6.3
>Reporter: Andy Tran
>Assignee: David Smiley
>Priority: Major
> Fix For: 7.4
>
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> With Solr v6.3, when I issue this query:
> http://localhost:8983/solr/BestBuy/select?wt=json=10={!complexphrase%20inOrder=false}_text_:%22maytag~%20(refri~%20OR%20refri*)%20%22=id=true=false=60=nameX,shortDescription,longDescription,artistName,type,manufacturer,department
> I get this error in the JSON response:
> *
> {
>   "responseHeader": {
> "zkConnected": true,
> "status": 500,
> "QTime": 8,
> "params": {
>   "q": "{!complexphrase inOrder=false}_text_:\"maytag~ (refri~ OR refri*) 
> \"",
>   "hl": "true",
>   "hl.preserveMulti": "false",
>   "fl": "id",
>   "hl.fragsize": "60",
>   "hl.fl": 
> "nameX,shortDescription,longDescription,artistName,type,manufacturer,department",
>   "rows": "10",
>   "wt": "json"
> }
>   },
>   "response": {
> "numFound": 2,
> "start": 0,
> "docs": [
>   {
> "id": "5411379"
>   },
>   {
> "id": "5411404"
>   }
> ]
>   },
>   "error": {
> "msg": "Unknown query type:org.apache.lucene.search.MatchNoDocsQuery",
> "trace": "java.lang.IllegalArgumentException: Unknown query 
> type:org.apache.lucene.search.MatchNoDocsQuery\n\tat 
> org.apache.lucene.queryparser.complexPhrase.ComplexPhraseQueryParser$ComplexPhraseQuery.addComplexPhraseClause(ComplexPhraseQueryParser.java:388)\n\tat
>  
> org.apache.lucene.queryparser.complexPhrase.ComplexPhraseQueryParser$ComplexPhraseQuery.rewrite(ComplexPhraseQueryParser.java:289)\n\tat
>  
> org.apache.lucene.search.highlight.WeightedSpanTermExtractor.extract(WeightedSpanTermExtractor.java:230)\n\tat
>  
> org.apache.lucene.search.highlight.WeightedSpanTermExtractor.getWeightedSpanTerms(WeightedSpanTermExtractor.java:522)\n\tat
>  
> org.apache.lucene.search.highlight.QueryScorer.initExtractor(QueryScorer.java:218)\n\tat
>  
> org.apache.lucene.search.highlight.QueryScorer.init(QueryScorer.java:186)\n\tat
>  
> org.apache.lucene.search.highlight.Highlighter.getBestTextFragments(Highlighter.java:195)\n\tat
>  
> org.apache.solr.highlight.DefaultSolrHighlighter.doHighlightingByHighlighter(DefaultSolrHighlighter.java:602)\n\tat
>  
> org.apache.solr.highlight.DefaultSolrHighlighter.doHighlightingOfField(DefaultSolrHighlighter.java:448)\n\tat
>  
> org.apache.solr.highlight.DefaultSolrHighlighter.doHighlighting(DefaultSolrHighlighter.java:410)\n\tat
>  
> org.apache.solr.handler.component.HighlightComponent.process(HighlightComponent.java:141)\n\tat
>  
> org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:295)\n\tat
>  
> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:153)\n\tat
>  org.apache.solr.core.SolrCore.execute(SolrCore.java:2213)\n\tat 
> org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:654)\n\tat 
> org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:460)\n\tat 
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:303)\n\tat
>  
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:254)\n\tat
>  
> org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1668)\n\tat
>  
> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:581)\n\tat
>  
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)\n\tat
>  
> org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548)\n\tat
>  
> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:226)\n\tat
>  
> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1160)\n\tat
>  
> 

[JENKINS] Lucene-Solr-SmokeRelease-master - Build # 1021 - Still Failing

2018-05-09 Thread Apache Jenkins Server
Build: https://builds.apache.org/job/Lucene-Solr-SmokeRelease-master/1021/

No tests ran.

Build Log:
[...truncated 24177 lines...]
[asciidoctor:convert] asciidoctor: ERROR: about-this-guide.adoc: line 1: 
invalid part, must have at least one section (e.g., chapter, appendix, etc.)
[asciidoctor:convert] asciidoctor: ERROR: solr-glossary.adoc: line 1: invalid 
part, must have at least one section (e.g., chapter, appendix, etc.)
 [java] ID occurs multiple times: moving-average
 [java]  ... 
file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-SmokeRelease-master/solr/build/solr-ref-guide/bare-bones-html/time-series.html
 [java]  ... 
file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-SmokeRelease-master/solr/build/solr-ref-guide/bare-bones-html/dsp.html
 [java] Relative link points at id that doesn't exist in dest: 
dsp.html#digital-signal-processing
 [java]  ... source: 
file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-SmokeRelease-master/solr/build/solr-ref-guide/bare-bones-html/math-expressions.html
 [java] Processed 2207 links (1763 relative) to 3079 anchors in 245 files
 [java] Total of 2 problems found

BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-SmokeRelease-master/build.xml:446:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-SmokeRelease-master/solr/build.xml:192:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-SmokeRelease-master/solr/solr-ref-guide/build.xml:326:
 Java returned: 255

Total time: 14 minutes 36 seconds
Build step 'Invoke Ant' marked build as failure
Setting JDK_1_9_LATEST__HOME=/home/jenkins/tools/java/latest1.9
Setting JDK_1_9_LATEST__HOME=/home/jenkins/tools/java/latest1.9
Setting JDK_1_9_LATEST__HOME=/home/jenkins/tools/java/latest1.9
Setting JDK_1_9_LATEST__HOME=/home/jenkins/tools/java/latest1.9
Setting JDK_1_9_LATEST__HOME=/home/jenkins/tools/java/latest1.9
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Setting JDK_1_9_LATEST__HOME=/home/jenkins/tools/java/latest1.9
Setting JDK_1_9_LATEST__HOME=/home/jenkins/tools/java/latest1.9

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

[JENKINS] Solr-reference-guide-master - Build # 7375 - Still Failing

2018-05-09 Thread Apache Jenkins Server
Build: https://builds.apache.org/job/Solr-reference-guide-master/7375/

Log: 
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on websites1 (git-websites svn-websites) in workspace 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master
 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url git://git.apache.org/lucene-solr.git # 
 > timeout=10
Cleaning workspace
 > git rev-parse --verify HEAD # timeout=10
Resetting working tree
 > git reset --hard # timeout=10
 > git clean -fdx # timeout=10
Fetching upstream changes from git://git.apache.org/lucene-solr.git
 > git --version # timeout=10
 > git fetch --tags --progress git://git.apache.org/lucene-solr.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
Checking out Revision e91d120999d0e92523aed5b1ced1513538c3c05e 
(refs/remotes/origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f e91d120999d0e92523aed5b1ced1513538c3c05e
Commit message: "LUCENE-8305: ComplexPhraseQuery.rewrite now handles an 
embedded MultiTermQuery that rewrites to a MatchNoDocsQuery instead of throwing 
an exception. Fixes #258 Fixes #327"
 > git rev-list --no-walk c2819930d7a1ef675e1721242ac03ccc5d43b0b3 # timeout=10
No emails were triggered.
[Solr-reference-guide-master] $ /usr/bin/env bash 
/tmp/jenkins4744945253857041538.sh
+ set -e
+ RVM_PATH=/home/jenkins/.rvm
+ RUBY_VERSION=ruby-2.3.3
+ GEMSET=solr-refguide-gemset
+ curl -sSL https://get.rvm.io
+ bash -s -- --ignore-dotfiles stable
Turning on ignore dotfiles mode.
Downloading https://github.com/rvm/rvm/archive/1.29.3.tar.gz
Downloading 
https://github.com/rvm/rvm/releases/download/1.29.3/1.29.3.tar.gz.asc
gpg: Signature made Sun 10 Sep 2017 08:59:21 PM UTC using RSA key ID BF04FF17
gpg: Good signature from "Michal Papis (RVM signing) "
gpg: aka "Michal Papis "
gpg: aka "[jpeg image of size 5015]"
gpg: WARNING: This key is not certified with a trusted signature!
gpg:  There is no indication that the signature belongs to the owner.
Primary key fingerprint: 409B 6B17 96C2 7546 2A17  0311 3804 BB82 D39D C0E3
 Subkey fingerprint: 62C9 E5F4 DA30 0D94 AC36  166B E206 C29F BF04 FF17
GPG verified '/home/jenkins/.rvm/archives/rvm-1.29.3.tgz'

Upgrading the RVM installation in /home/jenkins/.rvm/
Upgrade of RVM in /home/jenkins/.rvm/ is complete.

Upgrade Notes:

  * No new notes to display.

+ set +x
Running 'source /home/jenkins/.rvm/scripts/rvm'
Running 'rvm autolibs disable'
Running 'rvm install ruby-2.3.3'
Already installed ruby-2.3.3.
To reinstall use:

rvm reinstall ruby-2.3.3

Running 'rvm gemset create solr-refguide-gemset'
ruby-2.3.3 - #gemset created 
/home/jenkins/.rvm/gems/ruby-2.3.3@solr-refguide-gemset
ruby-2.3.3 - #generating solr-refguide-gemset 
wrappers|/-\|/-\|.-\|/-\|/-.|/-\|/-\|.-\|/-\|/-.|/-\|/-\|.-\|/-\|/-.|/-\|/-\|.-\|/-.
Running 'rvm ruby-2.3.3@solr-refguide-gemset'
Using /home/jenkins/.rvm/gems/ruby-2.3.3 with gemset solr-refguide-gemset
Running 'gem install --force --version 3.5.0 jekyll'
Successfully installed jekyll-3.5.0
Parsing documentation for jekyll-3.5.0
Done installing documentation for jekyll after 1 seconds
1 gem installed
Running 'gem install --force --version 2.1.0 jekyll-asciidoc'
Successfully installed jekyll-asciidoc-2.1.0
Parsing documentation for jekyll-asciidoc-2.1.0
Done installing documentation for jekyll-asciidoc after 0 seconds
1 gem installed
Running 'gem install --force --version 1.1.2 pygments.rb'
Successfully installed pygments.rb-1.1.2
Parsing documentation for pygments.rb-1.1.2
Done installing documentation for pygments.rb after 0 seconds
1 gem installed
Running 'ant ivy-bootstrap'
Buildfile: 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master/build.xml

-ivy-bootstrap1:
 [echo] installing ivy 2.4.0 to /home/jenkins/.ant/lib
  [get] Getting: 
http://repo1.maven.org/maven2/org/apache/ivy/ivy/2.4.0/ivy-2.4.0.jar
  [get] To: /home/jenkins/.ant/lib/ivy-2.4.0.jar
  [get] Not modified - so not downloaded

-ivy-bootstrap2:

-ivy-checksum:

-ivy-remove-old-versions:

ivy-bootstrap:

BUILD SUCCESSFUL
Total time: 0 seconds
+ ant clean build-site build-pdf
Buildfile: 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master/solr/solr-ref-guide/build.xml

clean:

build-init:
[mkdir] Created dir: 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master/solr/build/solr-ref-guide/content
 [echo] Copying all non template files from src ...
 [copy] Copying 420 files to 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master/solr/build/solr-ref-guide/content
 [echo] Copy (w/prop 

[jira] [Comment Edited] (LUCENE-8264) Allow an option to rewrite all segments

2018-05-09 Thread Erick Erickson (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-8264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469894#comment-16469894
 ] 

Erick Erickson edited comment on LUCENE-8264 at 5/10/18 4:36 AM:
-

OK, we've pretty well disposed of the whole N-2 -> N upgrade issue, ain't gonna 
happen. There are still two other cases where this would be useful:

1> N-1 -> N
2> adding DocValues without re-indexing

Of the two, <2> is probably the most immediately useful, I've seen a lot of 
clients in the field be hurt when they realize that they'd have been better off 
with docValues but didn't have them turned on.

Since I'm working on TMP, that's where I'm focusing. How to implement? A new 
method on MergePolicy that no-op'd for everything except TMP? See the 
discussion at LUCENE-8004, but the gist is:

1> some new methods on MergePolicy that returned information from the concrete 
policy like default max merge segments (don't particularly like that). Callers 
would have to "do the right thing", which is trappy.

OR 

2> a new method on MergePolicy like {{findRewriteAllSegments}} that was 
essentially {{findForcedMerges}} that makes some extra decisions. A 
pass-through for everything except TMP currently.

Or is the right thing to do here is create, say a new MergePolicy 
{{AddDocValuesBecaseYouDidntReadTheManualAboutWhyDocValuesWereAGoodThingMergePolicy}}?

Off the top of my head it would take (somehow) a list of fields to add 
DocValues to and then "do the right thing". I don't have any details worked out 
yet, want to discuss before diving in.

The requirement is that in a distributed system I can issue one command that'll 
fix this everywhere I care about. I don't really have a clue how it'd deal with 
being applied twice in a row, merging some segments with and some segments 
without etc..


was (Author: erickerickson):
See comment 9-May.

> Allow an option to rewrite all segments
> ---
>
> Key: LUCENE-8264
> URL: https://issues.apache.org/jira/browse/LUCENE-8264
> Project: Lucene - Core
>  Issue Type: Improvement
>Reporter: Erick Erickson
>Assignee: Erick Erickson
>Priority: Major
>
> For the background, see SOLR-12259.
> There are several use-cases that would be much easier, especially during 
> upgrades, if we could specify that all segments get rewritten. 
> One example: Upgrading 5x->6x->7x. When segments are merged, they're 
> rewritten into the current format. However, there's no guarantee that a 
> particular segment _ever_ gets merged so the 6x-7x upgrade won't necessarily 
> be successful.
> How many merge policies support this is an open question. I propose to start 
> with TMP and raise other JIRAs as necessary for other merge policies.
> So far the usual response has been "re-index from scratch", but that's 
> increasingly difficult as systems get larger.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (LUCENE-8305) ComplexPhraseQuery.rewrite can throw exception RE MatchNoDocsQuery if MTQ sub-clause matches no terms

2018-05-09 Thread David Smiley (JIRA)

 [ 
https://issues.apache.org/jira/browse/LUCENE-8305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

David Smiley updated LUCENE-8305:
-
 Priority: Major  (was: Minor)
Fix Version/s: 7.4
  Summary: ComplexPhraseQuery.rewrite can throw exception RE 
MatchNoDocsQuery if MTQ sub-clause matches no terms  (was: Highlighter error: 
Unknown query type:org.apache.lucene.search.MatchNoDocsQuery)

> ComplexPhraseQuery.rewrite can throw exception RE MatchNoDocsQuery if MTQ 
> sub-clause matches no terms
> -
>
> Key: LUCENE-8305
> URL: https://issues.apache.org/jira/browse/LUCENE-8305
> Project: Lucene - Core
>  Issue Type: Bug
>  Components: modules/queryparser
>Affects Versions: 6.3
>Reporter: Andy Tran
>Assignee: David Smiley
>Priority: Major
> Fix For: 7.4
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> With Solr v6.3, when I issue this query:
> http://localhost:8983/solr/BestBuy/select?wt=json=10={!complexphrase%20inOrder=false}_text_:%22maytag~%20(refri~%20OR%20refri*)%20%22=id=true=false=60=nameX,shortDescription,longDescription,artistName,type,manufacturer,department
> I get this error in the JSON response:
> *
> {
>   "responseHeader": {
> "zkConnected": true,
> "status": 500,
> "QTime": 8,
> "params": {
>   "q": "{!complexphrase inOrder=false}_text_:\"maytag~ (refri~ OR refri*) 
> \"",
>   "hl": "true",
>   "hl.preserveMulti": "false",
>   "fl": "id",
>   "hl.fragsize": "60",
>   "hl.fl": 
> "nameX,shortDescription,longDescription,artistName,type,manufacturer,department",
>   "rows": "10",
>   "wt": "json"
> }
>   },
>   "response": {
> "numFound": 2,
> "start": 0,
> "docs": [
>   {
> "id": "5411379"
>   },
>   {
> "id": "5411404"
>   }
> ]
>   },
>   "error": {
> "msg": "Unknown query type:org.apache.lucene.search.MatchNoDocsQuery",
> "trace": "java.lang.IllegalArgumentException: Unknown query 
> type:org.apache.lucene.search.MatchNoDocsQuery\n\tat 
> org.apache.lucene.queryparser.complexPhrase.ComplexPhraseQueryParser$ComplexPhraseQuery.addComplexPhraseClause(ComplexPhraseQueryParser.java:388)\n\tat
>  
> org.apache.lucene.queryparser.complexPhrase.ComplexPhraseQueryParser$ComplexPhraseQuery.rewrite(ComplexPhraseQueryParser.java:289)\n\tat
>  
> org.apache.lucene.search.highlight.WeightedSpanTermExtractor.extract(WeightedSpanTermExtractor.java:230)\n\tat
>  
> org.apache.lucene.search.highlight.WeightedSpanTermExtractor.getWeightedSpanTerms(WeightedSpanTermExtractor.java:522)\n\tat
>  
> org.apache.lucene.search.highlight.QueryScorer.initExtractor(QueryScorer.java:218)\n\tat
>  
> org.apache.lucene.search.highlight.QueryScorer.init(QueryScorer.java:186)\n\tat
>  
> org.apache.lucene.search.highlight.Highlighter.getBestTextFragments(Highlighter.java:195)\n\tat
>  
> org.apache.solr.highlight.DefaultSolrHighlighter.doHighlightingByHighlighter(DefaultSolrHighlighter.java:602)\n\tat
>  
> org.apache.solr.highlight.DefaultSolrHighlighter.doHighlightingOfField(DefaultSolrHighlighter.java:448)\n\tat
>  
> org.apache.solr.highlight.DefaultSolrHighlighter.doHighlighting(DefaultSolrHighlighter.java:410)\n\tat
>  
> org.apache.solr.handler.component.HighlightComponent.process(HighlightComponent.java:141)\n\tat
>  
> org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:295)\n\tat
>  
> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:153)\n\tat
>  org.apache.solr.core.SolrCore.execute(SolrCore.java:2213)\n\tat 
> org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:654)\n\tat 
> org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:460)\n\tat 
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:303)\n\tat
>  
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:254)\n\tat
>  
> org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1668)\n\tat
>  
> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:581)\n\tat
>  
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)\n\tat
>  
> org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548)\n\tat
>  
> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:226)\n\tat
>  
> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1160)\n\tat
>  
> org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:511)\n\tat
>  
> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)\n\tat
>  
> 

[jira] [Commented] (LUCENE-8305) ComplexPhraseQuery.rewrite can throw exception RE MatchNoDocsQuery if MTQ sub-clause matches no terms

2018-05-09 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-8305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469861#comment-16469861
 ] 

ASF subversion and git services commented on LUCENE-8305:
-

Commit e91d120999d0e92523aed5b1ced1513538c3c05e in lucene-solr's branch 
refs/heads/master from [~dsmiley]
[ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=e91d120 ]

LUCENE-8305: ComplexPhraseQuery.rewrite now handles an embedded MultiTermQuery
that rewrites to a MatchNoDocsQuery instead of throwing an exception.
Fixes #258
Fixes #327


> ComplexPhraseQuery.rewrite can throw exception RE MatchNoDocsQuery if MTQ 
> sub-clause matches no terms
> -
>
> Key: LUCENE-8305
> URL: https://issues.apache.org/jira/browse/LUCENE-8305
> Project: Lucene - Core
>  Issue Type: Bug
>  Components: modules/queryparser
>Affects Versions: 6.3
>Reporter: Andy Tran
>Assignee: David Smiley
>Priority: Major
> Fix For: 7.4
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> With Solr v6.3, when I issue this query:
> http://localhost:8983/solr/BestBuy/select?wt=json=10={!complexphrase%20inOrder=false}_text_:%22maytag~%20(refri~%20OR%20refri*)%20%22=id=true=false=60=nameX,shortDescription,longDescription,artistName,type,manufacturer,department
> I get this error in the JSON response:
> *
> {
>   "responseHeader": {
> "zkConnected": true,
> "status": 500,
> "QTime": 8,
> "params": {
>   "q": "{!complexphrase inOrder=false}_text_:\"maytag~ (refri~ OR refri*) 
> \"",
>   "hl": "true",
>   "hl.preserveMulti": "false",
>   "fl": "id",
>   "hl.fragsize": "60",
>   "hl.fl": 
> "nameX,shortDescription,longDescription,artistName,type,manufacturer,department",
>   "rows": "10",
>   "wt": "json"
> }
>   },
>   "response": {
> "numFound": 2,
> "start": 0,
> "docs": [
>   {
> "id": "5411379"
>   },
>   {
> "id": "5411404"
>   }
> ]
>   },
>   "error": {
> "msg": "Unknown query type:org.apache.lucene.search.MatchNoDocsQuery",
> "trace": "java.lang.IllegalArgumentException: Unknown query 
> type:org.apache.lucene.search.MatchNoDocsQuery\n\tat 
> org.apache.lucene.queryparser.complexPhrase.ComplexPhraseQueryParser$ComplexPhraseQuery.addComplexPhraseClause(ComplexPhraseQueryParser.java:388)\n\tat
>  
> org.apache.lucene.queryparser.complexPhrase.ComplexPhraseQueryParser$ComplexPhraseQuery.rewrite(ComplexPhraseQueryParser.java:289)\n\tat
>  
> org.apache.lucene.search.highlight.WeightedSpanTermExtractor.extract(WeightedSpanTermExtractor.java:230)\n\tat
>  
> org.apache.lucene.search.highlight.WeightedSpanTermExtractor.getWeightedSpanTerms(WeightedSpanTermExtractor.java:522)\n\tat
>  
> org.apache.lucene.search.highlight.QueryScorer.initExtractor(QueryScorer.java:218)\n\tat
>  
> org.apache.lucene.search.highlight.QueryScorer.init(QueryScorer.java:186)\n\tat
>  
> org.apache.lucene.search.highlight.Highlighter.getBestTextFragments(Highlighter.java:195)\n\tat
>  
> org.apache.solr.highlight.DefaultSolrHighlighter.doHighlightingByHighlighter(DefaultSolrHighlighter.java:602)\n\tat
>  
> org.apache.solr.highlight.DefaultSolrHighlighter.doHighlightingOfField(DefaultSolrHighlighter.java:448)\n\tat
>  
> org.apache.solr.highlight.DefaultSolrHighlighter.doHighlighting(DefaultSolrHighlighter.java:410)\n\tat
>  
> org.apache.solr.handler.component.HighlightComponent.process(HighlightComponent.java:141)\n\tat
>  
> org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:295)\n\tat
>  
> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:153)\n\tat
>  org.apache.solr.core.SolrCore.execute(SolrCore.java:2213)\n\tat 
> org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:654)\n\tat 
> org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:460)\n\tat 
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:303)\n\tat
>  
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:254)\n\tat
>  
> org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1668)\n\tat
>  
> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:581)\n\tat
>  
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)\n\tat
>  
> org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548)\n\tat
>  
> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:226)\n\tat
>  
> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1160)\n\tat
>  
> 

[JENKINS] Solr-reference-guide-master - Build # 7374 - Still Failing

2018-05-09 Thread Apache Jenkins Server
Build: https://builds.apache.org/job/Solr-reference-guide-master/7374/

Log: 
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on websites1 (git-websites svn-websites) in workspace 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master
 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url git://git.apache.org/lucene-solr.git # 
 > timeout=10
Cleaning workspace
 > git rev-parse --verify HEAD # timeout=10
Resetting working tree
 > git reset --hard # timeout=10
 > git clean -fdx # timeout=10
Fetching upstream changes from git://git.apache.org/lucene-solr.git
 > git --version # timeout=10
 > git fetch --tags --progress git://git.apache.org/lucene-solr.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
Checking out Revision c2819930d7a1ef675e1721242ac03ccc5d43b0b3 
(refs/remotes/origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f c2819930d7a1ef675e1721242ac03ccc5d43b0b3
Commit message: "SOLR-12280: Add dsp to math-expression children"
 > git rev-list --no-walk c2819930d7a1ef675e1721242ac03ccc5d43b0b3 # timeout=10
No emails were triggered.
[Solr-reference-guide-master] $ /usr/bin/env bash 
/tmp/jenkins6426117463766259422.sh
+ set -e
+ RVM_PATH=/home/jenkins/.rvm
+ RUBY_VERSION=ruby-2.3.3
+ GEMSET=solr-refguide-gemset
+ curl -sSL https://get.rvm.io
+ bash -s -- --ignore-dotfiles stable
Turning on ignore dotfiles mode.
Downloading https://github.com/rvm/rvm/archive/1.29.3.tar.gz
Downloading 
https://github.com/rvm/rvm/releases/download/1.29.3/1.29.3.tar.gz.asc
gpg: Signature made Sun 10 Sep 2017 08:59:21 PM UTC using RSA key ID BF04FF17
gpg: Good signature from "Michal Papis (RVM signing) "
gpg: aka "Michal Papis "
gpg: aka "[jpeg image of size 5015]"
gpg: WARNING: This key is not certified with a trusted signature!
gpg:  There is no indication that the signature belongs to the owner.
Primary key fingerprint: 409B 6B17 96C2 7546 2A17  0311 3804 BB82 D39D C0E3
 Subkey fingerprint: 62C9 E5F4 DA30 0D94 AC36  166B E206 C29F BF04 FF17
GPG verified '/home/jenkins/.rvm/archives/rvm-1.29.3.tgz'

Upgrading the RVM installation in /home/jenkins/.rvm/
Upgrade of RVM in /home/jenkins/.rvm/ is complete.

Upgrade Notes:

  * No new notes to display.

+ set +x
Running 'source /home/jenkins/.rvm/scripts/rvm'
Running 'rvm autolibs disable'
Running 'rvm install ruby-2.3.3'
Already installed ruby-2.3.3.
To reinstall use:

rvm reinstall ruby-2.3.3

Running 'rvm gemset create solr-refguide-gemset'
ruby-2.3.3 - #gemset created 
/home/jenkins/.rvm/gems/ruby-2.3.3@solr-refguide-gemset
ruby-2.3.3 - #generating solr-refguide-gemset 
wrappers|/-\|/-\|.-\|/-\|/-.|/-\|/-\|.-\|/-\|/-.|/-\|/-\|.-\|/-\|/-.|/-\|/-\|.-\|/-.
Running 'rvm ruby-2.3.3@solr-refguide-gemset'
Using /home/jenkins/.rvm/gems/ruby-2.3.3 with gemset solr-refguide-gemset
Running 'gem install --force --version 3.5.0 jekyll'
Successfully installed jekyll-3.5.0
Parsing documentation for jekyll-3.5.0
Done installing documentation for jekyll after 1 seconds
1 gem installed
Running 'gem install --force --version 2.1.0 jekyll-asciidoc'
Successfully installed jekyll-asciidoc-2.1.0
Parsing documentation for jekyll-asciidoc-2.1.0
Done installing documentation for jekyll-asciidoc after 0 seconds
1 gem installed
Running 'gem install --force --version 1.1.2 pygments.rb'
Successfully installed pygments.rb-1.1.2
Parsing documentation for pygments.rb-1.1.2
Done installing documentation for pygments.rb after 0 seconds
1 gem installed
Running 'ant ivy-bootstrap'
Buildfile: 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master/build.xml

-ivy-bootstrap1:
 [echo] installing ivy 2.4.0 to /home/jenkins/.ant/lib
  [get] Getting: 
http://repo1.maven.org/maven2/org/apache/ivy/ivy/2.4.0/ivy-2.4.0.jar
  [get] To: /home/jenkins/.ant/lib/ivy-2.4.0.jar
  [get] Not modified - so not downloaded

-ivy-bootstrap2:

-ivy-checksum:

-ivy-remove-old-versions:

ivy-bootstrap:

BUILD SUCCESSFUL
Total time: 0 seconds
+ ant clean build-site build-pdf
Buildfile: 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master/solr/solr-ref-guide/build.xml

clean:

build-init:
[mkdir] Created dir: 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master/solr/build/solr-ref-guide/content
 [echo] Copying all non template files from src ...
 [copy] Copying 420 files to 
/home/jenkins/jenkins-slave/workspace/Solr-reference-guide-master/solr/build/solr-ref-guide/content
 [echo] Copy (w/prop replacement) any template files from src...
 [copy] Copying 1 file to 

[GitHub] lucene-solr pull request #258: SOLR-10078: Handle MatchNoDocsQuery in Boolea...

2018-05-09 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/lucene-solr/pull/258


---

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[GitHub] lucene-solr pull request #327: SOLR-10078: Handle MatchNoDocsQuery in Boolea...

2018-05-09 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/lucene-solr/pull/327


---

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Comment Edited] (LUCENE-7976) Make TieredMergePolicy respect maxSegmentSizeMB and allow singleton merges of very large segments

2018-05-09 Thread Erick Erickson (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-7976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469931#comment-16469931
 ] 

Erick Erickson edited comment on LUCENE-7976 at 5/10/18 5:08 AM:
-

Latest patch incorporating comments so far and adding tests, plus some Solr 
documentation changes.

I'd really like to wrap this up soon, I think we should move more 
refactoring/restructuring on to other JIRAs.

Precommit and tests run, or at least ran before I worked on the tests. 

TODO:
- make sure precommit and test still runs.
- do some more measurements against old code to insure that the write rates are 
OK.
- give the code a last once-over, make sure I took out anything I had in there 
for debugging and the like.

Otherwise, AFAICT, it's ready to rock-n-roll.


was (Author: erickerickson):
Latest patch incorporating comments so far and adding tests, plus some Solr 
documentation changes.

I'd really like to wrap this up soon, I think we should move more 
refactoring/restructuring on to other JIRAs.

Precommit and tests run, or at least ran before I worked on the tests. 

TODO:
- make sure precommit and test still runs.
- do some more measurements against old code to insure that the write rates are 
OK.

Otherwise, AFAICT, it's ready to rock-n-roll.

> Make TieredMergePolicy respect maxSegmentSizeMB and allow singleton merges of 
> very large segments
> -
>
> Key: LUCENE-7976
> URL: https://issues.apache.org/jira/browse/LUCENE-7976
> Project: Lucene - Core
>  Issue Type: Improvement
>Reporter: Erick Erickson
>Assignee: Erick Erickson
>Priority: Major
> Attachments: LUCENE-7976.patch, LUCENE-7976.patch, LUCENE-7976.patch, 
> LUCENE-7976.patch, LUCENE-7976.patch, LUCENE-7976.patch, LUCENE-7976.patch, 
> LUCENE-7976.patch
>
>
> We're seeing situations "in the wild" where there are very large indexes (on 
> disk) handled quite easily in a single Lucene index. This is particularly 
> true as features like docValues move data into MMapDirectory space. The 
> current TMP algorithm allows on the order of 50% deleted documents as per a 
> dev list conversation with Mike McCandless (and his blog here:  
> https://www.elastic.co/blog/lucenes-handling-of-deleted-documents).
> Especially in the current era of very large indexes in aggregate, (think many 
> TB) solutions like "you need to distribute your collection over more shards" 
> become very costly. Additionally, the tempting "optimize" button exacerbates 
> the issue since once you form, say, a 100G segment (by 
> optimizing/forceMerging) it is not eligible for merging until 97.5G of the 
> docs in it are deleted (current default 5G max segment size).
> The proposal here would be to add a new parameter to TMP, something like 
>  (no, that's not serious name, suggestions 
> welcome) which would default to 100 (or the same behavior we have now).
> So if I set this parameter to, say, 20%, and the max segment size stays at 
> 5G, the following would happen when segments were selected for merging:
> > any segment with > 20% deleted documents would be merged or rewritten NO 
> > MATTER HOW LARGE. There are two cases,
> >> the segment has < 5G "live" docs. In that case it would be merged with 
> >> smaller segments to bring the resulting segment up to 5G. If no smaller 
> >> segments exist, it would just be rewritten
> >> The segment has > 5G "live" docs (the result of a forceMerge or optimize). 
> >> It would be rewritten into a single segment removing all deleted docs no 
> >> matter how big it is to start. The 100G example above would be rewritten 
> >> to an 80G segment for instance.
> Of course this would lead to potentially much more I/O which is why the 
> default would be the same behavior we see now. As it stands now, though, 
> there's no way to recover from an optimize/forceMerge except to re-index from 
> scratch. We routinely see 200G-300G Lucene indexes at this point "in the 
> wild" with 10s of  shards replicated 3 or more times. And that doesn't even 
> include having these over HDFS.
> Alternatives welcome! Something like the above seems minimally invasive. A 
> new merge policy is certainly an alternative.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-7976) Make TieredMergePolicy respect maxSegmentSizeMB and allow singleton merges of very large segments

2018-05-09 Thread Erick Erickson (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-7976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469931#comment-16469931
 ] 

Erick Erickson commented on LUCENE-7976:


Latest patch incorporating comments so far and adding tests, plus some Solr 
documentation changes.

I'd really like to wrap this up soon, I think we should move more 
refactoring/restructuring on to other JIRAs.

Precommit and tests run, or at least ran before I worked on the tests. 

TODO:
- make sure precommit and test still runs.
- do some more measurements against old code to insure that the write rates are 
OK.

Otherwise, AFAICT, it's ready to rock-n-roll.

> Make TieredMergePolicy respect maxSegmentSizeMB and allow singleton merges of 
> very large segments
> -
>
> Key: LUCENE-7976
> URL: https://issues.apache.org/jira/browse/LUCENE-7976
> Project: Lucene - Core
>  Issue Type: Improvement
>Reporter: Erick Erickson
>Assignee: Erick Erickson
>Priority: Major
> Attachments: LUCENE-7976.patch, LUCENE-7976.patch, LUCENE-7976.patch, 
> LUCENE-7976.patch, LUCENE-7976.patch, LUCENE-7976.patch, LUCENE-7976.patch, 
> LUCENE-7976.patch
>
>
> We're seeing situations "in the wild" where there are very large indexes (on 
> disk) handled quite easily in a single Lucene index. This is particularly 
> true as features like docValues move data into MMapDirectory space. The 
> current TMP algorithm allows on the order of 50% deleted documents as per a 
> dev list conversation with Mike McCandless (and his blog here:  
> https://www.elastic.co/blog/lucenes-handling-of-deleted-documents).
> Especially in the current era of very large indexes in aggregate, (think many 
> TB) solutions like "you need to distribute your collection over more shards" 
> become very costly. Additionally, the tempting "optimize" button exacerbates 
> the issue since once you form, say, a 100G segment (by 
> optimizing/forceMerging) it is not eligible for merging until 97.5G of the 
> docs in it are deleted (current default 5G max segment size).
> The proposal here would be to add a new parameter to TMP, something like 
>  (no, that's not serious name, suggestions 
> welcome) which would default to 100 (or the same behavior we have now).
> So if I set this parameter to, say, 20%, and the max segment size stays at 
> 5G, the following would happen when segments were selected for merging:
> > any segment with > 20% deleted documents would be merged or rewritten NO 
> > MATTER HOW LARGE. There are two cases,
> >> the segment has < 5G "live" docs. In that case it would be merged with 
> >> smaller segments to bring the resulting segment up to 5G. If no smaller 
> >> segments exist, it would just be rewritten
> >> The segment has > 5G "live" docs (the result of a forceMerge or optimize). 
> >> It would be rewritten into a single segment removing all deleted docs no 
> >> matter how big it is to start. The 100G example above would be rewritten 
> >> to an 80G segment for instance.
> Of course this would lead to potentially much more I/O which is why the 
> default would be the same behavior we see now. As it stands now, though, 
> there's no way to recover from an optimize/forceMerge except to re-index from 
> scratch. We routinely see 200G-300G Lucene indexes at this point "in the 
> wild" with 10s of  shards replicated 3 or more times. And that doesn't even 
> include having these over HDFS.
> Alternatives welcome! Something like the above seems minimally invasive. A 
> new merge policy is certainly an alternative.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-8305) Highlighter error: Unknown query type:org.apache.lucene.search.MatchNoDocsQuery

2018-05-09 Thread David Smiley (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-8305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469852#comment-16469852
 ] 

David Smiley commented on LUCENE-8305:
--

+1 Looks good.  Thanks for the contribution.  This apparently was overlooked in 
LUCENE-7337 which flipped how BQ & MatchNoDocsQuery rewrite to each other.

I'll commit shortly.

> Highlighter error: Unknown query 
> type:org.apache.lucene.search.MatchNoDocsQuery
> ---
>
> Key: LUCENE-8305
> URL: https://issues.apache.org/jira/browse/LUCENE-8305
> Project: Lucene - Core
>  Issue Type: Bug
>  Components: modules/queryparser
>Affects Versions: 6.3
>Reporter: Andy Tran
>Assignee: David Smiley
>Priority: Minor
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> With Solr v6.3, when I issue this query:
> http://localhost:8983/solr/BestBuy/select?wt=json=10={!complexphrase%20inOrder=false}_text_:%22maytag~%20(refri~%20OR%20refri*)%20%22=id=true=false=60=nameX,shortDescription,longDescription,artistName,type,manufacturer,department
> I get this error in the JSON response:
> *
> {
>   "responseHeader": {
> "zkConnected": true,
> "status": 500,
> "QTime": 8,
> "params": {
>   "q": "{!complexphrase inOrder=false}_text_:\"maytag~ (refri~ OR refri*) 
> \"",
>   "hl": "true",
>   "hl.preserveMulti": "false",
>   "fl": "id",
>   "hl.fragsize": "60",
>   "hl.fl": 
> "nameX,shortDescription,longDescription,artistName,type,manufacturer,department",
>   "rows": "10",
>   "wt": "json"
> }
>   },
>   "response": {
> "numFound": 2,
> "start": 0,
> "docs": [
>   {
> "id": "5411379"
>   },
>   {
> "id": "5411404"
>   }
> ]
>   },
>   "error": {
> "msg": "Unknown query type:org.apache.lucene.search.MatchNoDocsQuery",
> "trace": "java.lang.IllegalArgumentException: Unknown query 
> type:org.apache.lucene.search.MatchNoDocsQuery\n\tat 
> org.apache.lucene.queryparser.complexPhrase.ComplexPhraseQueryParser$ComplexPhraseQuery.addComplexPhraseClause(ComplexPhraseQueryParser.java:388)\n\tat
>  
> org.apache.lucene.queryparser.complexPhrase.ComplexPhraseQueryParser$ComplexPhraseQuery.rewrite(ComplexPhraseQueryParser.java:289)\n\tat
>  
> org.apache.lucene.search.highlight.WeightedSpanTermExtractor.extract(WeightedSpanTermExtractor.java:230)\n\tat
>  
> org.apache.lucene.search.highlight.WeightedSpanTermExtractor.getWeightedSpanTerms(WeightedSpanTermExtractor.java:522)\n\tat
>  
> org.apache.lucene.search.highlight.QueryScorer.initExtractor(QueryScorer.java:218)\n\tat
>  
> org.apache.lucene.search.highlight.QueryScorer.init(QueryScorer.java:186)\n\tat
>  
> org.apache.lucene.search.highlight.Highlighter.getBestTextFragments(Highlighter.java:195)\n\tat
>  
> org.apache.solr.highlight.DefaultSolrHighlighter.doHighlightingByHighlighter(DefaultSolrHighlighter.java:602)\n\tat
>  
> org.apache.solr.highlight.DefaultSolrHighlighter.doHighlightingOfField(DefaultSolrHighlighter.java:448)\n\tat
>  
> org.apache.solr.highlight.DefaultSolrHighlighter.doHighlighting(DefaultSolrHighlighter.java:410)\n\tat
>  
> org.apache.solr.handler.component.HighlightComponent.process(HighlightComponent.java:141)\n\tat
>  
> org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:295)\n\tat
>  
> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:153)\n\tat
>  org.apache.solr.core.SolrCore.execute(SolrCore.java:2213)\n\tat 
> org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:654)\n\tat 
> org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:460)\n\tat 
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:303)\n\tat
>  
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:254)\n\tat
>  
> org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1668)\n\tat
>  
> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:581)\n\tat
>  
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)\n\tat
>  
> org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548)\n\tat
>  
> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:226)\n\tat
>  
> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1160)\n\tat
>  
> org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:511)\n\tat
>  
> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)\n\tat
>  
> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1092)\n\tat
>  
> 

[jira] [Created] (SOLR-12338) Replay buffering tlog in parallel

2018-05-09 Thread Cao Manh Dat (JIRA)
Cao Manh Dat created SOLR-12338:
---

 Summary: Replay buffering tlog in parallel
 Key: SOLR-12338
 URL: https://issues.apache.org/jira/browse/SOLR-12338
 Project: Solr
  Issue Type: Improvement
  Security Level: Public (Default Security Level. Issues are Public)
Reporter: Cao Manh Dat
Assignee: Cao Manh Dat


Since updates with different id are independent, therefore it is safe to replay 
them in parallel. This will significantly reduce recovering time of replicas in 
high load indexing environment. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Resolved] (LUCENE-8305) ComplexPhraseQuery.rewrite can throw exception RE MatchNoDocsQuery if MTQ sub-clause matches no terms

2018-05-09 Thread David Smiley (JIRA)

 [ 
https://issues.apache.org/jira/browse/LUCENE-8305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

David Smiley resolved LUCENE-8305.
--
Resolution: Fixed

> ComplexPhraseQuery.rewrite can throw exception RE MatchNoDocsQuery if MTQ 
> sub-clause matches no terms
> -
>
> Key: LUCENE-8305
> URL: https://issues.apache.org/jira/browse/LUCENE-8305
> Project: Lucene - Core
>  Issue Type: Bug
>  Components: modules/queryparser
>Affects Versions: 6.3
>Reporter: Andy Tran
>Assignee: David Smiley
>Priority: Major
> Fix For: 7.4
>
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> With Solr v6.3, when I issue this query:
> http://localhost:8983/solr/BestBuy/select?wt=json=10={!complexphrase%20inOrder=false}_text_:%22maytag~%20(refri~%20OR%20refri*)%20%22=id=true=false=60=nameX,shortDescription,longDescription,artistName,type,manufacturer,department
> I get this error in the JSON response:
> *
> {
>   "responseHeader": {
> "zkConnected": true,
> "status": 500,
> "QTime": 8,
> "params": {
>   "q": "{!complexphrase inOrder=false}_text_:\"maytag~ (refri~ OR refri*) 
> \"",
>   "hl": "true",
>   "hl.preserveMulti": "false",
>   "fl": "id",
>   "hl.fragsize": "60",
>   "hl.fl": 
> "nameX,shortDescription,longDescription,artistName,type,manufacturer,department",
>   "rows": "10",
>   "wt": "json"
> }
>   },
>   "response": {
> "numFound": 2,
> "start": 0,
> "docs": [
>   {
> "id": "5411379"
>   },
>   {
> "id": "5411404"
>   }
> ]
>   },
>   "error": {
> "msg": "Unknown query type:org.apache.lucene.search.MatchNoDocsQuery",
> "trace": "java.lang.IllegalArgumentException: Unknown query 
> type:org.apache.lucene.search.MatchNoDocsQuery\n\tat 
> org.apache.lucene.queryparser.complexPhrase.ComplexPhraseQueryParser$ComplexPhraseQuery.addComplexPhraseClause(ComplexPhraseQueryParser.java:388)\n\tat
>  
> org.apache.lucene.queryparser.complexPhrase.ComplexPhraseQueryParser$ComplexPhraseQuery.rewrite(ComplexPhraseQueryParser.java:289)\n\tat
>  
> org.apache.lucene.search.highlight.WeightedSpanTermExtractor.extract(WeightedSpanTermExtractor.java:230)\n\tat
>  
> org.apache.lucene.search.highlight.WeightedSpanTermExtractor.getWeightedSpanTerms(WeightedSpanTermExtractor.java:522)\n\tat
>  
> org.apache.lucene.search.highlight.QueryScorer.initExtractor(QueryScorer.java:218)\n\tat
>  
> org.apache.lucene.search.highlight.QueryScorer.init(QueryScorer.java:186)\n\tat
>  
> org.apache.lucene.search.highlight.Highlighter.getBestTextFragments(Highlighter.java:195)\n\tat
>  
> org.apache.solr.highlight.DefaultSolrHighlighter.doHighlightingByHighlighter(DefaultSolrHighlighter.java:602)\n\tat
>  
> org.apache.solr.highlight.DefaultSolrHighlighter.doHighlightingOfField(DefaultSolrHighlighter.java:448)\n\tat
>  
> org.apache.solr.highlight.DefaultSolrHighlighter.doHighlighting(DefaultSolrHighlighter.java:410)\n\tat
>  
> org.apache.solr.handler.component.HighlightComponent.process(HighlightComponent.java:141)\n\tat
>  
> org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:295)\n\tat
>  
> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:153)\n\tat
>  org.apache.solr.core.SolrCore.execute(SolrCore.java:2213)\n\tat 
> org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:654)\n\tat 
> org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:460)\n\tat 
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:303)\n\tat
>  
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:254)\n\tat
>  
> org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1668)\n\tat
>  
> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:581)\n\tat
>  
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)\n\tat
>  
> org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548)\n\tat
>  
> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:226)\n\tat
>  
> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1160)\n\tat
>  
> org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:511)\n\tat
>  
> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)\n\tat
>  
> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1092)\n\tat
>  
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)\n\tat
>  
> 

[jira] [Updated] (LUCENE-8004) IndexUpgraderTool should rewrite segments rather than forceMerge

2018-05-09 Thread Erick Erickson (JIRA)

 [ 
https://issues.apache.org/jira/browse/LUCENE-8004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Erick Erickson updated LUCENE-8004:
---
Environment: 
Marking as blocker since I think there are some observations here that should 
be discussed and resolved before releasing 7.4. Related to LUCENE-7976.

1> By default it uses TMP and merges down to one segment. It's ironic that we 
say "don't optimize", then provide a tool that does exactly that.

2> if we are respecting max segment size (the new default), TMP will not 
attempt to merge segments that are >= the max segment size _and_ have no 
deleted docs.

3> <1> and <2> mean that the bit at the end of 
{{UpgradeIndexMergePolicy.findForcedMerges}} where it collects all the old 
segments not returned by {{in.findForcedMerges}} into one segment has the 
potential to create a very large segments, which is trappy.

Straw-man proposal:

I really dislike constructs like

{{ if (instanceof TieredMergePolicy) { do one thing} else { do something else} 
}}

Seems like that knowledge should be built into the classes themselves. WDYT 
about a new method or two in MergePolicy? They'd be no-ops for everything 
except TMP at this point. We need a couple of things:

1> hard-coding {{w.forceMerge(1);}} in IndexUpgrader is evil so I'm thinking of 
something like 
{{w.forceMerge(iwc.getMergePolicy().getDefaultForceMergeSegmentCount());}} 
instead. It would return 1 by default. Return default in MergePolicy and 
override only in TMP? Make it abstract and override everywhere?

2a> We need a way to tell TMP.findForcedMerges to return segments even if 
they're large and have no deletes in this case. Another (expert) method on 
MergePolicy set/getUsingForUpgrade? I don't particularly like that at all

2b.1> change UpgradeIndexMergePolicy.findForcedMerges to singleton-merge all 
leftover segments rather than merge them all into a single segment. I'd argue 
that this is "more correct"; Anything findForcedMerges leaves un-merged was 
determined by the merge policy NOT to be "cheap" so we should respect that.

2.b.2> change UpgradeIndexMergePolicy to "somehow" respect max segment size 
when it gathers the segments into at the end of findForcedMerges(). This 
pollutes MergePolicy some more.

2.b.3> Add a new method to MergePolicy {{findRewriteAllSegments}} or something. 
It'd look just like {{findForcedMerges}} except it would "understand" that 
every segment would need to be rewritten, even large ones with no deleted 
documents. This would make <1> unnecessary. For everything except TMP it would 
be a passthrough to {{findForcedMerges}} at this point.

I don't much like changing MergePolicy, it's nice and clean and adding methods 
to get specifics from each subclass pollutes it a bit. So <2.b.2> at least 
doesn't require that the caller understand anything about the guts of the class.

Also keep in mind that distributed systems have a hard time using the 
IndexUpgrader on every node in the system, so we need to have something that is 
easy to invoke in that environment, see the discussion at LUCENE-8264.

I'm totally open to any better ideas, haven't started work on this yet.
   Priority: Blocker  (was: Major)

> IndexUpgraderTool should rewrite segments rather than forceMerge
> 
>
> Key: LUCENE-8004
> URL: https://issues.apache.org/jira/browse/LUCENE-8004
> Project: Lucene - Core
>  Issue Type: Improvement
> Environment: Marking as blocker since I think there are some 
> observations here that should be discussed and resolved before releasing 7.4. 
> Related to LUCENE-7976.
> 1> By default it uses TMP and merges down to one segment. It's ironic that we 
> say "don't optimize", then provide a tool that does exactly that.
> 2> if we are respecting max segment size (the new default), TMP will not 
> attempt to merge segments that are >= the max segment size _and_ have no 
> deleted docs.
> 3> <1> and <2> mean that the bit at the end of 
> {{UpgradeIndexMergePolicy.findForcedMerges}} where it collects all the old 
> segments not returned by {{in.findForcedMerges}} into one segment has the 
> potential to create a very large segments, which is trappy.
> Straw-man proposal:
> I really dislike constructs like
> {{ if (instanceof TieredMergePolicy) { do one thing} else { do something 
> else} }}
> Seems like that knowledge should be built into the classes themselves. WDYT 
> about a new method or two in MergePolicy? They'd be no-ops for everything 
> except TMP at this point. We need a couple of things:
> 1> hard-coding {{w.forceMerge(1);}} in IndexUpgrader is evil so I'm thinking 
> of something like 
> {{w.forceMerge(iwc.getMergePolicy().getDefaultForceMergeSegmentCount());}} 
> instead. It would return 1 by default. Return default in MergePolicy and 
> override only in TMP? Make it abstract and 

<    1   2   3   >