[jira] [Commented] (SOLR-2452) rewrite solr build system
[ https://issues.apache.org/jira/browse/SOLR-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13065295#comment-13065295 ] Yonik Seeley commented on SOLR-2452: On trunk in solr, ant example after touching a single source file was 31 seconds before this patch and is now 51. Anyone have any ideas where we lost? (the original description did cite speed as one reason for a rewrite ;-) rewrite solr build system - Key: SOLR-2452 URL: https://issues.apache.org/jira/browse/SOLR-2452 Project: Solr Issue Type: Task Components: Build Reporter: Robert Muir Assignee: Steven Rowe Fix For: 3.4, 4.0 Attachments: SOLR-2452-post-reshuffling.patch, SOLR-2452-post-reshuffling.patch, SOLR-2452-post-reshuffling.patch, SOLR-2452.diffSource.py.patch.zip, SOLR-2452.dir.reshuffle.branch_3x.sh, SOLR-2452.dir.reshuffle.sh, SOLR-2452.dir.reshuffle.sh, SOLR-2452.post.dir.reshuffle.branch_3x.patch As discussed some in SOLR-2002 (but that issue is long and hard to follow), I think we should rewrite the solr build system. Its slow, cumbersome, and messy, and makes it hard for us to improve things. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-2452) rewrite solr build system
[ https://issues.apache.org/jira/browse/SOLR-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13065428#comment-13065428 ] Steven Rowe commented on SOLR-2452: --- bq. On trunk in solr, ant example after touching a single source file was 31 seconds before this patch and is now 51. Anyone have any ideas where we lost? (the original description did cite speed as one reason for a rewrite ;) I've opened an issue to speed up the build. rewrite solr build system - Key: SOLR-2452 URL: https://issues.apache.org/jira/browse/SOLR-2452 Project: Solr Issue Type: Task Components: Build Reporter: Robert Muir Assignee: Steven Rowe Fix For: 3.4, 4.0 Attachments: SOLR-2452-post-reshuffling.patch, SOLR-2452-post-reshuffling.patch, SOLR-2452-post-reshuffling.patch, SOLR-2452.diffSource.py.patch.zip, SOLR-2452.dir.reshuffle.branch_3x.sh, SOLR-2452.dir.reshuffle.sh, SOLR-2452.dir.reshuffle.sh, SOLR-2452.post.dir.reshuffle.branch_3x.patch As discussed some in SOLR-2002 (but that issue is long and hard to follow), I think we should rewrite the solr build system. Its slow, cumbersome, and messy, and makes it hard for us to improve things. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-2452) rewrite solr build system
[ https://issues.apache.org/jira/browse/SOLR-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13063821#comment-13063821 ] Steven Rowe commented on SOLR-2452: --- I removed the patch hack script attachments, since the version in svn is now better, and I don't want to keep posting fixes here. rewrite solr build system - Key: SOLR-2452 URL: https://issues.apache.org/jira/browse/SOLR-2452 Project: Solr Issue Type: Task Components: Build Reporter: Robert Muir Assignee: Steven Rowe Fix For: 3.4, 4.0 Attachments: SOLR-2452-post-reshuffling.patch, SOLR-2452-post-reshuffling.patch, SOLR-2452-post-reshuffling.patch, SOLR-2452.diffSource.py.patch.zip, SOLR-2452.dir.reshuffle.sh, SOLR-2452.dir.reshuffle.sh As discussed some in SOLR-2002 (but that issue is long and hard to follow), I think we should rewrite the solr build system. Its slow, cumbersome, and messy, and makes it hard for us to improve things. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-2452) rewrite solr build system
[ https://issues.apache.org/jira/browse/SOLR-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13063394#comment-13063394 ] Yonik Seeley commented on SOLR-2452: bq. What's the right thing to do here in terms of a patch against the old file structure? Is it reasonable to check out fresh code, hack the patch file to reflect the new paths and apply it to the new structure or must I re-edit the source? That's what I did. bq. And is SVN merge smart enough to deal when merging from trunk to 3x when 3x hasn't been changed, or is it better to just wait on it all until the back-port is done? Apply the changes in 3x however you can (i.e. patch, etc) and then use svn merge --record-only. http://wiki.apache.org/lucene-java/SvnMerge rewrite solr build system - Key: SOLR-2452 URL: https://issues.apache.org/jira/browse/SOLR-2452 Project: Solr Issue Type: Task Components: Build Reporter: Robert Muir Assignee: Steven Rowe Fix For: 3.4, 4.0 Attachments: SOLR-2452-post-reshuffling.patch, SOLR-2452-post-reshuffling.patch, SOLR-2452-post-reshuffling.patch, SOLR-2452.diffSource.py.patch.zip, SOLR-2452.dir.reshuffle.sh, SOLR-2452.dir.reshuffle.sh As discussed some in SOLR-2002 (but that issue is long and hard to follow), I think we should rewrite the solr build system. Its slow, cumbersome, and messy, and makes it hard for us to improve things. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-2452) rewrite solr build system
[ https://issues.apache.org/jira/browse/SOLR-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13063418#comment-13063418 ] Yonik Seeley commented on SOLR-2452: The script produced output like this: {code} Index: solr/core/src/java/org/apache/solr/core/SolrCore.java === --- solr/src/java/org/apache/solr/core/SolrCore.java(revision 80231429dc9c7680375a0a21b1886e59b194) +++ solr/src/java/org/apache/solr/core/SolrCore.java(revision ) {code} Notice that core wasn't substituted on the lines starting with --- and +++ Trying to use the resulting patch file, I got: {code} /opt/code/lusolr$ patch -p0 tt.patch can't find file to patch at input line 5 Perhaps you used the wrong -p or --strip option? The text leading up to this was: -- |Index: solr/core/src/java/org/apache/solr/core/SolrCore.java |=== |--- solr/src/java/org/apache/solr/core/SolrCore.java (revision 80231429dc9c7680375a0a21b1886e59b194) |+++ solr/src/java/org/apache/solr/core/SolrCore.java (revision ) -- {code} rewrite solr build system - Key: SOLR-2452 URL: https://issues.apache.org/jira/browse/SOLR-2452 Project: Solr Issue Type: Task Components: Build Reporter: Robert Muir Assignee: Steven Rowe Fix For: 3.4, 4.0 Attachments: SOLR-2452-post-reshuffling.patch, SOLR-2452-post-reshuffling.patch, SOLR-2452-post-reshuffling.patch, SOLR-2452.diffSource.py.patch.zip, SOLR-2452.dir.reshuffle.sh, SOLR-2452.dir.reshuffle.sh, SOLR-2452.patch.hack.pl As discussed some in SOLR-2002 (but that issue is long and hard to follow), I think we should rewrite the solr build system. Its slow, cumbersome, and messy, and makes it hard for us to improve things. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-2452) rewrite solr build system
[ https://issues.apache.org/jira/browse/SOLR-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13063419#comment-13063419 ] Steven Rowe commented on SOLR-2452: --- Thanks Yonik - I'll fix it rewrite solr build system - Key: SOLR-2452 URL: https://issues.apache.org/jira/browse/SOLR-2452 Project: Solr Issue Type: Task Components: Build Reporter: Robert Muir Assignee: Steven Rowe Fix For: 3.4, 4.0 Attachments: SOLR-2452-post-reshuffling.patch, SOLR-2452-post-reshuffling.patch, SOLR-2452-post-reshuffling.patch, SOLR-2452.diffSource.py.patch.zip, SOLR-2452.dir.reshuffle.sh, SOLR-2452.dir.reshuffle.sh, SOLR-2452.patch.hack.pl As discussed some in SOLR-2002 (but that issue is long and hard to follow), I think we should rewrite the solr build system. Its slow, cumbersome, and messy, and makes it hard for us to improve things. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-2452) rewrite solr build system
[ https://issues.apache.org/jira/browse/SOLR-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13063488#comment-13063488 ] Steven Rowe commented on SOLR-2452: --- If there are no objections, I plan on committing the patch hacking script to {{dev-tools/scripts/}} later today. rewrite solr build system - Key: SOLR-2452 URL: https://issues.apache.org/jira/browse/SOLR-2452 Project: Solr Issue Type: Task Components: Build Reporter: Robert Muir Assignee: Steven Rowe Fix For: 3.4, 4.0 Attachments: SOLR-2452-post-reshuffling.patch, SOLR-2452-post-reshuffling.patch, SOLR-2452-post-reshuffling.patch, SOLR-2452.diffSource.py.patch.zip, SOLR-2452.dir.reshuffle.sh, SOLR-2452.dir.reshuffle.sh, SOLR-2452.patch.hack.pl, SOLR-2452.patch.hack.pl As discussed some in SOLR-2002 (but that issue is long and hard to follow), I think we should rewrite the solr build system. Its slow, cumbersome, and messy, and makes it hard for us to improve things. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-2452) rewrite solr build system
[ https://issues.apache.org/jira/browse/SOLR-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13062811#comment-13062811 ] Steven Rowe commented on SOLR-2452: --- bq. What's the right thing to do here in terms of a patch against the old file structure? Is it reasonable to check out fresh code, hack the patch file to reflect the new paths and apply it to the new structure or must I re-edit the source? I'm working on a script to automatically hack patch files against the old file structure. When it's ready, I'll attach it to this issue. bq. And is SVN merge smart enough to deal when merging from trunk to 3x when 3x hasn't been changed, or is it better to just wait on it all until the back-port is done? AFAIK, SVN merge is not smart enough. I should be able to finish the backport in a day or two, though, so waiting shouldn't be too bad. You don't need to wait for these things, and for small patches it may be feasible to manually manage the patch hacking and the 3.x merging. But for larger patches, the effort should be much smaller when the patch hacking script is available and the 3.x backport is finished. rewrite solr build system - Key: SOLR-2452 URL: https://issues.apache.org/jira/browse/SOLR-2452 Project: Solr Issue Type: Task Components: Build Reporter: Robert Muir Assignee: Steven Rowe Fix For: 3.4, 4.0 Attachments: SOLR-2452-post-reshuffling.patch, SOLR-2452-post-reshuffling.patch, SOLR-2452-post-reshuffling.patch, SOLR-2452.diffSource.py.patch.zip, SOLR-2452.dir.reshuffle.sh, SOLR-2452.dir.reshuffle.sh As discussed some in SOLR-2002 (but that issue is long and hard to follow), I think we should rewrite the solr build system. Its slow, cumbersome, and messy, and makes it hard for us to improve things. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-2452) rewrite solr build system
[ https://issues.apache.org/jira/browse/SOLR-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13061999#comment-13061999 ] Robert Muir commented on SOLR-2452: --- playing around with the branch, the whole situation looks so much better to me. in my opinion we can then go and make other little improvements, make things faster, add new targets, in separate issues... so I think you should just commit before the patch goes out of date. maybe we even encounter some serious grief, but I think we should just work thru this in svn. great work! rewrite solr build system - Key: SOLR-2452 URL: https://issues.apache.org/jira/browse/SOLR-2452 Project: Solr Issue Type: Task Components: Build Reporter: Robert Muir Assignee: Steven Rowe Fix For: 3.4, 4.0 Attachments: SOLR-2452-post-reshuffling.patch, SOLR-2452-post-reshuffling.patch, SOLR-2452-post-reshuffling.patch, SOLR-2452.diffSource.py.patch.zip, SOLR-2452.dir.reshuffle.sh, SOLR-2452.dir.reshuffle.sh As discussed some in SOLR-2002 (but that issue is long and hard to follow), I think we should rewrite the solr build system. Its slow, cumbersome, and messy, and makes it hard for us to improve things. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-2452) rewrite solr build system
[ https://issues.apache.org/jira/browse/SOLR-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13062184#comment-13062184 ] Steven Rowe commented on SOLR-2452: --- Merged with trunk, committed in r1144510. (Forgot to include issue number in log comment.) rewrite solr build system - Key: SOLR-2452 URL: https://issues.apache.org/jira/browse/SOLR-2452 Project: Solr Issue Type: Task Components: Build Reporter: Robert Muir Assignee: Steven Rowe Fix For: 3.4, 4.0 Attachments: SOLR-2452-post-reshuffling.patch, SOLR-2452-post-reshuffling.patch, SOLR-2452-post-reshuffling.patch, SOLR-2452.diffSource.py.patch.zip, SOLR-2452.dir.reshuffle.sh, SOLR-2452.dir.reshuffle.sh As discussed some in SOLR-2002 (but that issue is long and hard to follow), I think we should rewrite the solr build system. Its slow, cumbersome, and messy, and makes it hard for us to improve things. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-2452) rewrite solr build system
[ https://issues.apache.org/jira/browse/SOLR-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13051907#comment-13051907 ] Chris Male commented on SOLR-2452: -- I haven't reviewed the changes but just a comment on the philosophy: {quote} I merged solr/src/common/ into the solrj/ directory {quote} I don't hugely like this decision. Core Solr code (like SolrDocument for example) should be in Solr core, not in SolrJ which is just a client library. Like Lucene, Solr core should contain all the code it needs. Any other modules (which SolrJ can be considered as one) should then depend on the core. Whats the reason for making the choice to put the common code in SolrJ? rewrite solr build system - Key: SOLR-2452 URL: https://issues.apache.org/jira/browse/SOLR-2452 Project: Solr Issue Type: Task Components: Build Reporter: Robert Muir Fix For: 3.3 Attachments: SOLR-2452-post-reshuffling.patch, SOLR-2452.dir.reshuffle.sh As discussed some in SOLR-2002 (but that issue is long and hard to follow), I think we should rewrite the solr build system. Its slow, cumbersome, and messy, and makes it hard for us to improve things. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-2452) rewrite solr build system
[ https://issues.apache.org/jira/browse/SOLR-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13051912#comment-13051912 ] Steven Rowe commented on SOLR-2452: --- bq. Whats the reason for making the choice to put the common code in SolrJ? The current packaging arrangement has the the {{common/}} code in the solrj jar; similarly, the solr-core jar contains the {{webapp/src/}} code. The only thing I've done here is eliminated separate source directories. I haven't changed the packaging. rewrite solr build system - Key: SOLR-2452 URL: https://issues.apache.org/jira/browse/SOLR-2452 Project: Solr Issue Type: Task Components: Build Reporter: Robert Muir Fix For: 3.3 Attachments: SOLR-2452-post-reshuffling.patch, SOLR-2452.dir.reshuffle.sh As discussed some in SOLR-2002 (but that issue is long and hard to follow), I think we should rewrite the solr build system. Its slow, cumbersome, and messy, and makes it hard for us to improve things. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-2452) rewrite solr build system
[ https://issues.apache.org/jira/browse/SOLR-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13051916#comment-13051916 ] Chris Male commented on SOLR-2452: -- I see. Can we address the packaging or is that out of scope of this work? rewrite solr build system - Key: SOLR-2452 URL: https://issues.apache.org/jira/browse/SOLR-2452 Project: Solr Issue Type: Task Components: Build Reporter: Robert Muir Fix For: 3.3 Attachments: SOLR-2452-post-reshuffling.patch, SOLR-2452.dir.reshuffle.sh As discussed some in SOLR-2002 (but that issue is long and hard to follow), I think we should rewrite the solr build system. Its slow, cumbersome, and messy, and makes it hard for us to improve things. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-2452) rewrite solr build system
[ https://issues.apache.org/jira/browse/SOLR-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13051919#comment-13051919 ] Steven Rowe commented on SOLR-2452: --- bq. SolrJ [...] is just a client library That's not all it is; on 8/18/2010 on #lucene IRC, yonik wrote: bq. solrj used to not be included in the war, but solr core uses solrj for distributed search rewrite solr build system - Key: SOLR-2452 URL: https://issues.apache.org/jira/browse/SOLR-2452 Project: Solr Issue Type: Task Components: Build Reporter: Robert Muir Fix For: 3.3 Attachments: SOLR-2452-post-reshuffling.patch, SOLR-2452.dir.reshuffle.sh As discussed some in SOLR-2002 (but that issue is long and hard to follow), I think we should rewrite the solr build system. Its slow, cumbersome, and messy, and makes it hard for us to improve things. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-2452) rewrite solr build system
[ https://issues.apache.org/jira/browse/SOLR-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13051920#comment-13051920 ] Steven Rowe commented on SOLR-2452: --- bq. Can we address the packaging or is that out of scope of this work? What did you have in mind? rewrite solr build system - Key: SOLR-2452 URL: https://issues.apache.org/jira/browse/SOLR-2452 Project: Solr Issue Type: Task Components: Build Reporter: Robert Muir Fix For: 3.3 Attachments: SOLR-2452-post-reshuffling.patch, SOLR-2452.dir.reshuffle.sh As discussed some in SOLR-2002 (but that issue is long and hard to follow), I think we should rewrite the solr build system. Its slow, cumbersome, and messy, and makes it hard for us to improve things. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-2452) rewrite solr build system
[ https://issues.apache.org/jira/browse/SOLR-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13051923#comment-13051923 ] Chris Male commented on SOLR-2452: -- Hmmm I hadn't considered the issue of SolrJ being used for distributed search. rewrite solr build system - Key: SOLR-2452 URL: https://issues.apache.org/jira/browse/SOLR-2452 Project: Solr Issue Type: Task Components: Build Reporter: Robert Muir Fix For: 3.3 Attachments: SOLR-2452-post-reshuffling.patch, SOLR-2452.dir.reshuffle.sh As discussed some in SOLR-2002 (but that issue is long and hard to follow), I think we should rewrite the solr build system. Its slow, cumbersome, and messy, and makes it hard for us to improve things. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-2452) rewrite solr build system
[ https://issues.apache.org/jira/browse/SOLR-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13051928#comment-13051928 ] Chris Male commented on SOLR-2452: -- I think my comments can be addressed later on maybe and shouldn't stop these improvements from going forward so +1 rewrite solr build system - Key: SOLR-2452 URL: https://issues.apache.org/jira/browse/SOLR-2452 Project: Solr Issue Type: Task Components: Build Reporter: Robert Muir Fix For: 3.3 Attachments: SOLR-2452-post-reshuffling.patch, SOLR-2452.dir.reshuffle.sh As discussed some in SOLR-2002 (but that issue is long and hard to follow), I think we should rewrite the solr build system. Its slow, cumbersome, and messy, and makes it hard for us to improve things. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-2452) rewrite solr build system
[ https://issues.apache.org/jira/browse/SOLR-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13051939#comment-13051939 ] Robert Muir commented on SOLR-2452: --- {quote} but solrj tests depend on core tests {quote} Curious why this is? some base classes that could be moved into test-framework instead? rewrite solr build system - Key: SOLR-2452 URL: https://issues.apache.org/jira/browse/SOLR-2452 Project: Solr Issue Type: Task Components: Build Reporter: Robert Muir Fix For: 3.3 Attachments: SOLR-2452-post-reshuffling.patch, SOLR-2452.dir.reshuffle.sh As discussed some in SOLR-2002 (but that issue is long and hard to follow), I think we should rewrite the solr build system. Its slow, cumbersome, and messy, and makes it hard for us to improve things. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-2452) rewrite solr build system
[ https://issues.apache.org/jira/browse/SOLR-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13051943#comment-13051943 ] Steven Rowe commented on SOLR-2452: --- {quote} bq. but solrj tests depend on core tests Curious why this is? some base classes that could be moved into test-framework instead? {quote} At a minimum, {{o.a.s.client.solrj.SolrJettyTestBase}} (likely should be moved to another package, given that Solr core {{o.a.s.servlet.\*CacheHeaderTest\*}} tests extend this class) and {{o.a.s.util.ExternalPaths}}. rewrite solr build system - Key: SOLR-2452 URL: https://issues.apache.org/jira/browse/SOLR-2452 Project: Solr Issue Type: Task Components: Build Reporter: Robert Muir Fix For: 3.3 Attachments: SOLR-2452-post-reshuffling.patch, SOLR-2452.dir.reshuffle.sh As discussed some in SOLR-2002 (but that issue is long and hard to follow), I think we should rewrite the solr build system. Its slow, cumbersome, and messy, and makes it hard for us to improve things. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-2452) rewrite solr build system
[ https://issues.apache.org/jira/browse/SOLR-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13051953#comment-13051953 ] Robert Muir commented on SOLR-2452: --- ok, i was just curious, sounds like something that could possibly be dealt with later. I think i said it before too, I find it confusing the way these directories all depend upon each other today and how each one is not its own 'subproject' of the build (that basically acts like a contrib or module itself and states its dependencies). So I would *really* like to see this fixed. However, I think I would recommend thinking about when you want to make the change: it will make merging code up to this branch nearly impossible... is it holding back other changes or is this a final step? rewrite solr build system - Key: SOLR-2452 URL: https://issues.apache.org/jira/browse/SOLR-2452 Project: Solr Issue Type: Task Components: Build Reporter: Robert Muir Fix For: 3.3 Attachments: SOLR-2452-post-reshuffling.patch, SOLR-2452.dir.reshuffle.sh As discussed some in SOLR-2002 (but that issue is long and hard to follow), I think we should rewrite the solr build system. Its slow, cumbersome, and messy, and makes it hard for us to improve things. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-2452) rewrite solr build system
[ https://issues.apache.org/jira/browse/SOLR-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13051957#comment-13051957 ] Robert Muir commented on SOLR-2452: --- by the way, obviously since you have been doing all the work here, i don't want you to read this as me questioning/objecting to the change, just trying to maybe help save you some sanity... if you don't mind dealing with the merging I would just say go for it. rewrite solr build system - Key: SOLR-2452 URL: https://issues.apache.org/jira/browse/SOLR-2452 Project: Solr Issue Type: Task Components: Build Reporter: Robert Muir Fix For: 3.3 Attachments: SOLR-2452-post-reshuffling.patch, SOLR-2452.dir.reshuffle.sh As discussed some in SOLR-2002 (but that issue is long and hard to follow), I think we should rewrite the solr build system. Its slow, cumbersome, and messy, and makes it hard for us to improve things. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-2452) rewrite solr build system
[ https://issues.apache.org/jira/browse/SOLR-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13052250#comment-13052250 ] Steven Rowe commented on SOLR-2452: --- bq. However, I think I would recommend thinking about when you want to make the change: it will make merging code up to this branch nearly impossible... is it holding back other changes or is this a final step? It's not a final step. All of the targets you removed need to be put back (I counted 40 or so). But I think this will be a minor amount of work comparitively. I think for the moment I'll keep iterating on the patch, rather than committing it to the branch, to minimize merge costs, until I have all of the Solr targets re-implemented. I don't think it'll take too long, maybe another day or two. Once that's done, I'll commit the moves/copies from the shell script and the patch, then generate a full patch for review. Assuming there are no objections then, I plan to commit within a day or so to minimize merge costs. So I hope to have this issue resolved this week. rewrite solr build system - Key: SOLR-2452 URL: https://issues.apache.org/jira/browse/SOLR-2452 Project: Solr Issue Type: Task Components: Build Reporter: Robert Muir Fix For: 3.3, 4.0 Attachments: SOLR-2452-post-reshuffling.patch, SOLR-2452.dir.reshuffle.sh As discussed some in SOLR-2002 (but that issue is long and hard to follow), I think we should rewrite the solr build system. Its slow, cumbersome, and messy, and makes it hard for us to improve things. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-2452) rewrite solr build system
[ https://issues.apache.org/jira/browse/SOLR-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13052252#comment-13052252 ] Robert Muir commented on SOLR-2452: --- bq. So I hope to have this issue resolved this week. Really? thats awesome! Worst case, some of those top-level targets could be literally 'put back' probably with minimal modifications. My idea of temporary nuking was to try to start over, extending lucene's build system, as otherwise i got lost in all the xml. rewrite solr build system - Key: SOLR-2452 URL: https://issues.apache.org/jira/browse/SOLR-2452 Project: Solr Issue Type: Task Components: Build Reporter: Robert Muir Assignee: Steven Rowe Fix For: 3.3, 4.0 Attachments: SOLR-2452-post-reshuffling.patch, SOLR-2452.dir.reshuffle.sh As discussed some in SOLR-2002 (but that issue is long and hard to follow), I think we should rewrite the solr build system. Its slow, cumbersome, and messy, and makes it hard for us to improve things. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-2452) rewrite solr build system
[ https://issues.apache.org/jira/browse/SOLR-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13049430#comment-13049430 ] Steven Rowe commented on SOLR-2452: --- Forgot to include the issue number in the comment, so it's not showing up here, but I just committed a merge with trunk up to r1135758. Here's the ViewVC link: http://svn.apache.org/viewvc?view=revisionrevision=1135759 rewrite solr build system - Key: SOLR-2452 URL: https://issues.apache.org/jira/browse/SOLR-2452 Project: Solr Issue Type: Task Components: Build Reporter: Robert Muir Fix For: 3.3 As discussed some in SOLR-2002 (but that issue is long and hard to follow), I think we should rewrite the solr build system. Its slow, cumbersome, and messy, and makes it hard for us to improve things. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-2452) rewrite solr build system
[ https://issues.apache.org/jira/browse/SOLR-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13042434#comment-13042434 ] Robert Muir commented on SOLR-2452: --- Steven, I think there we should just set the property in lucene/common-build.xml, in the reusable 'test' target. I've already done this with a couple others if you look :) rewrite solr build system - Key: SOLR-2452 URL: https://issues.apache.org/jira/browse/SOLR-2452 Project: Solr Issue Type: Task Components: Build Reporter: Robert Muir Fix For: 3.2, 4.0 As discussed some in SOLR-2002 (but that issue is long and hard to follow), I think we should rewrite the solr build system. Its slow, cumbersome, and messy, and makes it hard for us to improve things. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-2452) rewrite solr build system
[ https://issues.apache.org/jira/browse/SOLR-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13042435#comment-13042435 ] Robert Muir commented on SOLR-2452: --- Oh, and, by the way thanks for picking up on that branch... hopefully I can come in and help soon, but its really a relief you are working on it. rewrite solr build system - Key: SOLR-2452 URL: https://issues.apache.org/jira/browse/SOLR-2452 Project: Solr Issue Type: Task Components: Build Reporter: Robert Muir Fix For: 3.2, 4.0 As discussed some in SOLR-2002 (but that issue is long and hard to follow), I think we should rewrite the solr build system. Its slow, cumbersome, and messy, and makes it hard for us to improve things. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-2452) rewrite solr build system
[ https://issues.apache.org/jira/browse/SOLR-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13042492#comment-13042492 ] Steven Rowe commented on SOLR-2452: --- bq. Steven, I think there we should just set the property in lucene/common-build.xml, in the reusable 'test' target. I've already done this with a couple others if you look :) Thanks, I added it to the junit task invocation in the test-macro definition. rewrite solr build system - Key: SOLR-2452 URL: https://issues.apache.org/jira/browse/SOLR-2452 Project: Solr Issue Type: Task Components: Build Reporter: Robert Muir Fix For: 3.2, 4.0 As discussed some in SOLR-2002 (but that issue is long and hard to follow), I think we should rewrite the solr build system. Its slow, cumbersome, and messy, and makes it hard for us to improve things. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-2452) rewrite solr build system
[ https://issues.apache.org/jira/browse/SOLR-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13038159#comment-13038159 ] Steven Rowe commented on SOLR-2452: --- Robert, I synch'd this up to trunk yesterday (and it's already out of date!), and made a few minor changes. One of the changes I made was switching the {{solr/contrib/analysis-extras/}} layout to the conventional Maven layout, to mirror all the other Solr contribs: {noformat} src/ +--- main/ |+--- java/ +--- test/ +--- java/ +--- resources/ {noformat} But I see that the layout for the new {{modules/suggest/}} module you just added (LUCENE-2995) is: {noformat} src/ +--- java/ +--- test/ {noformat} (and if it had had any test resources, I assume they would be under {{src/test-files/}}). I think there should just be one layout for all Lucene Solr modules (in the abstract sense of the word). I would be fine with switching all the Solr contribs to use the same layout as the new suggest module. Thoughts? rewrite solr build system - Key: SOLR-2452 URL: https://issues.apache.org/jira/browse/SOLR-2452 Project: Solr Issue Type: Task Components: Build Reporter: Robert Muir Fix For: 3.2, 4.0 As discussed some in SOLR-2002 (but that issue is long and hard to follow), I think we should rewrite the solr build system. Its slow, cumbersome, and messy, and makes it hard for us to improve things. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-2452) rewrite solr build system
[ https://issues.apache.org/jira/browse/SOLR-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13038196#comment-13038196 ] Robert Muir commented on SOLR-2452: --- {quote} I think there should just be one layout for all Lucene Solr modules (in the abstract sense of the word). I would be fine with switching all the Solr contribs to use the same layout as the new suggest module. {quote} +1, and thanks for iterating on this issue more! I would like to see this stuff consistent, the particulars of whatever that layout is, do not matter to me. My only thoughts are that I think this should be fixed in trunk, and also backported to branch 3.x to make merging easier... rewrite solr build system - Key: SOLR-2452 URL: https://issues.apache.org/jira/browse/SOLR-2452 Project: Solr Issue Type: Task Components: Build Reporter: Robert Muir Fix For: 3.2, 4.0 As discussed some in SOLR-2002 (but that issue is long and hard to follow), I think we should rewrite the solr build system. Its slow, cumbersome, and messy, and makes it hard for us to improve things. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-2452) rewrite solr build system
[ https://issues.apache.org/jira/browse/SOLR-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13038212#comment-13038212 ] Steven Rowe commented on SOLR-2452: --- Okay, I'll standardize on the following layout, since it's used by the vast majority of Lucene/Solr modules, and so will wreak the least havoc: {noformat} src/ +--- java/ +--- resources/ (optional) +--- test/ +--- test-files/ (optional) +--- tools/ (optional) {noformat} rewrite solr build system - Key: SOLR-2452 URL: https://issues.apache.org/jira/browse/SOLR-2452 Project: Solr Issue Type: Task Components: Build Reporter: Robert Muir Fix For: 3.2, 4.0 As discussed some in SOLR-2002 (but that issue is long and hard to follow), I think we should rewrite the solr build system. Its slow, cumbersome, and messy, and makes it hard for us to improve things. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-2452) rewrite solr build system
[ https://issues.apache.org/jira/browse/SOLR-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1301#comment-1301 ] Robert Muir commented on SOLR-2452: --- I brought my previous patch up to date and committed it to https://svn.apache.org/repos/asf/lucene/dev/branches/solr2452 i ripped all the existing stuff out of the solr build: we can always add stuff back but I wanted to start lean and mean. compile/test/clean/dependencies/etc should work, and are extended from lucene's build. appreciate anyone who wants to spend time trying to help. rewrite solr build system - Key: SOLR-2452 URL: https://issues.apache.org/jira/browse/SOLR-2452 Project: Solr Issue Type: Task Components: Build Reporter: Robert Muir Fix For: 3.2, 4.0 As discussed some in SOLR-2002 (but that issue is long and hard to follow), I think we should rewrite the solr build system. Its slow, cumbersome, and messy, and makes it hard for us to improve things. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org