[jira] [Commented] (SOLR-2610) Add an option to delete index through CoreAdmin UNLOAD action

2011-06-24 Thread Shalin Shekhar Mangar (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-2610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13054316#comment-13054316
 ] 

Shalin Shekhar Mangar commented on SOLR-2610:
-

bq. But you might want to (in fact, I do this). If you are really done with a 
core, if you really want to remove it, what do you need the config files around 
for anymore?

I was approaching this particular issue more from the angle of making it useful 
for SolrCloud. I can see how deleting configs can be useful to some people but 
is it worth introducing such an inconsistency i.e. you can delete config but 
cannot add it back? Anyways, it is best handled via a separate issue.

 Add an option to delete index through CoreAdmin UNLOAD action
 -

 Key: SOLR-2610
 URL: https://issues.apache.org/jira/browse/SOLR-2610
 Project: Solr
  Issue Type: Improvement
  Components: multicore
Reporter: Shalin Shekhar Mangar
Assignee: Shalin Shekhar Mangar
Priority: Minor
 Fix For: 3.3, 4.0

 Attachments: SOLR-2610-branch3x.patch, SOLR-2610.patch


 Right now, one can unload a Solr Core but the index files are left behind and 
 consume disk space. We should have an option to delete the index when 
 unloading a core.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira



-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-2610) Add an option to delete index through CoreAdmin UNLOAD action

2011-06-24 Thread Shalin Shekhar Mangar (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-2610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13054320#comment-13054320
 ] 

Shalin Shekhar Mangar commented on SOLR-2610:
-

{quote}
I can think of a corollary core action I'd like to see – the ability on a core 
RELOAD to entirely delete the index from a core and replace it with a fresh 
empty index that will start building at segment _0. I would do this to my 
build core before using it, and later after swapping it with the live core 
and ensuring it's good, to free up disk space.
{quote}

Shawn, that is not a use-case for RELOAD. The idea behind it is to reload an 
existing core's index with updated configuration changes and swap it with the 
existing core without causing downtime. It seems like your use-case is handled 
well with the stock CREATE, SWAP and UNLOAD+deleteIndex?

 Add an option to delete index through CoreAdmin UNLOAD action
 -

 Key: SOLR-2610
 URL: https://issues.apache.org/jira/browse/SOLR-2610
 Project: Solr
  Issue Type: Improvement
  Components: multicore
Reporter: Shalin Shekhar Mangar
Assignee: Shalin Shekhar Mangar
Priority: Minor
 Fix For: 3.3, 4.0

 Attachments: SOLR-2610-branch3x.patch, SOLR-2610.patch


 Right now, one can unload a Solr Core but the index files are left behind and 
 consume disk space. We should have an option to delete the index when 
 unloading a core.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira



-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-2610) Add an option to delete index through CoreAdmin UNLOAD action

2011-06-24 Thread Mark Miller (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-2610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13054415#comment-13054415
 ] 

Mark Miller commented on SOLR-2610:
---

bq.I was approaching this particular issue more from the angle of making it 
useful for SolrCloud. 

where do you mention how this helps with SolrCloud?

bq. I can see how deleting configs can be useful to some people but is it worth 
introducing such an inconsistency i.e. you can delete config but cannot add it 
back? Anyways, it is best handled via a separate issue.

Why are you deleting cores only to add them back again with the same config? Do 
you really think it's inconsistent to actually be able to delete something? 
Does it really seem like a weird use case to say, I want to delete a SolrCore I 
no longer have an interest in?

Looks like a few people have an interest in this issue, so I'm not sure why you 
rammed it in so quickly.

 Add an option to delete index through CoreAdmin UNLOAD action
 -

 Key: SOLR-2610
 URL: https://issues.apache.org/jira/browse/SOLR-2610
 Project: Solr
  Issue Type: Improvement
  Components: multicore
Reporter: Shalin Shekhar Mangar
Assignee: Shalin Shekhar Mangar
Priority: Minor
 Fix For: 3.3, 4.0

 Attachments: SOLR-2610-branch3x.patch, SOLR-2610.patch


 Right now, one can unload a Solr Core but the index files are left behind and 
 consume disk space. We should have an option to delete the index when 
 unloading a core.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira



-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-2610) Add an option to delete index through CoreAdmin UNLOAD action

2011-06-24 Thread Shalin Shekhar Mangar (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-2610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13054443#comment-13054443
 ] 

Shalin Shekhar Mangar commented on SOLR-2610:
-

bq. where do you mention how this helps with SolrCloud?

I didn't and I'm sorry about that. I was just trying to tell you my 
perspective. These are small pieces that need to be fixed before tackling 
larger problems in SolrCloud and this one seemed generally useful and simple 
enough by itself that I opened the issue without giving the bigger picture. 
Some of the other pieces are captured in SOLR-2595

bq. Why are you deleting cores only to add them back again with the same config?

Hopefully SOLR-2595 will give you a better idea of what I was thinking. The 
use-case is to split and migrate pieces of an index and this issue will help in 
deleting the leftover temporary cores.

bq. Do you really think it's inconsistent to actually be able to delete 
something?
The inconsistency is to be able to delete a configuration file when there is no 
way to add it back but I'm not against the feature in general.

bq. Does it really seem like a weird use case to say, I want to delete a 
SolrCore I no longer have an interest in?
Absolutely not. If you want that feature, that's fine. You don't need 
permissions to put up a patch and commit it :)

bq. Looks like a few people have an interest in this issue, so I'm not sure why 
you rammed it in so quickly.

The issue clearly talks about deleting index on unload and that's what it does. 
And I got a +1 from you and Jason on the topic of the issue (or at least, 
that's what I assumed). I waited a day to commit - would you like me to wait 
longer for future issues or leave a comment to that effect? If the patch is not 
what you intended, go ahead and reopen/extend the scope of the issue or open 
another issue.

 Add an option to delete index through CoreAdmin UNLOAD action
 -

 Key: SOLR-2610
 URL: https://issues.apache.org/jira/browse/SOLR-2610
 Project: Solr
  Issue Type: Improvement
  Components: multicore
Reporter: Shalin Shekhar Mangar
Assignee: Shalin Shekhar Mangar
Priority: Minor
 Fix For: 3.3, 4.0

 Attachments: SOLR-2610-branch3x.patch, SOLR-2610.patch


 Right now, one can unload a Solr Core but the index files are left behind and 
 consume disk space. We should have an option to delete the index when 
 unloading a core.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira



-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-2610) Add an option to delete index through CoreAdmin UNLOAD action

2011-06-24 Thread Mark Miller (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-2610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13054450#comment-13054450
 ] 

Mark Miller commented on SOLR-2610:
---

bq. And I got a +1 from you and Jason on the topic of the issue (or at least, 
that's what I assumed). I waited a day to commit - would you like me to wait 
longer for future issues or leave a comment to that effect? 

No, I think a day is fine - just warning perhaps? Both Jason and I liked the 
idea, but it just seemed like we where discussing some of the details and you 
committed kind of without warning. I'm not that concerned about it, just 
mentioning it.

bq. If the patch is not what you intended, go ahead and reopen/extend the scope 
of the issue or open another issue.

I think the patch is fine - I've tweaked a couple little things on the changes 
entry, but the patch itself looks good so far. I opened SOLR-2621 to continue 
the other 'delete options' discussion.

 Add an option to delete index through CoreAdmin UNLOAD action
 -

 Key: SOLR-2610
 URL: https://issues.apache.org/jira/browse/SOLR-2610
 Project: Solr
  Issue Type: Improvement
  Components: multicore
Reporter: Shalin Shekhar Mangar
Assignee: Shalin Shekhar Mangar
Priority: Minor
 Fix For: 3.3, 4.0

 Attachments: SOLR-2610-branch3x.patch, SOLR-2610.patch


 Right now, one can unload a Solr Core but the index files are left behind and 
 consume disk space. We should have an option to delete the index when 
 unloading a core.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira



-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-2610) Add an option to delete index through CoreAdmin UNLOAD action

2011-06-24 Thread Shawn Heisey (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-2610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13054489#comment-13054489
 ] 

Shawn Heisey commented on SOLR-2610:


bq. Shawn, that is not a use-case for RELOAD. The idea behind it is to reload 
an existing core's index with updated configuration changes and swap it with 
the existing core without causing downtime. It seems like your use-case is 
handled well with the stock CREATE, SWAP and UNLOAD+deleteIndex?

CREATE requires that the caller be aware of internal server filesystem 
structures.  For the typical use of CREATE, this is not really a problem, but 
if what you're trying to do is unload a core, delete its index, and then 
immediately recreate it with the same config, it would be very nice to not have 
to specify (or even know) the solr.xml configuration bits.

In this particular case, the person who writes the scripts is the same person 
who maintains the Solr infrastructure (me) ... but that might not always be the 
case.  Currently the build scripts don't know anything about the internal 
structure other than core names, and I'd like to keep it that way.

Adding an option like deleteIndex to RELOAD seemed a logical way to handle 
this, since currently (1.4.1) I have to completely restart Solr when I wipe out 
an index directory.  If this is not a logical progression, I would argue that 
CoreAdmin needs an entirely new action.  Either way, if it's deemed desirable, 
it needs its own Jira issue.  I brought it up here because it's at least 
tangentially related.


 Add an option to delete index through CoreAdmin UNLOAD action
 -

 Key: SOLR-2610
 URL: https://issues.apache.org/jira/browse/SOLR-2610
 Project: Solr
  Issue Type: Improvement
  Components: multicore
Reporter: Shalin Shekhar Mangar
Assignee: Shalin Shekhar Mangar
Priority: Minor
 Fix For: 3.3, 4.0

 Attachments: SOLR-2610-branch3x.patch, SOLR-2610.patch


 Right now, one can unload a Solr Core but the index files are left behind and 
 consume disk space. We should have an option to delete the index when 
 unloading a core.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira



-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-2610) Add an option to delete index through CoreAdmin UNLOAD action

2011-06-23 Thread Mark Miller (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-2610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13053870#comment-13053870
 ] 

Mark Miller commented on SOLR-2610:
---

But you *might* want to (in fact, I do this). If you are really done with a 
core, if you *really* want to remove it, what do you need the config files 
around for anymore? Seems like a reasonable option to me - makes no sense as 
the default I'd agree with.

nukeEverything=true ;)

 Add an option to delete index through CoreAdmin UNLOAD action
 -

 Key: SOLR-2610
 URL: https://issues.apache.org/jira/browse/SOLR-2610
 Project: Solr
  Issue Type: Improvement
  Components: multicore
Reporter: Shalin Shekhar Mangar
Assignee: Shalin Shekhar Mangar
Priority: Minor
 Fix For: 3.3, 4.0

 Attachments: SOLR-2610-branch3x.patch, SOLR-2610.patch


 Right now, one can unload a Solr Core but the index files are left behind and 
 consume disk space. We should have an option to delete the index when 
 unloading a core.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira



-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-2610) Add an option to delete index through CoreAdmin UNLOAD action

2011-06-23 Thread Jason Rutherglen (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-2610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13053992#comment-13053992
 ] 

Jason Rutherglen commented on SOLR-2610:


Mark put it aptly.  The problem I think I encountered in my own version is left 
over file handles seemed to be preventing the deletion of all the files, many 
times some of them would be left over.  Also I deleted the entire core 
directory, which is useful for manual testing (eg, to avoid the directory 
exists exception).

 Add an option to delete index through CoreAdmin UNLOAD action
 -

 Key: SOLR-2610
 URL: https://issues.apache.org/jira/browse/SOLR-2610
 Project: Solr
  Issue Type: Improvement
  Components: multicore
Reporter: Shalin Shekhar Mangar
Assignee: Shalin Shekhar Mangar
Priority: Minor
 Fix For: 3.3, 4.0

 Attachments: SOLR-2610-branch3x.patch, SOLR-2610.patch


 Right now, one can unload a Solr Core but the index files are left behind and 
 consume disk space. We should have an option to delete the index when 
 unloading a core.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira



-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-2610) Add an option to delete index through CoreAdmin UNLOAD action

2011-06-23 Thread Shawn Heisey (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-2610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13054079#comment-13054079
 ] 

Shawn Heisey commented on SOLR-2610:


I can think of a corollary core action I'd like to see -- the ability on a core 
RELOAD to entirely delete the index from a core and replace it with a fresh 
empty index that will start building at segment _0.  I would do this to my 
build core before using it, and later after swapping it with the live core 
and ensuring it's good, to free up disk space.

 Add an option to delete index through CoreAdmin UNLOAD action
 -

 Key: SOLR-2610
 URL: https://issues.apache.org/jira/browse/SOLR-2610
 Project: Solr
  Issue Type: Improvement
  Components: multicore
Reporter: Shalin Shekhar Mangar
Assignee: Shalin Shekhar Mangar
Priority: Minor
 Fix For: 3.3, 4.0

 Attachments: SOLR-2610-branch3x.patch, SOLR-2610.patch


 Right now, one can unload a Solr Core but the index files are left behind and 
 consume disk space. We should have an option to delete the index when 
 unloading a core.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira



-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-2610) Add an option to delete index through CoreAdmin UNLOAD action

2011-06-22 Thread Shalin Shekhar Mangar (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-2610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13053650#comment-13053650
 ] 

Shalin Shekhar Mangar commented on SOLR-2610:
-

Which other files do you want to remove? In order to create a core, all 
required configuration files must already be present on the disk. I did not 
want to remove files during unload which I cannot later add to a host through 
the admin interfaces.

 Add an option to delete index through CoreAdmin UNLOAD action
 -

 Key: SOLR-2610
 URL: https://issues.apache.org/jira/browse/SOLR-2610
 Project: Solr
  Issue Type: Improvement
  Components: multicore
Reporter: Shalin Shekhar Mangar
Assignee: Shalin Shekhar Mangar
Priority: Minor
 Fix For: 3.3, 4.0

 Attachments: SOLR-2610-branch3x.patch, SOLR-2610.patch


 Right now, one can unload a Solr Core but the index files are left behind and 
 consume disk space. We should have an option to delete the index when 
 unloading a core.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira



-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-2610) Add an option to delete index through CoreAdmin UNLOAD action

2011-06-21 Thread Jason Rutherglen (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-2610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13052624#comment-13052624
 ] 

Jason Rutherglen commented on SOLR-2610:


This is good!  I had to write the same functionality into a custom Solr build 
on a project.

 Add an option to delete index through CoreAdmin UNLOAD action
 -

 Key: SOLR-2610
 URL: https://issues.apache.org/jira/browse/SOLR-2610
 Project: Solr
  Issue Type: Improvement
  Components: multicore
Reporter: Shalin Shekhar Mangar
Assignee: Shalin Shekhar Mangar
Priority: Minor
 Fix For: 3.3, 4.0

 Attachments: SOLR-2610.patch


 Right now, one can unload a Solr Core but the index files are left behind and 
 consume disk space. We should have an option to delete the index when 
 unloading a core.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira



-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-2610) Add an option to delete index through CoreAdmin UNLOAD action

2011-06-20 Thread Mark Miller (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-2610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13051948#comment-13051948
 ] 

Mark Miller commented on SOLR-2610:
---

+1

 Add an option to delete index through CoreAdmin UNLOAD action
 -

 Key: SOLR-2610
 URL: https://issues.apache.org/jira/browse/SOLR-2610
 Project: Solr
  Issue Type: Improvement
  Components: multicore
Reporter: Shalin Shekhar Mangar
Assignee: Shalin Shekhar Mangar
Priority: Minor
 Fix For: 3.3, 4.0


 Right now, one can unload a Solr Core but the index files are left behind and 
 consume disk space. We should have an option to delete the index when 
 unloading a core.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira



-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org