[jira] [Updated] (SOLR-14507) Option to allow location override if solr.hdfs.home isn't set in backup repo

2020-06-17 Thread Haley Reeve (Jira)


 [ 
https://issues.apache.org/jira/browse/SOLR-14507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Haley Reeve updated SOLR-14507:
---
Attachment: SOLR-14507-2.patch
Status: Patch Available  (was: Patch Available)

> Option to allow location override if solr.hdfs.home isn't set in backup repo
> 
>
> Key: SOLR-14507
> URL: https://issues.apache.org/jira/browse/SOLR-14507
> Project: Solr
>  Issue Type: Improvement
>  Components: Backup/Restore
>Reporter: Haley Reeve
>Priority: Major
> Attachments: SOLR-14507-2.patch, SOLR-14507.patch
>
>
> The Solr backup/restore API has an optional parameter for specifying the 
> directory to backup to. However, the HdfsBackupRepository class doesn't use 
> this location when creating the HDFS Filesystem object. Instead it uses the 
> solr.hdfs.home setting configured in solr.xml. This functionally means that 
> the backup location, which can be passed to the API call dynamically, is 
> limited by the static home directory defined in solr.xml. This requirement 
> means that if the solr.hdfs.home path and backup location don't share the 
> same URI scheme and hostname, the backup will fail, even if the backup could 
> otherwise have been written to the specified location successfully.
> This request is to allow the option of using the location setting to 
> initialize the filesystem object.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org



[jira] [Commented] (SOLR-14507) Option to allow location override if solr.hdfs.home isn't set in backup repo

2020-06-17 Thread Haley Reeve (Jira)


[ 
https://issues.apache.org/jira/browse/SOLR-14507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17138636#comment-17138636
 ] 

Haley Reeve commented on SOLR-14507:


I've talked with [~krisden] about the approach, and modified my initial 
proposal. The new proposal adds an option setting to the HdfsBackupRepository 
config. This setting in "solr.hdfs.allow.location.override", and if set to true 
and "solr.hdfs.home" is not defined for the repo, the location will be used to 
initiate the HDFS Filesystem object.

Enabling this setting will give a user initiating a backup a lot more leeway 
over where the backup data is written, so it should be used carefully and is 
disabled by default.

> Option to allow location override if solr.hdfs.home isn't set in backup repo
> 
>
> Key: SOLR-14507
> URL: https://issues.apache.org/jira/browse/SOLR-14507
> Project: Solr
>  Issue Type: Improvement
>  Components: Backup/Restore
>Reporter: Haley Reeve
>Priority: Major
> Attachments: SOLR-14507.patch
>
>
> The Solr backup/restore API has an optional parameter for specifying the 
> directory to backup to. However, the HdfsBackupRepository class doesn't use 
> this location when creating the HDFS Filesystem object. Instead it uses the 
> solr.hdfs.home setting configured in solr.xml. This functionally means that 
> the backup location, which can be passed to the API call dynamically, is 
> limited by the static home directory defined in solr.xml. This requirement 
> means that if the solr.hdfs.home path and backup location don't share the 
> same URI scheme and hostname, the backup will fail, even if the backup could 
> otherwise have been written to the specified location successfully.
> This request is to allow the option of using the location setting to 
> initialize the filesystem object.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org



[jira] [Updated] (SOLR-14507) Option to allow location override if solr.hdfs.home isn't set in backup repo

2020-06-17 Thread Haley Reeve (Jira)


 [ 
https://issues.apache.org/jira/browse/SOLR-14507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Haley Reeve updated SOLR-14507:
---
Description: 
The Solr backup/restore API has an optional parameter for specifying the 
directory to backup to. However, the HdfsBackupRepository class doesn't use 
this location when creating the HDFS Filesystem object. Instead it uses the 
solr.hdfs.home setting configured in solr.xml. This functionally means that the 
backup location, which can be passed to the API call dynamically, is limited by 
the static home directory defined in solr.xml. This requirement means that if 
the solr.hdfs.home path and backup location don't share the same URI scheme and 
hostname, the backup will fail, even if the backup could otherwise have been 
written to the specified location successfully.

This request is to allow the option of using the location setting to initialize 
the filesystem object.

  was:
The Solr backup/restore API has an optional parameter for specifying the 
directory to backup to. However, the HdfsBackupRepository class doesn't use 
this location when creating the HDFS Filesystem object. Instead it uses the 
solr.hdfs.home setting configured in solr.xml. This functionally means that the 
backup location, which can be passed to the API call dynamically, is limited by 
the static home directory defined in solr.xml. This requirement means that if 
the solr.hdfs.home path and backup location don't share the same URI scheme and 
hostname, the backup will fail, even if the backup could otherwise have been 
written to the specified location successfully.

If we had the option to pass the solr.hdfs.home path as part of the API call, 
it would remove this limitation on the backup location.


> Option to allow location override if solr.hdfs.home isn't set in backup repo
> 
>
> Key: SOLR-14507
> URL: https://issues.apache.org/jira/browse/SOLR-14507
> Project: Solr
>  Issue Type: Improvement
>  Components: Backup/Restore
>Reporter: Haley Reeve
>Priority: Major
> Attachments: SOLR-14507.patch
>
>
> The Solr backup/restore API has an optional parameter for specifying the 
> directory to backup to. However, the HdfsBackupRepository class doesn't use 
> this location when creating the HDFS Filesystem object. Instead it uses the 
> solr.hdfs.home setting configured in solr.xml. This functionally means that 
> the backup location, which can be passed to the API call dynamically, is 
> limited by the static home directory defined in solr.xml. This requirement 
> means that if the solr.hdfs.home path and backup location don't share the 
> same URI scheme and hostname, the backup will fail, even if the backup could 
> otherwise have been written to the specified location successfully.
> This request is to allow the option of using the location setting to 
> initialize the filesystem object.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org



[jira] [Updated] (SOLR-14507) Option to allow location override if solr.hdfs.home isn't set in backup repo

2020-06-17 Thread Haley Reeve (Jira)


 [ 
https://issues.apache.org/jira/browse/SOLR-14507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Haley Reeve updated SOLR-14507:
---
Summary: Option to allow location override if solr.hdfs.home isn't set in 
backup repo  (was: Option to pass solr.hdfs.home in API backup/restore calls)

> Option to allow location override if solr.hdfs.home isn't set in backup repo
> 
>
> Key: SOLR-14507
> URL: https://issues.apache.org/jira/browse/SOLR-14507
> Project: Solr
>  Issue Type: Improvement
>  Components: Backup/Restore
>Reporter: Haley Reeve
>Priority: Major
> Attachments: SOLR-14507.patch
>
>
> The Solr backup/restore API has an optional parameter for specifying the 
> directory to backup to. However, the HdfsBackupRepository class doesn't use 
> this location when creating the HDFS Filesystem object. Instead it uses the 
> solr.hdfs.home setting configured in solr.xml. This functionally means that 
> the backup location, which can be passed to the API call dynamically, is 
> limited by the static home directory defined in solr.xml. This requirement 
> means that if the solr.hdfs.home path and backup location don't share the 
> same URI scheme and hostname, the backup will fail, even if the backup could 
> otherwise have been written to the specified location successfully.
> If we had the option to pass the solr.hdfs.home path as part of the API call, 
> it would remove this limitation on the backup location.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org



[jira] [Updated] (SOLR-14507) Option to pass solr.hdfs.home in API backup/restore calls

2020-05-21 Thread Haley Reeve (Jira)


 [ 
https://issues.apache.org/jira/browse/SOLR-14507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Haley Reeve updated SOLR-14507:
---
Status: Patch Available  (was: Open)

> Option to pass solr.hdfs.home in API backup/restore calls
> -
>
> Key: SOLR-14507
> URL: https://issues.apache.org/jira/browse/SOLR-14507
> Project: Solr
>  Issue Type: Improvement
>  Security Level: Public(Default Security Level. Issues are Public) 
>  Components: Backup/Restore
>Reporter: Haley Reeve
>Priority: Major
> Attachments: SOLR-14507.patch
>
>
> The Solr backup/restore API has an optional parameter for specifying the 
> directory to backup to. However, the HdfsBackupRepository class doesn't use 
> this location when creating the HDFS Filesystem object. Instead it uses the 
> solr.hdfs.home setting configured in solr.xml. This functionally means that 
> the backup location, which can be passed to the API call dynamically, is 
> limited by the static home directory defined in solr.xml. This requirement 
> means that if the solr.hdfs.home path and backup location don't share the 
> same URI scheme and hostname, the backup will fail, even if the backup could 
> otherwise have been written to the specified location successfully.
> If we had the option to pass the solr.hdfs.home path as part of the API call, 
> it would remove this limitation on the backup location.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org



[jira] [Updated] (SOLR-14507) Option to pass solr.hdfs.home in API backup/restore calls

2020-05-21 Thread Haley Reeve (Jira)


 [ 
https://issues.apache.org/jira/browse/SOLR-14507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Haley Reeve updated SOLR-14507:
---
Attachment: SOLR-14507.patch
Status: Open  (was: Open)

> Option to pass solr.hdfs.home in API backup/restore calls
> -
>
> Key: SOLR-14507
> URL: https://issues.apache.org/jira/browse/SOLR-14507
> Project: Solr
>  Issue Type: Improvement
>  Security Level: Public(Default Security Level. Issues are Public) 
>  Components: Backup/Restore
>Reporter: Haley Reeve
>Priority: Major
> Attachments: SOLR-14507.patch
>
>
> The Solr backup/restore API has an optional parameter for specifying the 
> directory to backup to. However, the HdfsBackupRepository class doesn't use 
> this location when creating the HDFS Filesystem object. Instead it uses the 
> solr.hdfs.home setting configured in solr.xml. This functionally means that 
> the backup location, which can be passed to the API call dynamically, is 
> limited by the static home directory defined in solr.xml. This requirement 
> means that if the solr.hdfs.home path and backup location don't share the 
> same URI scheme and hostname, the backup will fail, even if the backup could 
> otherwise have been written to the specified location successfully.
> If we had the option to pass the solr.hdfs.home path as part of the API call, 
> it would remove this limitation on the backup location.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org



[jira] [Created] (SOLR-14507) Option to pass solr.hdfs.home in API backup/restore calls

2020-05-21 Thread Haley Reeve (Jira)
Haley Reeve created SOLR-14507:
--

 Summary: Option to pass solr.hdfs.home in API backup/restore calls
 Key: SOLR-14507
 URL: https://issues.apache.org/jira/browse/SOLR-14507
 Project: Solr
  Issue Type: Improvement
  Security Level: Public (Default Security Level. Issues are Public)
  Components: Backup/Restore
Reporter: Haley Reeve


The Solr backup/restore API has an optional parameter for specifying the 
directory to backup to. However, the HdfsBackupRepository class doesn't use 
this location when creating the HDFS Filesystem object. Instead it uses the 
solr.hdfs.home setting configured in solr.xml. This functionally means that the 
backup location, which can be passed to the API call dynamically, is limited by 
the static home directory defined in solr.xml. This requirement means that if 
the solr.hdfs.home path and backup location don't share the same URI scheme and 
hostname, the backup will fail, even if the backup could otherwise have been 
written to the specified location successfully.

If we had the option to pass the solr.hdfs.home path as part of the API call, 
it would remove this limitation on the backup location.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org