Re: project related configsets need to be deployed in both data and solr install folders ?

[Renee Sun]

thanks for your time!



--
View this message in context: 
http://lucene.472066.n3.nabble.com/project-related-configsets-need-to-be-deployed-in-both-data-and-solr-install-folders-tp4317897p4318382.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: project related configsets need to be deployed in both data and solr install folders ?

[Chris Hostetter]

Renee: Huh ... so sounds like something must have been wonky in your 
original install?

Glad it worked out for you, and thanks for following up.


: Date: Wed, 1 Feb 2017 15:09:54 -0700 (MST)
: From: Renee Sun 
: Reply-To: solr-user@lucene.apache.org
: To: solr-user@lucene.apache.org
: Subject: Re: project related configsets need to be deployed in both data and
: solr install folders ?
: 
: Hi Chris,
: since I have been playing with this install, and I am not certain if I have
: unknowingly messed some other settings. I want to avoid put in a false Jira
: wasting your time. 
: 
: I wiped out everything on my solr box and did  a fresh install of solr
: 6.4.0, made sure my config file set are placed in the data folder (
: /myprojectdata/solr/data/configsets/myproject_configs ).  My solr home is
: set to  /myprojectdata/solr/data , it is WORKING now.
: 
: I did not have to specify configSetBaseDir in the solr.xml (its in the data
: folder  /myprojectdata/solr/data/solr.xml, NOT the one in install folder
: /opt/solr/server/solr/solr.xml), the default correctly point at the solr
: home which is my data folder, and find the config file set.
: 
: So there is no problem, everything works fine, I can create new core without
: any issue. There is no bug whatsoever.
: 
: Thank you for all your help!
: 
: 
: 
: 
: --
: View this message in context: 
http://lucene.472066.n3.nabble.com/project-related-configsets-need-to-be-deployed-in-both-data-and-solr-install-folders-tp4317897p4318369.html
: Sent from the Solr - User mailing list archive at Nabble.com.
: 

-Hoss
http://www.lucidworks.com/

Re: project related configsets need to be deployed in both data and solr install folders ?

[Renee Sun]

Hi Chris,
since I have been playing with this install, and I am not certain if I have
unknowingly messed some other settings. I want to avoid put in a false Jira
wasting your time. 

I wiped out everything on my solr box and did  a fresh install of solr
6.4.0, made sure my config file set are placed in the data folder (
/myprojectdata/solr/data/configsets/myproject_configs ).  My solr home is
set to  /myprojectdata/solr/data , it is WORKING now.

I did not have to specify configSetBaseDir in the solr.xml (its in the data
folder  /myprojectdata/solr/data/solr.xml, NOT the one in install folder
/opt/solr/server/solr/solr.xml), the default correctly point at the solr
home which is my data folder, and find the config file set.

So there is no problem, everything works fine, I can create new core without
any issue. There is no bug whatsoever.

Thank you for all your help!




--
View this message in context: 
http://lucene.472066.n3.nabble.com/project-related-configsets-need-to-be-deployed-in-both-data-and-solr-install-folders-tp4317897p4318369.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: project related configsets need to be deployed in both data and solr install folders ?

[Chris Hostetter]

Based on your description of the problem, and the fact that explicitly 
setting configSetBaseDir in your solr.xml works, I suspect there is some 
sort of weird bug in how the "default" configSetBaseDir is determined in 
some diff code paths in Solr.

We should definitely file a jira issue tracking this -- i would have done 
so already, but to be completley honest: I got a little lost in reading 
your initial email as far as how you have solr installed, and how you are 
running it.

Can you please create a new "Solr" jira here...

https://issues.apache.org/jira/secure/CreateIssue!default.jspa

... and include the following details...

1) a description of how you installed solr - directory listings of 
the various dirs making it clear which files are where would be helpful.  

2) a copy of the solr.in.sh * solr.xml files for each "project"

3) an example of exactly how you start solr (ie: the exact bin/solr 
command you run)

4) the exact error you get when creating a collection depending on which 
directory does/doesn't contain a configset.

(Ideally: to make it really clear what's going on, it would be great if 
you could run this test with a "foo" configset in one dir, and a "bar" 
configset in the other dir, and show us what the diff error messages look 
like depending on which configset you try to use)

5) note how things change when you add configSetBaseDir



Does that make sense?





: Date: Tue, 31 Jan 2017 16:38:33 -0700 (MST)
: From: Renee Sun 
: Reply-To: solr-user@lucene.apache.org
: To: solr-user@lucene.apache.org
: Subject: Re: project related configsets need to be deployed in both data and
: solr install folders ?
: 
: Thanks Erick!
: 
: I looked at solr twiki though if configSetBaseDir is not set, the default
: should be SOLR_HOME/configsets:
: 
: configSetBaseDir
: 
:   The directory under which configsets for solr cores can be found. 
Defaults
: to SOLR_HOME/configsets
: 
: and I do have my solr started with :
: 
: -Dsolr.solr.home=/myprojectdata/solr/data
: 
: I also deploy my config into:
: 
: /myprojectdata/solr/data/configsets/myproject_configs
: 
: anyways, looks like the default is not working?
: 
: I found this https://issues.apache.org/jira/browse/SOLR-6158, which seems to
: talk about the configSetBaseDir issue ...
: 
: I do set configSetBaseDir in solr.xml and it works now. Just wonder why the
: default wont work. Or I might did something else wrong.
: 
: 
: 
: 
: 
: --
: View this message in context: 
http://lucene.472066.n3.nabble.com/project-related-configsets-need-to-be-deployed-in-both-data-and-solr-install-folders-tp4317897p4318163.html
: Sent from the Solr - User mailing list archive at Nabble.com.
: 

-Hoss
http://www.lucidworks.com/

Re: project related configsets need to be deployed in both data and solr install folders ?

[Renee Sun]

Thanks Erick!

I looked at solr twiki though if configSetBaseDir is not set, the default
should be SOLR_HOME/configsets:

configSetBaseDir

The directory under which configsets for solr cores can be found. 
Defaults
to SOLR_HOME/configsets

and I do have my solr started with :

-Dsolr.solr.home=/myprojectdata/solr/data

I also deploy my config into:

/myprojectdata/solr/data/configsets/myproject_configs

anyways, looks like the default is not working?

I found this https://issues.apache.org/jira/browse/SOLR-6158, which seems to
talk about the configSetBaseDir issue ...

I do set configSetBaseDir in solr.xml and it works now. Just wonder why the
default wont work. Or I might did something else wrong.





--
View this message in context: 
http://lucene.472066.n3.nabble.com/project-related-configsets-need-to-be-deployed-in-both-data-and-solr-install-folders-tp4317897p4318163.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: project related configsets need to be deployed in both data and solr install folders ?

[Erick Erickson]

Hmmm, did you try specifying the configSetBaseDir in solr.xml? See:
https://cwiki.apache.org/confluence/display/solr/Format+of+solr.xml


Best,
Erick

On Mon, Jan 30, 2017 at 3:54 PM, Renee Sun  wrote:
> Hi -
>
> We use separate solr install and data folders with a shared schema/config
> (configsets) in multi-cores setup, it seems the configsets need to be
> deployed in both places (we are running solr 6.4.0)?
>
> for example,
>
> solr is installed in /opt/solr, thus there is folder:
>
> /opt/solr/server/solr/configsets
>
> we separate the data into a different partition, thus there is:
>
> /mysolrdata/solr/data/configsets
>
> At first, I only deployed the project configsets to the solr install folder
> /opt/solr/server/solr/configsets :
>
> /opt/solr/server/solr/configsets/myproject_configs
>
> then when I create a core, solr complains it could not load config from
> /mysolrdata/solr/data/configsets/myproject_configs (the data folder):
>
> curl
> 'http://localhost:8983/solr/admin/cores?action=CREATE=abc=abc=myproject_configs'
> 
> 
> 400 name="QTime">14 name="error-class">org.apache.solr.common.SolrException name="root-error-class">org.apache.solr.common.SolrException name="msg">Error CREATEing SolrCore 'abc': Unable to create core [abc]
> Caused by: Could not load configuration from directory
> /mysolrdata/solr/data/configsets/myproject_configs name="code">400
> 
>
> So next, I moved the configs to /mysolrdata/solr/data/configsets, but it now
> complains it could not load config from the install folder
> /opt/solr/server/solr/configsets/myproject_configs with the same error.
>
> I had to copy the same config set to both folders ( I eventually did a
> symlink from the /opt/solr/server/solr/configsets/myproject_configs to
> /mysolrdata/solr/data/configsets), and it worked.
>
> I wonder if I have missed any settings to allow me only deploy the configset
> at one place: either my data folder or the install folder, I would assume
> the benefit is obvious.
>
> Thanks
> Renee
>
>
>
>
>
>
> --
> View this message in context: 
> http://lucene.472066.n3.nabble.com/project-related-configsets-need-to-be-deployed-in-both-data-and-solr-install-folders-tp4317897.html
> Sent from the Solr - User mailing list archive at Nabble.com.

project related configsets need to be deployed in both data and solr install folders ?

[Renee Sun]

Hi -

We use separate solr install and data folders with a shared schema/config
(configsets) in multi-cores setup, it seems the configsets need to be
deployed in both places (we are running solr 6.4.0)?

for example, 

solr is installed in /opt/solr, thus there is folder:

/opt/solr/server/solr/configsets

we separate the data into a different partition, thus there is:

/mysolrdata/solr/data/configsets

At first, I only deployed the project configsets to the solr install folder
/opt/solr/server/solr/configsets :

/opt/solr/server/solr/configsets/myproject_configs

then when I create a core, solr complains it could not load config from
/mysolrdata/solr/data/configsets/myproject_configs (the data folder):

curl
'http://localhost:8983/solr/admin/cores?action=CREATE=abc=abc=myproject_configs'


40014org.apache.solr.common.SolrExceptionorg.apache.solr.common.SolrExceptionError CREATEing SolrCore 'abc': Unable to create core [abc]
Caused by: Could not load configuration from directory
/mysolrdata/solr/data/configsets/myproject_configs400


So next, I moved the configs to /mysolrdata/solr/data/configsets, but it now
complains it could not load config from the install folder
/opt/solr/server/solr/configsets/myproject_configs with the same error.

I had to copy the same config set to both folders ( I eventually did a
symlink from the /opt/solr/server/solr/configsets/myproject_configs to
/mysolrdata/solr/data/configsets), and it worked.

I wonder if I have missed any settings to allow me only deploy the configset
at one place: either my data folder or the install folder, I would assume
the benefit is obvious.

Thanks
Renee






--
View this message in context: 
http://lucene.472066.n3.nabble.com/project-related-configsets-need-to-be-deployed-in-both-data-and-solr-install-folders-tp4317897.html
Sent from the Solr - User mailing list archive at Nabble.com.