Re: Solr with HDFS configuration example running in production/dev

Cloudera's default configuration for the HDFSDirectoryFactory is very similar to yours in solrconfig.xml. The solr.hdfs.home property is provided as a java property during Solr startup and we haven't seen the ":"

Re: Solr with HDFS configuration example running in production/dev

Hi Joe, Yes I had made these changes for getting HDFS to work with Solr. Below are config changes which I carried out: Changes in solr.in.cmd set SOLR_OPTS=%SOLR_OPTS% -Dsolr.directoryFactory=HdfsDirectoryFactory set

Re: Solr with HDFS configuration example running in production/dev

Are you running with solr.lock.type=hdfs ? Have you defined your DirectoryFactory - something like:     true     true     43     name="solr.hdfs.blockcache.direct.memory.allocation">true     16384     true     true     128     1024    

Re: Solr with HDFS configuration example running in production/dev

HDFS will still be there, just NOT on the core package, but as a plug-in or contrib. > On Aug 20, 2020, at 11:07 AM, Aroop Ganguly wrote: > > HDFS will still be there, just on the core package, but as a plug-in or > contrib.

Re: Solr with HDFS configuration example running in production/dev

HDFS will still be there, just on the core package, but as a plug-in or contrib. > On Aug 19, 2020, at 7:50 AM, Prashant Jyoti wrote: > > You're right Andrew. Even I read about that. But there's a use case for > which we want to configure the said case. > > Are you also aware of what feature

Re: Solr with HDFS configuration example running in production/dev

We have seen The : issue with hdfs With hbase and it won’t allow any IO if hdfs sees a : in a path. We found this with a storage array that uses snapshots and had dates and times in a path with a : I assume this is the exact same problem we have seen with HD FS. The : character does not need to

Re: Solr with HDFS configuration example running in production/dev

BTW thank you for your exception stack trace, I am now reading about https://webtide.com/eat-what-you-kill/ The name of the strategy catched my eyes! On Thu, Aug 20, 2020 at 8:25 AM Prashant Jyoti wrote: > Hi Joe, > These are the errors I am running into: > >

Re: Solr with HDFS configuration example running in production/dev

Hi I would not go down this road. What is the use case? Is this really the solution? Go read all the relevant docs and configuration provided by Cloudera/HortonWorks and everything else related to SOLR and HDFS. I am not inclined to help you down a road you do not want to travel. There be

Re: Solr with HDFS configuration example running in production/dev

Hi Joe, These are the errors I am running into: org.apache.solr.common.SolrException: Error CREATEing SolrCore 'newcollsolr2_shard1_replica_n1': Unable to create core [newcollsolr2_shard1_replica_n1] Caused by: Illegal char <:> at index 4: hdfs://

Re: Solr with HDFS configuration example running in production/dev

Your exception didn't come across - can you paste it in? -Joe On 8/19/2020 10:50 AM, Prashant Jyoti wrote: You're right Andrew. Even I read about that. But there's a use case for which we want to configure the said case. Are you also aware of what feature we are moving towards instead of

Re: Solr with HDFS configuration example running in production/dev

You're right Andrew. Even I read about that. But there's a use case for which we want to configure the said case. Are you also aware of what feature we are moving towards instead of HDFS? Will you be able to help me with the error that I'm running into? Thanks in advance! On Wed, 19 Aug, 2020,

Re: Solr with HDFS configuration example running in production/dev

I believe HDFS support is being deprecated in Solr. Not sure you want to continue configuration if support will disappear. On Wed, Aug 19, 2020 at 7:52 AM Prashant Jyoti wrote: > Hi all, > Hope you are healthy and safe. > > Need some help with HDFS configuration. > > Could anybody of you share