Re: Solr on HDInsight to write to Active Data Lake

2018-03-28 Thread Abhi Basu
Yes, for the life of me, cannot find info on azure data lake jars and MS has not been much help either. Maybe they dont want us to use Solr on ADLS, Thanks, Abhi On Wed, Mar 28, 2018 at 10:59 AM, Rick Leir wrote: > Hi, > The class that is not found is likely in the Azure related libraries. As

Re: Solr on HDInsight to write to Active Data Lake

2018-03-28 Thread Rick Leir
Hi, The class that is not found is likely in the Azure related libraries. As Erick said, are you sure that you have a library containing it? Cheers Rick -- Sorry for being brief. Alternate email is rickleir at yahoo dot com

Re: Solr on HDInsight to write to Active Data Lake

2018-03-26 Thread Abhi Basu
Yes, I copied the jars to all nodes and restarted Solr service. 04212org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException:Error CREATEing SolrCore 'ems-collection-700_shard1_replica2': Unable to create core: ems-collection-700_shard1_replica2 Caused by: Class org.apache.hadoop.f

Re: Solr on HDInsight to write to Active Data Lake

2018-03-26 Thread Erick Erickson
Several things: 1> I often start with an absolute path, knowing the exact relative path from where Solr starts can be confusing. If you've pathed properly and the jar file is in the path, it'll be found. 2> Are you sure HdiAdlFileSystem is in one of the jars? 3> did you restart the JVM? Best, E

Re: Solr on HDInsight to write to Active Data Lake

2018-03-26 Thread Abhi Basu
Adding this to solrconfig.xml did not work. I put all the azure and hadoop jars in the ext folder. Caused by: Class org.apache.hadoop.fs.adl.HdiAdlFileSystem not found Thanks, Abhi On Fri, Mar 23, 2018 at 7:40 PM, Abhi Basu <9000r...@gmail.com> wrote: > I'll try it out. > > Thanks > > Abhi >

Re: Solr on HDInsight to write to Active Data Lake

2018-03-23 Thread Abhi Basu
I'll try it out. Thanks Abhi On Fri, Mar 23, 2018, 6:22 PM Rick Leir wrote: > Abhi > Check your lib directives. > > https://lucene.apache.org/solr/guide/6_6/lib-directives-in-solrconfig.html#lib-directives-in-solrconfig > > I suspect your jars are not in a lib dir mentioned in solrconfig.xml >

Re: Solr on HDInsight to write to Active Data Lake

2018-03-23 Thread Rick Leir
Abhi Check your lib directives. https://lucene.apache.org/solr/guide/6_6/lib-directives-in-solrconfig.html#lib-directives-in-solrconfig I suspect your jars are not in a lib dir mentioned in solrconfig.xml Cheers -- Rick On March 23, 2018 11:12:17 AM EDT, Abhi Basu <9000r...@gmail.com> wrote: >MS

Solr on HDInsight to write to Active Data Lake

2018-03-23 Thread Abhi Basu
MS Azure does not support Solr 4.9 on HDI, so I am posting here. I would like to write index collection data to HDFS (hosted on ADL). Note: I am able to get to ADL from hadoop fs command like, so hadoop is configured correctly to get to ADL: hadoop fs -ls adl:// This is what I have done so far: 1