Re: Any solr api to force leader on a specified node

[Walter Underwood]

Don’t use DIH. DIH has a lot of limitations and problems, as you are 
discovering.

Write a simple program that fetches from the database and sends documents 
in batches to Solr. I did this before DIH was invented (Solr 1.3) and I’m doing 
it
now.

You can send the updates to the load balancer for the Solr Cloud cluster. The
updates will be automatically routed to the right leader. It is very fast.

My loader is written in Python and I don’t even bother with a special Solr 
library.
It just sends JSON to the update handler with the right options.

We do this for all of our clusters. Our biggest one is 48 hosts with 55 million
documents.

wunder
Walter Underwood
wun...@wunderwood.org
http://observer.wunderwood.org/  (my blog)

> On Oct 11, 2020, at 8:40 PM, yaswanth kumar  wrote:
> 
> Hi wunder 
> 
> Thanks for replying on this..
> 
> I did setup solr cloud with 4 nodes being one node having DIH configured that 
> pulls data from ms sql every minute.. if I install DIH on rest of the nodes 
> it’s causing connection issues on the source dB which I don’t want and manage 
> with only one sever polling dB while rest are used as replicas for search.
> 
> So now everything works fine but when the severs are rebooted for maintenance 
> and once they come back and if the leader is not the one that doesn’t have 
> DIH it stops pulling data from sql , so that’s the reason why I want always 
> to force a node as leader
> 
> Sent from my iPhone
> 
>> On Oct 11, 2020, at 11:05 PM, Walter Underwood  wrote:
>> 
>> That requirement is not necessary. Let Solr choose a leader.
>> 
>> Why is someone making this bad requirement?
>> 
>> wunder
>> Walter Underwood
>> wun...@wunderwood.org
>> http://observer.wunderwood.org/  (my blog)
>> 
>>> On Oct 11, 2020, at 8:01 PM, yaswanth kumar  wrote:
>>> 
>>> Can someone pls help me to know if there is any solr api /config where we 
>>> can make sure to always opt leader on a particular solr node in solr cloud??
>>> 
>>> Using solr 8.2 and zoo 3.4
>>> 
>>> I have four nodes and my requirement is to always make a particular node as 
>>> leader
>>> 
>>> Sent from my iPhone
>> 

Re: Any solr api to force leader on a specified node

[yaswanth kumar]

Hi wunder 

Thanks for replying on this..

I did setup solr cloud with 4 nodes being one node having DIH configured that 
pulls data from ms sql every minute.. if I install DIH on rest of the nodes 
it’s causing connection issues on the source dB which I don’t want and manage 
with only one sever polling dB while rest are used as replicas for search.

So now everything works fine but when the severs are rebooted for maintenance 
and once they come back and if the leader is not the one that doesn’t have DIH 
it stops pulling data from sql , so that’s the reason why I want always to 
force a node as leader

Sent from my iPhone

> On Oct 11, 2020, at 11:05 PM, Walter Underwood  wrote:
> 
> That requirement is not necessary. Let Solr choose a leader.
> 
> Why is someone making this bad requirement?
> 
> wunder
> Walter Underwood
> wun...@wunderwood.org
> http://observer.wunderwood.org/  (my blog)
> 
>> On Oct 11, 2020, at 8:01 PM, yaswanth kumar  wrote:
>> 
>> Can someone pls help me to know if there is any solr api /config where we 
>> can make sure to always opt leader on a particular solr node in solr cloud??
>> 
>> Using solr 8.2 and zoo 3.4
>> 
>> I have four nodes and my requirement is to always make a particular node as 
>> leader
>> 
>> Sent from my iPhone
> 

Shipping solr logs to any open source log viewer

[yaswanth kumar]

Can someone let me know if there is any integration available to ship all solr 
logs live to any open source log viewers??

Sent from my iPhone

Re: Any solr api to force leader on a specified node

[Walter Underwood]

That requirement is not necessary. Let Solr choose a leader.

Why is someone making this bad requirement?

wunder
Walter Underwood
wun...@wunderwood.org
http://observer.wunderwood.org/  (my blog)

> On Oct 11, 2020, at 8:01 PM, yaswanth kumar  wrote:
> 
> Can someone pls help me to know if there is any solr api /config where we can 
> make sure to always opt leader on a particular solr node in solr cloud??
> 
> Using solr 8.2 and zoo 3.4
> 
> I have four nodes and my requirement is to always make a particular node as 
> leader
> 
> Sent from my iPhone

Any solr api to force leader on a specified node

[yaswanth kumar]

Can someone pls help me to know if there is any solr api /config where we can 
make sure to always opt leader on a particular solr node in solr cloud??

Using solr 8.2 and zoo 3.4

I have four nodes and my requirement is to always make a particular node as 
leader

Sent from my iPhone

how to config split authentication methods -- BasicAuth for WebUI, & none (or SSL client) for client connections?

[PGNet Dev]

 I'm running,

solr -version
8.6.3

on

uname -rm
5.8.13-200.fc32.x86_64 x86_64

grep _NAME /etc/os-release
PRETTY_NAME="Fedora 32 (Server Edition)"
CPE_NAME="cpe:/o:fedoraproject:fedora:32"

with

java -version
openjdk version "15" 2020-09-15
OpenJDK Runtime Environment 20.9 (build 15+36)
OpenJDK 64-Bit Server VM 20.9 (build 15+36, mixed mode, sharing)

solr's configured for SSL usage.  both client search connections and WebUI 
access work OK, with EC certs in use

SOLR_SSL_KEY_STORE="/srv/ssl/solr.server.EC.pfx"
SOLR_SSL_TRUST_STORE="/srv/ssl/solr.server.EC.pfx"

If I enable BasicAuth, adding

/security.json
{
"authentication":{
"blockUnknown": true,
"class":"solr.BasicAuthPlugin",
"credentials":{
"myuser":"jO... Fe..."

},
"realm":"Solr REALM",
"forwardCredentials": false
},
"authorization":{
"class":"solr.RuleBasedAuthorizationPlugin",
"permissions":[{
"name":"security-edit",
"role":"admin"
}],
"user-role":{
"solr":"admin"
}
}
}

as expected, WebUI requires/accepts valid credentials for access.

BUT ... client connections, e.g. from a mail MUA using dovecot's fts solr 
plugin, immediately fail, returning "401 Unauthorized".

How can solr authentication be configured to split method -- using BasicAuth 
for WebUI access ONLY, and still allowing the client connections?

Eventually, I want those client connections to require solr-side SSL client 
auth.
Atm, I'd just like to get it working -- _with_ the BasicAuth WebUI protection 
in place.

Re: Help with uploading files to a core.

[Walter Underwood]

Solr is not a database. You can make a huge mess pretending it is a DB.

Also, it doesn’t store files.

What is your use case?

wunder
Walter Underwood
wun...@wunderwood.org
http://observer.wunderwood.org/  (my blog)

> On Oct 11, 2020, at 1:28 PM, Guilherme dos Reis Meneguello 
>  wrote:
> 
> Hello! My name is Guilherme and I'm a new user of Solr.
> 
> Basically, I'm developing a database to help a research team in my
> university, but I'm having some problems uploading the files to the
> database. Either using curl commands or through the admin interface, I
> can't quite upload the files from my computer to Solr and set up the field
> types I want that file to have while indexed. I can do that through the
> document builder, but my intent was to have the research team I'm
> supporting just upload them through the terminal or something like that. My
> schema is all set up nicely, however the Solr's field class guessing isn't
> guessing correctly.
> 
> The reference guides in lucene apache's website didn't help me much. I'm
> pretty newbie when it comes to this field, but I feel it's something really
> basic that I'm missing. If anyone could help me or point me in the right
> direction, I'd be really thankful.
> 
> Regards,
> Guilherme.
> 
> 
> Livre
> de vírus. www.avast.com
> .
> <#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>

Re: Help with uploading files to a core.

[Shawn Heisey]

On 10/11/2020 2:28 PM, Guilherme dos Reis Meneguello wrote:

Hello! My name is Guilherme and I'm a new user of Solr.

Basically, I'm developing a database to help a research team in my
university, but I'm having some problems uploading the files to the
database. Either using curl commands or through the admin interface, I
can't quite upload the files from my computer to Solr and set up the field
types I want that file to have while indexed. I can do that through the
document builder, but my intent was to have the research team I'm
supporting just upload them through the terminal or something like that. My
schema is all set up nicely, however the Solr's field class guessing isn't
guessing correctly.


If you're using the capability to automatically add unknown fields, then 
your schema is NOT "all set up nicely".  It's apparently not set up at all.


The "add unknown fields" update processor is not recommended for 
production, because as you have noticed, it sometimes guesses the field 
type incorrectly.  The fact that it guesses incorrectly is not a bug ... 
we can't fix it because it's not actually broken.  Getting it right in 
every case is not possible.


Your best bet will be to set up the entire schema manually in advance of 
any indexing.  To do that, you're going to have to know every field that 
the data uses, and have field definitions already in the schema.


Thanks,
Shawn

Help with uploading files to a core.

[Guilherme dos Reis Meneguello]

Hello! My name is Guilherme and I'm a new user of Solr.

Basically, I'm developing a database to help a research team in my
university, but I'm having some problems uploading the files to the
database. Either using curl commands or through the admin interface, I
can't quite upload the files from my computer to Solr and set up the field
types I want that file to have while indexed. I can do that through the
document builder, but my intent was to have the research team I'm
supporting just upload them through the terminal or something like that. My
schema is all set up nicely, however the Solr's field class guessing isn't
guessing correctly.

The reference guides in lucene apache's website didn't help me much. I'm
pretty newbie when it comes to this field, but I feel it's something really
basic that I'm missing. If anyone could help me or point me in the right
direction, I'd be really thankful.

Regards,
Guilherme.


Livre
de vírus. www.avast.com
.
<#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>