You can probably find an rsync port for Windows in the gnu32 or cygnus
distributions. There is a bigger problem here.
To quote myself in another recent mail:
The replication scripts use two Unix file system tricks.
1) Files are not directly bound with with filenames, instead
there is a layer of indirection called an 'inode'. So, multiple file and
directory names point to the same physical file. The "." and ".."
directory entries are implemented this way.
2) Physical files are bound to all open file descriptors even
after there are no file names for the files. So, file data exists until
all file names are gone AND all open files are gone.
Windows does not (I think) support these features, even if they use an
indirection in their file system. The hardlink tricks are not available.
If you want to replicate with snapshots, you will have to make a
complete copy of your new files at the source, and copy those into the
index directory at the target. You may have to stop Solr at the source
and/or target during these operations.
Lance
-----Original Message-----
From: Dilip.TS [mailto:[EMAIL PROTECTED]
Sent: Monday, December 17, 2007 8:26 PM
To: SOLR
Subject: RE: Solr replication
Hi,
I understand that the Rsync is a Unix/Linux daemon thread which needs
to be enable/run to achieve Solr Collection Distribution.
Do we have any similar support for the Solr Collection Distribution in
the Windows environment or Do we need to write equivalent commands (in
the form of batch files) which will do the same steps as the shell
scripts placed under solr/bin folder.
Thanks in advance.
Regards,
Dilip.
-----Original Message-----
From: Bill Au [mailto:[EMAIL PROTECTED]
Sent: Tuesday, December 18, 2007 4:00 AM
To: [EMAIL PROTECTED]
Subject: Re: Solr replication
Rsync is a Unix/Linux command. I dont' know if that's available on
Windows. All the distribution scripts were developed and tested under
Unix/Linux. They may or may not work on Windows. I don't know much
about Windows so if you are running on Windows that I am the wrong
person to be asking help. You may want to use the mailing list to see
if anyone is doing collection distribution on Windows.
Solr is accessed through HTTP so you just need to use HTTP (for
example,
IE) on a Windows system to access a Solr server.
Bill
On Dec 17, 2007 8:53 AM, Dilip.TS < [EMAIL PROTECTED]> wrote:
Hi Bill,
I have a basic question (as im not an expert in unix).
I understand that the rsync is a deamon thread (similar to services
in
Windows).
Im not clear about what are the things/steps required to set up this
rysncd
deamon thread?
(Dont mind asking this question againg since im not very much clear
about
this)
Does it mean that the SOLR servers(both master and slave) should be
made
running on a unix/linux machine only?
How does a client (using Windows environment) able to access the
SOLR Server
running on Unix/Platform?
Any links/references would be of great help.
Thanks in advance.
Regards
Dilip
-----Original Message-----
From: Bill Au [mailto: [EMAIL PROTECTED]
Sent: Saturday, December 15, 2007 1:08 AM
To: solr-user@lucene.apache.org; [EMAIL PROTECTED]
Cc: [EMAIL PROTECTED]; [EMAIL PROTECTED]
Subject: Re: Solr replication
On Dec 14, 2007 7:00 AM, Dilip.TS <[EMAIL PROTECTED]> wrote:
> Hi,
> I have the following requirement for SOLR Collection Distribution
using
> Embedded Solr with the Jetty server:
>
> I have different data folders for multiple instances of SOLR
within the
> Same
> application.
> Im using the same SOLR_HOME with a single bin and conf folder.
>
> My query is:
> 1)Is is possible to have the same SOLR_HOME for multiple solr
instances
> and
> still be able to
> achieve Solr Distribution?
> (As i understand that we need to have differnet rsync port for
different
> solr instances)
Yes, solr distribution will work for multiple solr instances even if
they
all use the same SOLR_HOME.
All the distribution scripts have a command line argument for
specifying the
data directory.
>
> 2)Can i get some more information about how to start this rsyncd
daemon
> and
> which is the best way of doing it i.e. to start during system
reboot or
> doing it manually?
Please note that the rsyncd
-CollectionDistributionScripts#head-1e6cdce516ecf1eb31bffceaccf2abeb72bd
ce81
So it is best to configure the master server to run the rsyncd-start
script
at system boot time. If the rsync daemon has for some reasons been
disabled, it will not be started automatically at system reboot even
if it
is configured to do so. If rsyncd is started manually, then one
will have
to remember to start it every time the master server is rebooted.
>
> 3)Let me know if my understanding is correct. We require 1 Master
Server
> and
> a minimum of 1 slave server.
> The master server and the slave server cannot be running on the
same
> machine. Am i right?
>
> In the case of the SOLR Distribution, if the SOLR server acts as
the
> Master server
> then how about this slave server ? Is it the Application server
which
> calls the Master SOLR Server
> acts as slave server?
Both the master and slave are SOLR servers. Typically they are on
different
machines.
It doesn't make sense (at least not to me) to have both of them on
the same
machine.
>
> 4)I observe the file scripts.conf for master server:
> solr_port=8983
> rsyncd_port=18983
>
> +Enable and start rsync:
> rsyncd-enable; rsyncd-start
> +Run snapshooter:
> snapshooter
>
> Just to confirm is it mandatory that the solr master server
should
have
> the solr_port as 8983 only?
It does not to be 8983. That's just an example.
>
>
> 5) How do we enable and start rsync? The link to
> SolrCollectionDistributionScripts mentions about
> installing rsyncd daemon either during system boot time or by
manually.
> Which method is more preferrable?
> How do we achieve this as iam not clear on this?
>
> 6) How do we setup crontab to run snappuller and snapinstaller
> periodically?
How to start rsyncd at system boot time and setup crontab to run
snappuller
and snapinstaller depends on the OS that Solr is running on.
>
>
>
> Regards,
> Dilip TS
> Starmark Services Pvt. Ltd.
>
>
