On 02/27/2014 09:04 AM, Dan Johansson wrote:
One question though, can I set the --no-ssl globally in some
config-file? That way I do not have to update my scripts that implement
s3ql.
No, that's not possible at this time. Sorry.
Best,
-Nikolaus
--
Encrypted emails preferred.
PGP
Nicola Cocchiaro nicola.cocchi...@gmail.com writes:
Nikolaus,
A while ago we had discussed an llfuse exception in a thread called
strange llfuse exception that was not being correctly formed due to a
Cython bug. With the workaround in llfuse 0.40 the issue with the exception
was resolved,
Tor Krill tor.kr...@gmail.com writes:
Hi all,
I really would like to run S3Ql 2.x on Debian Wheezy. Is this
possible?
Yes, you just need to install Python 3.3.
Looking at the PPA for Ubuntu S3QL requires Python 3.3 but Wheezy only
has Python 3.2. I investigated the possibilities to
Hi Nicola,
Nicola Cocchiaro nicola.cocchi...@gmail.com writes:
The reason I originally asked was due to seeing some outbound connections
not completing but just hanging, until using umount.s3ql would let them
return with a TimeoutError (no less than 15 minutes later in all cases
seen). I
Nicola Cocchiaro nicola.cocchi...@gmail.com writes:
On Tuesday, March 11, 2014 8:06:42 PM UTC-7, Nikolaus Rath wrote:
Hi Nicola,
Nicola Cocchiaro writes:
The reason I originally asked was due to seeing some outbound
connections
not completing but just hanging, until using umount.s3ql
On 03/14/2014 08:11 AM, aweber1nj wrote:
Do all the features in the subject work well together? That is, can I
enable all three options and assume:
1. All my data will be stored encrypted.
2. Data is compressed before storing.
3. Identical blocks (of original content, pre-compression
Hi,
On 03/26/2014 06:23 AM, Balázs wrote:
Hi Niko,
I was wondering if there is any way to limit / control the available
bandwidth that is available to the s3ql backend for its upload to the
cloud. The amount of data I have to move on a daily basis hangs into the
production hours, and other
Hi PA,
When replying to emails on this list, please do not put your reply
above the quoted text, and do not quote the entire message you're
answering to. This makes it unnecessarily hard for other readers to
understand the context of your email. Instead, please cut quoted parts
that are not
On 04/01/2014 07:45 AM, Randy Black wrote:
[...]
-- Download s3ql and install
cd /tmp; curl -O http://s3ql.googlecode.com/files/s3ql-1.14.tar.bz2
tar -jxvf s3ql-1.14.tar.bz2; cd s3ql-1.14
python3.3 ./setup.py install
If you have Python 3.3, you don't need to use the (outdated) S3QL 1.x
Cristian Manoni nethc...@gmail.com writes:
and now the test:
# python3 runtests.py tests
after some succesful tests:
tests/t2_block_cache.py:114: cache_tests.test_destroy_deadlock FAILED
FAILURES
On 04/14/2014 10:06 AM, Adam Watkins wrote:
This comes from another server running Debian 7.4 and using the S3QL
1.11 package:
This server _isn't_ running on my home network, and I've no reason to
believe that it's connection is particularly unreliable.
[]
Thanks! Could you please file
Dear all,
I am pleased to announce a new maintenance release of S3QL, version 1.18.
Please note that this is only a maintenance release. Development of S3QL
takes place in the 2.x series. The 1.x releases receive only selected
bugfixes and are only maintained for older systems that do not
Dear all,
I am pleased to announce a new maintenance release of S3QL, version 1.18.1.
Please note that this is only a maintenance release. Development of S3QL
takes place in the 2.x series. The 1.x releases receive only selected
bugfixes and are only maintained for older systems that do not
On 05/09/2014 05:55 AM, andycr...@gmail.com wrote:
Folks,
I am using s3ql-1.17 (on CentOS5 6) and I have a question.
From each system, it does fsck.s3ql to see if the bucket was previously
formatted, and if not it does mkfs.s3ql.
This sounds dangerous. Can't you create the file system
PA Nilsson p...@zid.nu writes:
It's a directory, not a file, and it is created when mount.s3ql
starts. If this directory (with its contents) disappears if you reboot
the system several minutes later, you have a real problem.
If I reboot several minutes later, the directory is there and
PA Nilsson p...@zid.nu writes:
So my thinking is that this is a problem that we have with our flash based
file system. The file is simply not yet written to flash.
This will be running on an non maintained system with no possibility for
user interaction.
If there is a high chance that the
On 06/21/2014 05:38 PM, Warren Daly wrote:
Could you please zip all the mount.log* and fsck.log* files and put
them
somewhere on the web? I'd like to see when this problem started
appearing.
http://www.invisibleagent.com/20mntfsk.tar
$ wget
On 06/30/2014 10:22 PM, Brice Burgess wrote:
I went ahead and used the --compress none flag to disable compression. I
had to re-create the fileksystem to get it working (as it was previously
mounted with LZMA compression, and thus rightly retains this setting
upon remounting it).
It should
On 07/11/2014 09:36 AM, Andy Cress wrote:
Which ports do I need to make sure are open in a firewall in order to
use s3ql mount points?
S3QL uses only outgoing connections. By default, it uses only TCP ports
80 and 443 (for HTTP and HTTP via TLS). If you specify a different port
number in your
Jimmy Tanzil jimmy.tan...@ichthysmedia.com writes:
I am having high CPU load issues when writing large files (above 5 GB) into
the mounted s3ql filesystem.
Could you quantify that? How do you measure it, and how does it depend
on file size? Is there really a jump at 5 GB, or is it rather a
Hi Jimmy,
When replying to emails on this list, please do not put your reply
above the quoted text, and do not quote the entire message you're
answering to. This makes it unnecessarily hard for other readers to
understand the context of your email. Instead, please cut quoted parts
that are not
On 07/16/2014 01:33 PM, Andy Cress wrote:
I encountered a client s3ql system with its system date/time set at
about 4 hours before the actual time.
On that system, attempting to do fsck.s3ql to the cloud resulted in an
infinite set of retries with these messages:
Encountered
On 07/16/2014 01:27 PM, Jimmy Tanzil wrote:
Is what normal?
The CPU being utilized more than 100% during writing larger files.
My concern is not the timing, the timing is excellent.
I am more concerned about the CPU showing above 100% when writing one 5
GB file.
Is there any other
Mark Mielke mark.mie...@gmail.com writes:
On Sat, Jul 19, 2014 at 11:19 PM, Nikolaus Rath nikol...@rath.org wrote:
It has been requested
(https://bitbucket.org/nikratio/s3ql/issue/62/add-support-for-aws-server-side-encryption)
that I enable AWS server-side encryption in S3QL.
I am ambigious
Jimmy Tanzil jimmy.tan...@ichthysmedia.com writes:
There is no indication of any crash (nor any other problem) in the log
file at all. Where did you get the File system appears to have crashed
message from?
I see it when I try to do umount.s3ql /mountpoint
Then I read on your documentation
On 07/20/2014 04:06 PM, Jimmy Tanzil wrote:
Is there an option on the mount command to utilize 80% of the available
CPU cores?
No, and I don't think that introducing it would make sense.
Best,
-Nikolaus
--
GPG encrypted emails preferred. Key id: 0xD113FCAC3C4E599F
Fingerprint: ED31 791B
On 07/24/2014 02:24 PM, Andy Cress wrote:
After checking this out on both Amazon and Google, I can see that the
implementation is consistent, but not what I expected.
A folder is created by the administrator (e.g. 'myfolder'), and the s3ql
data for mybucket/myfolder goes into blocks in
Dear all,
I am pleased to announce a new release of S3QL, version 2.10.
From the changelog:
2014-07-27, S3QL 2.10
* The internal file system revision has changed. File systems
created with S3QL 2.10 or newer are not compatible with prior S3QL
versions. To update an existing file
Nikolaus Rath nikol...@rath.org writes:
This bucket was created using s3ql v1.12 so I was a little confused by the
Fyle system already at most-recent revision' output.
Could this have anything to do with my failed attempt to upgrade it from
1.2 to 2.9 already.
(I assume you mean 1.12
Alexandre Goncalves alexandre@gmail.com writes:
Domingo, 3 de Agosto de 2014 4:29:35 UTC+1, Nikolaus Rath escreveu:
On 08/02/2014 08:13 PM, Alexandre Goncalves wrote:
Hello,
I want to install S3QL in my CentOS 6.5 (64bit) box.
For that I did:
install Python3.4.1
On 08/03/2014 08:07 PM, Alexandre Goncalves wrote:
Hello,
I want mount my bucket as needed, so I tried to configure autofs to
mount the gs bucket.
Tried this, without luck:
auto.master:
/gs-backup /etc/auto.gs--timeout=300
auto.gs:
*
On 08/06/2014 04:22 PM, motomura wrote:
I use s3ql-2.9.1 in Fedora 20 packages with OpenStack Swift (/v1) as
backed storage.
s3ql crash often.
Below the log when s3ql is crashed.
Is it a bug of s3ql?
-
2014-08-06 17:19:09.067 [pid=674, thread='Thread-6', module='root',
Serge Victor sergi...@pawlowicz.name writes:
The s3ql worked fine. After upgrading from
s3ql_2.9+dfsg-2~26~ubuntu14.04.1_amd64.deb to
s3ql_2.10.1+dfsg-1~27~ubuntu14.04.1_amd64.deb, I am trying to upgrade
revision, as required, which fails:
[...]
Cycling metadata backups...
Backing up old
Hi motomura,
On 08/08/2014 01:03 AM, motomura wrote:
s3ql crashed in version 2.10.1.
Below the log when s3ql is crashed.
-
2014-08-08 16:55:01.509 [pid=8686, thread='Thread-6', module='root',
fn='excepthook', line=163]: Uncaught top-level exception:
Traceback (most recent call last):
On 08/14/2014 03:17 PM, Adam Watkins wrote:
Upgrading from revision 20 to 21...
Unexpected server reply to copy operation:
200 OK
Date: Thu, 14 Aug 2014 21:04:15 +
Server: RestServer/1.0
Content-Length: 189
Content-Type: application/xml
ETag: d7ed6a310a47b69a91e13e655245fac9
On 08/24/2014 07:25 AM, Dan Johansson wrote:
Hi All,
After upgrading to 2.10.1 I encounter the following error each time I
try to do anything (fsck, s3qladm upgrade):
# /usr/bin/fsck.s3ql --no-ssl --batch s3://abcdef.dmj.nu
Using CONNECT proxy proxy.dmj.nu:8080
Encountered
On 08/25/2014 12:58 PM, Dan Johansson wrote:
On 24.08.2014 23:37, Nikolaus Rath wrote:
On 08/24/2014 07:25 AM, Dan Johansson wrote:
Hi All,
After upgrading to 2.10.1 I encounter the following error each time I
try to do anything (fsck, s3qladm upgrade):
# /usr/bin/fsck.s3ql --no-ssl
On 08/27/2014 03:25 AM, motomura wrote:
I use s3ql-2.10.1 in with OpenStack Swift (/v1) as backed storage.
s3ql crashed.
Below logs (swift.log and mount.log) when s3ql is crashed.
May be the reason of s3ql'crash is read timeout of swift?
Can I avoid this problem by setting of s3ql or
Dear all,
I am pleased to announce a new maintenance release of S3QL, version 1.19.
Please note that this is only a maintenance release. Development of S3QL
takes place in the 2.x series. The 1.x releases receive only selected
bugfixes and are only maintained for older systems that do not
On 09/01/2014 07:54 AM, Rich B wrote:
On Thursday, August 14, 2014 9:02:40 PM UTC-4, Nikolaus Rath wrote:
On 08/14/2014 03:17 PM, Adam Watkins wrote:
Upgrading from revision 20 to 21...
Unexpected server reply to copy operation:
200 OK
Date: Thu, 14 Aug 2014 21:04
On 09/03/2014 01:25 PM, Ido wrote:
Hello,
I've been using s3ql for about a year now, and I'm very happy / excited
about it! Unfortunately, the recent upgrade seems to hang it on my system.
This is what I'm getting:
sudo mount.s3ql --cachesize=500 --authfile=[...] [s3_dest]
On 09/04/2014 07:31 AM, Nick Carboni wrote:
I am using s3ql for an application that may require the user to read
large amounts of data over an NFS (or CIFS) export of the s3ql file
system. I came across the --nfs option for mount.s3ql which is
described as enabling some optimizations for
On 09/09/2014 12:20 PM, Adam Watkins wrote:
Regarding my original issue with StorageQloud, GreenQloud have now
responded after 25 days with the following:
Part of our object storage solution involves third party software,
so we will have to ask them to fix the namespace
On 09/22/2014 12:17 PM, Nick Carboni wrote:
Here is everything I've done. The commands are actually entered from a
C program using fork(2) and execl(3), but should be functionally
equivalent to running them from the command line which I've done below:
$ mkfs.s3ql
On 09/23/2014 06:16 AM, Nick Carboni wrote:
I did some additional testing and eventually got it to work with other
directories.
When I create the backend mountpoint through my C program I drop some
metadata in the directory in a file named meta and a lost+found
directory also gets created.
Hi Brian,
On 09/30/2014 06:36 AM, Brian Pribis wrote:
Running tests for s3ql-2.11.1 on test:
test_put_s3error_med[plain-mock_gs] I get the following error:
Traceback (most recent call last):
File
/usr/local/lib/python3.4/dist-packages/dugong-3.0-py3.4.egg/dugong/__init__.py,
line
p6su5t8...@snkmail.com writes:
Hi,
I have recently tried out s3ql on Debian testing, and I have a few
questions.
I'm using s3ql with local storage, without encryption or compression.
I set threads to 1 as a baseline
[...] .
I find when I specify cachesize manually to be small or zero that
On 10/07/2014 04:41 AM, Sven Martin wrote:
I have an Amazon S3 bucket mounted on an Ubuntu 14.04 server, which
serves as my ownCloud server (EFSS). This bucket is configured as the
data location for ownCloud. So all the users' files end up here.
What is the best way to:
- backup this
Sven Martin sproeg...@gmail.com writes:
My only concern is: Will I allways be able to mount the s3ql file system?
Can this get corrupted somehow?
I'm pretty sure there still a number of bugs in S3QL. And even if there
were none, there's always the danger of broken hardware on your computer
or
Raquel Carrillo raquel.carrillo.solorz...@gmail.com writes:
When list (ls) the contents of the mounted directory, using de
commandline in ec2, all that shows to me is lost+found. But When I see the
content of the bucket using the web console in s3 I see files like:
s3ql_metadata
Super Strobi strobis...@gmail.com writes:
**In summary**: is this setup supported by S3QL: local storage backend by
NFS share?
Yes, that should work.
Not sure why you're having performance issues. I'd try to isolate the
problem. For example, does the same thing happen if you use the local
On 10/18/2014 12:00 AM, Super Strobi wrote:
PS. as per documentation uncertainty: if the local ~/.s3ql is lost, is
the s3ql filesystem still mountable?
If the file system was unmounted properly, yes. Otherwise you may loose
all data that was modified since the last metadata upload.
Best,
On 10/18/2014 01:48 PM, Super Strobi wrote:
[root@strobiserver .s3ql]# cat /etc/mtab
[...]
local:///mnt/local-nfs/myfsdata-ttt /mnt/s3ql-ttt-local fuse.s3ql
rw,nosuid,nodev,relatime,user_id=0,group_id=0,default_permissions,allow_other
0 0
[...]
ls -alR /mnt/s3ql-ttt-local does show the
On 10/19/2014 05:50 AM, Super Strobi wrote:
Dumping metadata...
..objects..
..blocks..
Uncaught top-level exception:
Traceback (most recent call last):
File /bin/fsck.s3ql, line 9, in module
load_entry_point('s3ql==2.9', 'console_scripts', 'fsck.s3ql')()
File
On 10/19/2014 08:00 AM, Rich B wrote:
When I run s3qlstat it will sometimes hang and sometimes crash:
$ s3qlstat --debug /mnt/MyBucket/
2014-10-19 10:08:09.369 4344 MainThread root.excepthook: Uncaught
top-level exception:
Traceback (most recent call last):
File /usr/bin/s3qlstat, line
On 10/19/2014 08:00 AM, Rich B wrote:
Hello,
I'm trying to use S3QL with Google Storage, but I'm consistently
running into a problem where blocks from the cache are not making it
to the backend. I'm running on Ubuntu 14.04 and using S3QL from the
PPA (version 2.11.1+dfsg-1~trusty1).
My
On 10/19/2014 11:05 AM, Super Strobi wrote:
Does the file system metadata (i.e., file names, sizes, permissions)
contain confidential information? If not, can you upload it somewhere
and send me the link? Then I'll take a look.
I can share if it, however I run into this:
good4...@gmail.com writes:
Debian Wheezy. Python 3.3.0 running in pyvenv.
(virtualenv-3.3.0) nick@host:~/build/s3ql-2.11/contrib$ python -V
Python 3.3.0
(virtualenv-3.3.0) nick@host:~/build/s3ql-2.11/contrib$ python benchmark.py
Traceback (most recent call last):
File benchmark.py, line
Rich B rich...@gmail.com writes:
On Sunday, October 19, 2014 1:45:54 PM UTC-4, Nikolaus Rath wrote:
On 10/19/2014 08:00 AM, Rich B wrote:
When I run s3qlstat it will sometimes hang and sometimes crash:
This is probably not related to your other problems, but it might be
easier to debug
Rich B rich...@gmail.com writes:
Could you give some more context? In particular, I'd like to see the logs
from the 32st and 1st retry.
Because of log rotations, I had to re-run the test to get the 1st and 32nd
retry. This time more of the blocks managed to get uploaded. Some of the
gi...@liquidhealthcare.com writes:
Hi Guys
I've been looking through the wiki and I've noticed that this file system
doesn't support mounting on multiple machines, I wanted to check whether
there has been any benchmarks with this software.
I don't think anything has been published. You can
On 10/21/2014 09:33 PM, Maxim Kostrikin wrote:
Suddenly I found ghost folder on nfs client of s3ql.
Its name misticaly doubles ls output
On nfs server with s3ql no such behavior
|
user@server://nfs/sharedfs/logs$ ls -la
ls: reading directory .: Too many levels of symbolic links
total 0
On 10/22/2014 07:25 AM, Rich B wrote:
In the mean time, I have some questions about the tcp-timeout backend
option. The docs don't say what the units are, what the default value
is, or how to use the option.
From the code, it looks like the units are seconds, and the syntax is
Hi Sven,
When replying to emails on this list, please do not put your reply
above the quoted text, and do not quote the entire message you're
answering to. This makes it unnecessarily hard for other readers to
understand the context of your email. Instead, please cut quoted parts
that are not
Super Strobi strobis...@gmail.com writes:
Hello,
I'm currently investigating the possibility to synchronize 2 s3ql
filesystems, but without mounting them.
I assume you mean without mounting them at the same time? Otherwise I
don't understand what you're doing.
What I'm trying to achieve:
On 11/05/2014 02:37 PM, Super Strobi wrote:
Let me rephrase the question differently:
If I watch the original myfsdata directory, and looking at nodes like:
myfsdata/s3ql_data_/188/s3ql_data_188998
Is there any reason why rsync *thinks* they have changed with having
added only 2GB of
Dear all,
I am pleased to announce a new release of S3QL, version 2.12.
From the changelog:
2014-11-09, S3QL tip
* The s3c backend has a new 'dumb-copy' option. If this option
is enabled, copy operations are assumed to have succeeded
as soon as the server returns a '200 OK' status,
that are not relevant to your reply, and insert your responses right
after the points you're replying to (as I have done below). Thanks!
Maxim Kostrikin mkostri...@gmail.com writes:
вторник, 11 ноября 2014 г., 1:13:49 UTC+6 пользователь Nikolaus Rath
написал:
Maxim Kostrikin mkost...@gmail.com javascript
Dear all,
I have just released a new version of python-dugong (3.4). This release
adds proper HTTP (i.e., non HTTPS) proxy support. If you would like to
use this feature, you can update python-dugong and S3QL will use it
automatically.
Best,
-Nikolaus
--
GPG encrypted emails preferred. Key id:
On 12/03/2014 10:50 AM, Andy Cress wrote:
Using s3ql-1.17 and fuse-2.8.7-2.el6.x86_64
All other account/buckets on S3 work fine from the same system.
Only this account/bucket gets this error, what might be wrong with it?
This bucket gets the same error from multiple systems.
Below is the
Peter Schüller schuelle...@gmail.com writes:
Is there a way to mount s3ql read-only by setting bucket permissions in a
way that
* mounting is still possible, but
* changing the file system is not possible?
If I disable all Put/Delete actions of S3 then mounting fails, probably
because the
Hi netplus,
When replying to emails on this list, please do not put your reply
above the quoted text, and do not quote the entire message you're
answering to. This makes it unnecessarily hard for other readers to
understand the context of your email. Instead, please cut quoted parts
that are not
On 12/23/2014 04:17 AM, michael karotsieris wrote:
Hello ,
I get and HTTPerror() and a connection closed unexpectedly error when i
try to mount a s3ql container on a fuse fs in my machine .What happens
next is that whenever i try to access the fuse fs ,the process i am
using will go in
On 01/25/2015 09:55 PM, Di Pe wrote:
We have our local swift cluster and we have a few use cases for s3ql.
One of them is keeping a mirror of a posix file system. For this we want
to maximize write throughput per process. I am aware that each copy
process is limited by the write throughput of
Jeff Bogatay j...@bogatay.com writes:
I am in the process of crafting a s3ql backed backup solution. During
the development/testing I left the store mounted, installed some
system updates and rebooted.
Now I am unable to mount and/or check the store. Running 2.12 on
ArchLinux. It has been
Nikolaus Rath nikol...@rath.org writes:
4) How can I realize an additional backup of (the current state of) an
s3ql file system e.g. to an external drive?
Not easily. Instead I'd suggest to run an rsync job from your data
directory to an S3QL mount point, and to your external drive.
See
that are not relevant to your reply, and insert your responses right
after the points you're replying to (as I have done below). Thanks! ]
Andy Cress andycr...@gmail.com writes:
On Sun, Feb 1, 2015 at 4:43 PM, Nikolaus Rath nikol...@rath.org wrote:
Hello,
Does anyone depend on using API / old-style
Adam Watkins adam.gc.watk...@gmail.com writes:
Encountered ConnectionClosed exception (connection closed
unexpectedly), retrying call to Backend.lookup for the 3-th time...
..processed 147/16379 objects (0.9%, 0 bytes rewritten)..Uncaught
top-level exception:
Original/inner traceback (most
Jeff Bogatay j...@bogatay.com writes:
I was running 1.0.2.
I still had 1.0.1 in my archlinux pkg cache, so I downgraded and
everything worked fine. Fsck completed without any issues.
For anybody else out there experiencing this issue -- it's clearly an
openssl problem.
It'd be great if you
Strobi strobis...@gmail.com writes:
S3QL needs at least dugong 3. Are you sure that you've got that
installed? Try to run
That should have been dugang 3.4, sorry. But it's correct in the
user's guide :-P.
# python3 -c 'import dugong; print(dugong.__version__)'
#
On Feb 16 2015, Guilherme Barile guig...@gmail.com wrote:
with high I/O scenarios in the past (using the 1.x series), where the
mount daemon would die under high load, but managed to solve them all
with fsck.s3ql after rebooting.
Actually that doesn't sound like a solution at all.
On Feb 17 2015, Guilherme Barile guig...@gmail.com wrote:
Have you seen s3ql running on similar setups ? Serving webpages /
files directly ?
No.
Best,
-Nikolaus
--
GPG encrypted emails preferred. Key id: 0xD113FCAC3C4E599F
Fingerprint: ED31 791B 2C5C 1613 AF38 8B8A D113 FCAC 3C4E 599F
On Feb 16 2015, Guilherme Barile guig...@gmail.com wrote:
Hello,
I use s3ql for quite some time as my apache webroot, which serves
about 300gb of files and some php applications. I had few problems
^^^
you already said that. SCNR.
with high I/O scenarios in
On Feb 16 2015, Guilherme Barile guig...@gmail.com wrote:
Hello,
I use s3ql for quite some time as my apache webroot, which serves
about 300gb of files and some php applications. I had few problems
with high I/O scenarios in the past (using the 1.x series), where the
mount daemon would die
On Feb 18 2015, Guilherme Barile guig...@gmail.com wrote:
Nikolaus,
After fscking and upgrading my volume to the new db revision, I was
able to mount the filesystem and access all the files without problems
(even though I stress the filesystem a lot, I never lost data using
s3ql).
With the
Rabid Mutant rabidmutantstarg...@gmail.com writes:
On Saturday, January 24, 2015 at 3:00:20 AM UTC+11, Nikolaus Rath wrote:
On 01/21/2015 08:16 PM, Rabid Mutant wrote:
Does S3QL really need 1 file handle per cache entry?
In principle, no. The way it's currently programmed, yes.
Looking
Hi Warren,
Warren Daly invisibleagentreco...@gmail.com writes:
[...]
File
/usr/local/lib/python2.7/dist-packages/s3ql-1.17-py2.7-linux-x86_64.egg
/s3ql/backends/s3c.py, line 281, in open_read
resp = self._do_request('GET', '/%s%s' % (self.prefix, key))
File
Hi Eric,
When replying to emails on this list, please do not put your reply
above the quoted text, and do not quote the entire message you're
answering to. This makes it unnecessarily hard for other readers to
understand the context of your email. Instead, please cut quoted parts
that are not
Rabid Mutant rabidmutantstarg...@gmail.com writes:
I must admit I see the 'rsync -c' option as a much stronger guarantee
than a copy based on file dates sizes, and this could be irrational.
But, if 100% cache can be achieved at nearly zero performance impact
*and* it supports rsync -c as well
Eric Eijkelenboom eric.eijkelenb...@gmail.com writes:
Hi guys
Here’s what happened:
1. Due to a server shutdown, the filesystem was not cleanly umount’ed.
Hereafter, fsck resulted in ‘fs still mounted elsewhere, aborting’
errors (obviously, the backend was not mounted anywhere else).
Did
On Mar 31 2015, Shane Wilson coswort...@gmail.com wrote:
First, I'm very new to Swift, so I'm sure I'm doing something wrong.
I'm trying to mount swift to Ubuntu 14.04 linux using s3ql, but I getting
an error during the mkfs.s3ql.
Here is the command line:
root@owncloud:~/.s3ql# mkfs.s3ql
[Quoting repaired]
On Apr 20 2015, Viktor Szépe szepe.vik...@gmail.com wrote:
On Saturday, April 18, 2015 at 10:53:05 AM UTC+2, Viktor Szépe wrote:
Is there a way to upload only changed file, thus doing incremental backup?
My usecase is making backup of a website that has 1 or two new files
On Apr 28 2015, netplus.r...@gmail.com wrote:
Hmm. After a 502 error S3QL tries to re-establish the connection
Completely. The only difference is that it does not attempt to contact
The auth server again. Could it be that the auth server sends you to a
Different endpoint when you restart S3QL?
On Apr 28 2015, Maxim Kostrikin mkostri...@gmail.com wrote:
Hello,
I am faced with performance issue. My s3ql mount attached to s3 backend
with options: --cachesize 2000 --max-cache-entries 100 --threads 16
--allow-other --backend-options no-ssl,tcp-timeout=30 --nfs
I copy into
On May 04 2015, Maxim Kostrikin mkostri...@gmail.com wrote:
I see almost 16 connections with s3 servers, but tcpdump shows small
rate
of uploading PUTs.
What do you mean with small? What do you expect it to be, and what did
you find instead?
200 bytes - 1k per file.
On Apr 30 2015, Maxim Kostrikin mkostri...@gmail.com wrote:
среда, 29 апреля 2015 г., 2:55:05 UTC+6 пользователь Nikolaus Rath написал:
On Apr 28 2015, Maxim Kostrikin mkost...@gmail.com javascript: wrote:
I am faced with performance issue. My s3ql mount attached to s3 backend
On May 08 2015, Andy Cress andycr...@gmail.com wrote:
I’m using s3ql-1.17, and this pertains to Amazon S3.
I configured an S3QL mount point with mkfs.s3ql and mount.s3ql on one
system, then I did fsck.s3ql and mount.s3ql to the same bucket (same
credentials) on a second system, but it worked
On May 13 2015, joshua.phill...@semanticbits.com wrote:
Hi,
I'm trying to understand the benchmark.py output to identify an upload
bottleneck in my S3QL deployment. I'd appreciate any pointers you may have.
[...]
Threads: 1 2 4 8
On May 15 2015, Jeb Baxley jeb.bax...@gmail.com wrote:
So I'm looking at using S3QL on swift, and was wondering if it's possible
to provide a NFS cluster using s3ql on swift?
Depends what you mean by NFS cluster. You can export an S3QL mountpoint
over NFS.
Thinking about it, I'm not sure it
On May 13 2015, Maxim Kostrikin mkostri...@gmail.com wrote:
I think the only reason for bigger max-obj-size is a db size. But 62.8
MiB is considerably small. I have a setup with 10Gb+ of sqlite DB and
it works, I guess the cons of bigger max-obj-size is multicore
processing. If block is big,
1 - 100 of 495 matches
Mail list logo
