Re: Slow to upload thousands of tiny files over cpiod

2017-11-03 Thread Dor Laor
On Fri, Nov 3, 2017 at 8:14 PM, Waldek Kozaczuk wrote: > Miha, > > It looks like you are right. When I disabled printing of files names in > cpiod it made some difference when using QEMU and huge difference when > using VirtualBox on OSX. With QEMU on average I was able to

Re: Slow to upload thousands of tiny files over cpiod

2017-11-03 Thread Waldek Kozaczuk
Miha, It looks like you are right. When I disabled printing of files names in cpiod it made some difference when using QEMU and huge difference when using VirtualBox on OSX. With QEMU on average I was able to cut down the time from ~ 3 minutes to ~2 minutes and from ~10 minutes to ~ 10 SECONDS

Re: Slow to upload thousands of tiny files over cpiod

2017-11-03 Thread miha . plesko . xlab
Hi Waldek, I think the slowness comes because cpiod reports each file on the stdout. Could you try to comment-out the logging in cpiod and try if it works faster? So if you open two terminals and in the first one run: ``` $ capstan run demo --execute "/tools/cpiod.so --prefix /zfs/zfs" -f