Re: [fossil-users] Bug report: Terrible Performance, when Checking in LLVM Source

2016-12-03 Thread jungle boogie

On 12/03/2016 08:28 PM, Martin Vahi wrote:

Reproduction:

1) Download LLVM source.
   It might be done by executing the bash script from

http://www.softf1.com/cgi-bin/tree1/technology/flaws/mmmv_parasail_projects.bash/artifact/3a28f1fb67a5d860

2) Commit the source.

It is about 4.4GiB, over 100k files, over 6k folders,
but it should not be that bad. After all, that's what
many projects look like in 2016.



Doesn't this depend on the CPU and available RAM? Search the archives 
for importing large repos. This very likely is not an issue with your 
network connection.




Regards,
martin.v...@softf1.com



___
fossil-users mailing list
fossil-users@lists.fossil-scm.org
http://lists.fossil-scm.org:8080/cgi-bin/mailman/listinfo/fossil-users


[fossil-users] Bug report addon: may be it's the push commad

2016-12-03 Thread Martin Vahi
I forgot to mention that I also push the commited
files to a remote repository.
The uplink is ~1MiB/s (~10Mbps) and the ping
from my local machine to the remote machine is about 20ms

So, even, if files were uploaded one by one,

~100k-files * 20ms = ~ 100 * 20 s = 2000s  < 3600s = 1h

So far it has taken over 6 hours.
The 4.4GiB of data should be uploaded in about 2h
(1MiB/s, 3600MiB/h )

The fossil process also takes up 100% of one of
the 3GHz CPU-cores, more than 6h in a row.
Fossil version: custom-compiled 1.35
Compile flags included -mtune=native -ftree-vectorize
CPU is AMD 64bit, ~3GHz

Remote repository URL (so that You can check the server response):
http://www.softf1.com/cgi-bin/tree1/technology/flaws/mmmv_parasail_projects.bash/

___
fossil-users mailing list
fossil-users@lists.fossil-scm.org
http://lists.fossil-scm.org:8080/cgi-bin/mailman/listinfo/fossil-users


[fossil-users] Bug report: Terrible Performance, when Checking in LLVM Source

2016-12-03 Thread Martin Vahi
Reproduction:

1) Download LLVM source.
   It might be done by executing the bash script from

http://www.softf1.com/cgi-bin/tree1/technology/flaws/mmmv_parasail_projects.bash/artifact/3a28f1fb67a5d860

2) Commit the source.

It is about 4.4GiB, over 100k files, over 6k folders,
but it should not be that bad. After all, that's what
many projects look like in 2016.


Regards,
martin.v...@softf1.com

___
fossil-users mailing list
fossil-users@lists.fossil-scm.org
http://lists.fossil-scm.org:8080/cgi-bin/mailman/listinfo/fossil-users