Easiest way to get the writeup you want is to write it :-)
Cheers,
Greg

On 2014-11-18 12:27 PM, Waldman, Simon M wrote:

If somebody’s writing this up, it might be worth differentiating between large text files and large binaries.

Both are potentially problematic, but the binaries far more so! (at least if they change much)

*From:*Discuss [mailto:[email protected]] *On Behalf Of *Aron Ahmadia
*Sent:* 18 November 2014 16:28
*To:* Naupaka Zimmerman
*Cc:* Jed Brown; Software Carpentry Discussion; Karin Lagesen; Chris Kees
*Subject:* Re: [Discuss] version control of big files

Hi Karin,

Heavy binary versioning is an unsolved problem. A very trusted developer from my community (and friend), Jed Brown, has implemented a lightweight alternative to git annex called git-fat that is implemented in Python and intentionally easy to install. Here's the first reference to it in the discussion list, when it was a bare two weeks old: http://lists.software-carpentry.org/pipermail/tutors_lists.software-carpentry.org/2012-November/000415.html

You may also want to look into bup, especially if you're trying to version the differences between large files, instead of just their signatures.

I'm cc-ing Jed on the discussion, as well as another member of my research laboratory who has been looking at this issue.

Regards,
Aron

On Tue, Nov 18, 2014 at 11:19 AM, Naupaka Zimmerman <[email protected] <mailto:[email protected]>> wrote:

Hi Karin -

I believe at one point there was a lot of talk about using git annex for this purpose:
https://git-annex.branchable.com

Haven't used it myself, but perhaps others have and can chime in.

Best,
Naupaka



On 18 Nov 2014, at 9:15, Karin Lagesen wrote:

Hi!

I am working in a project where we have a lot of big files that we should be keeping under version control - I am talking about GB sized files here.

I suspect that there are people on this list that have been in a similar situation, and I was wondering what solutions people have ended up with using?

Thanks!


Karin
--
Karin Lagesen, Ph.D.
Department of Medical Genetics
Oslo University Hospital
http://blog.karinlag.no

_______________________________________________
Discuss mailing list
[email protected] <mailto:[email protected]>
http://lists.software-carpentry.org/mailman/listinfo/discuss_lists.software-carpentry.org


_______________________________________________
Discuss mailing list
[email protected] <mailto:[email protected]>
http://lists.software-carpentry.org/mailman/listinfo/discuss_lists.software-carpentry.org




We invite research leaders and ambitious early career researchers to join us in leading and driving research in key inter-disciplinary themes. Please see www.hw.ac.uk/researchleaders for further information and how to apply.

Heriot-Watt University is a Scottish charity registered under charity number SC000278.


_______________________________________________
Discuss mailing list
[email protected]
http://lists.software-carpentry.org/mailman/listinfo/discuss_lists.software-carpentry.org

--
Dr. Greg Wilson    | [email protected]
Software Carpentry | http://software-carpentry.org

_______________________________________________
Discuss mailing list
[email protected]
http://lists.software-carpentry.org/mailman/listinfo/discuss_lists.software-carpentry.org

Reply via email to