Right now without compaction you are looking at 45~ GB of data it looks like on the current npm public registry, and it can be replicated without needing any permission.
On Monday, February 18, 2013 1:01:33 PM UTC-6, andy wrote: > > Cool, thanks for the suggestion(s). > > Two quick questions: > 1) Can anyone replicate w/ the npm couch repo? I take it that's a yes but > maybe you need permission (then again maybe people are smart enough to not > want to have to do this, unlike us...) > 2) How big? 10GB? 100GB? 1TB+? > > Thanks, > > Andy > > On Mon, Feb 18, 2013 at 11:50 AM, Luke Arduini > <[email protected]<javascript:> > > wrote: > >> Touching on what Tim said, if you create a document for replication in >> /_replicator (not /_replicate) on couch you can turn couch off/on and have >> replication resume whenever. I do it all the time for my private npm and it >> works well, example: >> >> https://gist.github.com/st-luke/4165831 >> >> >> On Mon, Feb 18, 2013 at 1:46 PM, Tim Caswell >> <[email protected]<javascript:> >> > wrote: >> >>> If you want a mirror of the public npm repo, one option is to replicate >>> the couch database. It's pretty big, but once replicated would give you a >>> full mirror. I'm pretty sure you can do delta updates later on by putting >>> the couch database back online and syncing again. >>> >>> >>> On Mon, Feb 18, 2013 at 12:42 PM, Luke Arduini >>> <[email protected]<javascript:> >>> > wrote: >>> >>>> You could set up git on a server on your lan and just specify >>>> dependencies in your projects' package.json files pointing to the git >>>> address. Seems like it would be the easiest way to go for private modules >>>> not on the internet. >>>> >>>> >>>> On Mon, Feb 18, 2013 at 1:23 PM, andy e <[email protected]<javascript:> >>>> > wrote: >>>> >>>>> Apologies in advance because I've only glanced at this problem, but we >>>>> work in a unique environment where we have no Internet connectivity. >>>>> So, with our Java apps, we run an instance of Artifactory on our LAN >>>>> and load it by running an instance that is connected, which we then >>>>> export >>>>> and bring into the 'offline' instance. That gives us a sort of mirror of >>>>> Java dependencies for maven and what not when we're developing. >>>>> >>>>> Is there anything like Artifactory for npm? Do I need to roll my own >>>>> somehow (i.e. would a simple WebDAV server work or is it more complex)? >>>>> >>>>> I've glanced at Mike's node-reggie idea so maybe that is a place to >>>>> start (https://github.com/mbrevoort/node-reggie). >>>>> >>>>> We don't need anything fancy - just a way to add npm modules to a >>>>> project without having to check them in or pass around a giant .zip copy >>>>> with all possible repos...etc. (Right now I just have a >>>>> "node_modules_for_work" folder where I load up a ton of modules, then I >>>>> zip >>>>> that up and bring it in.) >>>>> >>>>> I'm happy to go off and do some reading/digging, so links to similar >>>>> ideas/attempts are appreciated. >>>>> >>>>> Thanks, >>>>> >>>>> Andy >>>>> >>>>> -- >>>>> -- >>>>> Job Board: http://jobs.nodejs.org/ >>>>> Posting guidelines: >>>>> https://github.com/joyent/node/wiki/Mailing-List-Posting-Guidelines >>>>> You received this message because you are subscribed to the Google >>>>> Groups "nodejs" group. >>>>> To post to this group, send email to [email protected]<javascript:> >>>>> To unsubscribe from this group, send email to >>>>> [email protected] <javascript:> >>>>> For more options, visit this group at >>>>> http://groups.google.com/group/nodejs?hl=en?hl=en >>>>> >>>>> --- >>>>> You received this message because you are subscribed to the Google >>>>> Groups "nodejs" group. >>>>> To unsubscribe from this group and stop receiving emails from it, send >>>>> an email to [email protected] <javascript:>. >>>>> For more options, visit https://groups.google.com/groups/opt_out. >>>>> >>>>> >>>>> >>>> >>>> -- >>>> -- >>>> Job Board: http://jobs.nodejs.org/ >>>> Posting guidelines: >>>> https://github.com/joyent/node/wiki/Mailing-List-Posting-Guidelines >>>> You received this message because you are subscribed to the Google >>>> Groups "nodejs" group. >>>> To post to this group, send email to [email protected]<javascript:> >>>> To unsubscribe from this group, send email to >>>> [email protected] <javascript:> >>>> For more options, visit this group at >>>> http://groups.google.com/group/nodejs?hl=en?hl=en >>>> >>>> --- >>>> You received this message because you are subscribed to the Google >>>> Groups "nodejs" group. >>>> To unsubscribe from this group and stop receiving emails from it, send >>>> an email to [email protected] <javascript:>. >>>> For more options, visit https://groups.google.com/groups/opt_out. >>>> >>>> >>>> >>> >>> -- >>> -- >>> Job Board: http://jobs.nodejs.org/ >>> Posting guidelines: >>> https://github.com/joyent/node/wiki/Mailing-List-Posting-Guidelines >>> You received this message because you are subscribed to the Google >>> Groups "nodejs" group. >>> To post to this group, send email to [email protected]<javascript:> >>> To unsubscribe from this group, send email to >>> [email protected] <javascript:> >>> For more options, visit this group at >>> http://groups.google.com/group/nodejs?hl=en?hl=en >>> >>> --- >>> You received this message because you are subscribed to the Google >>> Groups "nodejs" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to [email protected] <javascript:>. >>> For more options, visit https://groups.google.com/groups/opt_out. >>> >>> >>> >> >> -- >> -- >> Job Board: http://jobs.nodejs.org/ >> Posting guidelines: >> https://github.com/joyent/node/wiki/Mailing-List-Posting-Guidelines >> You received this message because you are subscribed to the Google >> Groups "nodejs" group. >> To post to this group, send email to [email protected]<javascript:> >> To unsubscribe from this group, send email to >> [email protected] <javascript:> >> For more options, visit this group at >> http://groups.google.com/group/nodejs?hl=en?hl=en >> >> --- >> You received this message because you are subscribed to the Google Groups >> "nodejs" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to [email protected] <javascript:>. >> For more options, visit https://groups.google.com/groups/opt_out. >> >> >> > > -- -- Job Board: http://jobs.nodejs.org/ Posting guidelines: https://github.com/joyent/node/wiki/Mailing-List-Posting-Guidelines You received this message because you are subscribed to the Google Groups "nodejs" group. To post to this group, send email to [email protected] To unsubscribe from this group, send email to [email protected] For more options, visit this group at http://groups.google.com/group/nodejs?hl=en?hl=en --- You received this message because you are subscribed to the Google Groups "nodejs" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/groups/opt_out.
