Re: [Nix-dev] Nix-Store sharing (with NFS + AUFS)?

2016-01-16 Thread Matthias Beyer
On 15-01-2016 17:19:37, Rok Garbas wrote:
> Quoting Matthias Beyer (2016-01-15 16:38:30)
> > Hi,
> > 
> > I'm currently thinking about the following problem:
> > 
> > I want to share the /nix/store from one Master machine to several Slaves, 
> > but
> > in a slightly different way than is currently possible with ssh / http:
> > 
> > I want _one_ store which contains software, which then can be used by all 
> > the
> > slaves (like you'd do with NFS).
> > 
> > The Slave machine should still be able to install software with the package
> > manager (nix) but only locally, not globally.
> > 
> > So the Slave installs software to /nix/store locally, while /nix/store 
> > contains
> > store entries which are hosted on the master.
> > 
> > My first idea would be NFS + AUFS, but maybe there are nix-buildin
> > possibilities?
> > 
> > 
> > Use-Case: Provide a standard-set of software but allow each VM to install 
> > own
> > software if needed, while keeping the amount of used storage as small as
> > possible.
> > 
> > With the solution I'm searching for, 100 VMs which only use the standard
> > set on software would cause 1 % Storage-use (the packages are only 
> > phyiscally
> > available on one machine: the master) of the amount of storage which would 
> > be
> > needed with each VM installing the stuff.
> > 
> 
> you could also just use ``services.nix-serve`` module
> 
> https://github.com/NixOS/nixpkgs/blob/release-15.09/nixos/modules/services/networking/nix-serve.nix
> 
> and change all slaves to point their binary cache to Master's url.
> 

But wouldn't that cause the slaves to download the binaries from the
master instead of using them directly from the masters harddisc?

-- 
Mit freundlichen Grüßen,
Kind regards,
Matthias Beyer

Proudly sent with mutt.
Happily signed with gnupg.


signature.asc
Description: PGP signature
___
nix-dev mailing list
nix-dev@lists.science.uu.nl
http://lists.science.uu.nl/mailman/listinfo/nix-dev


[Nix-dev] Container notification broken

2016-01-16 Thread Jookia
Hey there,

Spawning a container fails on my system with this error:

Spawning container vpn on /var/lib/containers/vpn.
Press ^] three times within 1s to kill container.
/etc/localtime does not point into /usr/share/zoneinfo/, not updating container 
timezone.
Failed to create mount point 
/var/lib/containers/vpn/var/lib/private/host-notify: No such device or address

Perhaps it's best to drop
"--bind=/run/systemd/notify:/var/lib/private/host-notify" and use systemd's
notifcation system if it breaks everything?

Cheers,
Jookia.
___
nix-dev mailing list
nix-dev@lists.science.uu.nl
http://lists.science.uu.nl/mailman/listinfo/nix-dev


Re: [Nix-dev] Nix-Store sharing (with NFS + AUFS)?

2016-01-16 Thread Arseniy Seroka
You can't share over nfs because of sqlite. I've tried that myself and got 
no luck.

-- 
Sincerely,
Arseniy Seroka



On 16 January 2016 15:47:26 Matthias Beyer  wrote:

> On 15-01-2016 17:19:37, Rok Garbas wrote:
>> Quoting Matthias Beyer (2016-01-15 16:38:30)
>> > Hi,
>> >
>> > I'm currently thinking about the following problem:
>> >
>> > I want to share the /nix/store from one Master machine to several Slaves, 
>> > but
>> > in a slightly different way than is currently possible with ssh / http:
>> >
>> > I want _one_ store which contains software, which then can be used by all 
>> > the
>> > slaves (like you'd do with NFS).
>> >
>> > The Slave machine should still be able to install software with the package
>> > manager (nix) but only locally, not globally.
>> >
>> > So the Slave installs software to /nix/store locally, while /nix/store 
>> contains
>> > store entries which are hosted on the master.
>> >
>> > My first idea would be NFS + AUFS, but maybe there are nix-buildin
>> > possibilities?
>> >
>> >
>> > Use-Case: Provide a standard-set of software but allow each VM to install 
>> > own
>> > software if needed, while keeping the amount of used storage as small as
>> > possible.
>> >
>> > With the solution I'm searching for, 100 VMs which only use the standard
>> > set on software would cause 1 % Storage-use (the packages are only 
>> > phyiscally
>> > available on one machine: the master) of the amount of storage which would 
>> > be
>> > needed with each VM installing the stuff.
>> >
>>
>> you could also just use ``services.nix-serve`` module
>> 
>> https://github.com/NixOS/nixpkgs/blob/release-15.09/nixos/modules/services/networking/nix-serve.nix
>>
>> and change all slaves to point their binary cache to Master's url.
>>
>
> But wouldn't that cause the slaves to download the binaries from the
> master instead of using them directly from the masters harddisc?
>
> --
> Mit freundlichen Grüßen,
> Kind regards,
> Matthias Beyer
>
> Proudly sent with mutt.
> Happily signed with gnupg.
>
>
>
> --
> ___
> nix-dev mailing list
> nix-dev@lists.science.uu.nl
> http://lists.science.uu.nl/mailman/listinfo/nix-dev
>


___
nix-dev mailing list
nix-dev@lists.science.uu.nl
http://lists.science.uu.nl/mailman/listinfo/nix-dev


Re: [Nix-dev] Nix-Store sharing (with NFS + AUFS)?

2016-01-16 Thread Wout Mertens
I looked into what would be needed to have multiple writers on the same
store here: https://github.com/NixOS/nix/issues/378#issuecomment-62724778

The same would apply for aufs-type multi writer setups.

The tl;dr is that Nix would need to treat sqlite as only a cache, with all
needed info written in the store, and that Eelco didn't like the idea :-)

I still would love to have this, the store is at the mercy of a single file
right now…

On Sat, Jan 16, 2016, 1:49 PM Arseniy Seroka  wrote:

> You can't share over nfs because of sqlite. I've tried that myself and got
> no luck.
>
> --
> Sincerely,
> Arseniy Seroka
>
>
>
> On 16 January 2016 15:47:26 Matthias Beyer  wrote:
>
> > On 15-01-2016 17:19:37, Rok Garbas wrote:
> >> Quoting Matthias Beyer (2016-01-15 16:38:30)
> >> > Hi,
> >> >
> >> > I'm currently thinking about the following problem:
> >> >
> >> > I want to share the /nix/store from one Master machine to several
> Slaves, but
> >> > in a slightly different way than is currently possible with ssh /
> http:
> >> >
> >> > I want _one_ store which contains software, which then can be used by
> all the
> >> > slaves (like you'd do with NFS).
> >> >
> >> > The Slave machine should still be able to install software with the
> package
> >> > manager (nix) but only locally, not globally.
> >> >
> >> > So the Slave installs software to /nix/store locally, while /nix/store
> >> contains
> >> > store entries which are hosted on the master.
> >> >
> >> > My first idea would be NFS + AUFS, but maybe there are nix-buildin
> >> > possibilities?
> >> >
> >> >
> >> > Use-Case: Provide a standard-set of software but allow each VM to
> install own
> >> > software if needed, while keeping the amount of used storage as small
> as
> >> > possible.
> >> >
> >> > With the solution I'm searching for, 100 VMs which only use the
> standard
> >> > set on software would cause 1 % Storage-use (the packages are only
> phyiscally
> >> > available on one machine: the master) of the amount of storage which
> would be
> >> > needed with each VM installing the stuff.
> >> >
> >>
> >> you could also just use ``services.nix-serve`` module
> >>
> https://github.com/NixOS/nixpkgs/blob/release-15.09/nixos/modules/services/networking/nix-serve.nix
> >>
> >> and change all slaves to point their binary cache to Master's url.
> >>
> >
> > But wouldn't that cause the slaves to download the binaries from the
> > master instead of using them directly from the masters harddisc?
> >
> > --
> > Mit freundlichen Grüßen,
> > Kind regards,
> > Matthias Beyer
> >
> > Proudly sent with mutt.
> > Happily signed with gnupg.
> >
> >
> >
> > --
> > ___
> > nix-dev mailing list
> > nix-dev@lists.science.uu.nl
> > http://lists.science.uu.nl/mailman/listinfo/nix-dev
> >
>
>
> ___
> nix-dev mailing list
> nix-dev@lists.science.uu.nl
> http://lists.science.uu.nl/mailman/listinfo/nix-dev
>
-- 

Wout.
(typed on mobile, excuse terseness)
___
nix-dev mailing list
nix-dev@lists.science.uu.nl
http://lists.science.uu.nl/mailman/listinfo/nix-dev


Re: [Nix-dev] Configuring mirror sites for fetchurl

2016-01-16 Thread Vladimír Čunát
Hello.

On 01/02/2016 12:54 AM, Tim Williams (Public) wrote:
> When doing a "nixos-rebuild switch" for 15.09, nix wanted to download 
> updated texlive sources, which are many gigabytes in size. This wouldn't 
> be a problem, if the mirror site didn't default to an Australian one, 
> which is a very slow choice for the where I am,  the UK.

(I'm sorry for late reply.)
I think the main point is that this monolithic TeX packaging is being
phased out in favor of a more granular one. For basic user docs see:
https://github.com/NixOS/nixpkgs/blob/release-15.09/pkgs/tools/typesetting/tex/texlive-new/default.nix#L1

The important parts of this new TeX packaging should be in our binary
caches. Mirroring of the original upstream sources is rather bad there.

--Vladimir




smime.p7s
Description: S/MIME Cryptographic Signature
___
nix-dev mailing list
nix-dev@lists.science.uu.nl
http://lists.science.uu.nl/mailman/listinfo/nix-dev