Re: [qubes-users] Building Qubes 4rc4 iso from source

2018-02-04 Thread Tim W
On Sunday, February 4, 2018 at 12:55:10 AM UTC-5, Tim W wrote:
> On Sunday, February 4, 2018 at 12:25:46 AM UTC-5, awokd wrote:
> > On Sun, February 4, 2018 4:48 am, Tim W wrote:
> > > On Saturday, February 3, 2018 at 11:39:09 PM UTC-5, awokd wrote:
> > >
> > >> On Sun, February 4, 2018 4:21 am, Tim W wrote:
> > >>
> > >>
> > >>> packages'. Error: Error downloading packages: Status code: 503 for
> > >>> https://mirrors.fedoraproject.org/metalink?repo=fedora-25=x86_64
> > >>>
> > >>
> > >>>
> > >>> An issue with the link in the makefile?
> > >>>
> > >>
> > >> Probably a Fedora repo issue, maybe it's being updated. You might run
> > >> into a bunch of those. All you can do is run "make qubes" again and
> > >> cross your fingers.
> > >
> > > Well that royally sucks.  Its not as if the build process is only 5-10
> > > mins.  That was 30-45 mins to hit that error.
> > >
> > > looked at the makefile.fedora and it looks like this section.  Does it
> > > look correct  I was wondering if something might change with depeciation
> > > of f25
> > 
> > I know, it takes me around 6 hours for a fresh download and full build.
> > Another thing you can try if you're frequently getting download issues
> > (status code 503 is server issue, not missing file) is to build one group
> > of components at a time instead of the full list (which "make qubes"
> > does).
> > If you want to try that instead, do "make help" and look for the list of
> > components towards the end. It's like 10 lines long. Then start copying
> > and pasting them into make, one batch at a time, like "make vmm-xen
> > core-libvirt core-vchan-xen" for the first batch. That way if it fails you
> > don't have to go so far back. Make sure to run them in order.
> 
> great idea.  I had done that on templates when working out issues back before 
> we all got archlinux building well.  Did not think of if for this.  So far 
> this time its still running on the build so hopefully in a few hours I will 
> have an iso.  We will see.  
> 
> After that I think I will start adding in other templates to make a list of 
> what works.   As I can leave it to do its thing will not be a big waste of 
> time.  I am thinking minimal templates should also work.  Then its onto 
> Centos.  I prefer it leaps and bounds over Fedora.  IMO its the ideal dom0 if 
> we need to stick to rpm based with its long LTS.  Now with the longer linux 
> kernel support it will go great together for a long term stable system 
> without having to upgrade.

OK I was able to get a standard build done to iso.  That is standard FC26 + 
Strech-Debain + Whonix.

I also successful built standard + minimal of those to iso as well.  

Next I will try adding in certain other templates 1 by 1.

A correction on the instructions to build these 4.0 ISOs:

You need significantly more private store drive space in the VM.  I am using a 
stand-alone VM FC23 so I have more initial space taken up.  Still with an app 
vm its 2x what the old docs recommend as a minimum.   

For just the standard build I needed 60gigbyes.  

For the standard + minimal 65 gig just barely made it.  Best to have 70 gigs.  

My guess if you wanted to build all the non EOL templates for 4.0rc4 if they 
all can be built would be 100 gigs.  

I will continue to see what will build and the space needed.  My guess is some 
laptops especially that are running ssd will not have the drive space to build 
depending on what's used up already for your system data.  Looks like I finally 
have to add the 1tb Samsung Pro SED SSD in the optical bay for vm user data.  

Still not sure what program differences between the full-loaded-template vs 
Standard-templates.  For me I would rather manually add the programs I wanted 
in each area.  I may try the builds for those so we know if the build or not.

I may also try the last template version to be EOL'd such as fc25 for fedora 
etc but that will be last.  Too bad I do not have quad xeons 1000 +gigs of ram 
workstations vs the T440 with I7 + 16gig.  I could get these built in 15-30 min 
rather than 3 hrs.  

In the attachment is the QM showing Build-Qubes VM Size used for at the end of 
#make iso with FC26-Standard+FC26-Minimal & Stretch-Standard + Stretch-Minimal 
+ Whonix 64309MB


Cheers,

Tim

-- 
You received this message because you are subscribed to the Google Groups 
"qubes-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to qubes-users+unsubscr...@googlegroups.com.
To post to this group, send email to qubes-users@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/qubes-users/32e8fc28-50b9-403e-bead-570445798cef%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: [qubes-users] Building Qubes 4rc4 iso from source

2018-02-03 Thread Tim W
On Sunday, February 4, 2018 at 12:25:46 AM UTC-5, awokd wrote:
> On Sun, February 4, 2018 4:48 am, Tim W wrote:
> > On Saturday, February 3, 2018 at 11:39:09 PM UTC-5, awokd wrote:
> >
> >> On Sun, February 4, 2018 4:21 am, Tim W wrote:
> >>
> >>
> >>> packages'. Error: Error downloading packages: Status code: 503 for
> >>> https://mirrors.fedoraproject.org/metalink?repo=fedora-25=x86_64
> >>>
> >>
> >>>
> >>> An issue with the link in the makefile?
> >>>
> >>
> >> Probably a Fedora repo issue, maybe it's being updated. You might run
> >> into a bunch of those. All you can do is run "make qubes" again and
> >> cross your fingers.
> >
> > Well that royally sucks.  Its not as if the build process is only 5-10
> > mins.  That was 30-45 mins to hit that error.
> >
> > looked at the makefile.fedora and it looks like this section.  Does it
> > look correct  I was wondering if something might change with depeciation
> > of f25
> 
> I know, it takes me around 6 hours for a fresh download and full build.
> Another thing you can try if you're frequently getting download issues
> (status code 503 is server issue, not missing file) is to build one group
> of components at a time instead of the full list (which "make qubes"
> does).
> If you want to try that instead, do "make help" and look for the list of
> components towards the end. It's like 10 lines long. Then start copying
> and pasting them into make, one batch at a time, like "make vmm-xen
> core-libvirt core-vchan-xen" for the first batch. That way if it fails you
> don't have to go so far back. Make sure to run them in order.

great idea.  I had done that on templates when working out issues back before 
we all got archlinux building well.  Did not think of if for this.  So far this 
time its still running on the build so hopefully in a few hours I will have an 
iso.  We will see.  

After that I think I will start adding in other templates to make a list of 
what works.   As I can leave it to do its thing will not be a big waste of 
time.  I am thinking minimal templates should also work.  Then its onto Centos. 
 I prefer it leaps and bounds over Fedora.  IMO its the ideal dom0 if we need 
to stick to rpm based with its long LTS.  Now with the longer linux kernel 
support it will go great together for a long term stable system without having 
to upgrade.

-- 
You received this message because you are subscribed to the Google Groups 
"qubes-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to qubes-users+unsubscr...@googlegroups.com.
To post to this group, send email to qubes-users@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/qubes-users/702c85d1-1130-4c4f-9c31-f1e9a68b0ca5%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: [qubes-users] Building Qubes 4rc4 iso from source

2018-02-03 Thread 'awokd' via qubes-users
On Sun, February 4, 2018 4:48 am, Tim W wrote:
> On Saturday, February 3, 2018 at 11:39:09 PM UTC-5, awokd wrote:
>
>> On Sun, February 4, 2018 4:21 am, Tim W wrote:
>>
>>
>>> packages'. Error: Error downloading packages: Status code: 503 for
>>> https://mirrors.fedoraproject.org/metalink?repo=fedora-25=x86_64
>>>
>>
>>>
>>> An issue with the link in the makefile?
>>>
>>
>> Probably a Fedora repo issue, maybe it's being updated. You might run
>> into a bunch of those. All you can do is run "make qubes" again and
>> cross your fingers.
>
> Well that royally sucks.  Its not as if the build process is only 5-10
> mins.  That was 30-45 mins to hit that error.
>
> looked at the makefile.fedora and it looks like this section.  Does it
> look correct  I was wondering if something might change with depeciation
> of f25

I know, it takes me around 6 hours for a fresh download and full build.
Another thing you can try if you're frequently getting download issues
(status code 503 is server issue, not missing file) is to build one group
of components at a time instead of the full list (which "make qubes"
does).
If you want to try that instead, do "make help" and look for the list of
components towards the end. It's like 10 lines long. Then start copying
and pasting them into make, one batch at a time, like "make vmm-xen
core-libvirt core-vchan-xen" for the first batch. That way if it fails you
don't have to go so far back. Make sure to run them in order.


-- 
You received this message because you are subscribed to the Google Groups 
"qubes-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to qubes-users+unsubscr...@googlegroups.com.
To post to this group, send email to qubes-users@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/qubes-users/30f869531249c0e08e3fbc534861f447.squirrel%40tt3j2x4k5ycaa5zt.onion.
For more options, visit https://groups.google.com/d/optout.


Re: [qubes-users] Building Qubes 4rc4 iso from source

2018-02-03 Thread Tim W
On Saturday, February 3, 2018 at 11:39:09 PM UTC-5, awokd wrote:
> On Sun, February 4, 2018 4:21 am, Tim W wrote:
> 
> > packages'. Error: Error downloading packages:
> > Status code: 503 for
> > https://mirrors.fedoraproject.org/metalink?repo=fedora-25=x86_64
> 
> >
> > An issue with the link in the makefile?
> 
> Probably a Fedora repo issue, maybe it's being updated. You might run into
> a bunch of those. All you can do is run "make qubes" again and cross your
> fingers.

Well that royally sucks.  Its not as if the build process is only 5-10 mins.  
That was 30-45 mins to hit that error.

looked at the makefile.fedora and it looks like this section.  Does it look 
correct  I was wondering if something might change with depeciation of f25

ifdef FEDORA_MIRROR
YUM_OPTS += --setopt=fedora.baseurl=$(patsubst 
%/,%,$(FEDORA_MIRROR))/releases/$(subst fc,,$(DIST))/Everything/x86_64/os/
YUM_OPTS += --setopt=updates.baseurl=$(patsubst 
%/,%,$(FEDORA_MIRROR))/updates/$(subst fc,,$(DIST))/x86_64/
endif


Ill try running it yet again.

-- 
You received this message because you are subscribed to the Google Groups 
"qubes-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to qubes-users+unsubscr...@googlegroups.com.
To post to this group, send email to qubes-users@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/qubes-users/204984c3-fc0a-407e-9e9d-c274099cd1f2%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: [qubes-users] Building Qubes 4rc4 iso from source

2018-02-03 Thread 'awokd' via qubes-users
On Sun, February 4, 2018 4:21 am, Tim W wrote:

> packages'. Error: Error downloading packages:
> Status code: 503 for
> https://mirrors.fedoraproject.org/metalink?repo=fedora-25=x86_64

>
> An issue with the link in the makefile?

Probably a Fedora repo issue, maybe it's being updated. You might run into
a bunch of those. All you can do is run "make qubes" again and cross your
fingers.

-- 
You received this message because you are subscribed to the Google Groups 
"qubes-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to qubes-users+unsubscr...@googlegroups.com.
To post to this group, send email to qubes-users@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/qubes-users/ec1b74cba460f4436482f8b3bf012a91.squirrel%40tt3j2x4k5ycaa5zt.onion.
For more options, visit https://groups.google.com/d/optout.


Re: [qubes-users] Building Qubes 4rc4 iso from source

2018-02-03 Thread Tim W
On Saturday, February 3, 2018 at 9:56:06 PM UTC-5, Tim W wrote:
> On Saturday, February 3, 2018 at 9:44:22 PM UTC-5, awokd wrote:
> > On Sun, February 4, 2018 2:29 am, Tim W wrote:
> > >
> > > Thanks will try that as the most basic.
> > >
> > >
> > > Did you use ./setup or just run off the master build.conf in examples
> > > directory?
> > 
> > ./setup. Mostly followed the same steps as here
> > https://github.com/QubesOS/qubes-issues/issues/3426, just skip the text
> > file edits and choose 4.0 instead of 3.2.
> 
> Thanks am starting the process now.  I always prefer to build my own OS and 
> prog from source whenever possible.  Makes updating a bit more tedious but it 
> keeps me more uptodate and with less possible points for code to be altered + 
> if I can't build something it concerns me.

It failed with below:


Downloading Packages:

The downloaded packages were saved in cache until the next successful 
transaction.
You can remove cached packages by executing 'dnf clean packages'.
Error: Error downloading packages:
  Status code: 503 for 
https://mirrors.fedoraproject.org/metalink?repo=fedora-25=x86_64
/home/user/qubes-builder/qubes-src/builder-fedora/Makefile.fedora:111: recipe 
for target 'dist-build-dep' failed
make[2]: *** [dist-build-dep] Error 1
make[2]: Leaving directory '/home/user/qubes-builder'
Makefile.generic:156: recipe for target 'packages' failed
make[1]: *** [packages] Error 1
make[1]: Leaving directory '/home/user/qubes-builder'
Makefile:224: recipe for target 'core-libvirt-dom0' failed
make: *** [core-libvirt-dom0] Error 1


An issue with the link in the makefile?

-- 
You received this message because you are subscribed to the Google Groups 
"qubes-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to qubes-users+unsubscr...@googlegroups.com.
To post to this group, send email to qubes-users@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/qubes-users/81dd9d4b-d06d-4104-8f39-7105c1b8c5c7%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: [qubes-users] Building Qubes 4rc4 iso from source

2018-02-03 Thread Tim W
On Saturday, February 3, 2018 at 9:44:22 PM UTC-5, awokd wrote:
> On Sun, February 4, 2018 2:29 am, Tim W wrote:
> >
> > Thanks will try that as the most basic.
> >
> >
> > Did you use ./setup or just run off the master build.conf in examples
> > directory?
> 
> ./setup. Mostly followed the same steps as here
> https://github.com/QubesOS/qubes-issues/issues/3426, just skip the text
> file edits and choose 4.0 instead of 3.2.

Thanks am starting the process now.  I always prefer to build my own OS and 
prog from source whenever possible.  Makes updating a bit more tedious but it 
keeps me more uptodate and with less possible points for code to be altered + 
if I can't build something it concerns me.

-- 
You received this message because you are subscribed to the Google Groups 
"qubes-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to qubes-users+unsubscr...@googlegroups.com.
To post to this group, send email to qubes-users@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/qubes-users/53c81e9a-c6b3-4fb6-9ba1-67a92af32e2e%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: [qubes-users] Building Qubes 4rc4 iso from source

2018-02-03 Thread 'awokd' via qubes-users
On Sun, February 4, 2018 2:29 am, Tim W wrote:
>
> Thanks will try that as the most basic.
>
>
> Did you use ./setup or just run off the master build.conf in examples
> directory?

./setup. Mostly followed the same steps as here
https://github.com/QubesOS/qubes-issues/issues/3426, just skip the text
file edits and choose 4.0 instead of 3.2.

-- 
You received this message because you are subscribed to the Google Groups 
"qubes-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to qubes-users+unsubscr...@googlegroups.com.
To post to this group, send email to qubes-users@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/qubes-users/7561b57636eb7701c8a17436df9e8873.squirrel%40tt3j2x4k5ycaa5zt.onion.
For more options, visit https://groups.google.com/d/optout.


Re: [qubes-users] Building Qubes 4rc4 iso from source

2018-02-03 Thread Tim W
On Saturday, February 3, 2018 at 8:40:27 PM UTC-5, awokd wrote:
> On Sun, February 4, 2018 1:16 am, Tim W wrote:
> > Has anyone accomplished a clean build?
> 
> I've successfuly built 4.0rc3 in a Fedora 26 VM with the following installed:
> sudo dnf install git createrepo rpm-build make wget rpmdevtools dialog
> rpm-sign gnupg dpkg-dev debootstrap python2-sh
> 
> I used the Fedora 26-standard, Debian 9-standard, and whonix-gw & ws
> templates. They should be the safest bets because they ship with Qubes.
> I'll kick off another build in case there's an rc4 regression; haven't
> tried recently.

Thanks will try that as the most basic.  

Did you use ./setup or just run off the master build.conf in examples directory?

-- 
You received this message because you are subscribed to the Google Groups 
"qubes-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to qubes-users+unsubscr...@googlegroups.com.
To post to this group, send email to qubes-users@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/qubes-users/fe51473d-e7fc-4034-93e6-d7c5b8610177%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: [qubes-users] Building Qubes 4rc4 iso from source

2018-02-03 Thread 'awokd' via qubes-users
On Sun, February 4, 2018 1:16 am, Tim W wrote:
> Has anyone accomplished a clean build?

I've successfuly built 4.0rc3 in a Fedora 26 VM with the following installed:
sudo dnf install git createrepo rpm-build make wget rpmdevtools dialog
rpm-sign gnupg dpkg-dev debootstrap python2-sh

I used the Fedora 26-standard, Debian 9-standard, and whonix-gw & ws
templates. They should be the safest bets because they ship with Qubes.
I'll kick off another build in case there's an rc4 regression; haven't
tried recently.


-- 
You received this message because you are subscribed to the Google Groups 
"qubes-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to qubes-users+unsubscr...@googlegroups.com.
To post to this group, send email to qubes-users@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/qubes-users/75c308d0951edec3dd7b43998fe1abf9.squirrel%40tt3j2x4k5ycaa5zt.onion.
For more options, visit https://groups.google.com/d/optout.


[qubes-users] Building Qubes 4rc4 iso from source

2018-02-03 Thread Tim W
Has anyone accomplished a clean build?

I have tried with a standard builder.conf as well as using the ./setup script 
to create the builder.conf.

Doing the builder.conf from example when I uncomment whonix I am asked for git 
username and password during #make get-sources for that.   Even with it removed 
during #make qubes I get failures.

Using ./setup I have tried numerous combos of the various templates offered 
removing ones that create errors.  Still I can not get a clean build.  It maybe 
because I am picking templates that while listed do not actually work with 4.0. 
  If this is the case which templates should work with building 4.0?

"Example last time I had it fail during the initial build steps of FC26+fully 
loaded with error:

Building template fc26 (logfile: build-logs/template-fc26.log)...
Makefile:297: recipe for target 'template-local-fc26+fullyloaded' failed
make: *** [template-local-fc26+fullyloaded] Error 1"

I did have some null failures but I think it had to do with misdirection of 
log.txt as it did not stop the build example below:

" Installing core RPM packages...
install-info: No such file or directory for /dev/null
install-info: No such file or directory for /dev/null
install-info: No such file or directory for /dev/null
install-info: No such file or directory for /dev/null
Failed to connect to bus: No such file or directory
Failed to set locale, defaulting to C
Running in chroot, ignoring request.
-> Installing package groups...
Failed to set locale, defaulting to C"

All I really care about in the end is a way to get a clean build of the latest 
release being 4.0rc4.

I did not have these issues before building 3.1 and 3.2.

Ideally I would like to build an iso with FC25, Fc26, Debian Stretch, Whonix, 
Centos7 would like the standard and minimal where they are available.  Not sure 
exactly what is difference between the standard Template and fully-loaded one.  
I get minimal but did not realize there were fully loaded and standard. I tried 
picking all of them but got failures.  After removing a number of them and 
still getting failures I decided it was time to ask some questions as my 
search-fu turned up nothing helpful.


I am working in a 3.1 fc23 standalone VM  in it phython2.sh is not found in 
repo so I loaded it as a rpm.  If you load only python.sh you get error looking 
for python2.sh  Other than that I have not seen anything error specific to 
building in FC23


Tim
Cheers,

-- 
You received this message because you are subscribed to the Google Groups 
"qubes-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to qubes-users+unsubscr...@googlegroups.com.
To post to this group, send email to qubes-users@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/qubes-users/5a317d6c-9e83-4996-be67-abf8af70873a%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.