Re: [tor-bugs] #17379 [Applications/Tor Browser]: Using the same build process in Tor Browser and Tor Messenger

[Tor Bug Tracker & Wiki]

#17379: Using the same build process in Tor Browser and Tor Messenger
--+---
 Reporter:  boklm |  Owner:  boklm
 Type:  task  | Status:  new
 Priority:  Medium|  Milestone:
Component:  Applications/Tor Browser  |Version:
 Severity:  Normal| Resolution:
 Keywords:  tbb-gitian|  Actual Points:
Parent ID:| Points:
 Reviewer:|Sponsor:
--+---

Comment (by boklm):

 Replying to [comment:13 boklm]:
 > > After we copied libevent from TB 7.0a1 to the /var/tmp/... path, we
 got further: tor.real started up and completed the bootstrap phase but it
 exited immediately after that point:
 > >  [notice] Owning controller connection has closed -- exiting now.
 > >
 > > We do not know why tor thinks the connection has closed (maybe the
 browser is closing the control port connection or maybe it is not). Is
 this a known problem?
 >
 > I also have the same error, but did not find the reason yet.

 This seems to be fixed now.

 I think the reason was a corrupt omni.ja file, which is fixed by this
 commit:
 https://gitweb.torproject.org/builders/tor-browser-
 build.git/commit/?id=38863663120244e4becc66fe7a10cce92d8e639b

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #17379 [Applications/Tor Browser]: Using the same build process in Tor Browser and Tor Messenger

[Tor Bug Tracker & Wiki]

#17379: Using the same build process in Tor Browser and Tor Messenger
--+---
 Reporter:  boklm |  Owner:  boklm
 Type:  task  | Status:  new
 Priority:  Medium|  Milestone:
Component:  Applications/Tor Browser  |Version:
 Severity:  Normal| Resolution:
 Keywords:  tbb-gitian|  Actual Points:
Parent ID:| Points:
 Reviewer:|Sponsor:
--+---

Comment (by boklm):

 Replying to [comment:12 mcs]:
 > Kathy and I successfully ran `make alpha_nightly` on an Ubuntu 14.04 LTS
 system. Here is some quick feedback:

 Thanks for this feedback!


 >
 > a) It would be nice to have log output that provided a "high level" view
 of progress (e.g., Building tor for Linux64, Building pluggable transports
 for Linux64, Building firefox for Linux64) The old gitian-based build
 system does not do this very well either; maybe we should have two log
 files? Or something that is easy to grep for within the make output.

 Detailed logs of the build of each component are now written in files the
 logs directory, and we only print on the screen high level logs.


 >
 > b) How can we reduce the number of languages that we produce packages
 for? Doing that is useful when creating test builds since it speeds up
 packaging time.

 I added a `testbuild` makefile target, which produce a build containing
 only the en-US bundle, without the mar files.


 >
 > c) The resulting Linux build runs, but the OSX one does not (we did not
 yet try to run the Windows build). On OSX, libevent seems to be missing
 and tor.real has a dependency on this path:
 >  /var/tmp/dist/libevent/lib/libevent-2.0.5.dylib
 > In current OSX builds (e.g., TB 7.0a1), tor.real has a dependency on:
 >  @executable_path/libevent-2.0.5.dylib

 This should be fixed now.


 >
 > After we copied libevent from TB 7.0a1 to the /var/tmp/... path, we got
 further: tor.real started up and completed the bootstrap phase but it
 exited immediately after that point:
 >  [notice] Owning controller connection has closed -- exiting now.
 >
 > We do not know why tor thinks the connection has closed (maybe the
 browser is closing the control port connection or maybe it is not). Is
 this a known problem?

 I also have the same error, but did not find the reason yet.

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #17379 [Applications/Tor Browser]: Using the same build process in Tor Browser and Tor Messenger

[Tor Bug Tracker & Wiki]

#17379: Using the same build process in Tor Browser and Tor Messenger
--+---
 Reporter:  boklm |  Owner:  boklm
 Type:  task  | Status:  new
 Priority:  Medium|  Milestone:
Component:  Applications/Tor Browser  |Version:
 Severity:  Normal| Resolution:
 Keywords:  tbb-gitian|  Actual Points:
Parent ID:| Points:
 Reviewer:|Sponsor:
--+---

Comment (by mcs):

 Kathy and I successfully ran `make alpha_nightly` on an Ubuntu 14.04 LTS
 system. Here is some quick feedback:

 a) It would be nice to have log output that provided a "high level" view
 of progress (e.g., Building tor for Linux64, Building pluggable transports
 for Linux64, Building firefox for Linux64) The old gitian-based build
 system does not do this very well either; maybe we should have two log
 files? Or something that is easy to grep for within the make output.

 b) How can we reduce the number of languages that we produce packages for?
 Doing that is useful when creating test builds since it speeds up
 packaging time.

 c) The resulting Linux build runs, but the OSX one does not (we did not
 yet try to run the Windows build). On OSX, libevent seems to be missing
 and tor.real has a dependency on this path:
  /var/tmp/dist/libevent/lib/libevent-2.0.5.dylib
 In current OSX builds (e.g., TB 7.0a1), tor.real has a dependency on:
  @executable_path/libevent-2.0.5.dylib

 After we copied libevent from TB 7.0a1 to the /var/tmp/... path, we got
 further: tor.real started up and completed the bootstrap phase but it
 exited immediately after that point:
  [notice] Owning controller connection has closed -- exiting now.

 We do not know why tor thinks the connection has closed (maybe the browser
 is closing the control port connection or maybe it is not). Is this a
 known problem?

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #17379 [Applications/Tor Browser]: Using the same build process in Tor Browser and Tor Messenger

[Tor Bug Tracker & Wiki]

#17379: Using the same build process in Tor Browser and Tor Messenger
--+---
 Reporter:  boklm |  Owner:  boklm
 Type:  task  | Status:  new
 Priority:  Medium|  Milestone:
Component:  Applications/Tor Browser  |Version:
 Severity:  Normal| Resolution:
 Keywords:  tbb-gitian|  Actual Points:
Parent ID:| Points:
 Reviewer:|Sponsor:
--+---

Comment (by boklm):

 We now have a `builders/tor-browser-build` git repository:
 https://gitweb.torproject.org/builders/tor-browser-build.git/

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #17379 [Applications/Tor Browser]: Using the same build process in Tor Browser and Tor Messenger

[Tor Bug Tracker & Wiki]

#17379: Using the same build process in Tor Browser and Tor Messenger
--+---
 Reporter:  boklm |  Owner:  boklm
 Type:  task  | Status:  new
 Priority:  Medium|  Milestone:
Component:  Applications/Tor Browser  |Version:
 Severity:  Normal| Resolution:
 Keywords:  tbb-gitian|  Actual Points:
Parent ID:| Points:
 Reviewer:|Sponsor:
--+---

Comment (by gk):

 Yes, option b) sounds like a good way forward to me as well.

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #17379 [Applications/Tor Browser]: Using the same build process in Tor Browser and Tor Messenger

[Tor Bug Tracker & Wiki]

#17379: Using the same build process in Tor Browser and Tor Messenger
--+---
 Reporter:  boklm |  Owner:  boklm
 Type:  task  | Status:  new
 Priority:  Medium|  Milestone:
Component:  Applications/Tor Browser  |Version:
 Severity:  Normal| Resolution:
 Keywords:  tbb-gitian|  Actual Points:
Parent ID:| Points:
 Reviewer:|Sponsor:
--+---

Comment (by boklm):

 Yes, I agree we should have two separate repositories, `tor-messenger-
 build` and `tor-browser-build`. What I was thinking was that maybe those
 two repositories could be two branches of the same things, containing all
 components for both projects, evolving in parallel but with a possibility
 to get them synchronized at some points.

 But if we don't want any tor-messenger component in the tor-browser
 repository, I think it is possible too, while still being able to easily
 share some components between the two. The tor-messenger repository could
 have a checkout of the tor-browser repository as a git submodule, to be
 able to use the tor-browser toolchain (and other shared components) in
 tor-messenger.

 So the two main possibilities I see are:

 a) The `tor-messenger-build` and `tor-browser-build` repositories both
 contain all components to build both projects. Which components are
 actually built depends on which Makefile command was used.

 b) The `tor-browser-build` repository contains only what is necessary for
 building Tor Browser and nothing else. The `tor-messenger-build`
 repository only contains the components that are specific to Tor
 Messenger, and has `tor-browser-build` as a git submodule, with a few
 symbolic links pointing to `tor-browser-build` sub-directories to pick the
 components from Tor Browser they want to use.

 I was initialy thinking about option 'a', but after thinking more about
 this, I think I like option 'b' more. The option 'a' would mean having
 many commits unrelated to the project in each projects repositories.
 Option 'b' avoids that while still allowing to easily share components
 between the two projects.

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #17379 [Applications/Tor Browser]: Using the same build process in Tor Browser and Tor Messenger

[Tor Bug Tracker & Wiki]

#17379: Using the same build process in Tor Browser and Tor Messenger
--+---
 Reporter:  boklm |  Owner:  boklm
 Type:  task  | Status:  new
 Priority:  Medium|  Milestone:
Component:  Applications/Tor Browser  |Version:
 Severity:  Normal| Resolution:
 Keywords:  tbb-gitian|  Actual Points:
Parent ID:| Points:
 Reviewer:|Sponsor:
--+---

Comment (by gk):

 To make my point clear: in the end when we switch to the new build system
 I think it should live in a new repo: e.g. tor-browser-build and should
 only contain the things necessary for Tor Browser. If those things work in
 tor-messenger-build as well that's fine with me.

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #17379 [Applications/Tor Browser]: Using the same build process in Tor Browser and Tor Messenger

[Tor Bug Tracker & Wiki]

#17379: Using the same build process in Tor Browser and Tor Messenger
--+---
 Reporter:  boklm |  Owner:  boklm
 Type:  task  | Status:  new
 Priority:  Medium|  Milestone:
Component:  Applications/Tor Browser  |Version:
 Severity:  Normal| Resolution:
 Keywords:  tbb-gitian|  Actual Points:
Parent ID:| Points:
 Reviewer:|Sponsor:
--+---

Comment (by gk):

 Replying to [comment:6 boklm]:
 > I am planning to start working on this from the Tor Messenger
 repository, adding the missing Tor Browser components there. When it is
 finished, it should be possible to launch Tor Browser and Tor Messenger
 builds from the same repository.

 Hm. I wonder what constraints this entails. One thing I assume is that the
 Tor Browser build related things are much more rapidly evolving than the
 Tor Messenger ones because there is no money available for Tor Messenger
 while we have a bunch of full-time employees concerned about Tor Browser.
 I fear trying to keep both in sync costs too much time and money. Apart
 from that `tor-messenger-build` sounds misleading if users are looking for
 a way to understand how Tor Browser is built.

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #17379 [Applications/Tor Browser]: Using the same build process in Tor Browser and Tor Messenger

[Tor Bug Tracker & Wiki]

#17379: Using the same build process in Tor Browser and Tor Messenger
--+---
 Reporter:  boklm |  Owner:  boklm
 Type:  task  | Status:  new
 Priority:  Medium|  Milestone:
Component:  Applications/Tor Browser  |Version:
 Severity:  Normal| Resolution:
 Keywords:  tbb-gitian|  Actual Points:
Parent ID:| Points:
 Reviewer:|Sponsor:
--+---

Comment (by boklm):

 I am planning to start working on this from the Tor Messenger repository,
 adding the missing Tor Browser components there. When it is finished, it
 should be possible to launch Tor Browser and Tor Messenger builds from the
 same repository.

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #17379 [Applications/Tor Browser]: Using the same build process in Tor Browser and Tor Messenger

[Tor Bug Tracker & Wiki]

#17379: Using the same build process in Tor Browser and Tor Messenger
--+---
 Reporter:  boklm |  Owner:  boklm
 Type:  task  | Status:  new
 Priority:  Medium|  Milestone:
Component:  Applications/Tor Browser  |Version:
 Severity:  Normal| Resolution:
 Keywords:  tbb-gitian|  Actual Points:
Parent ID:| Points:
 Reviewer:|Sponsor:
--+---

Comment (by boklm):

 Starting with the nightly builds sounds like a good idea.

 The next step will be getting the builds deterministic for all platforms,
 which will probably involve adding libfaketime in some parts, but should
 not be too hard. I opened a new child ticket for this part: #20426.

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #17379 [Applications/Tor Browser]: Using the same build process in Tor Browser and Tor Messenger

[Tor Bug Tracker & Wiki]

#17379: Using the same build process in Tor Browser and Tor Messenger
--+---
 Reporter:  boklm |  Owner:  boklm
 Type:  task  | Status:  new
 Priority:  Medium|  Milestone:
Component:  Applications/Tor Browser  |Version:
 Severity:  Normal| Resolution:
 Keywords:  tbb-gitian|  Actual Points:
Parent ID:| Points:
 Reviewer:|Sponsor:
--+---
Changes (by gk):

 * keywords:   => tbb-gitian


--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #17379 [Applications/Tor Browser]: Using the same build process in Tor Browser and Tor Messenger

[Tor Bug Tracker & Wiki]

#17379: Using the same build process in Tor Browser and Tor Messenger
--+---
 Reporter:  boklm |  Owner:  boklm
 Type:  task  | Status:  new
 Priority:  Medium|  Milestone:
Component:  Applications/Tor Browser  |Version:
 Severity:  Normal| Resolution:
 Keywords:|  Actual Points:
Parent ID:| Points:
 Reviewer:|Sponsor:
--+---
Changes (by gk):

 * cc: ln5 (added)


Comment:

 I think a good first milestone could be to get `rbm` going for nightly
 builds. The hard part will very probably be getting the builds
 deterministic for all platforms but that does not matter anyway for
 nightly builds. So, getting all the gitian conversion related issues
 sorted out and starting to test `rbm` for Tor Browser with nightly builds
 seems to be a good way forward IMO.

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #17379 [Applications/Tor Browser]: Using the same build process in Tor Browser and Tor Messenger

[Tor Bug Tracker & Wiki]

#17379: Using the same build process in Tor Browser and Tor Messenger
--+---
 Reporter:  boklm |  Owner:  boklm
 Type:  task  | Status:  new
 Priority:  Medium|  Milestone:
Component:  Applications/Tor Browser  |Version:
 Severity:  Normal| Resolution:
 Keywords:|  Actual Points:
Parent ID:| Points:
 Reviewer:|Sponsor:
--+---
Changes (by gk):

 * cc: gk (added)


--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs