Re: [Call For Help] Clang + OpenJDK + head + amd64 == cocktail of death (for clusters)

2013-07-25 Thread Peter Jeremy
On 2013-Jul-25 10:39:17 +0200, Baptiste Daroussin b...@freebsd.org wrote:
After some investigation we discover that blacklisting openjdk6 allows the
building process to go to completion again.
...
It seems to happen only on head amd64, so far we think it is only
happening when jdk is built with clang.

This mail arrives at an opportune time.  I've just discovered that if
I build openjdk6 with clang (on head/amd64), the resultant jdk SEGV's
if I again try to build openjdk6.  If I build it with USE_GCC=any
then the problem goes away.

I have no time, neither skill to investigate that,

I don't have the time to investigate further but forcing the use of gcc
instead of clang is at least a workaround.

-- 
Peter Jeremy


pgpDa0UXCa_Nr.pgp
Description: PGP signature


Re: [Call For Help] Clang + OpenJDK + head + amd64 == cocktail of death (for clusters)

2013-07-25 Thread Baptiste Daroussin
On Thu, Jul 25, 2013 at 01:13:02PM +0400, Dmitry Samersoff wrote:
 -BEGIN PGP SIGNED MESSAGE-
 Hash: SHA1
 
 Hi Baptiste,
 
 If I understand you correct, hotspot crashes because of out of memory
 or some other resource constraint?
 
 Could you send me whole hs_err_pid.log file (or better couple of it)?
 
 - -Dmitry

I would love to but this is done on the cluster where the jail is wiped out once
it finished (failure or not)

Best would be probably to ulimit -m 4194304 before building let say textproc/fop
from the ports tree. you should hit it pretty quickly.

regards,
Bapt


pgpf_FXiZo9JN.pgp
Description: PGP signature


Re: [Call For Help] Clang + OpenJDK + head + amd64 == cocktail of death (for clusters)

2013-07-25 Thread Sevan / Venture37

Trying to build openjdk6 dies on r253620
Tried setting MAKE_JOBS_UNSAFE=yes with not much success, happy to do 
further testing if anyone has any diffs or suggestions.



Sevan / Venture37


---  Reinstalling 'openjdk6-b27_5' (java/openjdk6)
---  Building '/usr/ports/java/openjdk6'
===  Cleaning for openjdk6-b27_5
===  License GPLv2 accepted by the user
===  Found saved configuration for openjdk6-b27_5
===   openjdk6-b27_5 depends on file: /usr/local/sbin/pkg - found
=== Fetching all distfiles required by openjdk6-b27_5 for building
===  Extracting for openjdk6-b27_5
= SHA256 Checksum OK for openjdk-6-src-b27-26_oct_2012.tar.gz.
= SHA256 Checksum OK for jaxp144_05.zip.
= SHA256 Checksum OK for jdk6-jaxws2_1_6-2011_06_13.zip.
= SHA256 Checksum OK for jdk6-jaf-b20.zip.
= SHA256 Checksum OK for apache-ant-1.8.4-bin.tar.bz2.
===  Patching for openjdk6-b27_5
===  Applying extra patch /usr/ports/java/openjdk6/files/icedtea/jaxp.patch
===  Applying extra patch 
/usr/ports/java/openjdk6/files/icedtea/jaxws.patch
===  Applying extra patch 
/usr/ports/java/openjdk6/files/icedtea/security/20120830/7182135-impossible_to_use_some_editors_directly.patch
===  Applying extra patch 
/usr/ports/java/openjdk6/files/icedtea/security/20130201/7201068.patch
===  Applying extra patch 
/usr/ports/java/openjdk6/files/icedtea/security/20130201/6563318.patch
===  Applying extra patch 
/usr/ports/java/openjdk6/files/icedtea/security/20130201/6664509.patch
===  Applying extra patch 
/usr/ports/java/openjdk6/files/icedtea/security/20130201/6776941.patch
===  Applying extra patch 
/usr/ports/java/openjdk6/files/icedtea/security/20130201/7141694.patch
===  Applying extra patch 
/usr/ports/java/openjdk6/files/icedtea/security/20130201/7173145.patch
===  Applying extra patch 
/usr/ports/java/openjdk6/files/icedtea/security/20130201/7186945.patch
===  Applying extra patch 
/usr/ports/java/openjdk6/files/icedtea/security/20130201/7186948.patch
===  Applying extra patch 
/usr/ports/java/openjdk6/files/icedtea/security/20130201/7186952.patch
===  Applying extra patch 
/usr/ports/java/openjdk6/files/icedtea/security/20130201/7186954.patch
===  Applying extra patch 
/usr/ports/java/openjdk6/files/icedtea/security/20130201/7192392.patch
===  Applying extra patch 
/usr/ports/java/openjdk6/files/icedtea/security/20130201/7192393.patch
===  Applying extra patch 
/usr/ports/java/openjdk6/files/icedtea/security/20130201/7192977.patch
===  Applying extra patch 
/usr/ports/java/openjdk6/files/icedtea/security/20130201/7197546.patch
===  Applying extra patch 
/usr/ports/java/openjdk6/files/icedtea/security/20130201/7200491.patch
===  Applying extra patch 
/usr/ports/java/openjdk6/files/icedtea/security/20130201/7200500.patch
===  Applying extra patch 
/usr/ports/java/openjdk6/files/icedtea/security/20130201/7201064.patch
===  Applying extra patch 
/usr/ports/java/openjdk6/files/icedtea/security/20130201/7201066.patch
===  Applying extra patch 
/usr/ports/java/openjdk6/files/icedtea/security/20130201/7201070.patch
===  Applying extra patch 
/usr/ports/java/openjdk6/files/icedtea/security/20130201/7201071.patch
===  Applying extra patch 
/usr/ports/java/openjdk6/files/icedtea/security/20130201/8000210.patch
===  Applying extra patch 
/usr/ports/java/openjdk6/files/icedtea/security/20130201/8000537.patch
===  Applying extra patch 
/usr/ports/java/openjdk6/files/icedtea/security/20130201/8000540.patch
===  Applying extra patch 
/usr/ports/java/openjdk6/files/icedtea/security/20130201/8000631.patch
===  Applying extra patch 
/usr/ports/java/openjdk6/files/icedtea/security/20130201/8001242.patch
===  Applying extra patch 
/usr/ports/java/openjdk6/files/icedtea/security/20130201/8001307.patch
===  Applying extra patch 
/usr/ports/java/openjdk6/files/icedtea/security/20130201/8001972.patch
===  Applying extra patch 
/usr/ports/java/openjdk6/files/icedtea/security/20130201/8002325.patch
===  Applying extra patch 
/usr/ports/java/openjdk6/files/icedtea/security/20130219/8006446.patch
===  Applying extra patch 
/usr/ports/java/openjdk6/files/icedtea/security/20130219/8006777.patch
===  Applying extra patch 
/usr/ports/java/openjdk6/files/icedtea/security/20130219/8007688.patch
===  Applying extra patch 
/usr/ports/java/openjdk6/files/icedtea/security/20130304/8007014.patch
===  Applying extra patch 
/usr/ports/java/openjdk6/files/icedtea/security/20130304/8007675.patch
===  Applying extra patch 
/usr/ports/java/openjdk6/files/icedtea/openjdk/7036559-concurrenthashmap_improvements.patch
===  Applying extra patch 
/usr/ports/java/openjdk6/files/icedtea/security/20130416/8009063.patch
===  Applying extra patch 
/usr/ports/java/openjdk6/files/icedtea/openjdk/8004302-soap_test_failure.patch
===  Applying extra patch 
/usr/ports/java/openjdk6/files/icedtea/security/20130416/6657673.patch
===  Applying extra patch 
/usr/ports/java/openjdk6/files/icedtea/security/20130416/6657673-fixup.patch
===  Applying extra patch 

Re: [Call For Help] Clang + OpenJDK + head + amd64 == cocktail of death (for clusters)

2013-07-25 Thread Dmitry Samersoff
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Hi Baptiste,

If I understand you correct, hotspot crashes because of out of memory
or some other resource constraint?

Could you send me whole hs_err_pid.log file (or better couple of it)?

- -Dmitry


On 2013-07-25 12:39, Baptiste Daroussin wrote:
 Hi all,
 
 It's been a while since we are experiencing major problem on the
 package buidling cluster: it dies when building package for head
 amd64. (the buidling jail being the snapshort from July 7th iirc.)
 
 After some investigation we discover that blacklisting openjdk6
 allows the building process to go to completion again.
 
 But not providing java packages is not a good solution.
 
 We have managed to fix the build by limiting the allowed memory
 usage on each building jail to 8G, the result is a huge load of
 java packages just fail to build because it eats all the memory and
 then segfault, but at least they do not kill the box again. Have a
 look at the pkg-fallout mailing list you should be able to see lots
 of java port failed because of that.
 
 It seems to happen only on head amd64, so far we think it is only
 happening when jdk is built with clang.
 
 I have no time, neither skill to investigate that, so please if you
 are interested in having java packages available have a look at it,
 fix the problem if any may that be clang, openjdk, the ports tree
 framework for java building, or anything related. Otherwise I'll
 have to mark all failing packages as broken on head amd64 in the
 portstree :(
 
 regards, Bapt
 


- -- 
Dmitry Samersoff
Saint Petersburg, Russia, http://devnull.samersoff.net
* There will come soft rains  ...
-BEGIN PGP SIGNATURE-
Version: GnuPG v2.0.19 (GNU/Linux)
Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/

iQEcBAEBAgAGBQJR8OweAAoJEHEy08c4gIABwsAH/jdIMktpssHgyhaE8GH2uEme
/8S5n8tXd2mCRszKsPde0FPwBsz1XfyeM/6sD1o6vBeLMCEwCKxyUHyRxL3cwZ0E
XYosan6id1v8vTGzHid3qGxJ68MHsGNbTO4uJ2mSh0sO39frofiL11kVyzMel31/
NhUElw/aZcWWVSCM3rVXx+QuzzF9tHn2WhYG9AQLYJcMuqerjvgniIYKB2C/TKo8
eM0qxhsR2JfI08TIruDmo/2AnDQICMI9oObdO1ewvuqOOP1ydndVMUj0ZR8NQgEx
eUYIcoWhpo6o2F9j1QXdjNIOfRod02MbCrtAimAXXpXlwgFMrVujowBB5P01ErY=
=svP7
-END PGP SIGNATURE-
___
freebsd-current@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to freebsd-current-unsubscr...@freebsd.org


Re: [Call For Help] Clang + OpenJDK + head + amd64 == cocktail of death (for clusters)

2013-07-25 Thread Baptiste Daroussin
On Thu, Jul 25, 2013 at 01:13:02PM +0400, Dmitry Samersoff wrote:
 -BEGIN PGP SIGNED MESSAGE-
 Hash: SHA1
 
 Hi Baptiste,
 
 If I understand you correct, hotspot crashes because of out of memory
 or some other resource constraint?
 
 Could you send me whole hs_err_pid.log file (or better couple of it)?
 
 - -Dmitry
 

FYI Dmitry fixed the problem thank you very much !
With the following patch:
http://www.andric.com/freebsd/ports/java__openjdk6-deoptimization-crash.diff

The bug is known upstream as: 
http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=6636110

I have committed in the ports tree as it is necessary to finish properly
building packages.

regards,
Bapt


pgpasbqI4IDyl.pgp
Description: PGP signature