And now a shorter post.
Besides everything else, I suspect there are some dependencies on GNU
conventions and/or specifics of the run-time environment.
The good news is that I can - again - generate a 32-bit build for AIX
- when I package on AIX 5.3.
All for now.
On Sat, Oct 24, 2015 at 7:46 PM, Michael Felt <aixto...@gmail.com> wrote:
> I have determined why there are many "WARNING: Duplicate symbol:" messages.
>
> *** My apologies for the length *** There is a lot of detail - but I
> hope the detail will help R - and others - setup correct options for
> shared libraries.
> *** As I press send, I have not stopped testing (my final trial here
> might not even work) - but!
> *** the message is that shared libraries do not need to have all
> external libraries on the command line to make a shareable library
> (that is the whole point of multiple shared libraries I think)
>
> Anyway, I hope you are"in" for a long read.
>
> a) the duplicate symbol messages occur during the creation (read
> linking) of a shared object.
> b) the shared object does not need to have all symbols resolved -
> actually, you do not want "external" symbols from elsewhere pulled
> into to the archive.
> c) one example - stats.so
>
> currently the command to make stats.so is:
>
> gcc -Wl,-bnoquiet -std=gnu99 -shared -Wl,-brtl -Wl,-G -Wl,-bexpall
> -Wl,-bnoentry -o stats.so init.o kmeans.o ansari.o bandwidth
> s.o chisqsim.o d2x2xk.o fexact.o kendall.o ks.o line.o smooth.o prho.o
> swilk.o ksmooth.o loessc.o monoSpl.o isoreg.o Srunmed.o d
> blcen.o distance.o hclust-utils.o nls.o rWishart.o HoltWinters.o
> PPsum.o arima.o burg.o filter.o mAR.o pacf.o starma.o port.o fa
> mily.o sbart.o approx.o loglin.o lowess.o massdist.o splines.o lm.o
> complete_cases.o cov.o deriv.o fft.o fourier.o model.o optim
> .o optimize.o integrate.o random.o distn.o zeroin.o rcont.o
> influence.o bsplvd.o bvalue.o bvalus.o loessf.o ppr.o qsbart.o sgram
> .o sinerp.o sslvrg.o stxwx.o hclust.o kmns.o eureka.o stl.o portsrc.o
> lminfl.o -fopenmp -L../../../../lib -lRlapack -lgfortran -
> lm /opt/lib/gcc/powerpc-ibm-aix5.3.0.0/4.7.4/libgcc.a -lg -lm
> /opt/lib/libintl.a /opt/lib/libiconv.a -lpthread
>
> The result has duplicate symbols:
>
> With comments:
>
> gcc -Wl,-bnoquiet -std=gnu99 -shared -Wl,-brtl -Wl,-G -Wl,-bexpall
> -Wl,-bnoentry -o stats.so init.o kmeans.o ansari.o bandwidths.o
> chisqsim.o d2x2xk.o fexact.o kendall.o ks.o line.o smooth.o prho.o
> swilk.o ksmooth.o loessc.o monoSpl.o isoreg.o Srunmed.o dblcen.o
> distance.o hclust-utils.o nls.o rWishart.o HoltWinters.o PPsum.o
> arima.o burg.o filter.o mAR.o pacf.o starma.o port.o family.o sbart.o
> approx.o loglin.o lowess.o massdist.o splines.o lm.o complete_cases.o
> cov.o deriv.o fft.o fourier.o model.o optim.o optimize.o integrate.o
> random.o distn.o zeroin.o rcont.o influence.o bsplvd.o bvalue.o
> bvalus.o loessf.o ppr.o qsbart.o sgram.o sinerp.o sslvrg.o stxwx.o
> hclust.o kmns.o eureka.o stl.o portsrc.o lminfl.o -fopenmp
> -L../../../../lib -lRlapack -lgfortran -lm
> /opt/lib/gcc/powerpc-ibm-aix5.3.0.0/4.7.4/libgcc.a -lg -lm
> /opt/lib/libintl.a /opt/lib/libiconv.a -lpthread -lc
> (ld): halt 4
> ** Display the options passed to ld
> (ld): setopt r/o->w
> (ld): setopt nodelcsect
> (ld): setopt noautoexp
> (ld): setopt expall
> (ld): setopt rtl
> (ld): setopt nortllib
> (ld): setopt symbolic:0
> (ld): setfflag 4
> (ld): savename stats.so
> (ld): filelist 82 2
> ** not a program, not all symbols need to resolve
> (ld): setopt noprogram
> ** not a program, not a defined entry point
> (ld): noentry
> NOENTRY: There is no entry point.
> ** link/load these objects
> (ld): i init.o
> (ld): i /tmp//ccc85WAT.o
> (ld): i kmeans.o
> (ld): i ansari.o
> (ld): i bandwidths.o
> (ld): i chisqsim.o
> (ld): i d2x2xk.o
> (ld): i fexact.o
> (ld): i kendall.o
> (ld): i ks.o
> (ld): i line.o
> (ld): i smooth.o
> (ld): i prho.o
> (ld): i swilk.o
> (ld): i ksmooth.o
> (ld): i loessc.o
> (ld): i monoSpl.o
> (ld): i isoreg.o
> (ld): i Srunmed.o
> (ld): i dblcen.o
> (ld): i distance.o
> (ld): i hclust-utils.o
> (ld): i nls.o
> (ld): i rWishart.o
> (ld): i HoltWinters.o
> (ld): i PPsum.o
> (ld): i arima.o
> (ld): i burg.o
> (ld): i filter.o
> (ld): i mAR.o
> (ld): i pacf.o
> (ld): i starma.o
> (ld): i port.o
> (ld): i family.o
> (ld): i sbart.o
> (ld): i approx.o
> (ld): i loglin.o
> (ld): i lowess.o
> (ld): i massdist.o
> (ld): i splines.o
> (ld): i lm.o
> (ld): i complete_cases.o
> (ld): i cov.o
> (ld): i deriv.o
> (ld): i fft.o
> (ld): i fourier.o
> (ld): i model.o
> (ld): i optim.o
> (ld): i optimize.o
> (ld): i integrate.o
> (ld): i random.o
> (ld): i distn.o
> (ld): i zeroin.o
> (ld): i rcont.o
> (ld): i influence.o
> (ld): i bsplvd.o
> (ld): i bvalue.o
> (ld): i bvalus.o
> (ld): i loessf.o
> (ld): i ppr.o
> (ld): i qsbart.o
> (ld): i sgram.o
> (ld): i sinerp.o
> (ld): i sslvrg.o
> (ld): i stxwx.o
> (ld): i hclust.o
> (ld): i kmns.o
> (ld): i eureka.o
> (ld): i stl.o
> (ld): i portsrc.o
> (ld): i lminfl.o
> ** continue loading objects - these are archives!
> (ld): lib ../../../../lib/libRlapack.so
> (ld): lib
> /opt/lib/gcc/powerpc-ibm-aix5.3.0.0/4.7.4/../../../pthread/libgfortran.a
> (ld): lib /usr/lib/libm.a
> (ld): i /opt/lib/gcc/powerpc-ibm-aix5.3.0.0/4.7.4/libgcc.a
> (ld): lib /usr/lib/libg.a
> (ld): i /opt/lib/libintl.a
> (ld): i /opt/lib/libiconv.a
> (ld): lib /usr/lib/libpthread.a
> (ld): lib /usr/lib/libc.a
> (ld): lib /opt/lib/gcc/powerpc-ibm-aix5.3.0.0/4.7.4/../../../pthread/libgomp.a
> (ld): lib
> /opt/lib/gcc/powerpc-ibm-aix5.3.0.0/4.7.4/../../../pthread/libgcc_s.a
> ** Import Symbols from the shared objects
> LIBRARY: Shared object libRlapack.so: 574 symbols imported.
> LIBRARY: Shared object libgfortran.a[libgfortran.so.3]: 1014 symbols imported.
> LIBRARY: Shared object /opt/lib/libintl.a[libintl.so.8]: 58 symbols imported.
> LIBRARY: Shared object /opt/lib/libiconv.a[libiconv.so.2]: 13 symbols
> imported.
> LIBRARY: Shared object /opt/lib/libiconv.a[shr4.o]: 10 symbols imported.
> LIBRARY: Shared object /opt/lib/libiconv.a[shr.o]: 11 symbols imported.
> LIBRARY: Shared object libpthread.a[shr_comm.o]: 179 symbols imported.
> LIBRARY: Shared object libpthread.a[shr_xpg5.o]: 173 symbols imported.
> LIBRARY: Shared object libc.a[shr.o]: 3287 symbols imported.
> LIBRARY: Shared object libc.a[meth.o]: 2 symbols imported.
> LIBRARY: Shared object libc.a[posix_aio.o]: 20 symbols imported.
> LIBRARY: Shared object libc.a[aio.o]: 18 symbols imported.
> LIBRARY: Shared object libc.a[pse.o]: 8 symbols imported.
> LIBRARY: Shared object libc.a[dl.o]: 4 symbols imported.
> LIBRARY: Shared object libc.a[pty.o]: 1 symbols imported.
> LIBRARY: Shared object libc.a[cthread.o]: 25 symbols imported.
> LIBRARY: Shared object libc.a[uchar.o]: 4 symbols imported.
> LIBRARY: Shared object libgomp.a[libgomp.so.1]: 228 symbols imported.
> LIBRARY: Shared object libgcc_s.a[shr.o]: 127 symbols imported.
> FILELIST: Number of previously inserted files processed: 82
> ** load the symbols we are exporting
> (ld): exports /tmp//ccNjuEdL.x
> EXPORTS: Symbols exported: 312
> (ld): initfini _GLOBAL__FI_stats_so _GLOBAL__FD_stats_so
> (ld): resolve
> ** during symbol resolution we see duplicates!!!
> ld: 0711-228 WARNING: Duplicate symbols were found while resolving symbols.
> The following duplicates were found:
> Symbol Source-File(Object) OR Import-File{Shared-object}
> ------------------------- -------------------------------------------------
> .fsav {../../../../lib/libRlapack.so}
> ** Duplicate ** noname(/usr/lib/libc.a[fsavres.o])
> .fres {../../../../lib/libRlapack.so}
> ** Duplicate ** noname(/usr/lib/libc.a[fsavres.o])
> .memcpy {../../../../lib/libRlapack.so}
> ** Duplicate ** moveeq.s(/usr/lib/libc.a[moveeq.o])
> .isnan {../../../../lib/libRlapack.so}
> ** Duplicate ** isnan.s(/usr/lib/libm.a[isnan.o])
> .finite {../../../../lib/libRlapack.so}
> ** Duplicate ** finite.s(/usr/lib/libm.a[finite.o])
> ** Duplicate ** finite.s(/usr/lib/libc.a[finite.o])
> .bcopy {../../../../lib/libRlapack.so}
> ** Duplicate ** moveeq.s(/usr/lib/libc.a[moveeq.o])
> RESOLVE: 1395 of 10573 symbols were kept.
> RESOLVE: The return code is 4.
> ** sigh - do not know what glink.o is...
> (ld): addgl /usr/lib/glink.o
> ADDGL: Glink code added for 507 symbols.
> (ld): mismatch
> MISMATCH: No type mismatches exist.
> (ld): comprld
> COMPRLD: Kept 10436 of 10436 relocation entries.
> (ld): origin page 0x10000000 0x20000000
> (ld): libpath
> ../../../../lib:/opt/lib/gcc/powerpc-ibm-aix5.3.0.0/4.7.4/pthread:/opt/lib/gcc/powerpc-ibm-aix5.3.0.0/4.7.4/../../../pthread:/opt/lib/gcc/powerpc-ibm-aix5.3.0.0/4.7.4:/opt/lib/gcc/powerpc-ibm-aix5.3.0.0/4.7.4/../../..:/usr/lib:/lib
> LIBPATH: Library path set to
> ../../../../lib:/opt/lib/gcc/powerpc-ibm-aix5.3.0.0/4.7.4/pthread:/opt/lib/gcc/powerpc-ibm-aix5.3.0.0/4.7.4/../../../pthread:/opt/lib/gcc/powerpc-ibm-aix5.3.0.0/4.7.4:/opt/lib/gcc/powerpc-ibm-aix5.3.0.0/4.7.4/../../..:/usr/lib:/lib
> (ld): save SRE .
> SAVE: Section sizes = 582204+13364+884 (0x8E23C+0x3434+0x374 hex)
> SAVE: Size of TOC: 4048 (0xFD0 hex)
> SAVE: No .loader section relocation entries exist for the .text section.
> (ld): rc
> RC: Highest return code was 4.
> ld: 0711-224 WARNING: Duplicate symbol: .fsav
> ld: 0711-224 WARNING: Duplicate symbol: .fres
> ld: 0711-224 WARNING: Duplicate symbol: .memcpy
> ld: 0711-224 WARNING: Duplicate symbol: .isnan
> ld: 0711-224 WARNING: Duplicate symbol: .finite
> ld: 0711-224 WARNING: Duplicate symbol: .bcopy
>
> OKAY - lets first just get rid of the Duplicates - by removing some
> references to external (shared) libraries.
>
> Now after removing the arguments -lRlapack and -lc the command looks like:
>
> gcc -Wl,-bnoquiet -std=gnu99 -shared -Wl,-brtl -Wl,-G -Wl,-bexpall
> -Wl,-bnoentry -o stats.so init.o kmeans.o ansari.o bandwidth
> s.o chisqsim.o d2x2xk.o fexact.o kendall.o ks.o line.o smooth.o prho.o
> swilk.o ksmooth.o loessc.o monoSpl.o isoreg.o Srunmed.o d
> blcen.o distance.o hclust-utils.o nls.o rWishart.o HoltWinters.o
> PPsum.o arima.o burg.o filter.o mAR.o pacf.o starma.o port.o fa
> mily.o sbart.o approx.o loglin.o lowess.o massdist.o splines.o lm.o
> complete_cases.o cov.o deriv.o fft.o fourier.o model.o optim
> .o optimize.o integrate.o random.o distn.o zeroin.o rcont.o
> influence.o bsplvd.o bvalue.o bvalus.o loessf.o ppr.o qsbart.o sgram
> .o sinerp.o sslvrg.o stxwx.o hclust.o kmns.o eureka.o stl.o portsrc.o
> lminfl.o -fopenmp -L../../../../lib -lgfortran -lm /opt/li
> b/gcc/powerpc-ibm-aix5.3.0.0/4.7.4/libgcc.a -lg -lm /opt/lib/libintl.a
> /opt/lib/libiconv.a -lpthread
>
> And the result is (truncated)
>
> FILELIST: Number of previously inserted files processed: 81
> (ld): exports /tmp//ccSxDrfr.x
> EXPORTS: Symbols exported: 312
> (ld): initfini _GLOBAL__FI_stats_so _GLOBAL__FD_stats_so
> (ld): resolve
> RESOLVE: 1638 of 10364 symbols were kept.
> (ld): addgl /usr/lib/glink.o
> ADDGL: Glink code added for 538 symbols.
> (ld): mismatch
> MISMATCH: No type mismatches exist.
> (ld): comprld
> COMPRLD: Kept 11305 of 11305 relocation entries.
> (ld): origin page 0x10000000 0x20000000
> (ld): libpath
> ../../../../lib:/opt/lib/gcc/powerpc-ibm-aix5.3.0.0/4.7.4/pthread:/opt/lib/gcc/powerpc-ibm-aix5.3.0.0/4.7.4/../../../pthread:/opt/lib/gcc/powerpc-ibm-aix5.3.0.0/4.7.4:/opt/lib/gcc/powerpc-ibm-aix5.3.0.0/4.7.4/../../..:/usr/lib:/lib
> LIBPATH: Library path set to
> ../../../../lib:/opt/lib/gcc/powerpc-ibm-aix5.3.0.0/4.7.4/pthread:/opt/lib/gcc/powerpc-ibm-aix5.3.0.0/4.7.4/../../../pthread:/opt/lib/gcc/powerpc-ibm-aix5.3.0.0/4.7.4:/opt/lib/gcc/powerpc-ibm-aix5.3.0.0/4.7.4/../../..:/usr/lib:/lib
> (ld): save SRE .
> SAVE: Section sizes = 624252+44524+1128 (0x9867C+0xADEC+0x468 hex)
> SAVE: Size of TOC: 4452 (0x1164 hex)
> SAVE: No .loader section relocation entries exist for the .text section.
> (ld): rc
> RC: Highest return code was 0.
>
> Note: RC is 0, rather than 4 (warnings)
>
> Now, lets try removing ALL the external libraries (better, all
> arguments from -fopenmp to the end of command)
>
> gcc -Wl,-bnoquiet -std=gnu99 -shared -Wl,-brtl -Wl,-G -Wl,-bexpall
> -Wl,-bnoentry -o stats.so init.o kmeans.o ansari.o bandwidth
> s.o chisqsim.o d2x2xk.o fexact.o kendall.o ks.o line.o smooth.o prho.o
> swilk.o ksmooth.o loessc.o monoSpl.o isoreg.o Srunmed.o d
> blcen.o distance.o hclust-utils.o nls.o rWishart.o HoltWinters.o
> PPsum.o arima.o burg.o filter.o mAR.o pacf.o starma.o port.o fa
> mily.o sbart.o approx.o loglin.o lowess.o massdist.o splines.o lm.o
> complete_cases.o cov.o deriv.o fft.o fourier.o model.o optim
> .o optimize.o integrate.o random.o distn.o zeroin.o rcont.o
> influence.o bsplvd.o bvalue.o bvalus.o loessf.o ppr.o qsbart.o sgram
> .o sinerp.o sslvrg.o stxwx.o hclust.o kmns.o eureka.o stl.o portsrc.o lminfl.o
>
> (ld): lib /opt/lib/gcc/powerpc-ibm-aix5.3.0.0/4.7.4/../../../libgcc_s.a
> (ld): lib /usr/lib/libc.a
> LIBRARY: Shared object libgcc_s.a[shr.o]: 127 symbols imported.
> LIBRARY: Shared object libc.a[shr.o]: 3287 symbols imported.
> LIBRARY: Shared object libc.a[meth.o]: 2 symbols imported.
> LIBRARY: Shared object libc.a[posix_aio.o]: 20 symbols imported.
> LIBRARY: Shared object libc.a[aio.o]: 18 symbols imported.
> LIBRARY: Shared object libc.a[pse.o]: 8 symbols imported.
> LIBRARY: Shared object libc.a[dl.o]: 4 symbols imported.
> LIBRARY: Shared object libc.a[pty.o]: 1 symbols imported.
> LIBRARY: Shared object libc.a[cthread.o]: 25 symbols imported.
> LIBRARY: Shared object libc.a[uchar.o]: 4 symbols imported.
> FILELIST: Number of previously inserted files processed: 73
> (ld): exports /tmp//ccsv1Vg9.x
> EXPORTS: Symbols exported: 312
> (ld): initfini _GLOBAL__FI_stats_so _GLOBAL__FD_stats_so
> (ld): resolve
> RESOLVE: 1325 of 6197 symbols were kept.
> (ld): addgl /usr/lib/glink.o
> ADDGL: Glink code added for 505 symbols.
> (ld): mismatch
> MISMATCH: No type mismatches exist.
> (ld): comprld
> COMPRLD: Kept 10401 of 10401 relocation entries.
> (ld): origin page 0x10000000 0x20000000
> (ld): libpath
> /opt/lib/gcc/powerpc-ibm-aix5.3.0.0/4.7.4:/opt/lib/gcc/powerpc-ibm-aix5.3.0.0/4.7.4/../../..:/usr/lib:/lib
> LIBPATH: Library path set to
> /opt/lib/gcc/powerpc-ibm-aix5.3.0.0/4.7.4:/opt/lib/gcc/powerpc-ibm-aix5.3.0.0/4.7.4/../../..:/usr/lib:/lib
> (ld): save SRE .
> SAVE: Section sizes = 575900+12696+860 (0x8C99C+0x3198+0x35C hex)
> SAVE: Size of TOC: 4016 (0xFB0 hex)
> SAVE: No .loader section relocation entries exist for the .text section.
> (ld): rc
> RC: Highest return code was 0.
>
> This is the same in all cases:
> EXPORTS: Symbols exported: 312
>
> but we have different SIZES:
> 1) SAVE: Section sizes = 582204+13364+884 (0x8E23C+0x3434+0x374 hex)
> 2) SAVE: Section sizes = 624252+44524+1128 (0x9867C+0xADEC+0x468 hex)
> 3) SAVE: Section sizes = 575900+12696+860 (0x8C99C+0x3198+0x35C hex)
>
> The size of the TOC varies accordingly.
>
> Now, for a final test - remove all the -Wl,... options except for the
> argument -G (-Wl,-G) and see what we get:
>
> gcc -Wl,-bnoquiet -std=gnu99 -Wl,-G -o stats.so init.o kmeans.o
> ansari.o bandwidths.o chisqsim.o d2x2xk.o fexact.o kendall.o ks.o
> line.o smooth.o prho.o swilk.o ksmooth.o loessc.o monoSpl.o isoreg.o
> Srunmed.o dblcen.o distance.o hclust-utils.o nls.o rWishart.o
> HoltWinters.o PPsum.o arima.o burg.o filter.o mAR.o pacf.o starma.o
> port.o family.o sbart.o approx.o loglin.o lowess.o massdist.o
> splines.o lm.o complete_cases.o cov.o deriv.o fft.o fourier.o model.o
> optim.o optimize.o integrate.o random.o distn.o zeroin.o rcont.o
> influence.o bsplvd.o bvalue.o bvalus.o loessf.o ppr.o qsbart.o sgram.o
> sinerp.o sslvrg.o stxwx.o hclust.o kmns.o eureka.o stl.o portsrc.o
> lminfl.o
>
> (ld): i stl.o
> (ld): i portsrc.o
> (ld): i lminfl.o
> (ld): i /opt/lib/gcc/powerpc-ibm-aix5.3.0.0/4.7.4/libgcc.a
> (ld): i /opt/lib/gcc/powerpc-ibm-aix5.3.0.0/4.7.4/libgcc_eh.a
> (ld): lib /usr/lib/libc.a
> LIBRARY: Shared object libc.a[shr.o]: 3287 symbols imported.
> LIBRARY: Shared object libc.a[meth.o]: 2 symbols imported.
> LIBRARY: Shared object libc.a[posix_aio.o]: 20 symbols imported.
> LIBRARY: Shared object libc.a[aio.o]: 18 symbols imported.
> LIBRARY: Shared object libc.a[pse.o]: 8 symbols imported.
> LIBRARY: Shared object libc.a[dl.o]: 4 symbols imported.
> LIBRARY: Shared object libc.a[pty.o]: 1 symbols imported.
> LIBRARY: Shared object libc.a[cthread.o]: 25 symbols imported.
> LIBRARY: Shared object libc.a[uchar.o]: 4 symbols imported.
> FILELIST: Number of previously inserted files processed: 74
> (ld): resolve
> RESOLVE: 29 of 6161 symbols were kept.
> (ld): addgl /usr/lib/glink.o
> ADDGL: Glink code added for 2 symbols.
> (ld): mismatch
> MISMATCH: No type mismatches exist.
> (ld): comprld
> COMPRLD: Kept 36 of 36 relocation entries.
> (ld): origin page 0x10000000 0x20000000
> (ld): libpath
> /opt/lib/gcc/powerpc-ibm-aix5.3.0.0/4.7.4:/opt/lib/gcc/powerpc-ibm-aix5.3.0.0/4.7.4/../../..:/usr/lib:/lib
> LIBPATH: Library path set to
> /opt/lib/gcc/powerpc-ibm-aix5.3.0.0/4.7.4:/opt/lib/gcc/powerpc-ibm-aix5.3.0.0/4.7.4/../../..:/usr/lib:/lib
> (ld): save SRE .
> SAVE: Section sizes = 680+240+4 (0x2A8+0xF0+0x4 hex)
> SAVE: Size of TOC: 68 (0x44 hex)
> SAVE: No .loader section relocation entries exist for the .text section.
> (ld): rc
> RC: Highest return code was 0.
>
> Note the SIZES:
> SAVE: Section sizes = 680+240+4 (0x2A8+0xF0+0x4 hex)
> SAVE: Size of TOC: 68 (0x44 hex)
>
> ** If stats.so is shareable - we will see a header
> root@x072:[/data/prj/cran/32/R-3.1.3.1/src/library/stats/src]dump -H stats.so
>
> stats.so:
>
> ***Loader Section***
> Loader Header Information
> VERSION# #SYMtableENT #RELOCent LENidSTR
> 0x00000001 0x00000007 0x0000000e 0x00000080
>
> #IMPfilID OFFidSTR LENstrTBL OFFstrTBL
> 0x00000003 0x00000170 0x0000002a 0x000001f0
>
>
> ***Import File Strings***
> INDEX PATH BASE MEMBER
> 0
> /opt/lib/gcc/powerpc-ibm-aix5.3.0.0/4.7.4:/opt/lib/gcc/powerpc-ibm-aix5.3.0.0/4.7.4/../../..:/usr/lib:/lib
>
> Looking at the symbols in stats.so - this is now too far "the other way"
>
> -G means
>
> (ld): halt 4
> (ld): setopt r/o->w
> (ld): setopt nodelcsect
> (ld): setopt noautoexp
> (ld): setopt rtl
> (ld): setopt nortllib
> (ld): setopt symbolic:0
> (ld): setfflag 4
> (ld): savename stats.so
> (ld): filelist 74 1
> (ld): setopt noprogram
> ** OOPS - we do not want to load crt0.o and/or init.o I think!
> (ld): i /lib/crt0.o
> (ld): i init.o
>
> Just adding -Wl,-bnoentry does not suffice, so... adding -Wl-bexpall
> gives us some body:
>
> (ld): lib /usr/lib/libc.a
> LIBRARY: Shared object libc.a[shr.o]: 3287 symbols imported.
> LIBRARY: Shared object libc.a[meth.o]: 2 symbols imported.
> LIBRARY: Shared object libc.a[posix_aio.o]: 20 symbols imported.
> LIBRARY: Shared object libc.a[aio.o]: 18 symbols imported.
> LIBRARY: Shared object libc.a[pse.o]: 8 symbols imported.
> LIBRARY: Shared object libc.a[dl.o]: 4 symbols imported.
> LIBRARY: Shared object libc.a[pty.o]: 1 symbols imported.
> LIBRARY: Shared object libc.a[cthread.o]: 25 symbols imported.
> LIBRARY: Shared object libc.a[uchar.o]: 4 symbols imported.
> FILELIST: Number of previously inserted files processed: 74
> (ld): resolve
> RESOLVE: 1324 of 6388 symbols were kept.
> (ld): addgl /usr/lib/glink.o
> ADDGL: Glink code added for 505 symbols.
> (ld): mismatch
> MISMATCH: No type mismatches exist.
> (ld): comprld
> COMPRLD: Kept 10394 of 10394 relocation entries.
> (ld): origin page 0x10000000 0x20000000
> (ld): libpath
> /opt/lib/gcc/powerpc-ibm-aix5.3.0.0/4.7.4:/opt/lib/gcc/powerpc-ibm-aix5.3.0.0/4.7.4/../../..:/usr/lib:/lib
> LIBPATH: Library path set to
> /opt/lib/gcc/powerpc-ibm-aix5.3.0.0/4.7.4:/opt/lib/gcc/powerpc-ibm-aix5.3.0.0/4.7.4/../../..:/usr/lib:/lib
> (ld): save SRE .
> SAVE: Section sizes = 575596+12560+872 (0x8C86C+0x3110+0x368 hex)
> SAVE: Size of TOC: 4012 (0xFAC hex)
> SAVE: No .loader section relocation entries exist for the .text section.
> (ld): rc
> RC: Highest return code was 0.
> root@x072:[/data/prj/cran/32/R-3.1.3.1/src/library/stats/src]ls -l stats.so
> -rwxr-xr-x 1 root system 1456186 Oct 24 17:36 stats.so
>
>
> On Sun, Oct 18, 2015 at 9:06 PM, aixtools <aixto...@gmail.com> wrote:
>> On 2015-10-15 15:02, Prof Brian Ripley wrote:
>>>
>>> On 15/10/2015 13:32, Michael Felt wrote:
>>>>
>>>> Hi.
>>>>
>>>> Just wanted to let you know I am getting close to packaging R for AIX in
>>
>> rephrase - would like to be active in keeping R binaries current for AIX. My
>> interest in not in R per se (rather a colleague who has a project that uses
>> R, so I hope to assist him, and others like him).
>>>
>>>
>>> Which version? (You mentioned 3.1.3 and 3.2.2 far below.) There is little
>>> value in reporting on frozen branches, and most value in reporting on
>>> R-devel where all the current changes have been incorporated.
>>
>> The reason for reporting old and current releases is to understand what is
>> new between releases, and what has been around for "awhile".
>>
>> Note: in the future I shall edit all the "you cannot build, could not
>> determine ... messages" - and as much as possible, shall focus on R-devel
>> "packaging".
>>
>> I (attempt to) 'package' a lot of Opensource tools for AIX. Generally, the
>> problems are not application code related (sometimes a function available on
>> one platform, e.g. Linux, but not on AIX) - but most are, or can be
>> resolved, with modifications via configure.ac, Makefile.in, etc..
>>
>> Sincerely,
>> Michael
>>
>> "Details"...
>>
>> When configure does complete - config.log starts with:
>> It was created by R configure 3.1.3, which was
>> generated by GNU Autoconf 2.69. Invocation command line was
>>
>> $ ./configure --prefix=/opt --sysconfdir=/var/R/etc
>> --sharedstatedir=/var/R/com --localstatedir=/var/R --mandir=/usr/share/man
>> --infodir=/opt/share/info/R --with-readline=no --with-x=no
>>
>> As I see you are using a recent autoconf (and I shall guess a recent
>> automake) I would like to try a more version of libtool and see if that
>> corrects anything. However, even in R-devel I do not see, directly, how you
>> are using these tools (some projects include either a setup.sh or a
>> buildconf script to standardize how the project does this.) I am quite
>> capable of just calling the tools in sequence, but would prefer to follow
>> your procedure.
>> I
>> Starting again - fresh 3.1.3, 3.2.2 and R-devel - all in 32-bit mode, for
>> the start. The goal is a 64-bit build so that memory management will be
>> easier.
>>
>> This is my "standard command for building a package"
>>
>> CPPFLAGS="-I/opt/buildaix/include -I/opt/include" CFLAGS="-I/opt/include
>> -I/opt/buildaix/include -O2" ./configure \
>> --prefix=/opt \
>> --sysconfdir=/var/R/etc \
>> --sharedstatedir=/var/R/com \
>> --localstatedir=/var/R \
>> --mandir=/usr/share/man \
>> --infodir=/opt/share/info/R --with-readline=no --with-x=no
>> Results for 3.1.3
>> configure: WARNING: you cannot build PDF versions of the R manuals
>> configure: WARNING: you cannot build PDF versions of vignettes and help
>> pages
>> configure: WARNING: you cannot build info or HTML versions of the R manuals
>> configure: WARNING: I could not determine a browser
>> configure: WARNING: I could not determine a PDF viewer
>> configure: WARNING: you cannot build info or HTML versions of the R manuals
>> configure: WARNING: you cannot build PDF versions of the R manuals
>> configure: WARNING: you cannot build PDF versions of vignettes and help
>> pages
>> configure: WARNING: I could not determine a browser
>> configure: WARNING: I could not determine a PDF viewer
>> + make > .buildaix/make.out
>> sys-std.c: In function 'Rstd_ChooseFile':
>> sys-std.c:1186:5: warning: implicit declaration of function 'isspace'
>> [-Wimplicit-function-declaration]
>> connections.c: In function 'fifo_open':
>> connections.c:885:5: warning: implicit declaration of function 'open'
>> [-Wimplicit-function-declaration]
>> main.c: In function 'dummy_ii':
>> main.c:1594:5: warning: function returns address of local variable [enabled
>> by default]
>> ld: 0711-224 WARNING: Duplicate symbol: .memcpy
>> ld: 0711-224 WARNING: Duplicate symbol: memcpy
>> ld: 0711-224 WARNING: Duplicate symbol: .bcopy
>> ld: 0711-224 WARNING: Duplicate symbol: bcopy
>> ld: 0711-224 WARNING: Duplicate symbol: .strcmp
>> ld: 0711-224 WARNING: Duplicate symbol: strcmp
>> ld: 0711-345 Use the -bloadmap or -bnoquiet option to obtain more
>> information.
>> Warning in solve.default(rgb) :
>> unable to load shared object
>> '/data/prj/cran/32/R-3.1.3/modules//lapack.so':
>> rtld: 0712-001 Symbol logf was referenced
>> from module /data/prj/cran/32/R-3.1.3/lib/libRlapack.so(), but a
>> runtime definition
>> of the symbol was not found.
>> Error in solve.default(rgb) : LAPACK routines cannot be loaded
>> Error: unable to load R code in package 'grDevices'
>> Execution halted
>> make: 1254-004 The error code from the last command is 1.
>>
>> ...
>>
>> Stop.
>> make returned an error
>> root@x072:[/data/prj/cran/32/R-3.1.3]
>> ++++++
>> Notes: Last April I was successful with building R - I do not recall
>> specifically how I changed the release. I shall determine what I did to get
>> it to build normally.
>> ++++++
>> Results for 3.2.2
>> configure: WARNING: you cannot build PDF versions of the R manuals
>> configure: WARNING: you cannot build PDF versions of vignettes and help
>> pages
>> configure: WARNING: you cannot build info or HTML versions of the R manuals
>> configure: WARNING: I could not determine a browser
>> configure: WARNING: I could not determine a PDF viewer
>> configure: WARNING: you cannot build info or HTML versions of the R manuals
>> configure: WARNING: you cannot build PDF versions of the R manuals
>> configure: WARNING: you cannot build PDF versions of vignettes and help
>> pages
>> configure: WARNING: I could not determine a browser
>> configure: WARNING: I could not determine a PDF viewer
>> + make > .buildaix/make.out
>> sys-std.c: In function 'Rstd_ChooseFile':
>> sys-std.c:1189:5: warning: implicit declaration of function 'isspace'
>> [-Wimplicit-function-declaration]
>> connections.c: In function 'fifo_open':
>> connections.c:876:5: warning: implicit declaration of function 'open'
>> [-Wimplicit-function-declaration]
>> main.c: In function 'dummy_ii':
>> main.c:1598:5: warning: function returns address of local variable [enabled
>> by default]
>> ld: 0711-415 WARNING: Symbol BM_norm_keep is already exported.
>> ld: 0711-415 WARNING: Symbol LoadInitFile is already exported.
>> ld: 0711-415 WARNING: Symbol N01_kind is already exported.
>> ld: 0711-415 WARNING: Symbol R_ReadItemDepth is already exported.
>> ld: 0711-224 WARNING: Duplicate symbol: LoadInitFile
>> ld: 0711-224 WARNING: Duplicate symbol: BM_norm_keep
>> ld: 0711-224 WARNING: Duplicate symbol: N01_kind
>> ld: 0711-224 WARNING: Duplicate symbol: R_ReadItemDepth
>> ld: 0711-345 Use the -bloadmap or -bnoquiet option to obtain more
>> information.
>> ld: 0711-415 WARNING: Symbol BM_norm_keep is already exported.
>> ld: 0711-415 WARNING: Symbol LoadInitFile is already exported.
>> ld: 0711-415 WARNING: Symbol N01_kind is already exported.
>> ld: 0711-415 WARNING: Symbol R_ReadItemDepth is already exported.
>> ld: 0711-224 WARNING: Duplicate symbol: LoadInitFile
>> ld: 0711-224 WARNING: Duplicate symbol: BM_norm_keep
>> ld: 0711-224 WARNING: Duplicate symbol: N01_kind
>> ld: 0711-224 WARNING: Duplicate symbol: R_ReadItemDepth
>> ld: 0711-345 Use the -bloadmap or -bnoquiet option to obtain more
>> information.
>> ld: 0711-224 WARNING: Duplicate symbol: .memcpy
>> ld: 0711-224 WARNING: Duplicate symbol: memcpy
>> ld: 0711-224 WARNING: Duplicate symbol: .bcopy
>> ld: 0711-224 WARNING: Duplicate symbol: bcopy
>> ld: 0711-224 WARNING: Duplicate symbol: .strcmp
>> ld: 0711-224 WARNING: Duplicate symbol: strcmp
>> ld: 0711-345 Use the -bloadmap or -bnoquiet option to obtain more
>> information.
>> /bin/sh: There is no process to read data written to a pipe.
>> Warning in solve.default(rgb) :
>> unable to load shared object
>> '/data/prj/cran/32/R-3.2.2/modules//lapack.so':
>> rtld: 0712-001 Symbol logf was referenced
>> from module /data/prj/cran/32/R-3.2.2/lib/libRlapack.so(), but a
>> runtime definition
>> of the symbol was not found.
>> Error in solve.default(rgb) : LAPACK routines cannot be loaded
>> Error: unable to load R code in package 'grDevices'
>> Execution halted
>> make: 1254-004 The error code from the last command is 1.
>>
>> ...
>> make returned an error
>> +++++
>> Here there are similiar - and new problems. The error re: rtld is usually a
>> compiler (actually ld) flag error - a routine is expected to be exported in
>> a shared object, but the object is still "static".
>> I have seen this same problem with at least one R module.
>>
>> I still am unsure why some functions are being defined double - that info
>> will come later
>> root@x072:[/data/prj/cran/32/R-3.2.2]
>>
>> +++++
>> From R-devel_2015-10-17.tar.bz2
>> configure: WARNING: you cannot build PDF versions of the R manuals
>> configure: WARNING: you cannot build PDF versions of vignettes and help
>> pages
>> configure: WARNING: you cannot build info or HTML versions of the R manuals
>> configure: WARNING: I could not determine a browser
>> configure: WARNING: I could not determine a PDF viewer
>> configure: error: bzip2 library and headers are required
>> buildaix: ./configure ... returned an error
>>
>> try doing "grep configure: config.log | tail" for possible explanation
>>
>> try "./configure --help" for additional arguments to buildaix
>> ++++ config.log configure: comments are ++++
>> configure:35647: checking bzlib.h presence
>> configure:35647: gcc -E -I/opt/buildaix/include -I/opt/include conftest.c
>> configure:35647: $? = 1
>> configure: failed program was:
>> configure:35647: result: no
>> configure:35647: checking for bzlib.h
>> configure:35647: result: no
>> configure:35712: checking whether bzip2 support suffices
>> configure:35719: error: bzip2 library and headers are required
>> configure: exit 1
>> ++++ ++++
>> Here is a completely new kind of "problem" - a demand for an include file.
>> bzip2 is available, but configure is looking for it in a different way and
>> now configure fails.
>>
>>>
>>>> One comment - the libtool.m4 I see used is quite old. The one I have on
>>>> my
>>>> system is 2.4.6, and what I see in R says:
>>>
>>>
>>> R-devel has 2.4.6 .
>>>
>>>> I am hoping a new libtool will clean up most of the manual work now
>>>> needed.
>>>
>>>
>>> But libtool is hardly used in building R.
>>>
>>>> # Which release of libtool.m4 was used?
>>>> macro_version=2.2.6
>>>> macro_revision=1.3012
>>>>
>>>> This may be all that is needed to cleanup what I am doing manually.
>>>>
>>>> working with gcc I have done the following for 64-bit building
>>>>
>>>> export OBJECT_MODE=64
>>>> export CFLAGS="-maix64 -O2"
>>>> export FFLAGS="-maix64 -O2"
>>>
>>>
>>> See the manual: flags such as -maix64 should be part of CC, not CFLAGS.
>>> That explains a lot of what was reported.
>>> Specifically,
>>> https://cran.r-project.org/doc/manuals/r-patched/R-admin.html#Essential-programs-and-libraries
>>> and https://cran.r-project.org/doc/manuals/r-patched/R-admin.html#AIX .
>>>
>>> It is safer to put such things on the configure command line or in a
>>> config.site file (they will be found when updating if you do).
>>>
>>> [Lots of test output removed.]
>>>
>>
______________________________________________
R-devel@r-project.org mailing list
https://stat.ethz.ch/mailman/listinfo/r-devel
