[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: Key note: it looks like the config option --with-hash-algorithm does nothing; python is still built with the siphash hash algorithim even though I specified fnv and, in pyconfig.h: /* Define hash algorithm for str, bytes and memoryview. SipHash24: 1, FNV: 2, externally defined: 0 */ #define Py_HASH_ALGORITHM 2 What's the correct way to build with fnv as the hash algorithm? -- ___ Python tracker <rep...@bugs.python.org> <http://bugs.python.org/issue23496> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: Pretty sure there are binaries, but the python binary can't build its own modules. I'm using GCC 4.9.2 on Android L...which means it is a PIE and that Python is being built as a PIE -- ___ Python tracker <rep...@bugs.python.org> <http://bugs.python.org/issue23496> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: GDB debugging isn't going to happen any time soon; all of the gdb tests fail. I re-compiled with the --with-pydebug option, thinking that would help, but it won't build; I get the following error when the newly built python starts to build packages: Debug memory block at address p=0xb6003070: API 'a' 795107700 bytes originally requested The 3 pad bytes at p-3 are not all FORBIDDENBYTE (0xfb): at p-3: 0x2f *** OUCH at p-2: 0x00 *** OUCH at p-1: 0x00 *** OUCH Because memory is corrupted at the start, the count of bytes requested may be bogus, and checking the trailing pad bytes may segfault. The 4 pad bytes at tail=0xe56491e4 are Segmentation fault generate-posix-vars failed Additional things I've attemptedto try to resolve the test_hash failure, based on this bug report (https://mail.python.org/pipermail/python-bugs-list/2015-March/267442.html) 1) compiling with -mno-unaligned-access 2) compiling with FNV as the default hash algorithm. Neither worked. At this point I am at a loss and am beginning to think there may be a problem with my device. Any suggestions are welcome. -- ___ Python tracker <rep...@bugs.python.org> <http://bugs.python.org/issue23496> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: UPDATE: Finslly rebuilding Python from github clone after having to factory reset my tablet for reasons (root access). Hopefully build and tests will benefit from paving and starting over. -- ___ Python tracker <rep...@bugs.python.org> <http://bugs.python.org/issue23496> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: Unfortunately, in spite of the other minor issues that resolved,I am still getting a bus error when the hash test runs. Before I dive back into trying to get gdb working to debug this, is there any way to skip this test to see of the others run? -- ___ Python tracker <rep...@bugs.python.org> <http://bugs.python.org/issue23496> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: UPDATE: Before downloading/building Google gdb source I ran test_gdb.py, which failed completely. Details of those tests are attached. -- Added file: http://bugs.python.org/file40586/test_gdb.log ___ Python tracker <rep...@bugs.python.org> <http://bugs.python.org/issue23496> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: Still battling this bus error issue. Recompiling gdb --with-python did not help; I still cannot get any useful info out of it. I suspect it may be due to this error: setpgrp failed in child: No such process but I'm not sure. At this point I'm going to try downloading the Google-patched version...hopefully it is patched such that the setpgrp bug is resolved. -- ___ Python tracker <rep...@bugs.python.org> <http://bugs.python.org/issue23496> ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment:
Ryan,
Here's the results after the edit to the ctypes test. I also re-compiled gdb
with python support, which is why this took so long
(gdb) file ./python
Load new symbol table from "./python"? (y or n) y
Reading symbols from ./python...done.
Traceback (most recent call last):
File "/bld/pyt/cpython-android/python-gdb.py", line 59, in
_type_char_ptr = gdb.lookup_type('char').pointer() # char*
AttributeError: 'module' object has no attribute 'lookup_type'
(gdb) set args -m tests
(gdb) set sysroot /usr/gcc-4.9-pie/sysroot
(gdb) run
Starting program: /bld/pyt/cpython-android/python -m tests
setpgrp failed in child: No such process
warning: Unable to find dynamic linker breakpoint function.
GDB will be unable to debug shared library initializers
and track explicitly loaded dynamic code.
Program received signal SIGILL, Illegal instruction.
0xb6a63cc8 in ?? ()
(gdb) bt
Python Exception No module named 'gdb.frames':
#0 0xb6a63cc8 in ?? ()
#1 0xb6a5feb0 in ?? ()
Backtrace stopped: previous frame identical to this frame (corrupt stack?)
--
___
Python tracker <rep...@bugs.python.org>
<http://bugs.python.org/issue23496>
___
___
Python-bugs-list mailing list
Unsubscribe:
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: UPDATE: Still working on the test_hash issue; not making much progress QUESTION Does gdb have to be configured with the --with-python switch in order to debug the python binary correctly? -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: On August 22, 2015 2:47:42 PM CDT, Ryan Gonzalez rep...@bugs.python.org wrote: Ryan Gonzalez added the comment: I'm assuming gdb still doesn't work? It does. I just don't know it well enough to know if the errors are something I'm doing wrong or something the program is doing wrong. Basically I'm running gdb file ./python set args -m test set sysroot /path/to/sysroot run and examining/posting the results. Which are confusing to me because, again, don't know it well enough. On August 22, 2015 1:06:41 PM CDT, Cyd Haselton rep...@bugs.python.org wrote: Cyd Haselton added the comment: Update: I found this bug report (https://bugs.python.org/issue23786) and re-compiled python with -mno-unaligned-access as mentioned. test_hash still throws a bus error. Back to drawing boardsuggestions welcome. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: Update: I found this bug report (https://bugs.python.org/issue23786) and re-compiled python with -mno-unaligned-access as mentioned. test_hash still throws a bus error. Back to drawing boardsuggestions welcome. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: Question for Ryan Gonzalez: Given this information... On August 20, 2015 8:03:13 PM CDT, Russell Keith-Magee rep...@bugs.python.org wrote: Russell Keith-Magee added the comment: What hardware architecture are you compiling for? If it's ARM64, and you're not using a trunk version of libffi, that segfault in test_ctypes is to be expected. Does this mean I can safely ignore the segfault? Well, safely in the sense that everything except a very recent version of libffi is known to not work on ARM64 - so if it doesn't work, it's not because of something Python is doing wrong, it's a problem with a dependency. ...do you know of a way to run all tests except _ctypes, so that Imcan verify everything else? And to answer Russell's questions: Are you using the libffi sources vendored into the Python source tree, or a more recent version? By 'vendored in' do you mean 'sources included in python source tree for building?' Correct. The libffi source code that is in the Python source tree is quite old, and *definitely* doesn't work on ARM64. I'm not even sure that it works on ARMv7. Definitely using the vendored in sources. Would your recommend downloading and building libffi from sources (on device) and then building python? Well, for starters - as I've said before, I'd recommend not compiling on device at all, but that's a separate issue. Any particular reason why? The device I'm working with has a port of GCC which I've used to build other utilities that work well...given that I'm working on a tablet. However, regardless of where you're compiling, you can either use an external libffi, or you can do what I've done in the iOS patch - update the Python source tree to include a newer version of libffi. If you update the source in the Python tree, you need to use 2 versions (or a merged version); you need v3.2 sources for ARMv7, and trunk sources for ARM64. This is because libffi v3.2 doesn't work for ARM64, and trunk doesn't even compile for ARMv7. See the iOS patch for details. Since I'm not compiling for ARM64...and have zero experience with hacking configure.ac files...would it be okay to include just the 3.2 sources if I note somewhere that this fork does not include ARM64 support? I'm asking the above questions because I've hit a fairly significant roadblock; I'm still getting the segfault when test_ctypes is run and I can't seem to get anything useful out of gdb. Personally, I've pretty much given up on CPython on Android. Even when I got it working, the performance of the JNI layer is *abysmal*, and severely crippled. If you're planning to actually interact with the device in any way (like, say, put a button on the screen), that's a big problem. My goal is to build a port that operates on Android in a Linux-like environment; I'm currently using KBOX3. I've no experience with the Python language so JNI interop is Greek to me. For what i'm using the port for it functions fairly well. I'm working on an approach that uses Java natively - think Jython for Android. I'm still a way off having anything working, though. I'll keep an eye out for it once I've got Python basics under my belt. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: Thanks Ryan. Running ./python -m test (with the edit to the __init__.py for ctypes) produces the following error: [151/390/18] test_hash Fatal Python error: Bus error Current thread 0xb6f72ec8 (most recent call first): File /bld/pyt/cpython-android/Lib/test/test_hash.py, line 89 in test_unaligned_buffers File /bld/pyt/cpython-android/Lib/unittest/case.py, line 577 in run File /bld/pyt/cpython-android/Lib/unittest/case.py, line 625 in __call__ File /bld/pyt/cpython-android/Lib/unittest/suite.py, line 122 in run File /bld/pyt/cpython-android/Lib/unittest/suite.py, line 84 in __call__ File /bld/pyt/cpython-android/Lib/unittest/suite.py, line 122 in run File /bld/pyt/cpython-android/Lib/unittest/suite.py, line 84 in __call__ File /bld/pyt/cpython-android/Lib/unittest/suite.py, line 122 in run File /bld/pyt/cpython-android/Lib/unittest/suite.py, line 84 in __call__ File /bld/pyt/cpython-android/Lib/test/support/__init__.py, line 1668 in run File /bld/pyt/cpython-android/Lib/test/support/__init__.py, line 1769 in _run_suite File /bld/pyt/cpython-android/Lib/test/support/__init__.py, line 1803 in run_unittest File /bld/pyt/cpython-android/Lib/test/regrtest.py, line 1279 in test_runner File /bld/pyt/cpython-android/Lib/test/regrtest.py, line 1280 in runtest_inner File /bld/pyt/cpython-android/Lib/test/regrtest.py, line 978 in runtest File /bld/pyt/cpython-android/Lib/test/regrtest.py, line 763 in main File /bld/pyt/cpython-android/Lib/test/regrtest.py, line 1564 in main_in_temp_cwd File /bld/pyt/cpython-android/Lib/test/__main__.py, line 3 in module File /bld/pyt/cpython-android/Lib/runpy.py, line 85 in _run_code File /bld/pyt/cpython-android/Lib/runpy.py, line 170 in _run_module_as_main Bus error Not sure what a bus error is...off to Google -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: A few questions for Russell: What hardware architecture are you compiling for? If it's ARM64, and you're not using a trunk version of libffi, that segfault in test_ctypes is to be expected. Does this mean I can safely ignore the segfault? Are you using the libffi sources vendored into the Python source tree, or a more recent version? By 'vendored in' do you mean 'sources included in python source tree for building?' I can verify that libffi v3.2 works on ARMv7 (on iOS, anyway), and there's been plenty of changes to the ARM source tree since the Python version was vendored in. Would your recommend downloading and building libffi from sources (on device) and then building python? I'm asking the above questions because I've hit a fairly significant roadblock; I'm still getting the segfault when test_ctypes is run and I can't seem to get anything useful out of gdb. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: Result: (gdb) bt #0 0xb6a63cc8 in ?? () #1 0xb6a5feb0 in ?? () Backtrace stopped: previous frame identical to this frame (corrupt stack?) -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: No...compiled with GCC 4.9.2 On August 17, 2015 9:39:55 AM CDT, Ryan Gonzalez rep...@bugs.python.org wrote: Ryan Gonzalez added the comment: Wait, did you compile this with Clang? On August 17, 2015 9:24:50 AM CDT, Cyd Haselton rep...@bugs.python.org wrote: Cyd Haselton added the comment: Result: (gdb) bt #0 0xb6a63cc8 in ?? () #1 0xb6a5feb0 in ?? () Backtrace stopped: previous frame identical to this frame (corrupt stack?) -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: I thought porting gdb would be the difficult part of getting debug info. I was so wrong. Here is what I have so far, after lengthy consultation of the gdb manual. Bear with me...it's basically a copy paste of gdb session output: (gdb) run Starting program: /bld/pyt/cpython-android/python setpgrp failed in child: No such process warning: Unable to find dynamic linker breakpoint function. GDB will be unable to debug shared library initializers and track explicitly loaded dynamic code. Program received signal SIGILL, Illegal instruction. 0xb6a63cc8 in ?? () (gdb) f #0 0xb6a63cc8 in ?? () (gdb) info f Stack level 0, frame at 0xbefff618: pc = 0xb6a63cc8; saved pc = 0xb6a5feb0 called by frame at 0xbefff618 Arglist at 0xbefff618, args: Locals at 0xbefff618, Previous frame's sp is 0xbefff618 (gdb) info args No symbol table info available. (gdb) info local No symbol table info available. (gdb) info source Current source file is ./Modules/python.c Compilation directory is /bld/pyt/cpython-android Located in /bld/pyt/cpython-android/Modules/python.c Contains 80 lines. Source language is c. Compiled with DWARF 2 debugging format. Does not include preprocessor macro info. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: After struggling to get helpful output from gdb it is looking like it will not be possible due to the lack of debugging symbols in the libs on the android device. Still investigating. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: A nominal bump before starting to re-build a PIE gdb to debug the segfault above -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: Finally found a hacky fix for the no module named _struct found; I copied all Modules/*.cpython-34m.so objects to Lib. Unfortunately I still get a segfault error when test_ctypes is run: [ 83/390/11] test_ctypes Fatal Python error: Segmentation fault Current thread 0xb6f2bec8 (most recent call first): File /bld/pyt/cpython-android/Lib/ctypes/test/test_as_parameter.py, line 85 in test_callbacks File /bld/pyt/cpython-android/Lib/unittest/case.py, line 577 in run File /bld/pyt/cpython-android/Lib/unittest/case.py, line 625 in __call__ File /bld/pyt/cpython-android/Lib/unittest/suite.py, line 122 in run File /bld/pyt/cpython-android/Lib/unittest/suite.py, line 84 in __call__ File /bld/pyt/cpython-android/Lib/unittest/suite.py, line 122 in run File /bld/pyt/cpython-android/Lib/unittest/suite.py, line 84 in __call__ File /bld/pyt/cpython-android/Lib/unittest/suite.py, line 122 in run File /bld/pyt/cpython-android/Lib/unittest/suite.py, line 84 in __call__ File /bld/pyt/cpython-android/Lib/unittest/suite.py, line 122 in run File /bld/pyt/cpython-android/Lib/unittest/suite.py, line 84 in __call__ File /bld/pyt/cpython-android/Lib/test/support/__init__.py, line 1668 in run File /bld/pyt/cpython-android/Lib/test/support/__init__.py, line 1769 in _run_suite File /bld/pyt/cpython-android/Lib/test/support/__init__.py, line 1803 in run_unittest File /bld/pyt/cpython-android/Lib/test/regrtest.py, line 1279 in test_runner File /bld/pyt/cpython-android/Lib/test/regrtest.py, line 1280 in runtest_inner File /bld/pyt/cpython-android/Lib/test/regrtest.py, line 978 in runtest File /bld/pyt/cpython-android/Lib/test/regrtest.py, line 763 in main File /bld/pyt/cpython-android/Lib/test/regrtest.py, line 1564 in main_in_temp_cwd File /bld/pyt/cpython-android/Lib/test/__main__.py, line 3 in module File /bld/pyt/cpython-android/Lib/runpy.py, line 85 in _run_code File /bld/pyt/cpython-android/Lib/runpy.py, line 170 in _run_module_as_main Segmentation fault -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: As soon as I build a PIE gdb I can. And right now, running ./python -m test throws the ImportError...so I'll need to resolve that first On Jul 25, 2015 12:38 PM, Ryan Gonzalez rep...@bugs.python.org wrote: Ryan Gonzalez added the comment: So...I have *no* clue why _struct can't be found. Can you use gdb to get the segfault backtrace like you did before? On July 25, 2015 6:56:10 AM CDT, Cyd Haselton rep...@bugs.python.org wrote: Cyd Haselton added the comment: I assume so; I'm using whatever is pulled frommy fork of the git repo. I've actually run into a different error that occured when i rebuilt to include readline support; when I run ./python -m test I;m getting ImportError: no module named _struct found. Trying to figure that one out first... -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: I assume so; I'm using whatever is pulled frommy fork of the git repo. I've actually run into a different error that occured when i rebuilt to include readline support; when I run ./python -m test I;m getting ImportError: no module named _struct found. Trying to figure that one out first... -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: I'm compiling for ARM, not ARM64, on an armv7 device. On July 23, 2015 7:10:35 PM CDT, Russell Keith-Magee rep...@bugs.python.org wrote: Russell Keith-Magee added the comment: What hardware architecture are you compiling for? If it's ARM64, and you're not using a trunk version of libffi, that segfault in test_ctypes is to be expected. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: Build complete. Unfortunately while some of the tests complete successfully, the run ends in a segfault (see attached log) -- Added file: http://bugs.python.org/file40002/py_test_results.log ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: UPDATE: Build environment is up and running; cloning repo now. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: UPDATE: Haven't forgotten about this; I'm currently (thanks to Android's new mandatory PIE binaries requirement) rebuilding all of the necessary utilities (openssl, curl, git, etc) so that I can clone and test. Between the above and a sharp increase in workload at the day job, expect a few weeks delay between now and continued work on this issue. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: Your question about -fPIE brings up a question: How should the differences between Android 5 and previous versions be handled in regards to this issue? Other than mandatory -fPIE, there are changes to Android[s libc that may make patches for python on Android 4.x incompatible with Android 5. Thoughts? On June 29, 2015 9:29:35 AM CDT, Cyd Haselton rep...@bugs.python.org wrote: Cyd Haselton added the comment: No...haven't upgraded to Android 5.0 yet. On June 29, 2015 9:00:01 AM CDT, Ryan Gonzalez rep...@bugs.python.org wrote: Ryan Gonzalez added the comment: You compiled with -fPIE and GCC, right? I know the Android Clang seems broken. On June 29, 2015 7:09:25 AM CDT, Cyd Haselton rep...@bugs.python.org wrote: Cyd Haselton added the comment: FYI, Figured out that running ./configure with --with-pydebug does NOT define Py_DEBUG in pyconfig.h. Defining it in pyconfig.h got me past the undefined reference to `_PyUnicode_CheckConsistency' error, but i'm now getting this: if test $? -ne 0 ; then \ echo generate-posix-vars failed ; \ rm -f ./pybuilddir.txt ; \ exit 1 ; \ fi Debug memory block at address p=0x90b7b0: API '' 2416312320 bytes originally requested The 3 pad bytes at p-3 are not all FORBIDDENBYTE (0xfb): at p-3: 0x00 *** OUCH at p-2: 0x00 *** OUCH at p-1: 0x00 *** OUCH Because memory is corrupted at the start, the count of bytes requested may be bogus, and checking the trailing pad bytes may segfault. The 4 pad bytes at tail=0x9096b7b0 are Segmentation fault generate-posix-vars failed make: *** [pybuilddir.txt] Error 1 Will re-check patch application and try again -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: On June 30, 2015 9:20:45 AM CDT, Ryan Gonzalez rep...@bugs.python.org wrote: Ryan Gonzalez added the comment: On June 30, 2015 8:14:34 AM CDT, Cyd Haselton rep...@bugs.python.org wrote: Cyd Haselton added the comment: Your question about -fPIE brings up a question: How should the differences between Android 5 and previous versions be handled in regards to this issue? Other than mandatory -fPIE, there are changes to Android[s libc that may make patches for python on Android 4.x incompatible with Android 5. WHAT??? :( I can't find a list anywhere; how do you know? I tried building GCC for Android 5 on device and ran into a bunch of errors like 'undefined symbol __swbuf.' Googling the errors led to this page: https://developer.android.com/ndk/downloads/revision_history.html. Relevant Part here: Removed the following symbols from all architectures: get_malloc_leak_info,free_malloc_leak_info, __srget, __swbuf, __srefill,__swsetup, __sdidinit, __sflags, __sfp, __sinit, __smakebuf,__sflush, __sread, __swrite, __sseek, __sclose, _fwalk,__sglue, __get_thread, __wait4, __futex_wake, __open,__get_tls, __getdents64, and dlmalloc. Thoughts? Not really... Would setting up two repos be advisable...one for 5 and one for 4.x and earlier? On June 29, 2015 9:29:35 AM CDT, Cyd Haselton rep...@bugs.python.org wrote: Cyd Haselton added the comment: No...haven't upgraded to Android 5.0 yet. On June 29, 2015 9:00:01 AM CDT, Ryan Gonzalez rep...@bugs.python.org wrote: Ryan Gonzalez added the comment: You compiled with -fPIE and GCC, right? I know the Android Clang seems broken. On June 29, 2015 7:09:25 AM CDT, Cyd Haselton rep...@bugs.python.org wrote: Cyd Haselton added the comment: FYI, Figured out that running ./configure with --with-pydebug does NOT define Py_DEBUG in pyconfig.h. Defining it in pyconfig.h got me past the undefined reference to `_PyUnicode_CheckConsistency' error, but i'm now getting this: if test $? -ne 0 ; then \ echo generate-posix-vars failed ; \ rm -f ./pybuilddir.txt ; \ exit 1 ; \ fi Debug memory block at address p=0x90b7b0: API '' 2416312320 bytes originally requested The 3 pad bytes at p-3 are not all FORBIDDENBYTE (0xfb): at p-3: 0x00 *** OUCH at p-2: 0x00 *** OUCH at p-1: 0x00 *** OUCH Because memory is corrupted at the start, the count of bytes requested may be bogus, and checking the trailing pad bytes may segfault. The 4 pad bytes at tail=0x9096b7b0 are Segmentation fault generate-posix-vars failed make: *** [pybuilddir.txt] Error 1 Will re-check patch application and try again -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: FYI, Figured out that running ./configure with --with-pydebug does NOT define Py_DEBUG in pyconfig.h. Defining it in pyconfig.h got me past the undefined reference to `_PyUnicode_CheckConsistency' error, but i'm now getting this: if test $? -ne 0 ; then \ echo generate-posix-vars failed ; \ rm -f ./pybuilddir.txt ; \ exit 1 ; \ fi Debug memory block at address p=0x90b7b0: API '' 2416312320 bytes originally requested The 3 pad bytes at p-3 are not all FORBIDDENBYTE (0xfb): at p-3: 0x00 *** OUCH at p-2: 0x00 *** OUCH at p-1: 0x00 *** OUCH Because memory is corrupted at the start, the count of bytes requested may be bogus, and checking the trailing pad bytes may segfault. The 4 pad bytes at tail=0x9096b7b0 are Segmentation fault generate-posix-vars failed make: *** [pybuilddir.txt] Error 1 Will re-check patch application and try again -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: No...haven't upgraded to Android 5.0 yet. On June 29, 2015 9:00:01 AM CDT, Ryan Gonzalez rep...@bugs.python.org wrote: Ryan Gonzalez added the comment: You compiled with -fPIE and GCC, right? I know the Android Clang seems broken. On June 29, 2015 7:09:25 AM CDT, Cyd Haselton rep...@bugs.python.org wrote: Cyd Haselton added the comment: FYI, Figured out that running ./configure with --with-pydebug does NOT define Py_DEBUG in pyconfig.h. Defining it in pyconfig.h got me past the undefined reference to `_PyUnicode_CheckConsistency' error, but i'm now getting this: if test $? -ne 0 ; then \ echo generate-posix-vars failed ; \ rm -f ./pybuilddir.txt ; \ exit 1 ; \ fi Debug memory block at address p=0x90b7b0: API '' 2416312320 bytes originally requested The 3 pad bytes at p-3 are not all FORBIDDENBYTE (0xfb): at p-3: 0x00 *** OUCH at p-2: 0x00 *** OUCH at p-1: 0x00 *** OUCH Because memory is corrupted at the start, the count of bytes requested may be bogus, and checking the trailing pad bytes may segfault. The 4 pad bytes at tail=0x9096b7b0 are Segmentation fault generate-posix-vars failed make: *** [pybuilddir.txt] Error 1 Will re-check patch application and try again -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: I've run into an error when building python in preparation for running tests (i. e. with --with-pydebug in the ./configure params). ./libpython3.4dm.so: undefined reference to `_PyUnicode_CheckConsistency' It doesn't seem to be defined anywhere in source that I can see and i'm not sure why. Google turns up a few hits from the bug-tracker but none have resolutions http://bugs.python.org/issue13869 http://bugs.python.org/msg151986 Any thoughts? -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: UPDATE: Spent this past weekend fixing the broken on-device compiler. Will get to tests this weekend -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: Update: Now that I;ve finished porting a much-needed gdb to my device, I should have time to tackle patch and testing this weekend. Will post results when I have them. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: Will do...if by try the tests now you mean run 'make tests'...but it may be about a week or two as a) I'm currently in the last stages of a mono port and b) will be working on a PIE gcc for android 5.0 after, so that I have a KBOX environment to work with after verizon updates my tablet. If I can keep putting off the verizon 5.0 update On June 4, 2015 4:52:59 PM CDT, Ryan Gonzalez rep...@bugs.python.org wrote: Ryan Gonzalez added the comment: #1 and #2 are fixed. I hand-edited the patch file (!!), so here's to hoping it'll work... Working on #3. You probably should try the tests now (which is obviously the scary part ;). -- Added file: http://bugs.python.org/file39628/kbox_fix.patch ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: All, Just checking in as it has been a while...is there anything I need to do on my end for this port? -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: On May 29, 2015 10:52:23 AM CDT, Ryan Gonzalez rep...@bugs.python.org wrote: Ryan Gonzalez added the comment: I thought you were running the tests... Which tests? Or was there something I had to do that I missed? From one of the earlier messages I posted: 1) -python3.4m needs to be changed to -python3.5m...or the appropriate versioning variable. 2) colons at the end of the elif lines in setup.py (1950- ) 3) The _crypt and readline module builds in setup.py need additional libraries to work...python3.5m for both and possibly ncurses for readline, I'll test and get back to you. With #1 and #2 added, the build and install completes successfully, although you obviously can't import readline and _crypt. *snip* The messages after that one document how I got readline to work On May 29, 2015 5:54:18 AM CDT, Cyd Haselton rep...@bugs.python.org wrote: Cyd Haselton added the comment: All, Just checking in as it has been a while...is there anything I need to do on my end for this port? -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: On a related note, I managed to get pip working with this build...minus some errors with verbose mode. I first had to make some edits to setup.py and Modules/Setup so that the build would find and make the _ssl and lzip modules. After running make install, I ran 'python -m ensurepip'. I tested it by searching for and installing the BeautifulSoup module. Ryan, Let me know what are the next steps for this issue/build...and I'll do my best to get them done. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: Finally got readline to work with this build, but since the fixes are to the readline source tree I'm not sure if they should go here. With that plus whatever fixes to patches I suggested previously, I think this build works. What would be the next steps for this...running tests? -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: Still working at this; I can't get the readline module to work. It is built successfully but importing it produces the following error: Traceback (most recent call last): File stdin, line 1, in module ImportError: dlopen failed: could not load library libreadline.so.6 needed by readline.cpython-35m-arm-linux-gnueabi.so; caused by cannot locate symbol tgetnum referenced by libreadline.so.6... tgetnum is undefined in libreadline but defined in -libncurses and libtinfo. I've built and re-built readline (--with-curses and -without that option...linking -lncurses, then -lncurses and -ltinfo) in the KBOX environment. I've edited Modules/Setup and setup.py so as to specify the readline library plus a combination of others (-ncurses, -tinfo) to no avail. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: FYI, I'm on commit c917493dc4ea2c32371da861aca2235f0a08e68e -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: Ryan, There's not a python.c in the ./Programs file? -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: Ryan, Completely forgot to download and apply it, but based on what I see there are a few things that need to be corrected. 1) -python3.4m needs to be changed to -python3.5m...or the appropriate versioning variable. 2) colons at the end of the elif lines in setup.py (1950- ) 3) The _crypt and readline module builds in setup.py need additional libraries to work...python3.5m for both and possibly ncurses for readline, I'll test and get back to you. With #1 and #2 added, the build and install completes successfully, although you obviously can't import readline and _crypt. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment:
Ryan,
Found the missing fix.
In ./Programs/python.c
#ifndef __ANDROID__
oldloc = _PyMem_RawStrdup(setlocale(LC_ALL, NULL));
if (!oldloc) {
fprintf(stderr, out of memory\n);
return 1;
}
#endif
Added the #ifndef __ANDROID__ #endif around lines 46-51
I'm now looking at the following syntax error:
File ./setup.py, line 1950
elif host_platform.startswith('arm-linux')
^
SyntaxError: invalid syntax
make: *** [sharedmods] Error 1
--
___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue23496
___
___
Python-bugs-list mailing list
Unsubscribe:
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: Patch for python.c that prevents segfault on Android -- Added file: http://bugs.python.org/file39135/python.patch ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: Ryan, That fix is in the android_segfault patch, but it's for frozenmain.c not python.c I cloned from master on Fri/Sat. Will double-check commit tomorrow but I think the problem is with the unpatched python.c -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: Do you have the time/means to create a quick patch for that? I ask because even a simple flip like that becomes a major pain when working with nano on a tablet. If not, I'll start on it. Just thought Id ask -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: Ryan, Sorry...same problem. Segmentation fault generate-posix-vars failed make: *** [pybuilddir.txt] Error 1 /bld/python/cpython-master/cpython $ addr2line -C -f -e /lib/libpython3.5m.so.1.0 0008f42c _PyMem_RawStrdup /bld/python/cpython-master/cpython/Objects/obmalloc.c:358 -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: Ryan, Here's the output from addr2line bld/python/cpython-master/cpython $ addr2line -C -f -e /lib/libpython3.5m.so.1.0 0008f42c _PyMem_RawStrdup /bld/python/cpython-master/cpython/Objects/obmalloc.c:358 -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: Unfortunately starting from scratch did not solve the issue. Still getting a segfault when the newly built binary tries to run sysconfig -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: FYI, even with patches applied to main.c and python.c, the newly-built python binary segfaults in the same location. I'll tear down and re-do everything (git clone master, patch, configure and make) but I may not get to it until next weekend. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: Perhaps the 'include androidfn.h' should be removed from pythonrun.c? Or the function definition added to the androidfn.h? (IANACC) -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: FYI, running 'make clean' make does not resolve the last reported issue. Trying 'make distclean' ./configure make. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: H. That patch failed to apply: Possibly reversed hunk 1 at 1582 Hunk 1 failed 35/35 -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment:
Hello Ryan,
Error from latest patch:
Python/pythonrun.c:44:8: error: conflicting types for 'android_mbstowcs'
size_t android_mbstowcs(wchar_t *dest, char * in, int maxlen) {
^
In file included from Python/pythonrun.c:18:0:
Include/androidfn.h:10:8: note: previous declaration of 'android_mbstowcs' was
here
size_t android_mbstowcs(wchar_t *dest, const char * source, int maxlen);
^
Python/pythonrun.c:61:8: error: conflicting types for 'android_wcstombs'
size_t android_wcstombs(char * dest, wchar_t *source, int maxlen)
^
In file included from Python/pythonrun.c:18:0:
Include/androidfn.h:9:8: note: previous declaration of 'android_wcstombs' was
here
size_t android_wcstombs(char * dest, const wchar_t *source, int maxlen);
^
Python/pythonrun.c: In function 'android_wcstombs':
Python/pythonrun.c:68:5: error: expected ';' before 'if'
if (c = 0xdc800 c = 0xdcff)
^
Python/pythonrun.c:63:11: warning: variable 'c' set but not used
[-Wunused-but-set-variable]
wchar_t c;
^
make: *** [Python/pythonrun.o] Error 1
--
___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue23496
___
___
Python-bugs-list mailing list
Unsubscribe:
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: Done, but got this error: Python/pythonrun.c: In function 'android_wcstombs': Python/pythonrun.c:67:5: error: expected ';' before 'if' if (c = 0xdc800 c = 0xdcff) ^ Python/pythonrun.c:62:11: warning: variable 'c' set but not used [-Wunused-but-set-variable] wchar_t c; ^ make: *** [Python/pythonrun.o] Error 1 -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: Thanks Ryan. (Probably should remove original androidfn.h patch; patch complains with 'file already exists' if I don't delete Include/androidfn.h before applying the latest patch) -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: Will do, re: removing the '+'. Also, attempted to apply the updated patch and got the following: /bld/python/cpython-master $ patch -p1 issue_20306\ \(1\).patch patching file Modules/pwdmodule.c Possibly reversed hunk 1 at 244 Hunk 1 FAILED 79/79. SETS(setIndex++, p-pw_passwd); PyStructSequence_SET_ITEM(v, setIndex++, _PyLong_FromUid(p-pw_uid)); PyStructSequence_SET_ITEM(v, setIndex++, _PyLong_FromGid(p-pw_gid)); +#ifdef HAVE_PASSWD_GECOS_FIELD SETS(setIndex++, p-pw_gecos); +#else +SETS(setIndex++, Py_None); +Py_INCREF(Py_None); +#endif SETS(setIndex++, p-pw_dir); SETS(setIndex++, p-pw_shell); patching file configure.ac Hunk 56 FAILED 4944/4944. AC_MSG_RESULT($ENSUREPIP) AC_SUBST(ENSUREPIP) +AC_CHECK_MEMBER([struct passwd.pw_gecos], + [AC_DEFINE(HAVE_PASSWD_GECOS_FIELD, 1, [Define if pwd.h defines field passwd.pw_gecos])], + [], + [[#include pwd.h]]) + # generate output files AC_CONFIG_FILES(Makefile.pre Modules/Setup.config Misc/python.pc Misc/python-config.sh) AC_CONFIG_FILES([Modules/ld_so_aix], [chmod +x Modules/ld_so_aix]) /bld/python/cpython-master $ -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: Update: Removing the random '+' on line 87 of pwdmodule.c allowed the build to continue but it failed again with the following during or soon after linking: Objects/unicodeobject.o: In function `PyUnicode_EncodeLocale': /bld/python/cpython-master/Objects/unicodeobject.c:3236: undefined reference to `android_wcstombs' /bld/python/cpython-master/Objects/unicodeobject.c:3248: undefined reference to `android_wcstombs' Objects/unicodeobject.o: In function `wcstombs_errorpos': /bld/python/cpython-master/Objects/unicodeobject.c:3154: undefined reference to `android_wcstombs' Objects/unicodeobject.o: In function `PyUnicode_DecodeLocaleAndSize': /bld/python/cpython-master/Objects/unicodeobject.c:3518: undefined reference to `android_mbstowcs' /bld/python/cpython-master/Objects/unicodeobject.c:3518: undefined reference to `android_mbstowcs' Objects/complexobject.o: In function `_Py_c_pow': /bld/python/cpython-master/Objects/complexobject.c:129: undefined reference to `sincos' Python/fileutils.o: In function `Py_DecodeLocale': /bld/python/cpython-master/Python/fileutils.c:322: undefined reference to `android_mbstowcs' Python/fileutils.o: In function `Py_EncodeLocale': /bld/python/cpython-master/Python/fileutils.c:487: undefined reference to `android_wcstombs' /bld/python/cpython-master/Python/fileutils.c:489: undefined reference to `android_wcstombs' Python/fileutils.o: In function `_Py_wfopen': /bld/python/cpython-master/Python/fileutils.c:1008: undefined reference to `android_wcstombs' collect2: error: ld returned 1 exit status make: *** [Programs/_freeze_importlib] Error 1 Maybe the androidfn.h wasn't added to the files above? -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: Thanks Ryan, the patch worked. Latest error (when building Modules/pwdmodule.c:) ^ ./Modules/pwdmodule.c:86:2: error: stray '#' in program +#endif ^ ./Modules/pwdmodule.c:86:3: error: 'endif' undeclared (first use in this function) +#endif ^ ./Modules/pwdmodule.c:86:3: note: each undeclared identifier is reported only once for each function it appears in ./Modules/pwdmodule.c:75:21: error: expected ';' before 'sets' #define SETS(i,val) sets(v, i, val) ^ ./Modules/pwdmodule.c:87:5: note: in expansion of macro 'SETS' SETS(setIndex++, p-pw_dir); ^ ./Modules/pwdmodule.c: At top level: ./Modules/pwdmodule.c:81:0: error: unterminated #else #ifdef HAVE_PASSWD_GECOS_FIELD ^ make: *** [Modules/pwdmodule.o] Error 1 /bld/python/cpython-master $ -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: Latest error: gcc --sysroot=/usr/gcc-4.9.2/sysroot -c -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g -O3 -Wall -Wstrict-prototypes -Werror=declaration-after-statement -I. -IInclude -I./Include -DPy_BUILD_CORE -o Objects/unicodeobject.o Objects/unicodeobject.c Objects/unicodeobject.c:45:23: fatal error: androidfn.h: No such file or directory #include androidfn.h ^ compilation terminated. make: *** [Objects/unicodeobject.o] Error 1 No idea what androidfn.h is, but will troubleshoot in the AM -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: issue_20306.patch won't install; attempting to do so yields the following: patching file configure.ac Hunk 56 FAILED 4944/4944. AC_MSG_RESULT($ENSUREPIP) AC_SUBST(ENSUREPIP) +AC_CHECK_MEMBER([struct passwd.pw_gecos], + [AC_DEFINE(HAVE_PASSWD_GECOS_FIELD, 1, [Define if pwd.h defines field passwd.pw_gecos])], + [], + [[#include pwd.h]]) + # generate output files AC_CONFIG_FILES(Makefile.pre Modules/Setup.config Misc/python.pc Misc/python-config.sh) AC_CONFIG_FILES([Modules/ld_so_aix], [chmod +x Modules/ld_so_aix]) For the time being I'll just use --without-ensurepip when configuring. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment:
Hey Ryan,
Just now patching downloaded/unzipped tip and was wondering if there was an
order in which patches should be applied.
I ask because i'm getting the following when applying the
android_segfault_fix.patch
/bld/python/cpython-3.4/cpython-3.4/Python $ patch android_segfault_fix.patch
patching file frozenmain.c
Hunk 3 FAILED 53/56.
}
setlocale(LC_ALL, );
+#endif
for (i = 0; i argc; i++) {
argv_copy[i] = Py_DecodeLocale(argv[i], NULL);
argv_copy2[i] = argv_copy[i];
patching file pylifecycle.c
patch: can't open 'pylifecycle.c': No such file or directory
Thoughts?
--
___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue23496
___
___
Python-bugs-list mailing list
Unsubscribe:
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: UPDATE: I found the file in github, under master, in Python/. It's not in the 3.4 or origin/3.4 branches...aren't we working on those? Or does it not matter? -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: From previous post: ** How does this sound? * I'll clone the fork of the 3.4 branch I made in github, build and patch. * Ryan will (as best as he can) grab said patches, regenerate them for the bug tracker or forward port them to 3.5 (in github? to Mercurial) ** For some reason I was thinking that the 3.4 branch I cloned was a dev branch. I'll start again with a download of 3.5 dev. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: Ryan, For now I'll make the edits to pyconfig.h manually after downloading the zip from the tip and running configure with necessary params. I'll do my best to get this done this weekend, but it may have to wait until next. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: Ryan, From where do you want me to download Python for testing? I'm assuming I need to test by a) downloading an unpatched 3.4.2, b) applying patches, c) running ./configure make make install.. If this is not correct let me know -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: Ryan, Has anyone taken you up on the non-KBOX testing? Do you need me to test the patches within the KBOX environment? -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: Dog just died unexpectedly, behind on photograph project, need to start on Python tutorial, have a chat in a different language on Sunday I need to prep for and its patch day tomorrow. So yeah. Completely understand. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: Ryan, What version of Android and KBOX are you using? Are you cross-compiling? If not could you post the output of printenv from within KBOX here? -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: Ryan, There are utilities you'll need in the KBOX environment, some of which may not be available at the KBOX download site. You'll need to download the make, gcc 4.8.0 and gawk packages from the download site, and vim and/or nano depending on your preference. If you get an 'undefined reference to dlopen' error during the build, you'll need the updated libfakechroot; update this ticket and I'll figure out a way to get it to you (I'm not sure if the currently available KBOX includes it or not). -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: Ryan, Here are the changes to pyconfig.h. I left out this #define ANDROID 1 because GCC 4.8.x and up have -mandroid -mbionic that define __ANDROID__ so I've been using that. #define HAVE_BROKEN_MBSTOWCS 1 #undef HAVE_DEV_PTMX #undef HAVE_GETHOSTBYNAME_R #undef HAVE_MBRTOWC #define HAVE_NCURSES_H 1 /* This only if you've cross compiled curses */ #undef HAVE_SETLOCALE #undef HAVE_WCSCOLL #undef HAVE_WCSFTIME #undef HAVE_WCSXFRM The following changes were made to Modules/Setup *shared* snip array arraymodule.c -L. -lpython3.4m # array objects cmath cmathmodule.c _math.c -L. -lpython3.4m -lm # complex math library functions math mathmodule.c _math.c -L. -lpython3.4m -lm # math library functions, e.g. sin() _struct _struct.c -L. -lpython3.4m # binary structure packing/unpacking time timemodule.c -L. -lpython3.4m -lm # time operations and variables _testcapi _testcapimodule.c-L. -lpython3.4m # Python C API test module _random _randommodule.c -L. -lpython3.4m # Random number generator _elementtree -I$(srcdir)/Modules/expat -DHAVE_EXPAT_CONFIG_H -DUSE_PYEXPAT_CAPI _ele menttree.c -L -lpython3.4m # elementtree accelerator _pickle _pickle.c -L. -lpython3.4m # pickle accelerator _datetime _datetimemodule.c -L. -lpython3.4m # datetime accelerator _bisect _bisectmodule.c -L. -lpython3.4m # Bisection algorithms unicodedata unicodedata.c-L. -lpython3.4m # static Unicode character database snip #grp grpmodule.c# grp(3) select selectmodule.c -lm -L. -lpython3.4m # select(2); not on ancient System V # CSV file helper _csv _csv.c -L. -lpython3.4m # Socket module helper for socket(2) _socket socketmodule.c -L. -lpython3.4m # Socket module helper for SSL support; you must comment out the other # socket line above, and possibly edit the SSL variable: #SSL=/usr/local/ssl _ssl _ssl.c \ -DUSE_SSL -I$(SSL)/include -I$(SSL)/include/openssl \-L. -lpython3.4m -L$(SSL)/lib -lssl -lcrypto -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: I can... ./configure --prefix=/usr/python --enable-shared --without-ensurepip ...but configure didn't set up pyconfig.h correctly with those options. There are some changes I had to make post-configure to pyconfig.h and others when I initially built python...see this link: https://code.google.com/p/python-for-android/wiki/CrossCompilingPython specifically the part about manually editing pyconfig.h -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: I understand; I haven't made the edits to these files but the edits are needed in order for the Android build to work properly. How do you want me to handle them? I can post the expected values here as a diff, or just as plain text...? -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: Ryan, I believe I've gotten all non-configure dependent commits in. How do you want me to handle post-configure edits I;ve made to get Python working (i.e. changes to pyconfig.h, Modules/Setup...) -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: Ryan, Edits made to files generated or modified by running ./configure. Example: pyconfig.h. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: Ryan, Sounds good. I think I've got all of the bug tracker patches committed/pushed...now I need to do all of the other edits. Aiming to be finished by Friday/Saturday. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: Ryan, Thanks. First commit in; all fixes for Android's broken mbstowcs, new plat-android and plat-android/DLFCN.py. What are you trying to build? -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: Well, why don't you try? :) Resource optimization. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: Fine, I'm also optimizing and the fix isn't going into libmpdec. Android can use the Python version of decimal. Er, ok. Not entirely sure what this means, mostly because the handful of spare cycles not allocated to a) getting a fork up, running and patched b) learning git on the fly for a) c) porting spidermonkey (why I ported Python) and d) learning Python, are already dedicated to other projects. And work. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: *ALL Android devices have /dev/ptmx (adb even assumes it)...should the *configure script be modified to skip that check if cross-compiling for *Android? Yes, definitely. See the mods to pyconfig.h here https://code.google.com/p/python-for-android/wiki/CrossCompilingPython Ignore the #define ANDROID 1. GCC 4.8.x and later add -mandroid and/or -mbionic which defines __ANDROID__; I've been putting android-related changes under that macro. *Cyd (and anyone else who can), do you think you could test the binaries, *too? I'll get them to you somehow. You have a real device; I have an old *real device and an emulator. Sure...especially since the KBOX env is needed. *Side note for Cyd: I'd advise you just use the fork of CPython you have *and just push them to GitHub: $ git remote add origin url of your GitHub repo with .git at the end $ git push --all origin -u *That will push your changes (and every branch of CPython, I have no clue *what your branch name is, so this just does everything) to the GitHub *mirror. I forked the Cpython repo on Github, set 3.4 as the default branch and $git clone https://github.com/cydhaselton/cpython.git After modifying files and/or adding dirs, copying files $git add modified file Hopefully the above was ok. Off to read up on commits -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: Stefan, I wouldn't know if they're reported to the same bug tracker...it's possible they aren't. Additionally it's possible that the lack of locale support in libc isn't considered a bug. Ethan, Given Victor's recommendation of using the dev branch and the fact that my mods were made to a stable download (3.4.2), what would be the recommended way to go about getting my efforts into github so that they can be built upon? Should I start working with the fork I've already made of cpython (with 3.4.2 as the default branch) or is there a different method I should use? -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: Ethan, The binary produced runs in the KBOX environment. It can be copied between devices provided the target device has the KBOX environment installed. Victor et al, I read https://docs.python.org/devguide/devcycle.html#indevbranch a couple of times and, unless I;m missing something the dev branch only contains the 3.5 release. This may be an obvious question but if I fork the 3.4 branch would Android-related patches be eligible for that branch? I'm hesitant to clone the dev branch as I;ve worked hard to get the latest stable version (3.4.2?) working on my device; I'm more interested in a) making my efforts available to others and b) learning the Python language than c) constantly working at making the latest and greatest Android-friendly -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: Given Stephan's comments regarding Android support I'm beginning to think that I may have bitten off more than I can chew. Is there an option between 'constant work' and 'zero contribution'? I am not by any means an Android developer so the following is possibly riddled with miconceptions and errata, but, regarding locale support, I think there's a difference between 'regular' and 'native' development. Native development involves using the NDK to port various bits of C-written utilities and libraries to Android...like python... and it is where the locale is broken, because of Android's limited libc. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: How does this sound? * I'll clone the fork of the 3.4 branch I made in github, build and patch. * Ryan will (as best as he can) grab said patches, regenerate them for the bug tracker or forward port them to 3.5 (in github? to Mercurial) * I'll figure out the upgrade/maintain/patch workflow as best I can so i can set it up on my build device and help out with porting later versions of Python. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: ...or, should I fork the 3.4 branch? If so, which one...3.4 or origin/3.4? -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: Thanks Ryan. Should I create a branch off the master at github and patch there or just clone the master and patch? -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: Thanks for that suggestion R. David...that would be ideal given the 2.x requirements of Mercurial would mean i'd need to re-port Python before tackling a port of Mercurial. I'll wait until Ryan chimes in before I start serious work with git, just in case. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: Thanks for the suggestion Victor, however I've only ported git to this environment; the most I;ve used it is to run 'git clone' to pull source from a repo. The recommendation from the mobile-sig mailing list is...given my lack of familiarity with VCS..is to attempt to port and work with Mercurial. If doing so starts to take too much bandwidth I'll fall back to git and the article you linked. Side Note: I cannot emphasize enough how little I know about how to use git and most of the other tools I've ported to this environment. My goal was to get as many of the 'standard' Linux utilities running in this environment, then start learning them. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: The attached g-zipped file contains the first set of patches required to build Python 3.4.2 from source in the environment specified in the origonal post. Will post the second/final set ASAP -- Added file: http://bugs.python.org/file38209/python-3.4.2-androidpatches-1.tar.gz ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Changes by Cyd Haselton chasel...@gmail.com: Removed file: http://bugs.python.org/file38209/python-3.4.2-androidpatches-1.tar.gz ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
Cyd Haselton added the comment: Apologies for the tarball, but all patches within are related to this issue Removing tarball and will re-post individual, cleaned-up patches, grouped by issue. Ryan, can you re-do patch for pythonrun.c? If not. I'l. work it in. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue23496 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue23496] Steps for Android Native Build of Python 3.4.2
New submission from Cyd Haselton:
This is a (hopefully) complete list of patches and modifications required to
natively build Python 3.4.2 on an Android device where
patches == listed issues in this bug tracker
modifications (mods) == unsubmitted patches and/or edits made to source
CAVEATS
Build was completed on a tablet running Android 4.4.2 and within the KBOX
environment; an app that simulates a Linux filesystem by using a ported version
of fakechroot. Details of the environment can be found here:
http://kevinboone.net/kbox2_how_it_works.html. NOTE: During the Python build it
was necessary to patch this environment with a modified version of fakechroot;
the KBOX version currently available as of 2.21.2015 may not contain the
modified fakechroot.
CONFIGURE POST-CONFIGURE MAKE
The configure command was run with the following parameters
--enable-shared
--without-ensurepip
--prefix=/usr/python
After running configure. changes were made to pyconfig.h to account for various
platform limitations and to Setup to ensure that a) all modules specified were
built as shared and b) modules that used symbols from libpython were explicitly
linked to said library. See attached pyconfig.h and Setup.
Make fails when the newly built python binary tries to execute and run
setup.py. This is resolved by copying the shared library from the build
directory to /lib in the KBOX environment. Otherwise make make install runs
without errors provided patches/mods are applied. I did not run make test or
the equivalent for this build.
PATCHES/MODS
The attached patches from the following issues must be applied:
http://bugs.python.org/issue20305
http://bugs.python.org/issue16353 (NOTE: use patch with 'defpath' not
'confstr', which is not supported in Android)
http://bugs.python.org/issue21668
The following modifications to source must be made:
The instructions under 'Code Changes' at this link:
https://code.google.com/p/python-for-android/wiki/CrossCompilingPython
The attached patch, contributed by Ryan Gonzales (patch.diff)
The changes listed below by file (apologies for formatting)
/* patch for strdup segfault issue in readline.c */
#define RESTORE_LOCALE(sl) { if (sl) { setlocale(LC_CTYPE, sl); free(sl); } }
char *_locale = setlocale(LC_CTYPE, NULL);
char *saved_locale;
if(!_locale)
_locale = ;
saved_locale = strdup(_locale);
char *saved_locale = setlocale(LC_CTYPE, NULL);
if (saved_locale != NULL) {
saved_locale = strdup(saved_locale);
if (!saved_locale)
Py_FatalError(not enough memory to save locale);
}
/* fix for Lib/ctypes/__init.py__ */
30 DEFAULT_MODE == RTLD_GLOBAL
/* patch for python.c */
/* here line for oldloc is commented out */
24 int i, res;
25 /* char *oldloc; */
26 #ifdef __FreeBSD__
/* here oldloc lines commented out */
46
47 /* oldloc = _PyMem_RawStrdup(setlocale(LC_ALL, NULL));
48* if (!oldloc) {
49* fprintf(stderr, out of memory\n);
50* return 1;
51*
52* }
53*/
/* patch for pythonrun.c 307, --309-310, ++311-313 --1009-1012 ++1013-1014 */
305 return get_codec_name(codeset);
306 #else
307char* m;
308PyErr_SetNone(PyExc_NotImplementedError);
309/* return NULL; */
310/* char* m; */
311m = malloc(6);
312strcpy(m, ascii);
313return m;
314 #endif
315 }
1002 static int
1003 initfsencoding(PyInterpreterState *interp)
1004 {
1005 PyObject *codec;
1006
1007 if (Py_FileSystemDefaultEncoding == NULL)
1008 {
1009 /* Py_FileSystemDefaultEncoding = get_locale_encoding();
1010 * if (Py_FileSystemDefaultEncoding == NULL)
1011 * Py_FatalError(Py_Initialize: Unable to get the locale
encoding
1011 );
1012 */
1013Py_FileSystemDefaultEncoding = malloc(6);
1014strcpy(Py_FileSystemDefaultEncoding, ascii);
1015 Py_HasFileSystemDefaultEncoding = 0;
1016 interp-fscodec_initialized = 1;
1017 return 0;
1018 }
1019
/* changes to Lib/plat-linux/DLFCN.py */
76 # Included from bits/dlfcn.h
77 # Changed for Android
78 RTLD_LAZY = 1
79 RTLD_NOW = 0
80 #RTLD_BINDING_MASK = 0x3
81 #RTLD_NOLOAD = 0x4
82 RTLD_GLOBAL = 2
83 RTLD_LOCAL = 0
84 #RTLD_NODELETE = 0x01000
85
86 # Also from Android's dlfcn.h
87 RTLD_DEFAULT ((void*) 0x)
88 RTLD_NEXT ((void*) 0xfffe)
89
--
components: Build
files: patch.diff
keywords: patch
messages: 236389
nosy: chaselton
priority: normal
severity: normal
status: open
title: Steps for Android Native Build of Python 3.4.2
versions: Python 3.4
Added file: http://bugs.python.org/file38201/patch.diff
___
Python tracker rep...@bugs.python.org
http
Android Native Build Help: python build_ext
I'm building python on my Android tablet and, while the executable and library builds successfully, I run into a problem when the newly built python runs build_ext; it builds the _struct module and then immediately afterwards my build environment throws an 'undefined reference to dlopen' error. To figure out what is missing dlopen, I need to somehow figure out what build_ext is trying to do. I've tried running the command manually with the --verbose option with no results. Does build_ext build modules in a certain order? If so, what is that order? -- https://mail.python.org/mailman/listinfo/python-list
Re: Build Question: How to Add -Wl, --option Before Objects In Setup.py?
On Sun, Nov 2, 2014 at 3:38 PM, Ned Deily n...@acm.org wrote: In article cahu5pryq3xegtd-7ahzmdbwk32nprfxz24dfdm1oj-wnmyj...@mail.gmail.com, Cyd Haselton chasel...@gmail.com wrote: Just checking: is sincos() the same as sin() and cos()? Nm output for my toolchain's libm does show sin() and cos() just not sincos() See, this is what you get when you ask for free help: bad info. Silly me...what was I thinking? sincos isn't the same, as a little of googling informs me. But, as the thread starting here indicates: I did a fairly exhaustive search for the sincos() error code I was getting and that link did not turn up for me at all. Instead I found a reference that seemed to imply that such a macro should be implemented but it was not implemented in GCC-4.8.0. Then again, the link you found doesn't seem to indicate which version of GCC has this feature...maybe it is versions later than 4.8.0... https://sourceware.org/ml/binutils/2010-04/msg00219.html gcc can do an optimization that turns a pair of sin() and cos() calls with the same arguments into a single call to sincos(). And there is such a pair in Python's complexobject.c. As the thread explains, there are some platforms where sin() and cos() are implemented but not sincos(). As suggested in the thread, one approach is to give options to gcc to avoid the optimizations: CFLAGS='-fno-builtin-sin -fno-builtin-cos' That does seem to result in a libpython with no references to sincos. Sounds good...I'll try it if bootstrapping 4.9.0 goes south. -- Ned Deily, n...@acm.org -- https://mail.python.org/mailman/listinfo/python-list -- https://mail.python.org/mailman/listinfo/python-list
Re: Build Question: How to Add -Wl, --option Before Objects In Setup.py?
On Sat, Nov 1, 2014 at 5:25 PM, Ned Deily n...@acm.org wrote: In article cahu5praf_9rkgyw5yzp4tqs3dzsx0qm70esunuknodcqztm...@mail.gmail.com, Cyd Haselton chasel...@gmail.com wrote: On Sat, Nov 1, 2014 at 1:47 PM, Cyd Haselton chasel...@gmail.com wrote: [...] Sure enough, nm -D libm.so shows that sincos is NOT available in that library on my Android device. Now to figure out what to do about it. [...] UPDATE: After doing a bit of research it looks like it would be easier to build Python without sincos...is that possible? If not, I'll need to figure out how to get bionic libm sources with a proper Makefile (instead of Android's build system) While sin() and/or cos() are primarily used in the expected places in the Python standard library (like the math module), sin() is also used in the implementation of type complex objects, code that is part of the core interpreter. Just checking: is sincos() the same as sin() and cos()? Nm output for my toolchain's libm does show sin() and cos() just not sincos() I see that there is an old, undocumented, and unsupported macro to disable building of complex number support. But more hacking is needed to even get a somewhat working build with it these days and then, without complex support, many tests in the standard library fail and what you end up isn't really Python. So, I think rather than hacking up Python, you should try to fix the broken platform. There seem to be a number of project that claim to support Python on Android. Perhaps they could be of help. *sigh* Well, I had planned on bootstrapping GCC 4.9.0...I guess I'll be doing it sooner rather than later. Interestingly enough, the toolchain sources at android.googlesource.com only have Python 2.7.5...perhaps the reason is related to this issue. If GCC supports building Python in the source tree, I'll try it with that version and report back. FWIW, the macro is WITHOUT_COMPLEX: ./configure [...] CPPFLAGS='-DWITHOUT_COMPLEX' and Lib/optparse.py would need to be patched to comment out its use of complex. Again, good luck! And thanks again for all your help. I'll report back with results, if and when I have them. -- Ned Deily, n...@acm.org -- https://mail.python.org/mailman/listinfo/python-list -- https://mail.python.org/mailman/listinfo/python-list
Re: Build Question: How to Add -Wl, --option Before Objects In Setup.py?
On Sat, Nov 1, 2014 at 5:52 AM, Ned Deily n...@acm.org wrote: In article CAHu5PrbYMUzfs1AZYzPaN__51h7Q=4d5bfjm2eqofx90okx...@mail.gmail.com, Cyd Haselton chasel...@gmail.com wrote: So, after trying various ways to add that flag before lpython in setup.py, I stripped all --allow-shlib-undefined --no-allow-shlib-undefined feom the Makefile, ran make clean, and make. I still get the following error: Modules/python.o \ -lc -ldl -lm -L. -lpython2.7 -lm ./libpython2.7.so: undefined reference to `sincos' collect2: error: ld returned 1 exit status make: *** [python] Error 1 I don't understand why you are seeing that problem *unless you might be running into this issue that I found by searching for sincos Android: https://code.google.com/p/android/issues/detail?id=38423 That looks awfully suspicious. If it isn't that, I don't know what to tell you. You could open an issue on the Python bug tracker (bugs.python.org) but we don't officially support Android so I doubt that will help much. If you haven't already, you might try asking on some Android forums; I know other oddities of building things on Android have been reported. Good luck! -- Ned Deily, n...@acm.org -- https://mail.python.org/mailman/listinfo/python-list Hammer - Head - Nail. Sure enough, nm -D libm.so shows that sincos is NOT available in that library on my Android device. Now to figure out what to do about it. Nice find! Cyd -- https://mail.python.org/mailman/listinfo/python-list
Re: Build Question: How to Add -Wl, --option Before Objects In Setup.py?
On Sat, Nov 1, 2014 at 1:47 PM, Cyd Haselton chasel...@gmail.com wrote: On Sat, Nov 1, 2014 at 5:52 AM, Ned Deily n...@acm.org wrote: In article CAHu5PrbYMUzfs1AZYzPaN__51h7Q=4d5bfjm2eqofx90okx...@mail.gmail.com, Cyd Haselton chasel...@gmail.com wrote: So, after trying various ways to add that flag before lpython in setup.py, I stripped all --allow-shlib-undefined --no-allow-shlib-undefined feom the Makefile, ran make clean, and make. I still get the following error: Modules/python.o \ -lc -ldl -lm -L. -lpython2.7 -lm ./libpython2.7.so: undefined reference to `sincos' collect2: error: ld returned 1 exit status make: *** [python] Error 1 I don't understand why you are seeing that problem *unless you might be running into this issue that I found by searching for sincos Android: https://code.google.com/p/android/issues/detail?id=38423 That looks awfully suspicious. If it isn't that, I don't know what to tell you. You could open an issue on the Python bug tracker (bugs.python.org) but we don't officially support Android so I doubt that will help much. If you haven't already, you might try asking on some Android forums; I know other oddities of building things on Android have been reported. Good luck! -- Ned Deily, n...@acm.org -- https://mail.python.org/mailman/listinfo/python-list Hammer - Head - Nail. Sure enough, nm -D libm.so shows that sincos is NOT available in that library on my Android device. Now to figure out what to do about it. Nice find! Cyd UPDATE: After doing a bit of research it looks like it would be easier to build Python without sincos...is that possible? If not, I'll need to figure out how to get bionic libm sources with a proper Makefile (instead of Android's build system) -- https://mail.python.org/mailman/listinfo/python-list
Re: Build Question: How to Add -Wl, --option Before Objects In Setup.py?
On Tue, Oct 28, 2014 at 4:01 PM, Ned Deily n...@acm.org wrote: In article cahu5pra68edgkvfyhtq+srmb6syew9a1sabb5cemluzqbs5...@mail.gmail.com, Cyd Haselton chasel...@gmail.com wrote: On Tue, Oct 28, 2014 at 3:11 AM, Ned Deily n...@acm.org wrote: In article CAHu5PrY-T=DT3wOg-Y+Va9WgwBV3w9d7M-tu=_n-cngwssz...@mail.gmail.com, Cyd Haselton chasel...@gmail.com wrote: [...] I'm building python on an Android device in the KBOX environment...which simulates a Unix type filesystem. Python isn't installed; I'm building from sources (2.7.8) with GCC 4.8.0 and make. The problem with the LDFLAGS approach is that some of the libraries that must be linked (-lc -ldl) do not need the --allow-shlib-undefined option...it's only the lpython2.7 that does. Any way to do this? Sorry, I have no experience with that environment nor an understanding of why you need to specify --allow-shlib-undefined (it seems to be the default in some versions of ld). You could look at and, if necessary, modify Lib/distutils, the part of the Python standard library that builds extension modules from setup.py. No need to apologize. Also no need to have an understanding of the environment; with a few rare exceptions it behaves just like a Unix/Linux one. The reason why I need to specify --allow-shlib-undefined is for the python library; it's throwing undefined references to sincos even though the symbol is there. Specifying that option is the only fix I've found. As mentioned earlier, i'm not familiar with python or its build system; which file in the distutils dir do I need to modify? Perhaps I should apologize for not asking earlier what you are really trying to do before suggesting heading down the path of modifying Distutils :) So the issue is with an undefined reference to sincos? It appears that that routine is often supplied in libm. Is that the case on your platform? And, if so, the right fix might be to supply it manually or, better, ensure that Python supplies it as a result of running ./configure. Also, what version of Python are you building? -- Ned Deily, n...@acm.org -- https://mail.python.org/mailman/listinfo/python-list So, after trying various ways to add that flag before lpython in setup.py, I stripped all --allow-shlib-undefined --no-allow-shlib-undefined feom the Makefile, ran make clean, and make. I still get the following error: Modules/python.o \ -lc -ldl -lm -L. -lpython2.7 -lm ./libpython2.7.so: undefined reference to `sincos' collect2: error: ld returned 1 exit status make: *** [python] Error 1 Should I repost this to the dev mailing list? -- https://mail.python.org/mailman/listinfo/python-list
Re: Build Question: How to Add -Wl, --option Before Objects In Setup.py?
On Tue, Oct 28, 2014 at 4:01 PM, Ned Deily n...@acm.org wrote: In article cahu5pra68edgkvfyhtq+srmb6syew9a1sabb5cemluzqbs5...@mail.gmail.com, Cyd Haselton chasel...@gmail.com wrote: On Tue, Oct 28, 2014 at 3:11 AM, Ned Deily n...@acm.org wrote: In article CAHu5PrY-T=DT3wOg-Y+Va9WgwBV3w9d7M-tu=_n-cngwssz...@mail.gmail.com, Cyd Haselton chasel...@gmail.com wrote: [...] I'm building python on an Android device in the KBOX environment...which simulates a Unix type filesystem. Python isn't installed; I'm building from sources (2.7.8) with GCC 4.8.0 and make. The problem with the LDFLAGS approach is that some of the libraries that must be linked (-lc -ldl) do not need the --allow-shlib-undefined option...it's only the lpython2.7 that does. Any way to do this? Sorry, I have no experience with that environment nor an understanding of why you need to specify --allow-shlib-undefined (it seems to be the default in some versions of ld). You could look at and, if necessary, modify Lib/distutils, the part of the Python standard library that builds extension modules from setup.py. No need to apologize. Also no need to have an understanding of the environment; with a few rare exceptions it behaves just like a Unix/Linux one. The reason why I need to specify --allow-shlib-undefined is for the python library; it's throwing undefined references to sincos even though the symbol is there. Specifying that option is the only fix I've found. As mentioned earlier, i'm not familiar with python or its build system; which file in the distutils dir do I need to modify? Perhaps I should apologize for not asking earlier what you are really trying to do before suggesting heading down the path of modifying Distutils :) So the issue is with an undefined reference to sincos? It appears that that routine is often supplied in libm. Is that the case on your platform? Yes it is. And, if so, the right fix might be to supply it manually or, better, ensure that Python supplies it as a result of running ./configure. If the Makefile generated is a result of running ./configure, then Python is indeed finding the library...what it is doing with it after finding it may be something else entirely. I've tried everything from adding the -Wl,--no-allow-shlib-undefined option to adding #include math.h to the complexobject.c code...I still get an undefined reference to sincos. Running grep sincos libpython2.7.* turns up the offending symbol (function? declaration?) but re-running make after that still throws the same error. The only fix I've found is adding the -Wl,--allow-shlib-undefined before the python library...which I do by hacking the Makefile. That allows the build to continue, which it does until it hits the part where setup.py is run. Also, what version of Python are you building? 2.7.8. I thought that it would be easier to build it on Android -- Ned Deily, n...@acm.org -- https://mail.python.org/mailman/listinfo/python-list -- https://mail.python.org/mailman/listinfo/python-list
Re: Build Question: How to Add -Wl, --option Before Objects In Setup.py?
On Tue, Oct 28, 2014 at 3:11 AM, Ned Deily n...@acm.org wrote: In article CAHu5PrY-T=DT3wOg-Y+Va9WgwBV3w9d7M-tu=_n-cngwssz...@mail.gmail.com, Cyd Haselton chasel...@gmail.com wrote: [...] I'm building python on an Android device in the KBOX environment...which simulates a Unix type filesystem. Python isn't installed; I'm building from sources (2.7.8) with GCC 4.8.0 and make. The problem with the LDFLAGS approach is that some of the libraries that must be linked (-lc -ldl) do not need the --allow-shlib-undefined option...it's only the lpython2.7 that does. Any way to do this? Sorry, I have no experience with that environment nor an understanding of why you need to specify --allow-shlib-undefined (it seems to be the default in some versions of ld). You could look at and, if necessary, modify Lib/distutils, the part of the Python standard library that builds extension modules from setup.py. -- Ned Deily, n...@acm.org -- https://mail.python.org/mailman/listinfo/python-list No need to apologize. Also no need to have an understanding of the environment; with a few rare exceptions it behaves just like a Unix/Linux one. The reason why I need to specify --allow-shlib-undefined is for the python library; it's throwing undefined references to sincos even though the symbol is there. Specifying that option is the only fix I've found. As mentioned earlier, i'm not familiar with python or its build system; which file in the distutils dir do I need to modify? -- https://mail.python.org/mailman/listinfo/python-list
