[
https://issues.apache.org/jira/browse/AURORA-1717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
John Sirois updated AURORA-1717:
--------------------------------
Attachment: pip.zip
I'm going with the more drastic:
{noformat}
# Locate the standard user caches to the workspace to isolate concurrent runs
on the same machine.
# See: https://issues.apache.org/jira/browse/AURORA-1717
export HOME=$WORKSPACE/.home
...
{noformat}
I downloaded the {{$WORKSPACE/.cache/pip}} from Aurora job 1552 and found only
the {{http}} cache and not the {{wheel}} cache I see on my machine:
{noformat}
$ rm -rf /tmp/{cache,home} && mkdir /tmp/{cache,home} && HOME=/tmp/home
XDG_CACHE_HOME=/tmp/cache pip install pantsbuild.pants && find
/tmp/{cache,home} -type f
...
/tmp/cache/pip/wheels/7f/47/84/3115608daaf3aa16e94fde55c67c0904fefcde931dfd2178b1/twitter.common.options-0.3.5-cp27-none-any.whl
/tmp/cache/pip/wheels/86/e1/c2/9ff8cfe9773ce07003f2c2be096e169af4614c2f634671d49b/cov_core-1.15.0-cp27-none-any.whl
/tmp/cache/pip/wheels/5c/07/c8/dbbeb087112e8d9f3b861b3dbaee753612d293f8d335f23938/twitter.common.log-0.3.5-cp27-none-any.whl
/tmp/cache/pip/wheels/72/10/43/28655ed4bb6bd65cfee7d3e377b05c1218ba5ccfc52da4e1c4/pywatchman-1.3.0-cp27-cp27mu-linux_x86_64.whl
/tmp/cache/pip/wheels/92/60/bb/4befe8cc3a0f788bb05e52dca267e8518c1945ec4a333e8a6e/setproctitle-1.1.9-cp27-cp27mu-linux_x86_64.whl
/tmp/cache/pip/wheels/e5/94/08/eab43cda4e17e6ae729ed2cd832d7ca4e3ddca7fa6886ec2b8/pytest_cov-1.8.1-cp27-none-any.whl
/tmp/cache/pip/wheels/ca/1c/fe/8b76e537572f91c810910e822cccb178ba3156e432e644ac89/pytest-2.6.4-cp27-none-any.whl
/tmp/cache/pip/wheels/09/d5/14/fad8864342631171117f01b9b2473a07c053e5c1054d40e48c/coverage-3.7.1-cp27-cp27mu-linux_x86_64.whl
/tmp/cache/pip/wheels/90/12/0e/d989a688ee36fce91722795cc3a896b9581f35543fafbbb985/twitter.common.confluence-0.3.5-cp27-none-any.whl
/tmp/cache/pip/wheels/db/de/bd/b99b1e12d321fbc950766c58894c6576b1a73ae3131b29a151/docutils-0.12-cp27-none-any.whl
/tmp/cache/pip/wheels/ea/0e/59/c878cc73abc93eff6f42d83a924b5901f4163c3c9e1e1ffc1f/Pygments-1.4-cp27-none-any.whl
/tmp/cache/pip/wheels/54/57/5d/d85a28804ddffc92283587426652d63ed9578cc01fbf6be957/Markdown-2.1.1-cp27-none-any.whl
/tmp/cache/pip/wheels/b7/ab/a3/e2163d42dd018b3e7f4345b27155c636740d08518756700c53/psutil-3.1.1-cp27-cp27mu-linux_x86_64.whl
/tmp/cache/pip/wheels/9f/ad/66/0c671b563cdf76d88f1ab37a9db5e1804e2dd32cff0e70454e/pystache-0.5.3-cp27-none-any.whl
/tmp/cache/pip/wheels/3a/e9/7a/d539da1af316475bbfe0710f15249d194ccf96755293af318d/ansicolors-1.0.2-cp27-none-any.whl
/tmp/cache/pip/wheels/52/87/95/00c0300c02fb6e49ec182b4d6e9fe7b4c1015447f12250bd76/twitter.common.dirutil-0.3.5-cp27-none-any.whl
/tmp/cache/pip/wheels/05/fc/50/1a7e8fc57b03fe4c1299f1cf04e89ac8606614769ca65a9f5f/pathspec-0.3.4-cp27-none-any.whl
/tmp/cache/pip/wheels/da/14/f3/7f6763cd490a70e21ba86d989013ab318cb851ff4a69b74ec7/twitter.common.collections-0.3.5-cp27-none-any.whl
/tmp/cache/pip/wheels/7e/3b/92/354fdfaff17e5612dcf5aba7e4d26257ed91de3d809d9ea792/twitter.common.lang-0.3.5-cp27-none-any.whl
/tmp/cache/pip/wheels/7e/29/8c/39dda426df0b9cb4eb60b296666e884d4635be4fb6c56f03e2/pantsbuild.pants-1.0.1-cp27-none-any.whl
/tmp/cache/pip/http/c/5/3/d/6/c53d64e3c42c28f86b7631dc65ced42c47069e07586a998575c8d627
/tmp/cache/pip/http/c/f/b/3/4/cfb3489bd24de97171840d0881c37e9644ac7e1c5f7b188c25f4a2fe
/tmp/cache/pip/http/c/f/1/7/1/cf171239dd457b336c28871defb4c1ccf6afca1de6aa4593263f1e82
/tmp/cache/pip/http/2/e/d/8/9/2ed89cc9dd581ce0c518dcd8ec7f4e6c1b8451b1c2b221bd9b3c71ec
/tmp/cache/pip/http/2/d/2/f/9/2d2f967f926ccae3beb1c401b252e78674d794aa0d7b510911c17d3c
/tmp/cache/pip/http/2/6/2/9/2/262925ec32b1947864ceb8dd3ce1811111070a2756bbc2cddeb1469b
/tmp/cache/pip/http/2/f/6/0/e/2f60ee2e6b2f8d9d74debb0760385405e98f6d110bddba8ef79ec89c
/tmp/cache/pip/http/2/9/5/4/7/29547c5a6bf84d653771facbf527a0331e8046b94ef8e5550f2b4b61
/tmp/cache/pip/http/e/3/9/a/b/e39abe5c6e3603063a1c2d607301b697ea1eebf5ffaa8ed4ca433c8d
/tmp/cache/pip/http/e/e/7/b/c/ee7bcc53af4b764aa0953f176712d00888f8b1f118f93a08f2cf3fa6
/tmp/cache/pip/http/e/0/3/6/e/e036ec6c5df4ac94029443b8b783d40a65d3790a6e4c7182e6ed38c7
/tmp/cache/pip/http/e/4/f/6/8/e4f68015a92ed4255fa6251831d2c11bae022e778ed8b294a7412df8
/tmp/cache/pip/http/f/0/d/b/7/f0db74c887ad8d403a92a9a2e8d487a979b43153bf0da25f7861998e
/tmp/cache/pip/http/f/1/7/c/6/f17c6c89d11274ac921e936d99391bdf23b21cd355cca40d3aed81b8
/tmp/cache/pip/http/f/1/2/5/5/f125542bf61ccf27d59b895f53defbc74731d96ba6c77deae8c54257
/tmp/cache/pip/http/f/7/0/4/6/f704617fa6b9a1889fa56e72edeae7c1c0900ef65a62734dd18ec4db
/tmp/cache/pip/http/9/b/9/a/1/9b9a1bcf438bc0788bc11aa53253acdb0005505242ecee14704eb88a
/tmp/cache/pip/http/9/8/1/9/9/9819900ac5c98696e2bc8a9f9403741465c9746cbf4e23d4fada38f6
/tmp/cache/pip/http/9/8/6/9/9/98699498902615272ab771867239623248aaa33dfc970e0d77ae93e6
/tmp/cache/pip/http/9/e/6/1/9/9e61964f51d8a05a20ecf21eef694877f28cb654a123ce1316ff77e5
/tmp/cache/pip/http/1/f/5/e/0/1f5e0c055b7cfbc51543143d6fe87ee6cb457c7ec63548c81203bf56
/tmp/cache/pip/http/1/c/3/a/5/1c3a53e814a3a499f22dac562bf92be3a91fb1672363e06bbafdc5cf
/tmp/cache/pip/http/1/c/6/6/2/1c66200834fda427867f3a70d264f2fa5696f2f8edce4f0753ab3f58
/tmp/cache/pip/http/1/8/3/b/d/183bd97265271403b14be962225c6e558d30825cdf62886d681d2e73
/tmp/cache/pip/http/d/f/6/2/9/df6292f63d62b6809cd8a8ca307450c979481125d875ab0d76c382f2
/tmp/cache/pip/http/d/6/b/5/2/d6b5230839564f0125f72367e0caa10428c60204e8f0c9fa748b1221
/tmp/cache/pip/http/8/f/5/5/e/8f55e537a9bfa06f9e2ecc75d12e5fb14ed02118a71806a24f0e427f
/tmp/cache/pip/http/8/a/b/d/4/8abd41ca0fe6acae71b82a58712229dbcb895ae0c4bc2becffe9dde1
/tmp/cache/pip/http/8/3/3/5/6/833560db5654f6635c8962c43adc7d4beaaacef6e86b64eb3e1a1f85
/tmp/cache/pip/http/8/4/1/9/2/84192bbc0a9708713469ae32cfbc8ff70b73da4de028d75d1e552d0a
/tmp/cache/pip/http/8/d/e/9/f/8de9f8137ae75b1e3bb279ad54df6f8249f13b5b514909150a613a82
/tmp/cache/pip/http/8/2/a/f/a/82afac5e57e647e2e3d3d63f158828ea91528a51ceb833aad799c18b
/tmp/cache/pip/http/6/a/3/e/4/6a3e46900b4c76aac507ec55c28ae88b3bfbbec277a0bdf912ccbb70
/tmp/cache/pip/http/6/d/5/3/d/6d53d5119e2e1ddc16eec0d5e3887449d87c05eda50d8393d8fe76fe
/tmp/cache/pip/http/0/c/e/6/1/0ce61ca4a79103ff1d353136b942d882ae90b060e9bd68600f9224af
/tmp/cache/pip/http/0/7/7/a/f/077afcfea6f89eb143f63d875ad875dac1b65967bf8dff6159f6c4e0
/tmp/cache/pip/http/b/a/7/c/e/ba7ce65950e3c5abff61919b7776499da598ffd3f769194776c0e495
/tmp/cache/pip/http/b/9/2/d/5/b92d5efeb2406de109c0263ebfbbe56d85532219b7d0aae49a57069a
/tmp/cache/pip/http/3/9/4/3/e/3943eee1c1e908725a58858865be25175c406ced636fac3546e74dc4
/tmp/cache/pip/http/3/d/0/7/9/3d0790aa6d8aba43447ad4d8fdc684c544812f2cc57ad084f4b1b2db
/tmp/cache/pip/http/3/d/4/8/2/3d4824dfe161e5009af3d77ccf251511d5a0203be9bfe22a228bd067
/tmp/cache/pip/http/3/c/5/4/a/3c54adce9d14cb69afc32a499a183c2dbac4dfd050b3962920b7da0f
/tmp/cache/pip/http/4/1/b/f/0/41bf0e604e18998056c43b7e868f1e7a2be53b2392ba4042da796420
/tmp/cache/pip/http/4/9/3/3/3/49333d1e72613d59ee1b4ae0f0e1e93470a4dec75c71fac638b2b855
/tmp/cache/pip/http/4/9/7/4/8/49748c0ee2208fa7e924027c7bed232183cab77adb543aa7097ab153
/tmp/cache/pip/http/a/1/d/8/f/a1d8ff047101b60d27e3176d2b8d88f88c6b0124bfc6cdc8e0665dd6
/tmp/cache/pip/http/a/c/1/0/1/ac101e8cf49601082604b02a8a13937b06fded9144495898d0d80359
/tmp/cache/pip/http/a/9/5/b/1/a95b1e366422caa07b5ba5fc79636026b57716e26d614e2427980b9a
/tmp/cache/pip/http/a/6/c/5/d/a6c5dd8819ac28928c8352406f0f3db3545dc0f1af1c441f71ca7ac4
/tmp/cache/pip/http/a/b/c/4/f/abc4f8f26875bf8212c7ac51c4c3d8b673b255ffd488b6d58f402f1f
/tmp/cache/pip/http/5/5/b/d/3/55bd3ae2395728370e5c192ecb7da0671ceb0943a783a33d0459ef45
/tmp/cache/pip/http/5/c/8/2/b/5c82b325d2b6c3aeef929c3f653467715f1c9a5a7eda91d2950085f6
/tmp/cache/pip/http/5/7/6/d/a/576daa70f76d7b355101aed629221e4355e671ba97ea87a2027008c5
/tmp/cache/pip/http/5/7/3/b/a/573bac7f5526c6c6e5e3ced7461675307100399cd0741910bbf9eaef
{noformat}
> pants fails to run in integration tests (flaky)
> -----------------------------------------------
>
> Key: AURORA-1717
> URL: https://issues.apache.org/jira/browse/AURORA-1717
> Project: Aurora
> Issue Type: Bug
> Components: Build
> Reporter: John Sirois
> Assignee: John Sirois
> Attachments: AURORA-1717-XDG_CACHE_HOME.edited.png,
> builds.apache.org_job_Aurora_1552_consoleText.txt, pip.zip
>
>
> As noted by [~StephanErb] in
> [IRC|http://wilderness.apache.org/channels/?f=aurora/2016-06-15#1466009185],
> python tests occasionally fail like so under AuroraBot:
> {noformat}
> ...
> [1m with temporary_dir() as checkpoint_root:[0m
> [1m te = AuroraExecutor([0m
> [1m> runner_provider=make_provider(checkpoint_root),[0m
> [1m sandbox_provider=DefaultTestSandboxProvider())[0m
> src/test/python/apache/aurora/executor/test_thermos_executor.py:580:
> _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
> src/test/python/apache/aurora/executor/test_thermos_executor.py:193: in
> make_provider
> [1m pex_location=thermos_runner_path(),[0m
> _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
> build = True
> [1m def thermos_runner_path(build=True):[0m
> [1m if not build:[0m
> [1m return getattr(thermos_runner_path, 'value', None)[0m
> [1m [0m
> [1m if not hasattr(thermos_runner_path, 'value'):[0m
> [1m pex_dir = safe_mkdtemp()[0m
> [1m> assert subprocess.call(["./pants", "--pants-distdir=%s" %
> pex_dir, "binary",[0m
> [1m "src/main/python/apache/thermos/runner:thermos_runner"]) ==
> 0[0m
> [1m[31mE assert 1 == 0[0m
> [1m[31mE + where 1 = <function call at 0x7f39ef905938>(['./pants',
> '--pants-distdir=/tmp/user/2396/tmpU8sLiq', 'binary',
> 'src/main/python/apache/thermos/runner:thermos_runner'])[0m
> [1m[31mE + where <function call at 0x7f39ef905938> =
> subprocess.call[0m
> src/test/python/apache/aurora/executor/test_thermos_executor.py:185:
> AssertionError
> -------------- Captured stderr call --------------
> Traceback (most recent call last):
> File
> "/home/jenkins/.cache/pants/setup/bootstrap-Linux-x86_64/0.0.80/bin/pants",
> line 7, in <module>
> from pants.bin.pants_exe import main
> ImportError: No module named pants.bin.pants_exe
> generated xml file:
> /home/jenkins/jenkins-slave/workspace/AuroraBot/dist/test-results/415337499eb72578eab327a6487c1f5c9452b3d6.xml
>
> [1m[31m 16 failed, 638 passed, 6 skipped, 1 warnings, 8 error in 127.24
> seconds [0m
> ...
> {noformat}
> This has all the signs of a race in pants bootstrapping; ie: the {{\[version
> symlink]/bin/pants}} script is installed but the interpreter it points to in
> its shebang does not have pants fully installed yet. That said, a review of
> the pants bootstrap script seems to indicate correct atomicity.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
