[jira] [Created] (AURORA-1717) pants fails to run in integration tests (flaky)

[John Sirois (JIRA)]

John Sirois created AURORA-1717:
-----------------------------------

             Summary: pants fails to run in integration tests (flaky)
                 Key: AURORA-1717
                 URL: https://issues.apache.org/jira/browse/AURORA-1717
             Project: Aurora
          Issue Type: Bug
          Components: Build
            Reporter: John Sirois
            Assignee: John Sirois


As noted by [~StephanErb] in 
[IRC|http://wilderness.apache.org/channels/?f=aurora/2016-06-15#1466009185], 
python tests occasionally fail like so under AuroraBot:
{noformat}
...
      with temporary_dir() as checkpoint_root:
        te = AuroraExecutor(
>           runner_provider=make_provider(checkpoint_root),
            sandbox_provider=DefaultTestSandboxProvider())

src/test/python/apache/aurora/executor/test_thermos_executor.py:580: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
src/test/python/apache/aurora/executor/test_thermos_executor.py:193: in 
make_provider
    pex_location=thermos_runner_path(),
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

build = True

    def thermos_runner_path(build=True):
      if not build:
        return getattr(thermos_runner_path, 'value', None)
    
      if not hasattr(thermos_runner_path, 'value'):
        pex_dir = safe_mkdtemp()
>       assert subprocess.call(["./pants", "--pants-distdir=%s" % pex_dir, 
"binary",
          "src/main/python/apache/thermos/runner:thermos_runner"]) == 0
E       assert 1 == 0
E        +  where 1 = <function call at 0x7f39ef905938>(['./pants', 
'--pants-distdir=/tmp/user/2396/tmpU8sLiq', 'binary', 
'src/main/python/apache/thermos/runner:thermos_runner'])
E        +    where <function call at 0x7f39ef905938> = 
subprocess.call

src/test/python/apache/aurora/executor/test_thermos_executor.py:185: 
AssertionError
-------------- Captured stderr call --------------
Traceback (most recent call last):
File 
"/home/jenkins/.cache/pants/setup/bootstrap-Linux-x86_64/0.0.80/bin/pants", 
line 7, in <module>
 from pants.bin.pants_exe import main
ImportError: No module named pants.bin.pants_exe
generated xml file: 
/home/jenkins/jenkins-slave/workspace/AuroraBot/dist/test-results/415337499eb72578eab327a6487c1f5c9452b3d6.xml
 
 16 failed, 638 passed, 6 skipped, 1 warnings, 8 error in 127.24 
seconds 
...
{noformat}

This has all the signs of a race in pants bootstrapping; ie: the {{\[version 
symlink]/bin/pants}} script is installed but the interpreter it points to in 
its shebang does not have pants fully installed yet.  That said, a review of 
the pants bootstrap script seems to indicate correct atomicity.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)