See 
<https://builds.apache.org/job/bookkeeper_postcommit_master_python/22/display/redirect?page=changes>

Changes:

[github] ISSUE #1757: prevent race between flush and delete from recreating 
index

[github] [TESTS] Fix integration test

[github] [TABLE SERVICE] Fix python client can't read keys written by java

[guosijie] Reduce stack traces in logs for common cases

------------------------------------------
[...truncated 91.39 KB...]
deleted: sha256:1e8bc9c21c5fe37115a066b75e8851efee81094dc44ff8b78a791cf6e18e29dd
deleted: sha256:840870ce9416abdc25a20efd1a779945d883a4927ce77f33ef26464477194609
deleted: sha256:15412e14567b45cda11b3aabcfa13527e94c20094c1b8321abacdf9e7ea9e84e
deleted: sha256:b9cf26772bfff46d0adb206d21234a5b054ff31d892bcd0d8b87ddad446141d5
deleted: sha256:7e0dd8d4a5602afc1ca83aa371998fdf7bf34c14c7f9d8d09344ebf8c54fbb2d
deleted: sha256:2b50a0bf8bb572c8d95efa80c4f78b7ea7a208a10edd58f4ed0ee7ad05d1c4f7
deleted: sha256:3510fc9d55c59eae9078b012e575d6aa9d3ef8b2f68783db6c488e833ff5d604
deleted: sha256:c181f47764f66b9351923d7c87c88ec1ff4b9b4f1a7dce3ea2a028dad6128d82
deleted: sha256:fd9b49fbc4253f0d08abbde5032947164fc4307dfed738c4f48be8e4b84720ff
deleted: sha256:92477d5735a0e5cf97bfdc15f5a9046f0964ae6b65fcc15e449885301ac0467e
deleted: sha256:dcc81b5ccb55315188fd2aa505485d7f81531d6b2a5e39e8e858855ba014f364
deleted: sha256:cca3ecc843d20fbc31e349c613345342e5a70690389ba63d336523390ea8f50b
deleted: sha256:ab0106fd1d22bc1fd832ea41adfa17028723c85b30886d415700a37fddf1711c
deleted: sha256:30cfbea0fc5ea56d1042409d44bf5e1706ee3caaf46707b778322c4f56d72750
deleted: sha256:9c4a1e6c6d95096236cf423b5229af35b8b76fc9221ae8495e1e462a0f5ea223
deleted: sha256:bd59e8f0a7ffd6dc19d46ca0ad3e22e70d6b9592183c038d97d0d2db69a02284
deleted: sha256:68ea216c12270eed9e55dd068ac043c486f46ab54824d7c9a50a14c6e4f513dd
deleted: sha256:42d28cbf597d2b3b625db3701b7b6ad8b1ec1d85ed8a09c6d9170ba124f0c833
deleted: sha256:2a391268fab4afc6b022011cbe553c48324c443cc0ce898760f1193b73aace03
deleted: sha256:cf3994d2c9931d912efd74f49fff4cc41faa2ce181f30110ddf989e271d7f9c8
deleted: sha256:25e66b3ab7e5a319213b3997b86fd1e359741fdeaf93bd2ce24a016b9be88cfd
deleted: sha256:15ccc6efb3b2ff151aa23ca80c6dd7dd7c8e2d674565267e765687a37eaef23d
deleted: sha256:730c9e30ac0357217e9b001068fb8d86503654d2b37551e77de0fafd0b31bdf1
deleted: sha256:56bb350c2382930d642b4a372fba83b5ddd07a12a1b1d6c8f00976d8367dea97
deleted: sha256:2b5d0e028deee503ec7e7ad6d364ba30dbe258c9756ad989adfb6b719d2d6ba3
deleted: sha256:92c42e15ad3e6202393f1eb707a1375e3f1f74a1600e554b56fbd24967efeed3
deleted: sha256:b6c4d020982f7ab5bc3aa9403ed2bbc5500a4fde20d684def77d51571d38d926
deleted: sha256:8847da1682718bcfc5f8948744fe72c34d27d8d86ca9f2d142fd9e3ba3603da0
deleted: sha256:2251c3a693470f779011491fa135cb1ae5fd324125cc91f0f0bb5ce244082e34
deleted: sha256:303ad8599737a1c579221f76308309d325b246cde1b73a7ff96ee75c4050f95b
deleted: sha256:4f0e9595fa4280135982f8aa39ee968a12f5efa8c7908a5df69e5d17879168d4
deleted: sha256:f87bb66a324c2a863af971a92c69de160071f2ce74d6c1a0301b88f7854f4e5d
deleted: sha256:4f65e60eb438f9e19b4fc84a6e6b6f3b60812bd0cf9c394f0d137900a48506ec
deleted: sha256:4d20f160881c2055b042ca55d074349b1ee8e616a1de3800e4de19c657b19826
deleted: sha256:3f1b4319b403005306c71dcff1422edd2e891f77e55579fd4f3e2749bb18ae5f
deleted: sha256:e7e56933c25d889074e0352b23870de40dbad61e3e6c2c1112e04831f884b910
deleted: sha256:779f50236e7e86fa649f58d1fc4fdb83c710efee8caf186f5288f4301d64d80e
deleted: sha256:d0df04495fdee7a8894739865a6f4f55b7887dcce9fa10dfe391c16bc23e7172
deleted: sha256:26762c979e3d987acffa517f2d4e6efb1f07cf1724c7a92d63831405304f846f
deleted: sha256:aaa7e8c9531ca6de9d65a8a4b6d9e2459ab5defa58638bf261f8d43909410889
deleted: sha256:6cdb59cfbe264d4c158aa398a9ce15f146a05065d8c3b6054350efdc5ab58fbc
deleted: sha256:d66cf258465c048b6bf4eacb8f905938d0f6d731948dbcb9497850cabff8a264
deleted: sha256:d724cc2e6fd0187e513c01310bad9cc3b219fb449a7963b42f5879317877aedc
deleted: sha256:2135dcf7a20a9912ba5a055292f1c20b609d8dd1be98f114ef34a6933cbb2184
deleted: sha256:2924c97bff4b190903c88c04e5c8baef15b2ded18d286c3a590c716831b7a48e
deleted: sha256:74c9be8686a2cda5e8bcdcfcc5e069599a3c48e4006b8a3d4aea4cc6674926bd
deleted: sha256:5214472cb463c4b91192b8d9eda9ddd1f994f133b66d102fe7f56e3b4de27f91
deleted: sha256:aedfa4ec520f00e92c849ae3735d826ccbf077bc28db9f215dc16405661ab7ef
deleted: sha256:b7151403e88031f325d02ebf2a191954cbdcd24734ee713c164aecea5c949c78
deleted: sha256:95c12fbe9d45b56f628ece485decf9c534e2d16a606ae540a31ddb2600446d89
deleted: sha256:18f0300d0d5eb5cc5e22e0338167d9ce5907d40a80a8103b8e7ad8691840982a
deleted: sha256:ca304408c50a62b49578eb3c9ef9c18660f458b9895a34946f9c2fbb654ab258
deleted: sha256:62a96d7292ccd3ae974dbe4c5f8ec75c91436e14d316c348368286954f8315fb
deleted: sha256:ead96d64f85d325267ab048174a22a309d9253d67db0b333e274043673774bf5
deleted: sha256:bad8c3bfa5f93bdefc7cf956f0f6758c8a347d449a7f7650dda772ba8c2c936d
deleted: sha256:01dd31a5b0b0b066646ed527c3c77fd8e7f92e355cee3fbaea277b6ae67acf70
deleted: sha256:ef74b2c7f550c856c6134f03b5facf9cd7acd28d1ecd9889b65c8bd21e4a23c6
deleted: sha256:21df7907dd1130fdc403b2cbfd26e15095425bfe61ee7c487c7903b9344be817
deleted: sha256:109318888c0b7bab18a6806c58ec270827cc84302e28996c1f5cc12df7f4fdbd
deleted: sha256:41a7c493b26b41203e35a551a902a2a3a8f013afbc79a6a680e99969dd815763
deleted: sha256:58f6c9c6531c73fdf863078b176d58605db08ca8201c8b47c88c687d98986618
deleted: sha256:afe3c76a96d9d7b691477882bd21a3e8a7e7b4d0552cb9ed5b7fc27a537688e0
deleted: sha256:816457a6b17e899d5fc013058f2b0507ce9217d2be1bdd0f0e9d539c8334b3c5
deleted: sha256:9a4ceebdabe3b2c5c116df110af348fea474c034c015f0ecb8b46cee7e264aea
deleted: sha256:e93cd0885a5caf0eeea95d00f62baee1e2a4b2fae72c895781043008f95588df
deleted: sha256:b058b45b13bb7d77049cc0581f18d0c9f999908d031a783039509d1aad191fd4
deleted: sha256:c389eec337f2bbb3f91430b905c9c9aa7cb31a9c2f032009daee0eb4aab2d7b3
deleted: sha256:aefb706ed9aa051dc2ce23808dc963e6178f6af95faaea194d449793679ee427
deleted: sha256:8c03857c371c1c755ae5b9cdeb93e73d5cd2fb66f0d84a9a8d9047baf3d158e9
deleted: sha256:2b4b93bddfa9e5d58230806fbf6309a10f96b2fa06937186d4e753d444091d74
deleted: sha256:5f8e58f519b3f2823c6e61c54198b39ef5df8f5ae63cab91c7ee5fbc44cf543f

Total reclaimed space: 2.349GB
+ docker network prune -f --filter 'name=testnetwork_*'
+ echo 318
+ docker system events
+ docker pull quay.io/coreos/etcd:v3.3
v3.3: Pulling from coreos/etcd
2bc1c5ee8605: Already exists
075a2fcf78bc: Already exists
35e5ff0bd5f1: Already exists
ec90809a24af: Already exists
27b2768170ac: Already exists
52ad13cdb1de: Already exists
Digest: sha256:00304fb914dbc8205275bc7630f376171344753a17ec3c81f0b424fa8f841d66
Status: Image is up to date for quay.io/coreos/etcd:v3.3
Process leaked file descriptors. See 
https://jenkins.io/redirect/troubleshooting/process-leaked-file-descriptors for 
more information
[bookkeeper_postcommit_master_python] $ /bin/bash -xe 
/tmp/jenkins5232635426249066933.sh
+ docker pull python:3.7
3.7: Pulling from library/python
bc9ab73e5b14: Already exists
193a6306c92a: Already exists
e5c3f8c317dc: Already exists
a587a86c9dcb: Already exists
72744d0a318b: Already exists
3493e487c18d: Pulling fs layer
a89e0510fd87: Pulling fs layer
2100d277cd6f: Pulling fs layer
b61a0d6fb492: Pulling fs layer
b61a0d6fb492: Waiting
3493e487c18d: Verifying Checksum
3493e487c18d: Download complete
2100d277cd6f: Verifying Checksum
2100d277cd6f: Download complete
a89e0510fd87: Verifying Checksum
a89e0510fd87: Download complete
b61a0d6fb492: Verifying Checksum
b61a0d6fb492: Download complete
3493e487c18d: Pull complete
a89e0510fd87: Pull complete
2100d277cd6f: Pull complete
b61a0d6fb492: Pull complete
Digest: sha256:a837aefef8f2553789bc70436621160af4da65d95b0fb02d5032557f887d0ca5
Status: Downloaded newer image for python:3.7
[bookkeeper_postcommit_master_python] $ /bin/bash -xe 
/tmp/jenkins486250959143110298.sh
+ docker pull python:3.6
3.6: Pulling from library/python
bc9ab73e5b14: Already exists
193a6306c92a: Already exists
e5c3f8c317dc: Already exists
a587a86c9dcb: Already exists
72744d0a318b: Already exists
6598fc9d11d1: Pulling fs layer
770079cf7a7e: Pulling fs layer
03c4d24b3523: Pulling fs layer
aaa91e2585ce: Pulling fs layer
aaa91e2585ce: Waiting
6598fc9d11d1: Verifying Checksum
6598fc9d11d1: Download complete
03c4d24b3523: Download complete
770079cf7a7e: Verifying Checksum
770079cf7a7e: Download complete
aaa91e2585ce: Download complete
6598fc9d11d1: Pull complete
770079cf7a7e: Pull complete
03c4d24b3523: Pull complete
aaa91e2585ce: Pull complete
Digest: sha256:be8258268093afd16846564e3963af3059fd341e16677d7cd0bc157f0d7fcdfa
Status: Downloaded newer image for python:3.6
[bookkeeper_postcommit_master_python] $ /bin/bash -xe 
/tmp/jenkins2456719816414033734.sh
+ docker pull python:3.5
3.5: Pulling from library/python
bc9ab73e5b14: Already exists
193a6306c92a: Already exists
e5c3f8c317dc: Already exists
a587a86c9dcb: Already exists
72744d0a318b: Already exists
6598fc9d11d1: Already exists
74d2ee7772b2: Pulling fs layer
ab2e66176e69: Pulling fs layer
2c4175ee7cad: Pulling fs layer
ab2e66176e69: Download complete
2c4175ee7cad: Download complete
74d2ee7772b2: Verifying Checksum
74d2ee7772b2: Download complete
74d2ee7772b2: Pull complete
ab2e66176e69: Pull complete
2c4175ee7cad: Pull complete
Digest: sha256:ef14a52ee8bacfa498b46ef1620ae3da16b0cbda8286b1f0a1a81aa71ac3a818
Status: Downloaded newer image for python:3.5
[bookkeeper_postcommit_master_python] $ /bin/bash -xe 
/tmp/jenkins2956543460805666880.sh
+ docker pull python:2.7
2.7: Pulling from library/python
Digest: sha256:caeeb98fc920f4f7146c929fee29b35b7c8c37e23ca194be3bb48e54c9ec8527
Status: Downloaded newer image for python:2.7
[bookkeeper_postcommit_master_python] $ /bin/bash -xe 
/tmp/jenkins7086484295038634996.sh
+ ./stream/clients/python/scripts/test.sh
+++ dirname ./stream/clients/python/scripts/test.sh
++ cd ./stream/clients/python/scripts
++ pwd
+ 
SCRIPT_DIR=<https://builds.apache.org/job/bookkeeper_postcommit_master_python/ws/stream/clients/python/scripts>
+ PY_VERSION=3.7
+ NOXSESSION=lint,lint_setup_py,unit
+ 
<https://builds.apache.org/job/bookkeeper_postcommit_master_python/ws/stream/clients/python/scripts/docker_tests.sh>
+++ dirname 
<https://builds.apache.org/job/bookkeeper_postcommit_master_python/ws/stream/clients/python/scripts/docker_tests.sh>
++ cd 
<https://builds.apache.org/job/bookkeeper_postcommit_master_python/ws/stream/clients/python/scripts>
++ pwd
+ 
SCRIPT_DIR=<https://builds.apache.org/job/bookkeeper_postcommit_master_python/ws/stream/clients/python/scripts>
+ PY_VERSION=3.7
+ NOXSESSION=lint,lint_setup_py,unit
+ [[ 3.7 == 3* ]]
++ cat
+ TEST_COMMANDS='find . | grep -E "(__pycache__|\.pyc|\.pyo$)" | xargs rm -rf
pip install nox
nox'
+ docker run -v 
<https://builds.apache.org/job/bookkeeper_postcommit_master_python/ws/stream/clients/python/scripts/..>:/opt/bookkeeper
 -w /opt/bookkeeper -e PY_VERSION=3.7 -e NOXSESSION=lint,lint_setup_py,unit 
python:3.7 /bin/bash -c 'find . | grep -E "(__pycache__|\.pyc|\.pyo$)" | xargs 
rm -rf
pip install nox
nox'
Collecting nox
  Downloading 
https://files.pythonhosted.org/packages/6a/31/6d83de53dd55c1b541eae28479b011d10691dc8ac91ab34fd827ac44eca3/nox-2018.10.17-py2.py3-none-any.whl
Collecting virtualenv>=14.0.0 (from nox)
  Downloading 
https://files.pythonhosted.org/packages/7c/17/9b7b6cddfd255388b58c61e25b091047f6814183e1d63741c8df8dcd65a2/virtualenv-16.1.0-py2.py3-none-any.whl
 (1.9MB)
Collecting colorlog<4.0.0,>=2.6.1 (from nox)
  Downloading 
https://files.pythonhosted.org/packages/69/eb/58ae10d3c46a0195ffdd0e3943d255d0d5029d71e5457785ecd665bcf0f3/colorlog-3.1.4-py2.py3-none-any.whl
Collecting py<2.0.0,>=1.4.0 (from nox)
  Downloading 
https://files.pythonhosted.org/packages/3e/c7/3da685ef117d42ac8d71af525208759742dd235f8094221fdaafcd3dba8f/py-1.7.0-py2.py3-none-any.whl
 (83kB)
Installing collected packages: virtualenv, colorlog, py, nox
Successfully installed colorlog-3.1.4 nox-2018.10.17 py-1.7.0 virtualenv-16.1.0
Running session unit-3.7
Creating virtualenv using python3.7 in /opt/bookkeeper/.nox/unit-3-7
pip install --upgrade mock pytest pytest-cov
pip install --upgrade -e .
py.test --quiet --cov-append --cov-report= --cov=bookkeeper 
--cov-config=.coveragerc tests/unit
..............................................................           [100%]


=============================== warnings summary ===============================
.nox/unit-3-7/lib/python3.7/site-packages/google/protobuf/internal/api_implementation.py:154
  
/opt/bookkeeper/.nox/unit-3-7/lib/python3.7/site-packages/google/protobuf/internal/api_implementation.py:154:
 DeprecationWarning: Using or importing the ABCs from 'collections' instead of 
from 'collections.abc' is deprecated, and in 3.8 it will stop working
    from google.protobuf.pyext import _message

.nox/unit-3-7/lib/python3.7/site-packages/google/protobuf/internal/containers.py:182
  
/opt/bookkeeper/.nox/unit-3-7/lib/python3.7/site-packages/google/protobuf/internal/containers.py:182:
 DeprecationWarning: Using or importing the ABCs from 'collections' instead of 
from 'collections.abc' is deprecated, and in 3.8 it will stop working
    MutableMapping = collections.MutableMapping

tests/unit/bookkeeper/common/test_protobuf_helpers.py::test_get_dict_absent
  /opt/bookkeeper/bookkeeper/common/protobuf_helpers.py:146: 
DeprecationWarning: Using or importing the ABCs from 'collections' instead of 
from 'collections.abc' is deprecated, and in 3.8 it will stop working
    elif isinstance(msg_or_dict, collections.Mapping):

-- Docs: https://docs.pytest.org/en/latest/warnings.html
62 passed, 3 warnings in 3.47 seconds
Session unit-3.7 was successful.
Running session lint
Creating virtualenv using python in /opt/bookkeeper/.nox/lint
pip install --upgrade flake8
pip install --upgrade .
flake8 bookkeeper tests
bookkeeper/admin/namespaces.py:62:80: E501 line too long (87 > 79 characters)
bookkeeper/admin/namespace.py:58:80: E501 line too long (81 > 79 characters)
bookkeeper/admin/namespace.py:65:80: E501 line too long (86 > 79 characters)
tests/integration/bookkeeper/kv/test_client.py:19:1: F401 'pytest' imported but 
unused
tests/integration/bookkeeper/kv/test_client.py:33:80: E501 line too long (89 > 
79 characters)
Command flake8 bookkeeper tests failed with exit code 1
Session lint failed.
Running session lint_setup_py
Creating virtualenv using python in /opt/bookkeeper/.nox/lint_setup_py
pip install --upgrade docutils Pygments
python setup.py check --restructuredtext --strict
running check
/opt/bookkeeper/.nox/lint_setup_py/lib/python3.7/site-packages/setuptools/dist.py:398:
 UserWarning: Normalizing '4.9.0-alpha-2' to '4.9.0a2'
  normalized_version,
Session lint_setup_py was successful.
Ran multiple sessions:
* unit-3.7: success
* lint: failed
* lint_setup_py: success
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]

Reply via email to