[incubator-heron] branch huijunwu/20200702 updated (2458c45 -> 050c095)
This is an automated email from the ASF dual-hosted git repository. huijun pushed a change to branch huijunwu/20200702 in repository https://gitbox.apache.org/repos/asf/incubator-heron.git. from 2458c45 Merge branch 'master' of https://github.com/apache/incubator-heron into huijunwu/20200702 add 050c095 updatemaven_install.json No new revisions were added by this update. Summary of changes: maven_install.json | 5292 ++-- 1 file changed, 2646 insertions(+), 2646 deletions(-)
[incubator-heron] branch huijunwu/20200702 updated (2458c45 -> 050c095)
This is an automated email from the ASF dual-hosted git repository. huijun pushed a change to branch huijunwu/20200702 in repository https://gitbox.apache.org/repos/asf/incubator-heron.git. from 2458c45 Merge branch 'master' of https://github.com/apache/incubator-heron into huijunwu/20200702 add 050c095 updatemaven_install.json No new revisions were added by this update. Summary of changes: maven_install.json | 5292 ++-- 1 file changed, 2646 insertions(+), 2646 deletions(-)
[incubator-heron] branch huijunwu/20200702 updated (86936ba -> 2458c45)
This is an automated email from the ASF dual-hosted git repository. huijun pushed a change to branch huijunwu/20200702 in repository https://gitbox.apache.org/repos/asf/incubator-heron.git. from 86936ba fixdarwin-mavenjson add 7544160 Adding missing baseUrl (#3553) add 4f7f90f Python 3 upgrade (#3522) add 2458c45 Merge branch 'master' of https://github.com/apache/incubator-heron into huijunwu/20200702 No new revisions were added by this update. Summary of changes: .travis.yml| 15 +- README.md |2 +- WORKSPACE | 39 +- bazel_configure.py |4 +- config/configure.ac|4 +- docker/base/Dockerfile.base.debian9|2 +- docker/compile/Dockerfile.centos7 |4 +- docker/compile/Dockerfile.debian10 |5 +- docker/compile/Dockerfile.debian9 |4 +- docker/compile/Dockerfile.ubuntu14.04 |2 +- docker/compile/Dockerfile.ubuntu16.04 |9 +- docker/compile/Dockerfile.ubuntu18.04 |3 +- docker/compile/Dockerfile.ubuntu20.04 |3 +- docker/dist/Dockerfile.dist.centos7|3 +- docker/dist/Dockerfile.dist.debian10 |3 +- docker/dist/Dockerfile.dist.debian9|3 +- docker/dist/Dockerfile.dist.ubuntu14.04|3 +- docker/dist/Dockerfile.dist.ubuntu16.04|3 +- docker/dist/Dockerfile.dist.ubuntu18.04|3 +- docker/dist/Dockerfile.dist.ubuntu20.04|3 +- docker/test/Dockerfile.centos7 |2 +- docker/test/Dockerfile.ubuntu18.04 |1 - examples/src/python/bolt/consume_bolt.py |2 +- examples/src/python/bolt/count_bolt.py |2 +- examples/src/python/bolt/half_ack_bolt.py |2 +- examples/src/python/bolt/stateful_count_bolt.py|2 +- examples/src/python/bolt/stream_aggregate_bolt.py |2 +- examples/src/python/bolt/window_size_bolt.py |2 +- examples/src/python/custom_grouping_topology.py|2 +- examples/src/python/half_acking_topology.py|2 +- examples/src/python/join_streamlet_topology.py |2 +- examples/src/python/misc/test_task_hook.py |2 +- examples/src/python/multi_stream_topology.py |2 +- examples/src/python/pulsar_word_count_streamlet.py |2 +- examples/src/python/spout/multi_stream_spout.py|2 +- examples/src/python/spout/stateful_word_spout.py |2 +- examples/src/python/spout/word_spout.py|2 +- .../src/python/stateful_word_count_topology.py |2 +- examples/src/python/window_size_topology.py|2 +- examples/src/python/word_count_streamlet.py|2 +- examples/src/python/word_count_topology.py |2 +- heron/common/src/python/pex_loader.py | 10 +- heron/common/src/python/utils/log.py |7 +- heron/common/src/python/utils/proc.py |8 +- heron/common/tests/python/pex_loader/constants.py |2 +- .../tests/python/pex_loader/pex_loader_unittest.py |2 +- .../tests/python/pex_loader/testdata/src/sample.py |4 +- heron/executor/src/python/heron_executor.py| 43 +- .../tests/python/heron_executor_unittest.py| 34 +- heron/instance/src/python/basics/base_instance.py |6 +- heron/instance/src/python/basics/bolt_instance.py |9 +- heron/instance/src/python/basics/spout_instance.py | 12 +- .../src/python/instance/st_heron_instance.py |7 +- heron/instance/src/python/network/event_looper.py | 14 +- .../instance/src/python/network/gateway_looper.py |7 +- heron/instance/src/python/network/heron_client.py |7 +- .../src/python/network/metricsmgr_client.py|2 +- heron/instance/src/python/network/protocol.py | 29 +- .../instance/src/python/network/socket_options.py |2 +- .../instance/src/python/network/st_stmgr_client.py |2 +- .../src/python/utils/metrics/metrics_helper.py |8 +- .../src/python/utils/metrics/py_metrics.py |2 +- .../instance/src/python/utils/misc/communicator.py |4 +- .../python/utils/misc/custom_grouping_helper.py| 21 +- .../src/python/utils/misc/outgoing_tuple_helper.py |4 +- .../instance/src/python/utils/misc/pplan_helper.py | 18 +- .../src/python/utils/misc/serializer_helper.py | 23 +- heron/instance/src/python/utils/system_config.py |2 +- .../instance/src/python/utils/system_constants.py |2 +- .../python/utils/topology/topology_context_impl.py |5 +- heron/instance/src/python/utils/tuple.py |4 +- heron/instance/tests/python/mock_protobuf.py |2 +-
[GitHub] [incubator-heron] Code0x58 opened a new issue #3558: Investigate and fix zip_safe=False in PEX
Code0x58 opened a new issue #3558: URL: https://github.com/apache/incubator-heron/issues/3558 While upgrading from python2 to python3, the generated PEXs would not work due to being unable to import from at least `pex_library` includes, related to the introduction of [PEP-420](https://www.python.org/dev/peps/pep-0420/), but for some reason wasn't working with the default `zip_safe=None`/`zip_safe=True`, so the workaround was to cause the PEXs to always be extracted to disk rather than loaded straight into memory. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-heron] Code0x58 opened a new issue #3556: Use cloudpickle via pypi rather than vendoring
Code0x58 opened a new issue #3556: URL: https://github.com/apache/incubator-heron/issues/3556 This would be a nice and hopefully simple clean up which was noticed while upgrading from python2 to python3. Files: * `website/public/api/python/api/cloudpickle.m.html` * `licenses/LICENSE-cloudpickle.txt` * `heronpy/api/cloudpickle.py` This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-heron] Code0x58 opened a new issue #3557: Improve/clean up genproto rules
Code0x58 opened a new issue #3557: URL: https://github.com/apache/incubator-heron/issues/3557 While upgrading to python3, the bazel protobuf rules took [some coercing](https://github.com/apache/incubator-heron/blob/4f7f90f2b823dc7e714ee2898b033cfc78f88cb0/tools/rules/genproto.bzl#L168) to get around https://github.com/protocolbuffers/protobuf/issues/1491. A better solution should be used to clean up code and improve stability†. It seems to me that these are options, by order of preference: - using standard protobuf bazel rules and their `import_prefix` - pursue https://github.com/protocolbuffers/protobuf/pull/7470 - use relative paths in the protoc command so the imports are absolute (mentioned in issue) † the build may flake due to files being removed while they are being iterated over This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-heron] Code0x58 opened a new issue #3559: Use builtin python3 modules instead of externals
Code0x58 opened a new issue #3559: URL: https://github.com/apache/incubator-heron/issues/3559 These are leftovers from the python2 to python3 upgrade: * `enum34` → `enum` * `mock` → `unittest.mock` * `unittest2` → `unittest` This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-heron] Code0x58 opened a new issue #3560: DRY up Dockerfiles by using build stages
Code0x58 opened a new issue #3560:
URL: https://github.com/apache/incubator-heron/issues/3560
`docker/{compile,dist,base,test}/*` look like good candidates for
consolidation with [multi-stage
builds](https://docs.docker.com/develop/develop-images/multistage-build/)
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
