[incubator-heron] 17/21: Some python cleanup for pylint
This is an automated email from the ASF dual-hosted git repository. nicknezis pushed a commit to branch nicknezis/bazel-2 in repository https://gitbox.apache.org/repos/asf/incubator-heron.git commit 3a31848b451162dda9b8f4b67eaaf502cf3050cf Author: Nicholas Nezis AuthorDate: Sun Feb 2 10:00:12 2020 -0500 Some python cleanup for pylint --- heron/instance/src/python/network/gateway_looper.py | 3 ++- heron/instance/src/python/utils/misc/serializer_helper.py | 5 ++--- heron/instance/src/python/utils/topology/topology_context_impl.py | 5 ++--- heron/tools/cli/src/python/submit.py | 8 4 files changed, 10 insertions(+), 11 deletions(-) diff --git a/heron/instance/src/python/network/gateway_looper.py b/heron/instance/src/python/network/gateway_looper.py index 4b13605..62c8e8c 100644 --- a/heron/instance/src/python/network/gateway_looper.py +++ b/heron/instance/src/python/network/gateway_looper.py @@ -26,8 +26,9 @@ import os import time import select -from .event_looper import EventLooper from heron.common.src.python.utils.log import Log +from .event_looper import EventLooper + class GatewayLooper(EventLooper): """A GatewayLooper, inheriting EventLooper diff --git a/heron/instance/src/python/utils/misc/serializer_helper.py b/heron/instance/src/python/utils/misc/serializer_helper.py index b894788..f81d1f0 100644 --- a/heron/instance/src/python/utils/misc/serializer_helper.py +++ b/heron/instance/src/python/utils/misc/serializer_helper.py @@ -20,12 +20,11 @@ '''serializer_helper.py''' -from heronpy.api.serializer import PythonSerializer +import heron.common.src.python.pex_loader as pex_loader +from heronpy.api.serializer import PythonSerializer import heronpy.api.api_constants as constants -import heron.common.src.python.pex_loader as pex_loader - class SerializerHelper(object): """Helper class for getting serializer for component""" @staticmethod diff --git a/heron/instance/src/python/utils/topology/topology_context_impl.py b/heron/instance/src/python/utils/topology/topology_context_impl.py index 95687a0..579aea9 100644 --- a/heron/instance/src/python/utils/topology/topology_context_impl.py +++ b/heron/instance/src/python/utils/topology/topology_context_impl.py @@ -22,14 +22,13 @@ import os from collections import namedtuple +import heronpy.api.api_constants as api_constants +from heronpy.api.topology_context import TopologyContext from heronpy.api.task_hook import (ITaskHook, EmitInfo, SpoutAckInfo, SpoutFailInfo, BoltExecuteInfo, BoltAckInfo, BoltFailInfo) -from heronpy.api.topology_context import TopologyContext -import heronpy.api.api_constants as api_constants from heron.instance.src.python.utils.metrics import MetricsCollector - import heron.instance.src.python.utils.system_constants as system_constants import heron.common.src.python.pex_loader as pex_loader diff --git a/heron/tools/cli/src/python/submit.py b/heron/tools/cli/src/python/submit.py index 57df7fb..a1cb9a6 100644 --- a/heron/tools/cli/src/python/submit.py +++ b/heron/tools/cli/src/python/submit.py @@ -19,16 +19,16 @@ # under the License. ''' submit.py ''' -from future.standard_library import install_aliases -install_aliases() - import glob import logging import os import tempfile -import requests import subprocess from urllib.parse import urlparse +import requests + +from future.standard_library import install_aliases +install_aliases() from heron.common.src.python.utils.log import Log from heron.proto import topology_pb2
[incubator-heron] 08/21: autoreconf to fix libevent build
This is an automated email from the ASF dual-hosted git repository. nicknezis pushed a commit to branch nicknezis/bazel-2 in repository https://gitbox.apache.org/repos/asf/incubator-heron.git commit 1602c1dc540267e1644bbfaf754b4d833cd68ef0 Author: Nicholas Nezis AuthorDate: Tue Jan 28 03:32:11 2020 -0500 autoreconf to fix libevent build --- third_party/libevent/libevent.BUILD | 1 + 1 file changed, 1 insertion(+) diff --git a/third_party/libevent/libevent.BUILD b/third_party/libevent/libevent.BUILD index b708b28..a825842 100644 --- a/third_party/libevent/libevent.BUILD +++ b/third_party/libevent/libevent.BUILD @@ -52,6 +52,7 @@ genrule( 'mkdir -p $$TMP_DIR', 'cp -R $$(pwd)/external/org_libevent_libevent/* $$TMP_DIR', 'cd $$TMP_DIR', +'autoreconf -f -i', './configure --prefix=$$INSTALL_DIR --enable-shared=no --disable-openssl', 'make install', 'rm -rf $$TMP_DIR',
[incubator-heron] branch nicknezis/bazel-2 updated (b14857e -> 1e72d12)
This is an automated email from the ASF dual-hosted git repository. nicknezis pushed a change to branch nicknezis/bazel-2 in repository https://gitbox.apache.org/repos/asf/incubator-heron.git. omit b14857e Update setuptools to 18.8.1 omit c90ae40 Minor deprecation syntax cleanup omit b61e880 More pylint cleanup to make build pass omit f62779b Some python cleanup for pylint omit 8ca436c Updated Ubuntu 16.04 Dockerfile omit e325316 Updated Ubuntu 14.04 Dockerfile omit 564d0e7 Some python cleanup omit 2ad0592 Adding rest of cppcheck files omit 258e25f Added libcppunit-dev package to travic ci omit c6c854a autorecond for glog omit 37e57b2 autoreconf to lib zookeeper omit ad15145 autoreconf for libunwind omit f3ec6be autoreconf to fix libevent build omit e17c07e Added python3-wheel to travis.yml omit 3630536 Upgrade cppcheck to 1.90 omit 9598bef Various initial updates to support Bazel 2.0.0 omit c602e0d Added missing kafka dependency omit 875424d Update to fix examples/... build omit 9bb75aa Updated to use `maven_install` omit 46b57b4 Initial changes from buildozer migration add f7371e1 Added execute permission to dev-env-create.sh (#3443) add d43f6bd Use netcat-bsd in Debian (#3447) add b22f442 remove old site (#3446) add c9d18e6 Add redirect from github pages to new apache site (#3448) add d179c83 Bump mixin-deep from 1.3.1 to 1.3.2 in /website2/website (#3391) add 783581b adding new committers (#3451) add db255f4 removing symlink. Adding contributing guidelines back (#3450) add 0a6cecb adding examples folder to classpath (#3458) add 1476076 Java 11 support (#3454) add 4379fe1 Update website for java 11 (#3462) add 1c59862 Update README for Java 11 (#3464) add f0b6e1b Make log/sink/consume Streamlet component support setName and setNumPartitions (#3459) add a6ec96e Patch to fix cppcheck with newer glibc (#3471) add 98a084a Add documents for setting up a docker based development environment (#3475) add ee1c44a Improve concurrency for needed parts. (#3107) add 6846f70 Revert "Upgrade to Python3 (#3431)" (#3478) add 576e0c7 Joshfischer/debian10 java11 (#3481) add 43c7c74 Update Debian docker build with JDK11 and correct debian version (#3487) add 9ddbeb6 updating docs for compiling (#3483) add f76f479 fixstmgrcrash (#3492) add c3d29a4 rolling back docusaurus version (#3501) new 20c4a01 Initial changes from buildozer migration new 4e3b810 Updated to use `maven_install` new 1649559 Update to fix examples/... build new 94eb6ef Added missing kafka dependency new f4a4119 Various initial updates to support Bazel 2.0.0 new d7a1d22 Upgrade cppcheck to 1.90 new f7b43ad Added python3-wheel to travis.yml new 1602c1d autoreconf to fix libevent build new 511b8ac autoreconf for libunwind new 3f130c7 autoreconf to lib zookeeper new b9ba344 autorecond for glog new 3437e03 Added libcppunit-dev package to travic ci new f891e9c Adding rest of cppcheck files new bec4d33 Some python cleanup new 432f557 Updated Ubuntu 14.04 Dockerfile new eeecbf8 Updated Ubuntu 16.04 Dockerfile new 3a31848 Some python cleanup for pylint new e3eb28b More pylint cleanup to make build pass new 1fca5f2 Minor deprecation syntax cleanup new 91703fb Update setuptools to 18.8.1 new 1e72d12 Adding missing maven dependencies This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (b14857e) \ N -- N -- N refs/heads/nicknezis/bazel-2 (1e72d12) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 21 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .asf.yaml |3 +- .travis.yml| 13 +- CONTRIBUTING.md| 75 +- README.md |4 +- WORKSPACE |8 +- bazel_configure.py |4 +- config/configure.ac|4 +-
[incubator-heron] 09/21: autoreconf for libunwind
This is an automated email from the ASF dual-hosted git repository. nicknezis pushed a commit to branch nicknezis/bazel-2 in repository https://gitbox.apache.org/repos/asf/incubator-heron.git commit 511b8ac05090e975de3ee2ce44e2628c3cd0c3fc Author: Nicholas Nezis AuthorDate: Tue Jan 28 03:45:51 2020 -0500 autoreconf for libunwind --- third_party/libunwind/libunwind.BUILD | 1 + 1 file changed, 1 insertion(+) diff --git a/third_party/libunwind/libunwind.BUILD b/third_party/libunwind/libunwind.BUILD index 0fa20f9..a592be5 100644 --- a/third_party/libunwind/libunwind.BUILD +++ b/third_party/libunwind/libunwind.BUILD @@ -27,6 +27,7 @@ genrule( "mkdir -p $$TMP_DIR", "cp -LR $$(pwd)/external/org_nongnu_libunwind/* $$TMP_DIR", "cd $$TMP_DIR", +"autoreconf -f -i", "./configure --prefix=$$INSTALL_DIR --enable-shared=no --disable-minidebuginfo", 'make install SUBDIRS="src tests"', "rm -rf $$TMP_DIR",
[incubator-heron] 03/21: Update to fix examples/... build
This is an automated email from the ASF dual-hosted git repository. nicknezis pushed a commit to branch nicknezis/bazel-2 in repository https://gitbox.apache.org/repos/asf/incubator-heron.git commit 16495599f5fad1864c52985f49fdaf1045afc577 Author: Nicholas Nezis AuthorDate: Wed Jan 22 01:46:05 2020 -0500 Update to fix examples/... build --- examples/src/java/BUILD | 2 +- third_party/java/BUILD | 4 ++-- 2 files changed, 3 insertions(+), 3 deletions(-) diff --git a/examples/src/java/BUILD b/examples/src/java/BUILD index c32a05f..113579f 100644 --- a/examples/src/java/BUILD +++ b/examples/src/java/BUILD @@ -27,7 +27,7 @@ java_binary( "//heron/common/src/java:basics-java", "//heron/simulator/src/java:simulator-java", "//third_party/java:kryo", -"@maven//:apache_pulsar_client", +"@maven//:org_apache_pulsar_pulsar_client_shaded", ], ) diff --git a/third_party/java/BUILD b/third_party/java/BUILD index 7425c6c..21068a1 100644 --- a/third_party/java/BUILD +++ b/third_party/java/BUILD @@ -225,10 +225,10 @@ java_library( name = "apache-pulsar-client", srcs = ["Empty.java"], exports = [ -"@maven//:apache_pulsar_client", +"@maven//:org_apache_pulsar_pulsar_client_shaded", ], deps = [ -"@maven//:apache_pulsar_client", +"@maven//:org_apache_pulsar_pulsar_client_shaded", ], )
[incubator-heron] 20/21: Update setuptools to 18.8.1
This is an automated email from the ASF dual-hosted git repository. nicknezis pushed a commit to branch nicknezis/bazel-2 in repository https://gitbox.apache.org/repos/asf/incubator-heron.git commit 91703fbf110af1811ab1f4dd0023de68d4400932 Author: Nicholas Nezis AuthorDate: Thu Feb 6 02:09:42 2020 -0500 Update setuptools to 18.8.1 --- heron/proto/BUILD | 2 +- heronpy/proto/BUILD | 4 ++-- 2 files changed, 3 insertions(+), 3 deletions(-) diff --git a/heron/proto/BUILD b/heron/proto/BUILD index 2262332..1acd9a7 100644 --- a/heron/proto/BUILD +++ b/heron/proto/BUILD @@ -178,7 +178,7 @@ pex_library( name = "proto-py", reqs = [ "protobuf==3.8.0", -"setuptools==18.0.1", +"setuptools==18.8.1", ], deps = [ ":proto_ckptmgr_py", diff --git a/heronpy/proto/BUILD b/heronpy/proto/BUILD index e9c6354..c0ec11e 100644 --- a/heronpy/proto/BUILD +++ b/heronpy/proto/BUILD @@ -26,7 +26,7 @@ pex_library( srcs = glob(["**/*.py"]), reqs = [ "protobuf==3.8.0", -"setuptools==18.0.1", +"setuptools==18.8.1", ], deps = [ ":proto_ckptmgr_py", @@ -49,7 +49,7 @@ pex_binary( srcs = glob(["**/*.py"]), reqs = [ "protobuf==3.8.0", -"setuptools==18.0.1", +"setuptools==18.8.1", ], deps = [ ":proto_ckptmgr_py",
[incubator-heron] 14/21: Some python cleanup
This is an automated email from the ASF dual-hosted git repository.
nicknezis pushed a commit to branch nicknezis/bazel-2
in repository https://gitbox.apache.org/repos/asf/incubator-heron.git
commit bec4d33c7b41d55f3245632df38691ff054e207b
Author: Nicholas Nezis
AuthorDate: Fri Jan 31 08:31:26 2020 -0500
Some python cleanup
---
heron/executor/src/python/heron_executor.py| 2 +-
heron/instance/src/python/instance/st_heron_instance.py| 2 +-
heron/instance/src/python/network/heron_client.py | 3 ++-
heron/instance/src/python/network/st_stmgr_client.py | 1 -
heron/instance/src/python/utils/metrics/py_metrics.py | 5 -
heron/proto/BUILD | 2 +-
heron/tools/admin/src/python/standalone.py | 6 +++---
heron/tools/cli/src/python/update.py | 9 +
heron/tools/cli/src/python/version.py | 6 +++---
heron/tools/common/src/python/access/query.py | 2 --
heron/tools/tracker/src/python/BUILD | 2 +-
heron/tools/tracker/src/python/handlers/metadatahandler.py | 1 -
heron/tools/tracker/src/python/topology.py | 3 ++-
heron/tools/ui/src/python/handlers/topology.py | 5 +++--
heronpy/proto/BUILD| 4 ++--
scripts/packages/heronpy/requirements.txt | 2 +-
16 files changed, 29 insertions(+), 26 deletions(-)
diff --git a/heron/executor/src/python/heron_executor.py
b/heron/executor/src/python/heron_executor.py
index c9d4501..db8dff0 100755
--- a/heron/executor/src/python/heron_executor.py
+++ b/heron/executor/src/python/heron_executor.py
@@ -34,10 +34,10 @@ import sys
import stat
import threading
import time
-import yaml
import socket
import traceback
import itertools
+import yaml
from heron.common.src.python.utils import log
from heron.common.src.python.utils import proc
diff --git a/heron/instance/src/python/instance/st_heron_instance.py
b/heron/instance/src/python/instance/st_heron_instance.py
index 569e5aa..e790ae7 100644
--- a/heron/instance/src/python/instance/st_heron_instance.py
+++ b/heron/instance/src/python/instance/st_heron_instance.py
@@ -24,8 +24,8 @@ import collections
import logging
import os
import resource
-import traceback
import signal
+import traceback
import yaml
import heronpy.api.api_constants as api_constants
diff --git a/heron/instance/src/python/network/heron_client.py
b/heron/instance/src/python/network/heron_client.py
index fa071d3..61eb99e 100644
--- a/heron/instance/src/python/network/heron_client.py
+++ b/heron/instance/src/python/network/heron_client.py
@@ -22,10 +22,11 @@
import asyncore
import socket
+import time
import traceback
+
from abc import abstractmethod
-import time
from heron.common.src.python.utils.log import Log
import heron.instance.src.python.utils.system_constants as constants
from heron.instance.src.python.network import HeronProtocol, REQID,
StatusCode, OutgoingPacket
diff --git a/heron/instance/src/python/network/st_stmgr_client.py
b/heron/instance/src/python/network/st_stmgr_client.py
index 2e1bcb0..e2317e4 100644
--- a/heron/instance/src/python/network/st_stmgr_client.py
+++ b/heron/instance/src/python/network/st_stmgr_client.py
@@ -164,4 +164,3 @@ class SingleThreadStmgrClient(HeronClient):
"""Called when new NewInstanceAssignmentMessage arrives"""
Log.debug("In handle_assignment_message() of STStmgrClient, Physical Plan:
\n%s", str(pplan))
self.heron_instance_cls.handle_assignment_msg(pplan)
-
diff --git a/heron/instance/src/python/utils/metrics/py_metrics.py
b/heron/instance/src/python/utils/metrics/py_metrics.py
index 55636bd..96b095f 100644
--- a/heron/instance/src/python/utils/metrics/py_metrics.py
+++ b/heron/instance/src/python/utils/metrics/py_metrics.py
@@ -22,12 +22,15 @@
import gc
import resource
import traceback
+
from heronpy.api.metrics import AssignableMetrics
-from .metrics_helper import BaseMetricsHelper
+
import heron.instance.src.python.utils.system_constants as constants
from heron.instance.src.python.utils import system_config
from heron.common.src.python.utils.log import Log
+from .metrics_helper import BaseMetricsHelper
+
# pylint: disable=too-many-instance-attributes
class PyMetrics(BaseMetricsHelper):
"""Helper class to collect PyHeron program metrics"""
diff --git a/heron/proto/BUILD b/heron/proto/BUILD
index e03f718..2262332 100644
--- a/heron/proto/BUILD
+++ b/heron/proto/BUILD
@@ -177,7 +177,7 @@ java_library(
pex_library(
name = "proto-py",
reqs = [
-"protobuf==3.6.1",
+"protobuf==3.8.0",
"setuptools==18.0.1",
],
deps = [
diff --git a/heron/tools/admin/src/python/standalone.py
b/heron/tools/admin/src/python/standalone.py
index 6caf196..b7afdff 100644
--- a/heron/tools/admin/src/python/standalone.py
+++ b/heron/tools/admin/src/python/standalone.py
@@ -26,14
[incubator-heron] 11/21: autorecond for glog
This is an automated email from the ASF dual-hosted git repository. nicknezis pushed a commit to branch nicknezis/bazel-2 in repository https://gitbox.apache.org/repos/asf/incubator-heron.git commit b9ba344a01ef7210f2036be7ba1ae0a1d1142973 Author: Nicholas Nezis AuthorDate: Tue Jan 28 07:36:27 2020 -0500 autorecond for glog --- third_party/glog/glog.BUILD | 1 + 1 file changed, 1 insertion(+) diff --git a/third_party/glog/glog.BUILD b/third_party/glog/glog.BUILD index 7a5507a..716c38c 100644 --- a/third_party/glog/glog.BUILD +++ b/third_party/glog/glog.BUILD @@ -50,6 +50,7 @@ linux_script = "\n".join(common_script + [ 'export VAR_LIBS="-Wl,--rpath -Wl,$$UNWIND_DIR/lib -L$$UNWIND_DIR/lib"', 'export VAR_INCL="-I$$UNWIND_DIR/include"', 'export VAR_LD="-L$$UNWIND_DIR/lib"', + 'autoreconf -f -i', './configure --prefix=$$INSTALL_DIR --enable-shared=no LIBS="$$VAR_LIBS" CPPFLAGS="$$VAR_INCL" LDFLAGS="$$VAR_LD"', 'make install LIBS="$$VAR_LIBS" CPPFLAGS="$$VAR_INCL" LDFLAGS="$$VAR_LD"', 'rm -rf $$TMP_DIR',
[incubator-heron] 13/21: Adding rest of cppcheck files
This is an automated email from the ASF dual-hosted git repository. nicknezis pushed a commit to branch nicknezis/bazel-2 in repository https://gitbox.apache.org/repos/asf/incubator-heron.git commit f891e9c5d13744ee519f8df04c245cf1659a93d2 Author: Nicholas Nezis AuthorDate: Wed Jan 29 00:08:42 2020 -0500 Adding rest of cppcheck files --- third_party/cppcheck/cppcheck.BUILD | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/third_party/cppcheck/cppcheck.BUILD b/third_party/cppcheck/cppcheck.BUILD index 3e08a8c..a7099a7 100644 --- a/third_party/cppcheck/cppcheck.BUILD +++ b/third_party/cppcheck/cppcheck.BUILD @@ -7,7 +7,7 @@ install_script = "\n".join([ "make MATCHCOMPILER=yes CFGDIR=cfg CXXFLAGS='-O2 -DNDEBUG -Wall -Wno-sign-compare -Wno-unused-function'", "cd ../..", "rm -rf ../../$(@D)/*", -"cp -R ./external/com_github_danmar_cppcheck/cppcheck $(@)", +"cp -R ./external/com_github_danmar_cppcheck/* $(@D)", ]) genrule(
[incubator-heron] 07/21: Added python3-wheel to travis.yml
This is an automated email from the ASF dual-hosted git repository.
nicknezis pushed a commit to branch nicknezis/bazel-2
in repository https://gitbox.apache.org/repos/asf/incubator-heron.git
commit f7b43adb7c7da5e8b00408f1a8e1323d5192d622
Author: Nicholas Nezis
AuthorDate: Tue Jan 28 03:24:26 2020 -0500
Added python3-wheel to travis.yml
---
.travis.yml | 5 -
docker/compile/Dockerfile.centos7 | 4 +---
2 files changed, 1 insertion(+), 8 deletions(-)
diff --git a/.travis.yml b/.travis.yml
index 2b8313f..cd027ea 100644
--- a/.travis.yml
+++ b/.travis.yml
@@ -37,11 +37,6 @@ before_install:
- ./bazel-${BAZEL_VERSION}-installer-linux-x86_64.sh --user
before_script:
- # install python module for wheel files
- # required for python packaging
- # - sudo pip install wheel
-
-script:
- which gcc-4.8
- gcc --version
- which g++-4.8
diff --git a/docker/compile/Dockerfile.centos7
b/docker/compile/Dockerfile.centos7
index ce36899..9d7debc 100644
--- a/docker/compile/Dockerfile.centos7
+++ b/docker/compile/Dockerfile.centos7
@@ -19,7 +19,7 @@ FROM centos:centos7
# This is passed to the heron build command via the --config flag
ENV TARGET_PLATFORM centos
-ENV bazelVersion 0.26.0
+ENV bazelVersion 2.0.0
RUN yum -y upgrade
RUN yum -y install \
@@ -36,8 +36,6 @@ RUN yum -y install \
make \
patch \
python-devel \
- python3-devel \
- python3-setuptools \
zip \
unzip \
wget \
[incubator-heron] 18/21: More pylint cleanup to make build pass
This is an automated email from the ASF dual-hosted git repository. nicknezis pushed a commit to branch nicknezis/bazel-2 in repository https://gitbox.apache.org/repos/asf/incubator-heron.git commit e3eb28b733f49f4dc307b9fe06984e17c84aa2f4 Author: Nicholas Nezis AuthorDate: Sun Feb 2 13:26:09 2020 -0500 More pylint cleanup to make build pass --- examples/src/python/bolt/stateful_count_bolt.py | 1 + examples/src/python/bolt/stream_aggregate_bolt.py| 1 + examples/src/python/spout/multi_stream_spout.py | 1 + examples/src/python/spout/stateful_word_spout.py | 1 + examples/src/python/spout/word_spout.py | 1 + examples/src/python/stateful_word_count_topology.py | 1 + examples/src/python/window_size_topology.py | 2 ++ examples/src/python/word_count_topology.py | 1 + heron/instance/src/python/basics/base_instance.py| 12 +--- heron/instance/src/python/basics/bolt_instance.py| 11 --- heron/instance/src/python/instance/st_heron_instance.py | 9 - heron/instance/src/python/network/event_looper.py| 1 + heron/instance/src/python/network/socket_options.py | 1 + heron/instance/src/python/utils/misc/pplan_helper.py | 6 +++--- heron/instance/src/python/utils/tuple.py | 1 + heron/instance/tests/python/utils/mock_generator.py | 1 + heron/shell/src/python/handlers/killexecutorhandler.py | 8 .../integration_test/topology/all_grouping/all_grouping.py | 1 - 18 files changed, 33 insertions(+), 27 deletions(-) diff --git a/examples/src/python/bolt/stateful_count_bolt.py b/examples/src/python/bolt/stateful_count_bolt.py index a3ea6b6..260c0bf 100644 --- a/examples/src/python/bolt/stateful_count_bolt.py +++ b/examples/src/python/bolt/stateful_count_bolt.py @@ -20,6 +20,7 @@ """module for example bolt: CountBolt""" from collections import Counter + import heronpy.api.global_metrics as global_metrics from heronpy.api.bolt.bolt import Bolt from heronpy.api.state.stateful_component import StatefulComponent diff --git a/examples/src/python/bolt/stream_aggregate_bolt.py b/examples/src/python/bolt/stream_aggregate_bolt.py index 33b5d64..e94c3ca 100644 --- a/examples/src/python/bolt/stream_aggregate_bolt.py +++ b/examples/src/python/bolt/stream_aggregate_bolt.py @@ -20,6 +20,7 @@ '''stream aggregator''' from collections import Counter + from heronpy.api.bolt.bolt import Bolt # pylint: disable=unused-argument diff --git a/examples/src/python/spout/multi_stream_spout.py b/examples/src/python/spout/multi_stream_spout.py index 8a2cc18..b9e60a4 100644 --- a/examples/src/python/spout/multi_stream_spout.py +++ b/examples/src/python/spout/multi_stream_spout.py @@ -21,6 +21,7 @@ """Word spout with error streams""" from itertools import cycle + from heronpy.api.spout.spout import Spout from heronpy.api.stream import Stream diff --git a/examples/src/python/spout/stateful_word_spout.py b/examples/src/python/spout/stateful_word_spout.py index 9f368df..3a09777 100644 --- a/examples/src/python/spout/stateful_word_spout.py +++ b/examples/src/python/spout/stateful_word_spout.py @@ -22,6 +22,7 @@ from itertools import cycle from collections import Counter + from heronpy.api.spout.spout import Spout from heronpy.api.state.stateful_component import StatefulComponent diff --git a/examples/src/python/spout/word_spout.py b/examples/src/python/spout/word_spout.py index a194da3..d8a44c9 100644 --- a/examples/src/python/spout/word_spout.py +++ b/examples/src/python/spout/word_spout.py @@ -21,6 +21,7 @@ """module for example spout: WordSpout""" from itertools import cycle + from heronpy.api.spout.spout import Spout class WordSpout(Spout): diff --git a/examples/src/python/stateful_word_count_topology.py b/examples/src/python/stateful_word_count_topology.py index 1918dee..7068aa0 100644 --- a/examples/src/python/stateful_word_count_topology.py +++ b/examples/src/python/stateful_word_count_topology.py @@ -24,6 +24,7 @@ import sys import heronpy.api.api_constants as constants from heronpy.api.topology import TopologyBuilder from heronpy.api.stream import Grouping + from examples.src.python.spout import StatefulWordSpout from examples.src.python.bolt import StatefulCountBolt diff --git a/examples/src/python/window_size_topology.py b/examples/src/python/window_size_topology.py index d123199..3ef9409 100644 --- a/examples/src/python/window_size_topology.py +++ b/examples/src/python/window_size_topology.py @@ -25,7 +25,9 @@ import heronpy.api.api_constants as constants from heronpy.api.topology import TopologyBuilder from heronpy.api.stream import Grouping from heronpy.api.bolt.window_bolt import SlidingWindowBolt + from heron.examples.src.python.spout import WordSpout + from examples.src.python.bolt import WindowSizeBolt # Topology
[incubator-heron] 04/21: Added missing kafka dependency
This is an automated email from the ASF dual-hosted git repository. nicknezis pushed a commit to branch nicknezis/bazel-2 in repository https://gitbox.apache.org/repos/asf/incubator-heron.git commit 94eb6efeb4fe1b58b45117c93d2de793e909c795 Author: Nicholas Nezis AuthorDate: Wed Jan 22 02:06:06 2020 -0500 Added missing kafka dependency --- WORKSPACE | 1 + 1 file changed, 1 insertion(+) diff --git a/WORKSPACE b/WORKSPACE index 8a1ecb7..3afd468 100644 --- a/WORKSPACE +++ b/WORKSPACE @@ -65,6 +65,7 @@ maven_install( "com.hashicorp.nomad:nomad-sdk:0.7.0", "org.apache.hadoop:hadoop-core:0.20.2", "org.apache.pulsar:pulsar-client:shaded:1.19.0-incubating", +"org.apache.kafka:kafka-clients:2.2.0", "com.google.apis:google-api-services-storage:v1-rev108-" + google_client_version, "org.apache.reef:reef-runtime-yarn:" + reef_version, "org.apache.reef:reef-runtime-local:" + reef_version,
[incubator-heron] 12/21: Added libcppunit-dev package to travic ci
This is an automated email from the ASF dual-hosted git repository. nicknezis pushed a commit to branch nicknezis/bazel-2 in repository https://gitbox.apache.org/repos/asf/incubator-heron.git commit 3437e03958c82df135fbbebb487b16996689f629 Author: Nicholas Nezis AuthorDate: Tue Jan 28 21:11:30 2020 -0500 Added libcppunit-dev package to travic ci --- .travis.yml | 1 + 1 file changed, 1 insertion(+) diff --git a/.travis.yml b/.travis.yml index cd027ea..3767679 100644 --- a/.travis.yml +++ b/.travis.yml @@ -20,6 +20,7 @@ addons: - gcc-4.8-multilib - g++-4.8-multilib - python2.7 + - libcppunit-dev - wget - pkg-config - zip
[incubator-heron] 02/21: Updated to use `maven_install`
This is an automated email from the ASF dual-hosted git repository.
nicknezis pushed a commit to branch nicknezis/bazel-2
in repository https://gitbox.apache.org/repos/asf/incubator-heron.git
commit 4e3b810e01e0611381158142453b0d11446f10ae
Author: Nicholas Nezis
AuthorDate: Wed Jan 22 01:23:53 2020 -0500
Updated to use `maven_install`
---
WORKSPACE| 855 +++
contrib/bolts/kafka/src/java/BUILD | 2 +-
contrib/bolts/kafka/test/java/BUILD | 4 +-
contrib/spouts/kafka/sample/src/java/BUILD | 4 +-
contrib/spouts/kafka/src/java/BUILD | 2 +-
contrib/spouts/kafka/test/java/BUILD | 4 +-
eco/src/java/BUILD | 4 +-
eco/tests/java/BUILD | 2 +-
examples/src/java/BUILD | 2 +-
examples/src/scala/BUILD | 2 +-
heron/api/src/java/BUILD | 6 +-
heron/api/tests/java/BUILD | 2 +-
heron/ckptmgr/src/java/BUILD | 2 +-
heron/common/tests/java/BUILD| 2 +-
heron/downloaders/src/java/BUILD | 6 +-
heron/healthmgr/src/java/BUILD | 54 +-
heron/healthmgr/tests/java/BUILD | 54 +-
heron/instance/src/java/BUILD| 2 +-
heron/io/dlog/src/java/BUILD | 4 +-
heron/io/dlog/tests/java/BUILD | 6 +-
heron/metricscachemgr/tests/java/BUILD | 2 +-
heron/metricsmgr/src/java/BUILD | 2 +-
heron/metricsmgr/tests/java/BUILD| 2 +-
heron/packing/src/java/BUILD | 4 +-
heron/scheduler-core/src/java/BUILD | 8 +-
heron/scheduler-core/tests/java/BUILD| 4 +-
heron/schedulers/src/java/BUILD | 34 +-
heron/schedulers/tests/java/BUILD| 52 +-
heron/simulator/src/java/BUILD | 6 +-
heron/spi/src/java/BUILD | 14 +-
heron/statefulstorages/src/java/BUILD| 2 +-
heron/statefulstorages/tests/java/BUILD | 10 +-
heron/statemgrs/src/java/BUILD | 10 +-
heron/statemgrs/tests/java/BUILD | 6 +-
heron/tools/apiserver/src/java/BUILD | 8 +-
heron/tools/apiserver/tests/java/BUILD | 2 +-
heron/uploaders/src/java/BUILD | 12 +-
heron/uploaders/tests/java/BUILD | 10 +-
integration_test/src/java/BUILD | 24 +-
storm-compatibility/src/java/BUILD | 2 +-
third_party/java/BUILD | 236 +++
tools/java/src/org/apache/bazel/checkstyle/BUILD | 8 +-
tools/java/src/org/apache/bazel/cppcheck/BUILD | 6 +-
43 files changed, 421 insertions(+), 1062 deletions(-)
diff --git a/WORKSPACE b/WORKSPACE
index 065d85b..8a1ecb7 100644
--- a/WORKSPACE
+++ b/WORKSPACE
@@ -19,6 +19,16 @@ workspace(name = "org_apache_heron")
load("@bazel_tools//tools/build_defs/repo:http.bzl", "http_archive",
"http_file", "http_jar")
+RULES_JVM_EXTERNAL_TAG = "3.1"
+RULES_JVM_EXTERNAL_SHA =
"e246373de2353f3d34d35814947aa8b7d0dd1a58c2f7a6c41cfeaff3007c2d14"
+
+http_archive(
+name = "rules_jvm_external",
+strip_prefix = "rules_jvm_external-%s" % RULES_JVM_EXTERNAL_TAG,
+sha256 = RULES_JVM_EXTERNAL_SHA,
+url = "https://github.com/bazelbuild/rules_jvm_external/archive/%s.zip; %
RULES_JVM_EXTERNAL_TAG,
+)
+
# versions shared across artifacts that should be upgraded together
aws_version = "1.11.58"
curator_version = "2.9.0"
@@ -32,758 +42,107 @@ http_client_version = "4.5.2"
# heron API server
jetty_version = "9.4.6.v20170531"
-jersey_verion = "2.25.1"
+jersey_version = "2.25.1"
hk2_api = "2.5.0-b32"
-
-maven_server(
- name = "default",
- url = "https://repo1.maven.org/maven2/;,
-)
-
-maven_server(
- name = "maven_twttr_com",
- url = "https://maven.twttr.com;,
-)
-
-maven_jar(
- name = "org_apache_avro_avro",
- artifact = "org.apache.avro:avro:1.7.4"
-)
-
-maven_jar(
- name = "antlr_antlr",
- artifact = "antlr:antlr:2.7.7",
-)
-
-maven_jar(
-name = "aopalliance_aopalliance",
-artifact = "aopalliance:aopalliance:1.0",
-)
-
-maven_jar(
- name = "org_ow2_asm_asm_all",
- artifact = "org.ow2.asm:asm-all:5.1",
-)
-
-maven_jar(
- name = "com_amazonaws_aws_java_sdk_core",
- artifact = "com.amazonaws:aws-java-sdk-core:" + aws_version,
-)
-
-maven_jar(
- name = "com_amazonaws_aws_java_sdk_s3",
- artifact = "com.amazonaws:aws-java-sdk-s3:" + aws_version,
-)
-
-maven_jar(
- name = "com_puppycrawl_tools_checkstyle",
- artifact = "com.puppycrawl.tools:checkstyle:6.17",
-)
-
-maven_jar(
- name = "commons_beanutils_commons_beanutils",
- artifact = "commons-beanutils:commons-beanutils:1.9.2",
-)
-
-maven_jar(
- name = "commons_codec",
- artifact
[incubator-heron] 16/21: Updated Ubuntu 16.04 Dockerfile
This is an automated email from the ASF dual-hosted git repository. nicknezis pushed a commit to branch nicknezis/bazel-2 in repository https://gitbox.apache.org/repos/asf/incubator-heron.git commit eeecbf881a29a5600e0c840eb6931865b00c8186 Author: Nicholas Nezis AuthorDate: Sat Feb 1 22:24:19 2020 -0500 Updated Ubuntu 16.04 Dockerfile --- docker/compile/Dockerfile.ubuntu16.04 | 6 +- 1 file changed, 1 insertion(+), 5 deletions(-) diff --git a/docker/compile/Dockerfile.ubuntu16.04 b/docker/compile/Dockerfile.ubuntu16.04 index 510f59f..fc7ce78 100644 --- a/docker/compile/Dockerfile.ubuntu16.04 +++ b/docker/compile/Dockerfile.ubuntu16.04 @@ -19,7 +19,7 @@ FROM ubuntu:16.04 # This is passed to the heron build command via the --config flag ENV TARGET_PLATFORM ubuntu -ENV bazelVersion 0.26.0 +ENV bazelVersion 2.0.0 RUN apt-get update && apt-get -y install \ automake \ @@ -32,10 +32,6 @@ RUN apt-get update && apt-get -y install \ libunwind8 \ libunwind-setjmp0-dev \ python-dev \ - python3-dev \ - python3-software-properties \ - software-properties-common \ - python3-setuptools \ tree \ zip \ unzip \
[incubator-heron] 21/21: Adding missing maven dependencies
This is an automated email from the ASF dual-hosted git repository.
nicknezis pushed a commit to branch nicknezis/bazel-2
in repository https://gitbox.apache.org/repos/asf/incubator-heron.git
commit 1e72d126de7726682ad68a7ea9d492f392eeb7f2
Author: Nicholas Nezis
AuthorDate: Sun Mar 29 16:29:57 2020 -0400
Adding missing maven dependencies
---
WORKSPACE | 2 ++
heron/api/src/java/BUILD | 2 +-
heron/common/src/java/BUILD | 2 +-
heron/scheduler-core/src/java/BUILD | 2 +-
heron/simulator/src/java/BUILD| 2 +-
heron/tools/apiserver/src/java/BUILD | 2 +-
maven_install.json| 54 ++-
third_party/zookeeper/zookeeper.BUILD | 1 -
8 files changed, 60 insertions(+), 7 deletions(-)
diff --git a/WORKSPACE b/WORKSPACE
index acb6810..41cc032 100644
--- a/WORKSPACE
+++ b/WORKSPACE
@@ -117,6 +117,8 @@ maven_install(
"com.fasterxml.jackson.core:jackson-databind:" + jackson_version,
"com.fasterxml.jackson.jaxrs:jackson-jaxrs-base:2.8.8",
"com.fasterxml.jackson.jaxrs:jackson-jaxrs-json-provider:2.8.8",
+"javax.xml.bind:jaxb-api:2.3.0",
+"javax.activation:activation:1.1.1",
"org.mockito:mockito-all:1.10.19",
"org.sonatype.plugins:jarjar-maven-plugin:1.9",
"org.powermock:powermock-api-mockito:" + powermock_version,
diff --git a/heron/api/src/java/BUILD b/heron/api/src/java/BUILD
index c58bfe2..59dba89 100644
--- a/heron/api/src/java/BUILD
+++ b/heron/api/src/java/BUILD
@@ -16,7 +16,7 @@ api_deps_files = \
heron_java_api_proto_files() + [
":classification",
"//heron/common/src/java:basics-java",
-"@javax_xml_bind_jaxb//jar",
+"@maven//:javax_xml_bind_jaxb_api",
]
# Low Level Api
diff --git a/heron/common/src/java/BUILD b/heron/common/src/java/BUILD
index 7e7f23b..a4788db 100644
--- a/heron/common/src/java/BUILD
+++ b/heron/common/src/java/BUILD
@@ -21,7 +21,7 @@ java_library(
srcs = glob(["**/config/*.java"]),
deps = [
":basics-java",
-"@maven//:javax_xml_bind_jaxb",
+"@maven//:javax_xml_bind_jaxb_api",
"@maven//:org_yaml_snakeyaml",
],
)
diff --git a/heron/scheduler-core/src/java/BUILD
b/heron/scheduler-core/src/java/BUILD
index 86ed461..f880dc2 100644
--- a/heron/scheduler-core/src/java/BUILD
+++ b/heron/scheduler-core/src/java/BUILD
@@ -8,7 +8,7 @@ common_deps_files = [
"@maven//:commons_cli_commons_cli",
"@maven//:com_google_guava_guava",
"@maven//:org_apache_commons_commons_lang3",
-"@maven//:javax_xml_bind_jaxb",
+"@maven//:javax_xml_bind_jaxb_api",
"//third_party/java:jackson",
]
diff --git a/heron/simulator/src/java/BUILD b/heron/simulator/src/java/BUILD
index 5ff8af8..24b2640 100644
--- a/heron/simulator/src/java/BUILD
+++ b/heron/simulator/src/java/BUILD
@@ -20,7 +20,7 @@ simulator_deps_files = \
"//heron/common/src/java:utils-java",
"//heron/instance/src/java:instance-java",
"@maven//:org_yaml_snakeyaml",
-"@maven//:javax_xml_bind_jaxb",
+"@maven//:javax_xml_bind_jaxb_api",
]
java_library(
diff --git a/heron/tools/apiserver/src/java/BUILD
b/heron/tools/apiserver/src/java/BUILD
index 9014351..3fa5d6e 100644
--- a/heron/tools/apiserver/src/java/BUILD
+++ b/heron/tools/apiserver/src/java/BUILD
@@ -50,7 +50,7 @@ apiserver_deps_files = \
"//third_party/java:logging",
"@maven//:javax_activation_activation",
"@maven//:javax_annotation_javax_annotation_api",
-"@maven//:javax_xml_bind_jaxb",
+"@maven//:javax_xml_bind_jaxb_api",
"@maven//:org_yaml_snakeyaml",
]
diff --git a/maven_install.json b/maven_install.json
index bcdc53e..183508f 100644
--- a/maven_install.json
+++ b/maven_install.json
@@ -1,6 +1,6 @@
{
"dependency_tree": {
-"__AUTOGENERATED_FILE_DO_NOT_MODIFY_THIS_FILE_MANUALLY": 778817796,
+"__AUTOGENERATED_FILE_DO_NOT_MODIFY_THIS_FILE_MANUALLY": -1160448748,
"conflict_resolution": {},
"dependencies": [
{
@@ -2702,6 +2702,32 @@
"url":
"https://jcenter.bintray.com/it/unimi/dsi/fastutil/8.1.1/fastutil-8.1.1-sources.jar;
},
{
+"coord": "javax.activation:activation:1.1.1",
+"dependencies": [],
+"directDependencies": [],
+"file":
"v1/https/jcenter.bintray.com/javax/activation/activation/1.1.1/activation-1.1.1.jar",
+"mirror_urls": [
+
"https://jcenter.bintray.com/javax/activation/activation/1.1.1/activation-1.1.1.jar;,
+
"https://maven.google.com/javax/activation/activation/1.1.1/activation-1.1.1.jar;,
+
"https://repo1.maven.org/maven2/javax/activation/activation/1.1.1/activation-1.1.1.jar;
+],
+"sha256":
"ae475120e9fcd99b4b00b38329bd61cdc5eb754eee03fe66c01f50e137724f99",
+
[incubator-heron] 19/21: Minor deprecation syntax cleanup
This is an automated email from the ASF dual-hosted git repository.
nicknezis pushed a commit to branch nicknezis/bazel-2
in repository https://gitbox.apache.org/repos/asf/incubator-heron.git
commit 1fca5f263561061825a59a8715e0a71afdc770dd
Author: Nicholas Nezis
AuthorDate: Thu Feb 6 02:08:04 2020 -0500
Minor deprecation syntax cleanup
---
tools/rules/newgenproto.bzl | 28 ++--
tools/rules/proto.bzl | 14 +++---
2 files changed, 21 insertions(+), 21 deletions(-)
diff --git a/tools/rules/newgenproto.bzl b/tools/rules/newgenproto.bzl
index 6fd3cae..e21387b 100644
--- a/tools/rules/newgenproto.bzl
+++ b/tools/rules/newgenproto.bzl
@@ -33,7 +33,7 @@ def _genproto_impl(ctx):
if ctx.attr.gen_java:
if ctx.outputs.java_src.path.endswith(".srcjar"):
- srcjar = ctx.new_file(ctx.outputs.java_src.basename[:-6] + "jar")
+ srcjar = ctx.actions.declare_file(ctx.outputs.java_src.basename[:-6] +
"jar")
else:
srcjar = ctx.outputs.java_src
outputs += [srcjar]
@@ -43,7 +43,7 @@ def _genproto_impl(ctx):
outputs += [ctx.outputs.py_src]
arguments += ["--python_out=" + ctx.configuration.genfiles_dir.path]
- ctx.action(
+ ctx.actions.run(
mnemonic = "GenProto",
inputs = inputs,
outputs = outputs,
@@ -53,7 +53,7 @@ def _genproto_impl(ctx):
# This is required because protoc only understands .jar extensions, but Bazel
# requires source JAR files end in .srcjar.
if ctx.attr.gen_java and srcjar != ctx.outputs.java_src:
-ctx.action(
+ctx.actions.run(
mnemonic = "FixProtoSrcJar",
inputs = [srcjar],
outputs = [ctx.outputs.java_src],
@@ -70,7 +70,7 @@ def _genproto_impl(ctx):
_genproto_attrs = {
"src": attr.label(
allow_files = FileType([".proto"]),
-single_file = True,
+allow_single_file = True,
),
"deps": attr.label_list(
allow_files = False,
@@ -88,18 +88,18 @@ _genproto_attrs = {
def _genproto_outputs(attrs):
outputs = {}
if attrs.gen_cc:
-outputs += {
-"cc_hdr": "%{src}.pb.h",
-"cc_src": "%{src}.pb.cc"
-}
+outputs += dict(
+"cc_hdr"= "%{src}.pb.h",
+"cc_src"= "%{src}.pb.cc"
+)
if attrs.gen_java:
-outputs += {
-"java_src": "%{src}.srcjar",
-}
+outputs += dict(
+"java_src"= "%{src}.srcjar",
+)
if attrs.gen_py:
-outputs += {
-"py_src": "%{src}_pb2.py"
-}
+outputs += dict(
+"py_src"= "%{src}_pb2.py"
+)
return outputs
genproto = rule(
diff --git a/tools/rules/proto.bzl b/tools/rules/proto.bzl
index 0aae26c..4674d40 100644
--- a/tools/rules/proto.bzl
+++ b/tools/rules/proto.bzl
@@ -23,7 +23,7 @@ def proto_package_impl(ctx):
genproto_base_attrs = {
"src": attr.label(
allow_files = FileType([".proto"]),
-single_file = True,
+allow_single_file = True,
),
"deps": attr.label_list(
allow_files = False,
@@ -40,7 +40,7 @@ def genproto_java_impl(ctx):
src = ctx.file.src
protoc = ctx.file._protoc
- srcjar = ctx.new_file(ctx.configuration.genfiles_dir, ctx.label.name +
".srcjar")
+ srcjar = ctx.actions.declare_file(ctx.configuration.genfiles_dir,
ctx.label.name + ".srcjar")
java_srcs = srcjar.path + ".srcs"
inputs = [src, protoc]
@@ -52,7 +52,7 @@ def genproto_java_impl(ctx):
"jar cMf " + srcjar.path + " -C " + java_srcs + " .",
"rm -rf " + java_srcs,
])
- ctx.action(
+ ctx.actions.run(
inputs = inputs,
outputs = [srcjar],
mnemonic = 'ProtocJava',
@@ -63,13 +63,13 @@ def genproto_java_impl(ctx):
genproto_java = rule(
genproto_java_impl,
-attrs = genproto_base_attrs + {
-"_protoc": attr.label(
+attrs = dict(genproto_base_attrs,
+"_protoc" = attr.label(
default = Label("//third_party/protobuf:protoc"),
allow_files = True,
single_file = True,
-),
-},
+)
+)
)
def proto_library(name, src=None, includes=[], deps=[], visibility=None,
[incubator-heron] 15/21: Updated Ubuntu 14.04 Dockerfile
This is an automated email from the ASF dual-hosted git repository. nicknezis pushed a commit to branch nicknezis/bazel-2 in repository https://gitbox.apache.org/repos/asf/incubator-heron.git commit 432f557dd5ab9eb5a4c5e960a84ad4b45a3a43b1 Author: Nicholas Nezis AuthorDate: Fri Jan 31 22:48:42 2020 -0500 Updated Ubuntu 14.04 Dockerfile --- docker/compile/Dockerfile.ubuntu14.04 | 5 + 1 file changed, 1 insertion(+), 4 deletions(-) diff --git a/docker/compile/Dockerfile.ubuntu14.04 b/docker/compile/Dockerfile.ubuntu14.04 index 2d63357..52d913d 100644 --- a/docker/compile/Dockerfile.ubuntu14.04 +++ b/docker/compile/Dockerfile.ubuntu14.04 @@ -19,7 +19,7 @@ FROM ubuntu:14.04 # This is passed to the heron build command via the --config flag ENV TARGET_PLATFORM ubuntu -ENV bazelVersion 0.26.0 +ENV bazelVersion 2.0.0 RUN apt-get update && apt-get install -y software-properties-common @@ -34,9 +34,6 @@ RUN apt-get update && apt-get -y install \ git \ libtool \ python-dev \ - python3-dev \ - python3-software-properties \ - python3-setuptools \ zip \ unzip \ wget \
[incubator-heron] 06/21: Upgrade cppcheck to 1.90
This is an automated email from the ASF dual-hosted git repository. nicknezis pushed a commit to branch nicknezis/bazel-2 in repository https://gitbox.apache.org/repos/asf/incubator-heron.git commit d7a1d224ef629b52e4af5021ec36f0d82af5809b Author: Nicholas Nezis AuthorDate: Tue Jan 28 02:41:26 2020 -0500 Upgrade cppcheck to 1.90 --- third_party/cppcheck/cppcheck.BUILD | 5 +++-- 1 file changed, 3 insertions(+), 2 deletions(-) diff --git a/third_party/cppcheck/cppcheck.BUILD b/third_party/cppcheck/cppcheck.BUILD index db17532..3e08a8c 100644 --- a/third_party/cppcheck/cppcheck.BUILD +++ b/third_party/cppcheck/cppcheck.BUILD @@ -4,9 +4,10 @@ package(default_visibility = ["//visibility:public"]) install_script = "\n".join([ "cd external/com_github_danmar_cppcheck", -"make SRCDIR=build CFGDIR=cfg CXXFLAGS='-O2 -DNDEBUG -Wall -Wno-sign-compare -Wno-unused-function'", +"make MATCHCOMPILER=yes CFGDIR=cfg CXXFLAGS='-O2 -DNDEBUG -Wall -Wno-sign-compare -Wno-unused-function'", +"cd ../..", "rm -rf ../../$(@D)/*", -"cp -R $$(pwd)/* ../../$(@D)/", +"cp -R ./external/com_github_danmar_cppcheck/cppcheck $(@)", ]) genrule(
[GitHub] [incubator-heron] joshfischer1108 commented on issue #3493: Support custom metrics rules for PrometheusSink
joshfischer1108 commented on issue #3493: Support custom metrics rules for PrometheusSink URL: https://github.com/apache/incubator-heron/pull/3493#issuecomment-605674971 @thinker0 I don't seem to have the permissions to restart the build anymore. Not sure what's going on with Travis. @nwangtw could you try to restart the build? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [incubator-heron] nicknezis commented on issue #3497: Travis CI update to Ubuntu 18.04
nicknezis commented on issue #3497: Travis CI update to Ubuntu 18.04 URL: https://github.com/apache/incubator-heron/pull/3497#issuecomment-605657666 I sometimes get a build failure with the following output: ``` (07:07:20) INFO: Elapsed time: 1597.947s, Critical Path: 945.36s (07:07:20) INFO: 801 processes: 801 local. (07:07:20) INFO: Build completed, 1 test FAILED, 797 total actions //heron/stmgr/tests/cpp/server:stmgr_unittest TIMEOUT in 3 out of 3 in 315.0s Stats over 3 runs: max = 315.0s, min = 315.0s, avg = 315.0s, dev = 0.0s Test cases: finished with 6 passing and 1 failing out of 7 test cases Executed 4 out of 4 tests: 3 tests pass and 1 fails locally. (07:07:20) INFO: Build completed, 1 test FAILED, 797 total actions ``` I believe what I have is good, but I'm not sure why the build sometimes fails like this. Is it due to the OS update I did in this PR? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [incubator-heron] dttlgotv closed issue #3502: can not submit to aurora, it seems halt up.
dttlgotv closed issue #3502: can not submit to aurora, it seems halt up. URL: https://github.com/apache/incubator-heron/issues/3502 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [incubator-heron] thinker0 commented on issue #3502: can not submit to aurora, it seems halt up.
thinker0 commented on issue #3502: can not submit to aurora, it seems halt up. URL: https://github.com/apache/incubator-heron/issues/3502#issuecomment-605609537 > > Check Slak DM!! > > https://zoom.com.cn/j/604255874 > > can you use this link, I can not found your name... Take a look at Slack's DM. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [incubator-heron] thinker0 commented on issue #3502: can not submit to aurora, it seems halt up.
thinker0 commented on issue #3502: can not submit to aurora, it seems halt up. URL: https://github.com/apache/incubator-heron/issues/3502#issuecomment-605609332 @dttlgotv Check Slak DM!! This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [incubator-heron] dttlgotv commented on issue #3502: can not submit to aurora, it seems halt up.
dttlgotv commented on issue #3502: can not submit to aurora, it seems halt up. URL: https://github.com/apache/incubator-heron/issues/3502#issuecomment-605609112 > Check Slak DM!! https://zoom.com.cn/j/604255874 can you use this link, I can not found your name... This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [incubator-heron] thinker0 commented on issue #3502: can not submit to aurora, it seems halt up.
thinker0 commented on issue #3502: can not submit to aurora, it seems halt up. URL: https://github.com/apache/incubator-heron/issues/3502#issuecomment-605608512 Check Slak DM!! This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [incubator-heron] dttlgotv commented on issue #3502: can not submit to aurora, it seems halt up.
dttlgotv commented on issue #3502: can not submit to aurora, it seems halt up. URL: https://github.com/apache/incubator-heron/issues/3502#issuecomment-605608368 > Let's see with Zoom.us ? let me download zoom， then I contact you.. thanks a lot This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [incubator-heron] thinker0 edited a comment on issue #3502: can not submit to aurora, it seems halt up.
thinker0 edited a comment on issue #3502: can not submit to aurora, it seems halt up. URL: https://github.com/apache/incubator-heron/issues/3502#issuecomment-605607046 Let's see with Zoom ? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [incubator-heron] thinker0 edited a comment on issue #3502: can not submit to aurora, it seems halt up.
thinker0 edited a comment on issue #3502: can not submit to aurora, it seems halt up. URL: https://github.com/apache/incubator-heron/issues/3502#issuecomment-605607046 Let's see with Zoom.us ? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [incubator-heron] thinker0 commented on issue #3502: can not submit to aurora, it seems halt up.
thinker0 commented on issue #3502: can not submit to aurora, it seems halt up. URL: https://github.com/apache/incubator-heron/issues/3502#issuecomment-605607046 I'm not good at English. Let's see with Zoom This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [incubator-heron] thinker0 edited a comment on issue #3502: can not submit to aurora, it seems halt up.
thinker0 edited a comment on issue #3502: can not submit to aurora, it seems halt up. URL: https://github.com/apache/incubator-heron/issues/3502#issuecomment-605607046 Let's see with Zoom This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [incubator-heron] thinker0 edited a comment on issue #3502: can not submit to aurora, it seems halt up.
thinker0 edited a comment on issue #3502: can not submit to aurora, it seems halt up. URL: https://github.com/apache/incubator-heron/issues/3502#issuecomment-605605724 ``` File "/root/mesosdata/run/slaves/e2da2e47-de60-4a1c-a81e-4f14ac3cf16f-S1/frameworks/e2da2e47-de60-4a1c-a81e-4f14ac3cf16f-/executors/thermos-root-devel-StreamletCloneTopology-0-e50143f2-87fd-45f5-bd6f-00ab46dcf48c/runs/752698d1-c0e5-4f5f-be41-efa49aee3a12/thermos_executor/apache/aurora/executor/common/announcer.py", line 269, in stop AttributeError: 'NoneType' object has no attribute 'stop' ``` this ?  This task seems to fail? It should be like below to work well.  This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [incubator-heron] thinker0 edited a comment on issue #3502: can not submit to aurora, it seems halt up.
thinker0 edited a comment on issue #3502: can not submit to aurora, it seems halt up. URL: https://github.com/apache/incubator-heron/issues/3502#issuecomment-605605724 ``` File "/root/mesosdata/run/slaves/e2da2e47-de60-4a1c-a81e-4f14ac3cf16f-S1/frameworks/e2da2e47-de60-4a1c-a81e-4f14ac3cf16f-/executors/thermos-root-devel-StreamletCloneTopology-0-e50143f2-87fd-45f5-bd6f-00ab46dcf48c/runs/752698d1-c0e5-4f5f-be41-efa49aee3a12/thermos_executor/apache/aurora/executor/common/announcer.py", line 269, in stop AttributeError: 'NoneType' object has no attribute 'stop' ``` this ?  This task seems to fail? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [incubator-heron] thinker0 commented on issue #3502: can not submit to aurora, it seems halt up.
thinker0 commented on issue #3502: can not submit to aurora, it seems halt up. URL: https://github.com/apache/incubator-heron/issues/3502#issuecomment-605605724 ``` File "/root/mesosdata/run/slaves/e2da2e47-de60-4a1c-a81e-4f14ac3cf16f-S1/frameworks/e2da2e47-de60-4a1c-a81e-4f14ac3cf16f-/executors/thermos-root-devel-StreamletCloneTopology-0-e50143f2-87fd-45f5-bd6f-00ab46dcf48c/runs/752698d1-c0e5-4f5f-be41-efa49aee3a12/thermos_executor/apache/aurora/executor/common/announcer.py", line 269, in stop AttributeError: 'NoneType' object has no attribute 'stop' ``` this ? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [incubator-heron] dttlgotv commented on issue #3502: can not submit to aurora, it seems halt up.
dttlgotv commented on issue #3502: can not submit to aurora, it seems halt up. URL: https://github.com/apache/incubator-heron/issues/3502#issuecomment-605604868 this work has done well，i has tried to run the command on cmd line in slave machine. all works you can check my comments in three floor 发自我的iPhone -- Original -- From: choi se
[GitHub] [incubator-heron] thinker0 commented on issue #3502: can not submit to aurora, it seems halt up.
thinker0 commented on issue #3502: can not submit to aurora, it seems halt up. URL: https://github.com/apache/incubator-heron/issues/3502#issuecomment-605604038 Make the **hdfs** command work on all master/agent (slave). If you are using CentOS, CDH. You need to create an environment so that **hdfs** can work in advance on your agent (slave). `` ` yum install hadoop-client hadoop-hdfs `` ` Heron should pre-set your environment and set it to custom settings. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [incubator-heron] dttlgotv commented on issue #3502: can not submit to aurora, it seems halt up.
dttlgotv commented on issue #3502: can not submit to aurora, it seems halt up. URL: https://github.com/apache/incubator-heron/issues/3502#issuecomment-605603082 please give me more information..i can not get your idea 发自我的iPhone -- Original -- From: Roger Pack
[GitHub] [incubator-heron] thinker0 removed a comment on issue #3493: Support custom metrics rules for PrometheusSink
thinker0 removed a comment on issue #3493: Support custom metrics rules for PrometheusSink URL: https://github.com/apache/incubator-heron/pull/3493#issuecomment-605598114 retest this please This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [incubator-heron] thinker0 commented on issue #3493: Support custom metrics rules for PrometheusSink
thinker0 commented on issue #3493: Support custom metrics rules for PrometheusSink URL: https://github.com/apache/incubator-heron/pull/3493#issuecomment-605598114 retest this please This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [incubator-heron] thinker0 commented on issue #3502: can not submit to aurora, it seems halt up.
thinker0 commented on issue #3502: can not submit to aurora, it seems halt up.
URL:
https://github.com/apache/incubator-heron/issues/3502#issuecomment-605597031
Download hdfs: //./heron-cento.tgz packge from hdfs to the container.
```
heron_core_release_uri = '{{CORE_PACKAGE_URI}}'
```
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
With regards,
Apache Git Services
[GitHub] [incubator-heron] dttlgotv commented on issue #3502: can not submit to aurora, it seems halt up.
dttlgotv commented on issue #3502: can not submit to aurora, it seems halt up. URL: https://github.com/apache/incubator-heron/issues/3502#issuecomment-605591020 > When the mesos-agent server executor works > The hdfs command should work. > > ``` > /bin/bash: hdfs: command not found > ``` > > 1. fetch_heron_system: heron package binary > > 2. fetch_user_package: topology package binary ps -e |grep mesos 1645 ?00:29:27 mesos-agent https://user-images.githubusercontent.com/5996999/77843026-9a584f80-71cb-11ea-8daa-ec84895c5e8c.png;> This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [incubator-heron] thinker0 edited a comment on issue #3502: can not submit to aurora, it seems halt up.
thinker0 edited a comment on issue #3502: can not submit to aurora, it seems halt up. URL: https://github.com/apache/incubator-heron/issues/3502#issuecomment-605588362 When the mesos-agent server executor works The hdfs command should work. ``` /bin/bash: hdfs: command not found ``` 1. fetch_heron_system: heron package binary 2. fetch_user_package: topology package binary This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [incubator-heron] thinker0 commented on issue #3502: can not submit to aurora, it seems halt up.
thinker0 commented on issue #3502: can not submit to aurora, it seems halt up. URL: https://github.com/apache/incubator-heron/issues/3502#issuecomment-605588362 When the mesos-agent server executor works The hdfs command should work. ``` /bin/bash: hdfs: command not found ``` This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
