This is an automated email from the ASF dual-hosted git repository.
huijun pushed a change to branch huijunwu/submitremotejar
in repository https://gitbox.apache.org/repos/asf/incubator-heron.git.
from a35cfcb fix downloader command
add 1e7e35a Update license text in H files (#2885)
add dd7da90 Update license text in scala files (#2888)
add fed30ee Update license text in yaml files (#2887)
add 6c6b774 remove thrift and scribe to prepare for apache release (#2879)
add 2008084 check checkpoint file exists before deleting it (#2883)
add 831edc2 pull yaml cpp for official release page (#2893)
add 2a48237 Update license text in py files (#2889)
add 075e06e Refactoring Nomad documentation and add documentation on
running heron via docker on Nomad (#2876)
add 056ba11 fixing test (#2894)
add 5754033 Nwang/update license in other files (#2895)
add 70d17d0 move downloader registry map to yaml (#2884)
new 5ce574d Merge branch 'master' of
https://github.com/apache/incubator-heron into huijunwu/submitremotejar
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
WORKSPACE | 5 +-
config/empty.cc | 25 +-
deploy/kubernetes/general/apiserver.yaml | 17 ++
deploy/kubernetes/general/tools.yaml | 17 ++
deploy/kubernetes/general/zookeeper.yaml | 17 ++
deploy/kubernetes/gke/gcs-apiserver.yaml | 17 ++
deploy/kubernetes/gke/medium.yaml | 17 ++
deploy/kubernetes/gke/small.yaml | 17 ++
deploy/kubernetes/helm/templates/tools.yaml | 17 ++
deploy/kubernetes/helm/templates/zookeeper.yaml | 17 ++
deploy/kubernetes/minikube/apiserver.yaml | 17 ++
deploy/kubernetes/minikube/tools.yaml | 17 ++
deploy/kubernetes/minikube/zookeeper.yaml | 17 ++
.../examples/eco/heron-stateful-windowing.yaml | 25 +-
.../examples/eco/heron-stateful-word-count.yaml | 25 +-
.../apache/heron/examples/eco/heron_fibonacci.yaml | 25 +-
.../apache/heron/examples/eco/heron_windowing.yaml | 25 +-
.../apache/heron/examples/eco/heron_wordcount.yaml | 25 +-
.../apache/heron/examples/eco/sample.properties | 29 ++-
.../org/apache/heron/examples/eco/fibonacci.yaml | 25 +-
.../apache/heron/examples/eco/sample.properties | 29 ++-
.../heron/examples/eco/simple_windowing.yaml | 25 +-
.../heron/examples/eco/simple_wordcount.yaml | 25 +-
.../org/apache/heron/eco/parser/EcoParserTest.java | 89 ++++++-
examples/src/cpp/spouts/test-word-spout.h | 25 +-
examples/src/python/bolt/consume_bolt.py | 24 +-
examples/src/python/bolt/count_bolt.py | 24 +-
examples/src/python/bolt/half_ack_bolt.py | 24 +-
examples/src/python/bolt/stateful_count_bolt.py | 24 +-
examples/src/python/bolt/stream_aggregate_bolt.py | 24 +-
examples/src/python/bolt/window_size_bolt.py | 24 +-
examples/src/python/custom_grouping_topology.py | 24 +-
examples/src/python/half_acking_topology.py | 24 +-
examples/src/python/join_streamlet_topology.py | 26 +-
examples/src/python/misc/test_task_hook.py | 24 +-
examples/src/python/multi_stream_topology.py | 24 +-
examples/src/python/pulsar_word_count_streamlet.py | 24 +-
examples/src/python/spout/multi_stream_spout.py | 24 +-
examples/src/python/spout/stateful_word_spout.py | 24 +-
examples/src/python/spout/word_spout.py | 24 +-
.../src/python/stateful_word_count_topology.py | 24 +-
examples/src/python/window_size_topology.py | 24 +-
examples/src/python/word_count_streamlet.py | 24 +-
examples/src/python/word_count_topology.py | 24 +-
.../org/apache/heron/examples/SomeHeronBolt.scala | 31 ++-
.../org/apache/heron/examples/SomeStormBolt.scala | 31 ++-
.../scala/ScalaClassicalMusicTopology.scala | 31 ++-
.../scala/ScalaIntegerProcessingTopology.scala | 31 ++-
.../streamlet/scala/ScalaRepartitionTopology.scala | 31 ++-
.../scala/ScalaTransformsAndCloneTopology.scala | 31 ++-
.../scala/ScalaWindowedWordCountTopology.scala | 31 ++-
.../scala/common/ScalaTopologyExampleUtils.scala | 31 ++-
heron/api/src/cpp/bolt/base-basic-bolt.h | 25 +-
heron/api/src/cpp/bolt/base-rich-bolt.h | 25 +-
heron/api/src/cpp/bolt/basic-bolt-collector.h | 25 +-
heron/api/src/cpp/bolt/ibasic-bolt.h | 25 +-
heron/api/src/cpp/bolt/ibolt-output-collector.h | 25 +-
heron/api/src/cpp/bolt/ibolt.h | 25 +-
heron/api/src/cpp/bolt/irich-bolt.h | 25 +-
heron/api/src/cpp/config/config.h | 25 +-
.../src/cpp/exceptions/already-alive-exception.h | 25 +-
.../cpp/exceptions/invalid-topology-exception.h | 25 +-
.../src/cpp/exceptions/serialization-exception.h | 25 +-
heron/api/src/cpp/metric/assignable-metric.h | 25 +-
heron/api/src/cpp/metric/count-metric.h | 25 +-
heron/api/src/cpp/metric/imetric.h | 25 +-
heron/api/src/cpp/metric/imetrics-registrar.h | 25 +-
heron/api/src/cpp/metric/imulti-metric.h | 25 +-
heron/api/src/cpp/metric/mean-metric.h | 25 +-
heron/api/src/cpp/metric/multi-count-metric.h | 25 +-
heron/api/src/cpp/metric/multi-mean-metric.h | 25 +-
heron/api/src/cpp/serializer/cereal-serializer.h | 25 +-
.../api/src/cpp/serializer/ipluggable-serializer.h | 25 +-
heron/api/src/cpp/serializer/string-serializer.h | 25 +-
.../src/cpp/serializer/tuple-serializer-utils.h | 25 +-
heron/api/src/cpp/spout/base-rich-spout.h | 25 +-
heron/api/src/cpp/spout/irich-spout.h | 25 +-
heron/api/src/cpp/spout/ispout-output-collector.h | 25 +-
heron/api/src/cpp/spout/ispout.h | 25 +-
.../api/src/cpp/topology/base-component-declarer.h | 25 +-
heron/api/src/cpp/topology/bolt-declarer.h | 25 +-
heron/api/src/cpp/topology/heron-submitter.h | 25 +-
heron/api/src/cpp/topology/icomponent.h | 25 +-
.../api/src/cpp/topology/output-fields-declarer.h | 25 +-
heron/api/src/cpp/topology/output-fields-getter.h | 25 +-
heron/api/src/cpp/topology/spout-declarer.h | 25 +-
heron/api/src/cpp/topology/task-context.h | 25 +-
heron/api/src/cpp/topology/topology-builder.h | 25 +-
heron/api/src/cpp/topology/topology-context.h | 25 +-
heron/api/src/cpp/tuple/fields.h | 25 +-
heron/api/src/cpp/tuple/tuple.h | 25 +-
heron/api/src/cpp/utils/utils.h | 25 +-
.../org/apache/heron/streamlet/scala/Builder.scala | 31 ++-
.../org/apache/heron/streamlet/scala/Runner.scala | 31 ++-
.../streamlet/scala/SerializableTransformer.scala | 31 ++-
.../org/apache/heron/streamlet/scala/Sink.scala | 31 ++-
.../org/apache/heron/streamlet/scala/Source.scala | 31 ++-
.../apache/heron/streamlet/scala/Streamlet.scala | 31 ++-
.../scala/converter/ScalaToJavaConverter.scala | 31 ++-
.../heron/streamlet/scala/impl/BuilderImpl.scala | 31 ++-
.../heron/streamlet/scala/impl/StreamletImpl.scala | 31 ++-
.../apache/heron/streamlet/scala/SinkTest.scala | 31 ++-
.../apache/heron/streamlet/scala/SourceTest.scala | 31 ++-
.../streamlet/scala/common/BaseFunSuite.scala | 31 ++-
.../heron/streamlet/scala/common/TestContext.scala | 31 ++-
.../TestIncrementSerializableTransformer.scala | 31 ++-
.../scala/common/TestListBufferSink.scala | 31 ++-
.../scala/converter/ScalaToJavaConverterTest.scala | 31 ++-
.../streamlet/scala/impl/BuilderImplTest.scala | 31 ++-
.../streamlet/scala/impl/StreamletImplTest.scala | 31 ++-
heron/common/src/cpp/basics/basics.h | 25 +-
heron/common/src/cpp/basics/callback.h | 25 +-
heron/common/src/cpp/basics/callback1.h | 25 +-
heron/common/src/cpp/basics/classcallback.h | 25 +-
heron/common/src/cpp/basics/classcallback1.h | 25 +-
heron/common/src/cpp/basics/execmeta.h | 25 +-
heron/common/src/cpp/basics/fileutils.h | 25 +-
heron/common/src/cpp/basics/iputils.h | 25 +-
heron/common/src/cpp/basics/mempool.h | 26 +-
heron/common/src/cpp/basics/modinit.h | 25 +-
heron/common/src/cpp/basics/processutils.h | 25 +-
heron/common/src/cpp/basics/randutils.h | 25 +-
heron/common/src/cpp/basics/ridgen.h | 25 +-
heron/common/src/cpp/basics/sockutils.h | 25 +-
heron/common/src/cpp/basics/spconsts.h | 25 +-
heron/common/src/cpp/basics/spfuncs.h | 25 +-
heron/common/src/cpp/basics/sphash.h | 25 +-
heron/common/src/cpp/basics/sprcodes.h | 25 +-
heron/common/src/cpp/basics/sptest.h | 25 +-
heron/common/src/cpp/basics/sptypes.h | 25 +-
heron/common/src/cpp/basics/strutils.h | 25 +-
heron/common/src/cpp/config/allconfig.h | 25 +-
.../common/src/cpp/config/cluster-config-reader.h | 25 +-
heron/common/src/cpp/config/cluster-config-vars.h | 25 +-
heron/common/src/cpp/config/helper.h | 25 +-
.../src/cpp/config/heron-internals-config-reader.h | 25 +-
.../src/cpp/config/heron-internals-config-vars.h | 25 +-
heron/common/src/cpp/config/metrics-sinks-reader.h | 25 +-
heron/common/src/cpp/config/metrics-sinks-vars.h | 25 +-
.../src/cpp/config/operational-config-reader.h | 25 +-
.../src/cpp/config/operational-config-vars.h | 25 +-
heron/common/src/cpp/config/physical-plan-helper.h | 25 +-
heron/common/src/cpp/config/reader.h | 25 +-
.../common/src/cpp/config/topology-config-helper.h | 25 +-
heron/common/src/cpp/config/topology-config-vars.h | 25 +-
heron/common/src/cpp/config/yaml-file-reader.h | 25 +-
heron/common/src/cpp/errors/errors.h | 25 +-
heron/common/src/cpp/errors/gexception.h | 25 +-
heron/common/src/cpp/errors/modinit.h | 25 +-
heron/common/src/cpp/errors/sperrimpl.h | 25 +-
heron/common/src/cpp/errors/sperrmod.h | 25 +-
heron/common/src/cpp/errors/sperror.h | 25 +-
heron/common/src/cpp/errors/spexcept.h | 25 +-
heron/common/src/cpp/errors/syserr.h | 25 +-
heron/common/src/cpp/metrics/assignable-metric.h | 25 +-
heron/common/src/cpp/metrics/count-metric.h | 25 +-
heron/common/src/cpp/metrics/imetric.h | 25 +-
heron/common/src/cpp/metrics/mean-metric.h | 25 +-
heron/common/src/cpp/metrics/metrics-mgr-st.h | 25 +-
heron/common/src/cpp/metrics/metrics.h | 25 +-
heron/common/src/cpp/metrics/metricsmgr-client.h | 25 +-
.../src/cpp/metrics/multi-assignable-metric.h | 25 +-
heron/common/src/cpp/metrics/multi-count-metric.h | 25 +-
heron/common/src/cpp/metrics/multi-mean-metric.h | 25 +-
heron/common/src/cpp/metrics/time-spent-metric.h | 25 +-
heron/common/src/cpp/metrics/tmaster-metrics.h | 25 +-
heron/common/src/cpp/network/asyncdns.h | 25 +-
heron/common/src/cpp/network/baseclient.h | 25 +-
heron/common/src/cpp/network/baseconnection.h | 25 +-
heron/common/src/cpp/network/baseserver.h | 25 +-
heron/common/src/cpp/network/client.h | 25 +-
heron/common/src/cpp/network/connection.h | 25 +-
heron/common/src/cpp/network/event_loop.h | 25 +-
heron/common/src/cpp/network/event_loop_impl.h | 25 +-
heron/common/src/cpp/network/httpclient.h | 25 +-
heron/common/src/cpp/network/httpserver.h | 25 +-
heron/common/src/cpp/network/httputils.h | 25 +-
heron/common/src/cpp/network/modinit.h | 25 +-
heron/common/src/cpp/network/network.h | 25 +-
heron/common/src/cpp/network/network_error.h | 25 +-
heron/common/src/cpp/network/networkoptions.h | 25 +-
heron/common/src/cpp/network/packet.h | 25 +-
heron/common/src/cpp/network/piper.h | 25 +-
heron/common/src/cpp/network/regevent.h | 25 +-
heron/common/src/cpp/network/server.h | 25 +-
heron/common/src/cpp/threads/modinit.h | 25 +-
heron/common/src/cpp/threads/pcqueue.h | 25 +-
heron/common/src/cpp/threads/spcountdownlatch.h | 25 +-
heron/common/src/cpp/threads/threads.h | 25 +-
heron/common/src/cpp/zookeeper/mock_zkclient.h | 25 +-
heron/common/src/cpp/zookeeper/zkclient.h | 25 +-
heron/common/src/cpp/zookeeper/zkclient_factory.h | 25 +-
heron/common/src/python/pex_loader.py | 24 +-
heron/common/src/python/utils/log.py | 24 +-
heron/common/src/python/utils/proc.py | 24 +-
heron/common/tests/cpp/network/client_unittest.h | 25 +-
heron/common/tests/cpp/network/host_unittest.h | 25 +-
.../tests/cpp/network/http_server_unittest.h | 25 +-
heron/common/tests/cpp/network/oclient_unittest.h | 25 +-
heron/common/tests/cpp/network/oserver_unittest.h | 25 +-
heron/common/tests/cpp/network/server_unittest.h | 25 +-
heron/common/tests/python/pex_loader/constants.py | 24 +-
.../tests/python/pex_loader/pex_loader_unittest.py | 24 +-
.../tests/python/pex_loader/testdata/src/sample.py | 24 +-
heron/common/tests/resources/defaults.yaml | 17 ++
heron/common/tests/resources/sysconfig.yaml | 17 ++
heron/config/src/yaml/conf/aurora/client.yaml | 17 ++
.../src/yaml/conf/aurora/heron_internals.yaml | 17 ++
.../config/src/yaml/conf/aurora/metrics_sinks.yaml | 31 +--
heron/config/src/yaml/conf/aurora/packing.yaml | 17 ++
heron/config/src/yaml/conf/aurora/scheduler.yaml | 17 ++
heron/config/src/yaml/conf/aurora/stateful.yaml | 17 ++
heron/config/src/yaml/conf/aurora/statemgr.yaml | 17 ++
heron/config/src/yaml/conf/aurora/uploader.yaml | 17 ++
.../src/yaml/conf/examples/aurora_scheduler.yaml | 17 ++
.../src/yaml/conf/examples/heron_internals.yaml | 17 ++
.../src/yaml/conf/examples/local_scheduler.yaml | 17 ++
.../src/yaml/conf/examples/local_stateful.yaml | 17 ++
.../src/yaml/conf/examples/localfs_statemgr.yaml | 17 ++
.../src/yaml/conf/examples/localfs_uploader.yaml | 17 ++
.../src/yaml/conf/examples/metrics_sinks.yaml | 31 +--
.../src/yaml/conf/examples/roundrobin_packing.yaml | 17 ++
heron/config/src/yaml/conf/kubernetes/client.yaml | 17 ++
.../src/yaml/conf/kubernetes/heron_internals.yaml | 17 ++
.../src/yaml/conf/kubernetes/metrics_sinks.yaml | 31 +--
heron/config/src/yaml/conf/kubernetes/packing.yaml | 17 ++
.../config/src/yaml/conf/kubernetes/scheduler.yaml | 17 ++
.../config/src/yaml/conf/kubernetes/stateful.yaml | 17 ++
.../config/src/yaml/conf/kubernetes/statemgr.yaml | 17 ++
.../config/src/yaml/conf/kubernetes/uploader.yaml | 17 ++
heron/config/src/yaml/conf/local/client.yaml | 17 ++
heron/config/src/yaml/conf/local/healthmgr.yaml | 17 ++
.../src/yaml/conf/local/heron_internals.yaml | 17 ++
.../config/src/yaml/conf/local/metrics_sinks.yaml | 31 +--
heron/config/src/yaml/conf/local/packing.yaml | 17 ++
heron/config/src/yaml/conf/local/scheduler.yaml | 17 ++
heron/config/src/yaml/conf/local/stateful.yaml | 17 ++
heron/config/src/yaml/conf/local/statemgr.yaml | 17 ++
heron/config/src/yaml/conf/local/uploader.yaml | 17 ++
heron/config/src/yaml/conf/localzk/client.yaml | 17 ++
.../src/yaml/conf/localzk/heron_internals.yaml | 17 ++
.../src/yaml/conf/localzk/metrics_sinks.yaml | 31 +--
heron/config/src/yaml/conf/localzk/packing.yaml | 17 ++
heron/config/src/yaml/conf/localzk/scheduler.yaml | 17 ++
heron/config/src/yaml/conf/localzk/stateful.yaml | 17 ++
heron/config/src/yaml/conf/localzk/statemgr.yaml | 17 ++
heron/config/src/yaml/conf/localzk/uploader.yaml | 17 ++
heron/config/src/yaml/conf/marathon/client.yaml | 17 ++
.../src/yaml/conf/marathon/heron_internals.yaml | 17 ++
.../src/yaml/conf/marathon/metrics_sinks.yaml | 31 +--
heron/config/src/yaml/conf/marathon/packing.yaml | 17 ++
heron/config/src/yaml/conf/marathon/scheduler.yaml | 17 ++
heron/config/src/yaml/conf/marathon/stateful.yaml | 17 ++
heron/config/src/yaml/conf/marathon/statemgr.yaml | 17 ++
heron/config/src/yaml/conf/marathon/uploader.yaml | 17 ++
heron/config/src/yaml/conf/mesos/client.yaml | 17 ++
.../src/yaml/conf/mesos/heron_internals.yaml | 17 ++
.../config/src/yaml/conf/mesos/metrics_sinks.yaml | 31 +--
heron/config/src/yaml/conf/mesos/packing.yaml | 17 ++
heron/config/src/yaml/conf/mesos/scheduler.yaml | 17 ++
heron/config/src/yaml/conf/mesos/stateful.yaml | 17 ++
heron/config/src/yaml/conf/mesos/statemgr.yaml | 17 ++
heron/config/src/yaml/conf/mesos/uploader.yaml | 17 ++
heron/config/src/yaml/conf/nomad/client.yaml | 17 ++
heron/config/src/yaml/conf/nomad/cluster.yaml | 17 ++
.../src/yaml/conf/nomad/heron_internals.yaml | 17 ++
.../config/src/yaml/conf/nomad/metrics_sinks.yaml | 31 +--
heron/config/src/yaml/conf/nomad/packing.yaml | 17 ++
heron/config/src/yaml/conf/nomad/scheduler.yaml | 17 ++
heron/config/src/yaml/conf/nomad/stateful.yaml | 17 ++
heron/config/src/yaml/conf/nomad/statemgr.yaml | 17 ++
heron/config/src/yaml/conf/nomad/uploader.yaml | 17 ++
heron/config/src/yaml/conf/sandbox/client.yaml | 17 ++
heron/config/src/yaml/conf/sandbox/healthmgr.yaml | 17 ++
.../src/yaml/conf/sandbox/heron_internals.yaml | 17 ++
.../src/yaml/conf/sandbox/metrics_sinks.yaml | 31 +--
heron/config/src/yaml/conf/sandbox/packing.yaml | 17 ++
heron/config/src/yaml/conf/sandbox/scheduler.yaml | 17 ++
heron/config/src/yaml/conf/sandbox/stateful.yaml | 17 ++
heron/config/src/yaml/conf/sandbox/statemgr.yaml | 17 ++
heron/config/src/yaml/conf/sandbox/uploader.yaml | 17 ++
heron/config/src/yaml/conf/slurm/client.yaml | 17 ++
.../src/yaml/conf/slurm/heron_internals.yaml | 17 ++
.../config/src/yaml/conf/slurm/metrics_sinks.yaml | 31 +--
heron/config/src/yaml/conf/slurm/packing.yaml | 17 ++
heron/config/src/yaml/conf/slurm/scheduler.yaml | 17 ++
heron/config/src/yaml/conf/slurm/stateful.yaml | 17 ++
heron/config/src/yaml/conf/slurm/statemgr.yaml | 17 ++
heron/config/src/yaml/conf/slurm/uploader.yaml | 17 ++
heron/config/src/yaml/conf/standalone/client.yaml | 17 ++
heron/config/src/yaml/conf/standalone/cluster.yaml | 17 ++
.../src/yaml/conf/standalone/heron_internals.yaml | 17 ++
.../config/src/yaml/conf/standalone/inventory.yaml | 17 ++
.../src/yaml/conf/standalone/metrics_sinks.yaml | 31 +--
heron/config/src/yaml/conf/standalone/packing.yaml | 17 ++
.../config/src/yaml/conf/standalone/scheduler.yaml | 17 ++
.../config/src/yaml/conf/standalone/stateful.yaml | 17 ++
.../config/src/yaml/conf/standalone/statemgr.yaml | 17 ++
.../standalone/templates/scheduler.template.yaml | 17 ++
.../standalone/templates/statemgr.template.yaml | 17 ++
.../standalone/templates/uploader.template.yaml | 17 ++
.../config/src/yaml/conf/standalone/uploader.yaml | 17 ++
.../src/yaml/conf/test/test_heron_internals.yaml | 17 ++
.../src/yaml/conf/test/test_metrics_sinks.yaml | 17 ++
heron/config/src/yaml/conf/test/test_override.yaml | 17 ++
heron/config/src/yaml/conf/yarn/client.yaml | 17 ++
heron/config/src/yaml/conf/yarn/healthmgr.yaml | 17 ++
.../config/src/yaml/conf/yarn/heron_internals.yaml | 17 ++
heron/config/src/yaml/conf/yarn/metrics_sinks.yaml | 31 +--
heron/config/src/yaml/conf/yarn/packing.yaml | 17 ++
heron/config/src/yaml/conf/yarn/scheduler.yaml | 17 ++
heron/config/src/yaml/conf/yarn/stateful.yaml | 17 ++
heron/config/src/yaml/conf/yarn/statemgr.yaml | 17 ++
heron/config/src/yaml/conf/yarn/uploader.yaml | 17 ++
.../apache/heron/downloader/DownloadRunner.java | 16 +-
heron/executor/src/python/heron_executor.py | 24 +-
.../tests/python/heron_executor_unittest.py | 24 +-
heron/healthmgr/src/java/BUILD | 2 -
heron/instance/src/cpp/boltimpl/bolt-instance.h | 25 +-
heron/instance/src/cpp/boltimpl/bolt-metrics.h | 25 +-
.../src/cpp/boltimpl/bolt-output-collector-impl.h | 25 +-
heron/instance/src/cpp/boltimpl/tick-tuple.h | 25 +-
heron/instance/src/cpp/boltimpl/tuple-impl.h | 25 +-
heron/instance/src/cpp/gateway/gateway-metrics.h | 25 +-
heron/instance/src/cpp/gateway/gateway.h | 25 +-
heron/instance/src/cpp/gateway/stmgr-client.h | 25 +-
.../src/cpp/slave/imetrics-registrar-impl.h | 25 +-
heron/instance/src/cpp/slave/instance-base.h | 25 +-
.../src/cpp/slave/outgoing-tuple-collection.h | 25 +-
heron/instance/src/cpp/slave/slave.h | 25 +-
heron/instance/src/cpp/slave/task-context-impl.h | 25 +-
heron/instance/src/cpp/spoutimpl/root-tuple-info.h | 25 +-
heron/instance/src/cpp/spoutimpl/spout-instance.h | 25 +-
heron/instance/src/cpp/spoutimpl/spout-metrics.h | 25 +-
.../cpp/spoutimpl/spout-output-collector-impl.h | 25 +-
heron/instance/src/cpp/utils/communicator.h | 25 +-
.../src/cpp/utils/notifying-communicator.h | 25 +-
heron/instance/src/python/basics/base_instance.py | 24 +-
heron/instance/src/python/basics/bolt_instance.py | 24 +-
heron/instance/src/python/basics/spout_instance.py | 24 +-
.../src/python/instance/st_heron_instance.py | 24 +-
heron/instance/src/python/network/event_looper.py | 24 +-
.../instance/src/python/network/gateway_looper.py | 24 +-
heron/instance/src/python/network/heron_client.py | 24 +-
.../src/python/network/metricsmgr_client.py | 24 +-
heron/instance/src/python/network/protocol.py | 24 +-
.../instance/src/python/network/socket_options.py | 24 +-
.../instance/src/python/network/st_stmgr_client.py | 24 +-
.../src/python/utils/metrics/metrics_helper.py | 24 +-
.../src/python/utils/metrics/py_metrics.py | 24 +-
.../instance/src/python/utils/misc/communicator.py | 24 +-
.../python/utils/misc/custom_grouping_helper.py | 24 +-
.../src/python/utils/misc/outgoing_tuple_helper.py | 24 +-
.../instance/src/python/utils/misc/pplan_helper.py | 24 +-
.../src/python/utils/misc/serializer_helper.py | 24 +-
heron/instance/src/python/utils/system_config.py | 24 +-
.../instance/src/python/utils/system_constants.py | 24 +-
.../python/utils/topology/topology_context_impl.py | 24 +-
heron/instance/src/python/utils/tuple.py | 24 +-
heron/instance/tests/python/mock_protobuf.py | 24 +-
.../tests/python/network/event_looper_unittest.py | 24 +-
.../python/network/gateway_looper_unittest.py | 24 +-
.../tests/python/network/heron_client_unittest.py | 24 +-
.../python/network/metricsmgr_client_unittest.py | 24 +-
.../tests/python/network/mock_generator.py | 24 +-
.../tests/python/network/mock_generator_client.py | 24 +-
.../tests/python/network/protocol_unittest.py | 24 +-
.../python/network/st_stmgr_client_unittest.py | 24 +-
.../tests/python/utils/communicator_unittest.py | 24 +-
.../tests/python/utils/custom_grouping_unittest.py | 24 +-
.../tests/python/utils/global_metrics_unittest.py | 24 +-
heron/instance/tests/python/utils/log_unittest.py | 24 +-
.../tests/python/utils/metrics_helper_unittest.py | 24 +-
.../instance/tests/python/utils/mock_generator.py | 24 +-
.../python/utils/outgoing_tuple_helper_unittest.py | 24 +-
.../tests/python/utils/pplan_helper_unittest.py | 24 +-
.../tests/python/utils/py_metrics_unittest.py | 24 +-
.../python/utils/topology_context_impl_unittest.py | 24 +-
.../tests/python/utils/tuple_helper_unittest.py | 24 +-
heron/metricscachemgr/src/java/BUILD | 1 -
heron/metricscachemgr/tests/java/BUILD | 2 -
heron/metricsmgr/src/java/BUILD | 27 +-
.../heron/metricsmgr/sink/scribe/ScribeSink.java | 280 ---------------------
heron/metricsmgr/src/thrift/BUILD | 18 --
heron/metricsmgr/src/thrift/Empty.java | 18 --
heron/metricsmgr/src/thrift/scribe.thrift | 35 ---
heron/proto/empty.cc | 25 +-
heron/proto/messages.h | 25 +-
heron/shell/src/python/handlers/browsehandler.py | 24 +-
heron/shell/src/python/handlers/downloadhandler.py | 24 +-
heron/shell/src/python/handlers/filedatahandler.py | 24 +-
heron/shell/src/python/handlers/filehandler.py | 24 +-
.../shell/src/python/handlers/filestatshandler.py | 24 +-
heron/shell/src/python/handlers/jmaphandler.py | 24 +-
heron/shell/src/python/handlers/jstackhandler.py | 24 +-
.../src/python/handlers/killexecutorhandler.py | 24 +-
.../src/python/handlers/memoryhistogramhandler.py | 24 +-
heron/shell/src/python/handlers/pidhandler.py | 24 +-
heron/shell/src/python/handlers/pmaphandler.py | 24 +-
heron/shell/src/python/main.py | 24 +-
heron/shell/src/python/utils.py | 24 +-
.../heron/spi/common/testdata/local/cluster.yaml | 17 ++
.../heron/spi/common/testdata/local/healthmgr.yaml | 17 ++
.../heron/spi/common/testdata/local/packing.yaml | 17 ++
.../heron/spi/common/testdata/local/scheduler.yaml | 17 ++
.../heron/spi/common/testdata/local/stateful.yaml | 17 ++
.../heron/spi/common/testdata/local/statemgr.yaml | 17 ++
.../heron/spi/common/testdata/local/uploader.yaml | 17 ++
.../localfs/LocalFileSystemStorage.java | 22 +-
.../src/cpp/statemgr/heron-localfilestatemgr.h | 25 +-
heron/statemgrs/src/cpp/statemgr/heron-statemgr.h | 25 +-
.../statemgrs/src/cpp/statemgr/heron-zkstatemgr.h | 25 +-
heron/statemgrs/src/python/config.py | 24 +-
heron/statemgrs/src/python/configloader.py | 24 +-
heron/statemgrs/src/python/filestatemanager.py | 24 +-
heron/statemgrs/src/python/log.py | 24 +-
heron/statemgrs/src/python/stateexceptions.py | 24 +-
heron/statemgrs/src/python/statemanager.py | 24 +-
heron/statemgrs/src/python/statemanagerfactory.py | 24 +-
heron/statemgrs/src/python/zkstatemanager.py | 24 +-
.../tests/python/configloader_unittest.py | 24 +-
.../tests/python/statemanagerfactory_unittest.py | 24 +-
.../tests/python/zkstatemanager_unittest.py | 24 +-
heron/stmgr/src/cpp/grouping/all-grouping.h | 25 +-
heron/stmgr/src/cpp/grouping/custom-grouping.h | 25 +-
heron/stmgr/src/cpp/grouping/direct-grouping.h | 25 +-
heron/stmgr/src/cpp/grouping/fields-grouping.h | 25 +-
heron/stmgr/src/cpp/grouping/grouping.h | 25 +-
heron/stmgr/src/cpp/grouping/lowest-grouping.h | 25 +-
heron/stmgr/src/cpp/grouping/shuffle-grouping.h | 25 +-
heron/stmgr/src/cpp/manager/checkpoint-gateway.h | 25 +-
heron/stmgr/src/cpp/manager/ckptmgr-client.h | 25 +-
heron/stmgr/src/cpp/manager/instance-server.h | 25 +-
heron/stmgr/src/cpp/manager/stateful-restorer.h | 25 +-
heron/stmgr/src/cpp/manager/stmgr-client.h | 25 +-
heron/stmgr/src/cpp/manager/stmgr-clientmgr.h | 25 +-
heron/stmgr/src/cpp/manager/stmgr-server.h | 25 +-
heron/stmgr/src/cpp/manager/stmgr.h | 25 +-
heron/stmgr/src/cpp/manager/stream-consumers.h | 25 +-
heron/stmgr/src/cpp/manager/tmaster-client.h | 25 +-
heron/stmgr/src/cpp/util/neighbour-calculator.h | 25 +-
heron/stmgr/src/cpp/util/rotating-map.h | 25 +-
heron/stmgr/src/cpp/util/tuple-cache.h | 25 +-
heron/stmgr/src/cpp/util/xor-manager.h | 25 +-
.../stmgr/tests/cpp/server/dummy_ckptmgr_client.h | 25 +-
heron/stmgr/tests/cpp/server/dummy_instance.h | 25 +-
.../stmgr/tests/cpp/server/dummy_instance_server.h | 25 +-
heron/stmgr/tests/cpp/server/dummy_metricsmgr.h | 25 +-
heron/stmgr/tests/cpp/server/dummy_stmgr.h | 25 +-
.../stmgr/tests/cpp/server/dummy_stmgr_clientmgr.h | 25 +-
heron/stmgr/tests/cpp/server/dummy_tuple_cache.h | 25 +-
heron/tmaster/src/cpp/manager/ckptmgr-client.h | 25 +-
.../src/cpp/manager/stateful-checkpointer.h | 25 +-
.../tmaster/src/cpp/manager/stateful-controller.h | 25 +-
heron/tmaster/src/cpp/manager/stateful-restorer.h | 25 +-
heron/tmaster/src/cpp/manager/stats-interface.h | 25 +-
heron/tmaster/src/cpp/manager/stmgrstate.h | 25 +-
heron/tmaster/src/cpp/manager/tcontroller.h | 25 +-
heron/tmaster/src/cpp/manager/tmaster.h | 25 +-
heron/tmaster/src/cpp/manager/tmasterserver.h | 25 +-
heron/tmaster/src/cpp/manager/tmetrics-collector.h | 25 +-
heron/tmaster/src/cpp/processor/processor.h | 25 +-
.../src/cpp/processor/stmgr-heartbeat-processor.h | 25 +-
.../src/cpp/processor/stmgr-register-processor.h | 25 +-
.../tmaster/src/cpp/processor/tmaster-processor.h | 25 +-
heron/tmaster/tests/cpp/server/dummystmgr.h | 25 +-
heron/tmaster/tests/cpp/server/dummytmaster.h | 25 +-
heron/tools/admin/src/python/main.py | 24 +-
heron/tools/admin/src/python/standalone.py | 24 +-
heron/tools/cli/src/python/activate.py | 24 +-
heron/tools/cli/src/python/args.py | 24 +-
heron/tools/cli/src/python/cdefs.py | 24 +-
heron/tools/cli/src/python/cli_helper.py | 24 +-
heron/tools/cli/src/python/config.py | 24 +-
heron/tools/cli/src/python/deactivate.py | 24 +-
heron/tools/cli/src/python/execute.py | 24 +-
heron/tools/cli/src/python/help.py | 24 +-
heron/tools/cli/src/python/jars.py | 24 +-
heron/tools/cli/src/python/kill.py | 24 +-
heron/tools/cli/src/python/main.py | 24 +-
heron/tools/cli/src/python/opts.py | 24 +-
heron/tools/cli/src/python/rest.py | 24 +-
heron/tools/cli/src/python/restart.py | 24 +-
heron/tools/cli/src/python/result.py | 24 +-
heron/tools/cli/src/python/submit.py | 24 +-
heron/tools/cli/src/python/update.py | 24 +-
heron/tools/cli/src/python/version.py | 24 +-
.../cli/tests/python/client_command_unittest.py | 24 +-
heron/tools/cli/tests/python/opts_unittest.py | 24 +-
heron/tools/common/src/python/access/fetch.py | 24 +-
heron/tools/common/src/python/access/heron_api.py | 24 +-
heron/tools/common/src/python/access/query.py | 24 +-
.../common/src/python/access/tracker_access.py | 24 +-
heron/tools/common/src/python/utils/classpath.py | 24 +-
heron/tools/common/src/python/utils/config.py | 24 +-
heron/tools/common/src/python/utils/heronparser.py | 24 +-
.../config/src/yaml/tracker/heron_tracker.yaml | 17 ++
heron/tools/explorer/src/python/args.py | 24 +-
heron/tools/explorer/src/python/clusters.py | 24 +-
heron/tools/explorer/src/python/help.py | 24 +-
heron/tools/explorer/src/python/logicalplan.py | 24 +-
heron/tools/explorer/src/python/main.py | 24 +-
heron/tools/explorer/src/python/opts.py | 24 +-
heron/tools/explorer/src/python/physicalplan.py | 24 +-
heron/tools/explorer/src/python/topologies.py | 24 +-
heron/tools/explorer/src/python/version.py | 26 +-
.../explorer/tests/python/explorer_unittest.py | 24 +-
heron/tools/tracker/src/python/config.py | 24 +-
heron/tools/tracker/src/python/constants.py | 24 +-
heron/tools/tracker/src/python/graph.py | 24 +-
.../tracker/src/python/handlers/basehandler.py | 24 +-
.../tracker/src/python/handlers/clustershandler.py | 24 +-
.../src/python/handlers/containerfilehandler.py | 24 +-
.../tracker/src/python/handlers/defaulthandler.py | 24 +-
.../src/python/handlers/exceptionhandler.py | 24 +-
.../src/python/handlers/exceptionsummaryhandler.py | 24 +-
.../src/python/handlers/executionstatehandler.py | 24 +-
.../tracker/src/python/handlers/jmaphandler.py | 24 +-
.../tracker/src/python/handlers/jstackhandler.py | 24 +-
.../src/python/handlers/logicalplanhandler.py | 24 +-
.../tracker/src/python/handlers/machineshandler.py | 24 +-
.../tracker/src/python/handlers/mainhandler.py | 24 +-
.../src/python/handlers/memoryhistogramhandler.py | 24 +-
.../tracker/src/python/handlers/metadatahandler.py | 24 +-
.../tracker/src/python/handlers/metricshandler.py | 24 +-
.../src/python/handlers/metricsqueryhandler.py | 24 +-
.../src/python/handlers/metricstimelinehandler.py | 24 +-
.../src/python/handlers/physicalplanhandler.py | 24 +-
.../tracker/src/python/handlers/pidhandler.py | 24 +-
.../src/python/handlers/runtimestatehandler.py | 24 +-
.../python/handlers/schedulerlocationhandler.py | 24 +-
.../tracker/src/python/handlers/stateshandler.py | 24 +-
.../src/python/handlers/topologieshandler.py | 24 +-
.../src/python/handlers/topologyconfighandler.py | 24 +-
.../tracker/src/python/handlers/topologyhandler.py | 24 +-
heron/tools/tracker/src/python/javaobj.py | 24 +-
heron/tools/tracker/src/python/main.py | 24 +-
heron/tools/tracker/src/python/metricstimeline.py | 24 +-
heron/tools/tracker/src/python/pyutils.py | 24 +-
heron/tools/tracker/src/python/query.py | 24 +-
heron/tools/tracker/src/python/query_operators.py | 24 +-
heron/tools/tracker/src/python/topology.py | 24 +-
heron/tools/tracker/src/python/tracker.py | 24 +-
heron/tools/tracker/src/python/utils.py | 24 +-
heron/tools/ui/src/python/args.py | 24 +-
heron/tools/ui/src/python/consts.py | 24 +-
heron/tools/ui/src/python/handlers/api/metrics.py | 24 +-
heron/tools/ui/src/python/handlers/api/topology.py | 24 +-
heron/tools/ui/src/python/handlers/base.py | 24 +-
.../tools/ui/src/python/handlers/common/consts.py | 24 +-
heron/tools/ui/src/python/handlers/common/utils.py | 24 +-
heron/tools/ui/src/python/handlers/mainhandler.py | 24 +-
heron/tools/ui/src/python/handlers/notfound.py | 24 +-
heron/tools/ui/src/python/handlers/ranges.py | 24 +-
heron/tools/ui/src/python/handlers/topology.py | 24 +-
heron/tools/ui/src/python/main.py | 24 +-
.../org/apache/heron/uploader/hdfs/sample.yaml | 17 ++
.../java/org/apache/heron/uploader/s3/sample.yaml | 17 ++
.../java/org/apache/heron/uploader/scp/sample.yaml | 17 ++
heronpy/api/api_constants.py | 24 +-
heronpy/api/bolt/window_bolt.py | 26 +-
heronpy/api/component/component_spec.py | 24 +-
heronpy/api/custom_grouping.py | 24 +-
heronpy/api/global_metrics.py | 37 ++-
heronpy/api/metrics.py | 24 +-
heronpy/api/serializer.py | 24 +-
heronpy/api/spout/spout.py | 24 +-
heronpy/api/state/state.py | 24 +-
heronpy/api/state/stateful_component.py | 24 +-
heronpy/api/task_hook.py | 24 +-
heronpy/api/tests/python/component_unittest.py | 24 +-
heronpy/api/tests/python/metrics_unittest.py | 24 +-
heronpy/api/tests/python/serializer_unittest.py | 24 +-
heronpy/api/tests/python/stream_unittest.py | 24 +-
heronpy/api/tests/python/topology_unittest.py | 24 +-
heronpy/api/topology.py | 24 +-
heronpy/api/topology_context.py | 24 +-
heronpy/api/tuple.py | 24 +-
heronpy/connectors/mock/arraylooper.py | 26 +-
heronpy/connectors/pulsar/pulsarspout.py | 26 +-
heronpy/connectors/pulsar/pulsarstreamlet.py | 26 +-
heronpy/connectors/textfiles/textfilesgenerator.py | 26 +-
heronpy/streamlet/builder.py | 26 +-
heronpy/streamlet/config.py | 26 +-
heronpy/streamlet/context.py | 26 +-
heronpy/streamlet/impl/consumebolt.py | 24 +-
heronpy/streamlet/impl/contextimpl.py | 24 +-
heronpy/streamlet/impl/filterbolt.py | 24 +-
heronpy/streamlet/impl/flatmapbolt.py | 24 +-
heronpy/streamlet/impl/generatorspout.py | 24 +-
heronpy/streamlet/impl/joinbolt.py | 24 +-
heronpy/streamlet/impl/logbolt.py | 24 +-
heronpy/streamlet/impl/mapbolt.py | 24 +-
heronpy/streamlet/impl/reducebykeyandwindowbolt.py | 24 +-
heronpy/streamlet/impl/reducebywindowbolt.py | 24 +-
heronpy/streamlet/impl/repartitionbolt.py | 24 +-
heronpy/streamlet/impl/streamletboltbase.py | 24 +-
heronpy/streamlet/impl/streamletspoutbase.py | 24 +-
heronpy/streamlet/impl/supplierspout.py | 24 +-
heronpy/streamlet/impl/transformbolt.py | 24 +-
heronpy/streamlet/impl/unionbolt.py | 24 +-
heronpy/streamlet/keyedwindow.py | 26 +-
heronpy/streamlet/resources.py | 26 +-
heronpy/streamlet/runner.py | 26 +-
heronpy/streamlet/streamlet.py | 26 +-
heronpy/streamlet/window.py | 26 +-
heronpy/streamlet/windowconfig.py | 26 +-
integration_test/src/python/common/status.py | 24 +-
.../common/bolt/count_aggregator_bolt.py | 24 +-
.../common/bolt/double_tuples_bolt.py | 24 +-
.../integration_test/common/bolt/identity_bolt.py | 24 +-
.../common/bolt/word_count_bolt.py | 24 +-
.../integration_test/common/spout/ab_spout.py | 24 +-
.../integration_test/core/aggregator_bolt.py | 24 +-
.../src/python/integration_test/core/batch_bolt.py | 24 +-
.../src/python/integration_test/core/constants.py | 24 +-
.../integration_test/core/integration_test_bolt.py | 24 +-
.../core/integration_test_spout.py | 24 +-
.../python/integration_test/core/terminal_bolt.py | 24 +-
.../python/integration_test/core/test_runner.py | 24 +-
.../integration_test/core/test_topology_builder.py | 24 +-
.../topology/all_grouping/all_grouping.py | 24 +-
.../topology/basic_one_task/basic_one_task.py | 24 +-
.../bolt_double_emit_tuples.py | 24 +-
.../topology/fields_grouping/fields_grouping.py | 24 +-
.../topology/global_grouping/global_grouping.py | 24 +-
.../multi_spouts_multi_tasks.py | 24 +-
.../topology/none_grouping/none_grouping.py | 24 +-
.../one_bolt_multi_tasks/one_bolt_multi_tasks.py | 24 +-
.../one_spout_bolt_multi_tasks.py | 24 +-
.../one_spout_multi_tasks/one_spout_multi_tasks.py | 24 +-
.../one_spout_two_bolts/one_spout_two_bolts.py | 24 +-
.../topology/shuffle_grouping/shuffle_grouping.py | 24 +-
.../topology/streamlet/word_count_streamlet.py | 24 +-
.../topology/test_topology_main.py | 24 +-
.../src/python/local_test_runner/main.py | 24 +-
.../src/python/local_test_runner/test_kill_bolt.py | 24 +-
.../local_test_runner/test_kill_metricsmgr.py | 24 +-
.../python/local_test_runner/test_kill_stmgr.py | 24 +-
.../test_kill_stmgr_metricsmgr.py | 24 +-
.../python/local_test_runner/test_kill_tmaster.py | 24 +-
.../src/python/local_test_runner/test_scale_up.py | 24 +-
.../src/python/local_test_runner/test_template.py | 24 +-
.../common/ScalaIntegrationTestBase.scala | 31 ++-
.../ScalaStreamletWithFilterAndTransform.scala | 31 ++-
...reamletWithMapAndFlatMapAndFilterAndClone.scala | 31 ++-
scripts/compile/errors.sh | 23 +-
scripts/resources/idea/copyright/heron.xml | 2 +-
third_party/thrift/BUILD | 11 -
third_party/thrift/thrift-linux-x86_64.exe | Bin 2823416 -> 0 bytes
third_party/thrift/thrift-osx-x86_64.exe | Bin 1982356 -> 0 bytes
tools/build_rules/prelude_bazel | 7 +-
.../bazel/checkstyle/apache_coding_style.xml | 29 ++-
.../apache/bazel/checkstyle/heron_coding_style.xml | 29 ++-
tools/rules/genthrift.bzl | 90 -------
website/config.yaml | 17 ++
.../schedulers/{nomad.md => nomad-docker.md} | 116 ++-------
.../schedulers/{nomad.md => nomad-raw-execs.md} | 22 +-
.../docs/operators/deployment/schedulers/nomad.md | 205 +--------------
website/data/alerts.yaml | 17 ++
website/data/configs/descriptions.yaml | 17 ++
website/data/configs/kubernetes.yaml | 17 ++
website/data/toc.yaml | 17 ++
663 files changed, 9698 insertions(+), 6361 deletions(-)
delete mode 100644
heron/metricsmgr/src/java/org/apache/heron/metricsmgr/sink/scribe/ScribeSink.java
delete mode 100644 heron/metricsmgr/src/thrift/BUILD
delete mode 100644 heron/metricsmgr/src/thrift/Empty.java
delete mode 100644 heron/metricsmgr/src/thrift/scribe.thrift
delete mode 100644 third_party/thrift/BUILD
delete mode 100755 third_party/thrift/thrift-linux-x86_64.exe
delete mode 100755 third_party/thrift/thrift-osx-x86_64.exe
delete mode 100644 tools/rules/genthrift.bzl
copy website/content/docs/operators/deployment/schedulers/{nomad.md =>
nomad-docker.md} (57%)
copy website/content/docs/operators/deployment/schedulers/{nomad.md =>
nomad-raw-execs.md} (90%)
--
To stop receiving notification emails like this one, please contact
[email protected].
