[GitHub] joshfischer1108 closed pull request #2904: Test to verify gitbox change

2018-05-19 Thread GitBox
joshfischer1108 closed pull request #2904: Test to verify gitbox change URL: https://github.com/apache/incubator-heron/pull/2904 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance

[GitHub] nwangtw commented on issue #2692: Making emit, ack, and fail thread safe

2018-05-21 Thread GitBox
nwangtw commented on issue #2692: Making emit, ack, and fail thread safe URL: https://github.com/apache/incubator-heron/pull/2692#issuecomment-390711888 I think maosong's concern is still valid. For stateful process, we have to make sure the checkpoint are made after all user threads have

[GitHub] ajorgensen commented on issue #2900: Fix Potential Double Delete Bug

2018-05-21 Thread GitBox
ajorgensen commented on issue #2900: Fix Potential Double Delete Bug URL: https://github.com/apache/incubator-heron/pull/2900#issuecomment-390664392 @kramasamy Oh interesting... the checkstyles never run for me during a normal build. For example if I introduce the same checkstyle issue

[GitHub] ajorgensen commented on issue #2900: Fix Potential Double Delete Bug

2018-05-21 Thread GitBox
ajorgensen commented on issue #2900: Fix Potential Double Delete Bug URL: https://github.com/apache/incubator-heron/pull/2900#issuecomment-390664392 @kramasamy Oh interesting... the checkstyles never run for me during a normal build. For example if I introduce the same checkstyle issue

[GitHub] ajorgensen commented on issue #2900: Fix Potential Double Delete Bug

2018-05-21 Thread GitBox
ajorgensen commented on issue #2900: Fix Potential Double Delete Bug URL: https://github.com/apache/incubator-heron/pull/2900#issuecomment-390659395 @nlu90 fixed. Is there a bazel command just run checkstyle? This is an

[GitHub] jerrypeng commented on issue #2692: Making emit, ack, and fail thread safe

2018-05-21 Thread GitBox
jerrypeng commented on issue #2692: Making emit, ack, and fail thread safe URL: https://github.com/apache/incubator-heron/pull/2692#issuecomment-390730675 @nwangtw I agree that effectively-once semantics might not be honored if users decide process tuples asynchronously, but it is possible

[GitHub] nwangtw commented on issue #2692: Making emit, ack, and fail thread safe

2018-05-21 Thread GitBox
nwangtw commented on issue #2692: Making emit, ack, and fail thread safe URL: https://github.com/apache/incubator-heron/pull/2692#issuecomment-390739147 @jerrypeng agreed. The concern is that users CAN use the function in the wrong way. Avoiding it in code would be nice; protecting the

[GitHub] huijunwu opened a new pull request #2905: log the object when it cannot be serialized when emitting tuples

2018-05-21 Thread GitBox
huijunwu opened a new pull request #2905: log the object when it cannot be serialized when emitting tuples URL: https://github.com/apache/incubator-heron/pull/2905 We saw some topology may encounter the NotSerializableException and the heron-instance crashes. But the user may not be able

[GitHub] nwangtw commented on a change in pull request #2905: log the object when it cannot be serialized when emitting tuples

2018-05-21 Thread GitBox
nwangtw commented on a change in pull request #2905: log the object when it cannot be serialized when emitting tuples URL: https://github.com/apache/incubator-heron/pull/2905#discussion_r189724900 ## File path: heron/api/src/java/org/apache/heron/api/serializer/JavaSerializer.java

[GitHub] huijunw commented on a change in pull request #2905: log the object when it cannot be serialized when emitting tuples

2018-05-21 Thread GitBox
huijunw commented on a change in pull request #2905: log the object when it cannot be serialized when emitting tuples URL: https://github.com/apache/incubator-heron/pull/2905#discussion_r189730038 ## File path: heron/api/src/java/org/apache/heron/api/serializer/JavaSerializer.java

[GitHub] huijunw commented on issue #2907: stuck stmgr due to zk client destructor

2018-05-23 Thread GitBox
huijunw commented on issue #2907: stuck stmgr due to zk client destructor URL: https://github.com/apache/incubator-heron/issues/2907#issuecomment-391489175 replace https://github.com/apache/incubator-heron/issues/2765 This

[GitHub] huijunwu opened a new pull request #2908: reorder operations in zk_client destructor

2018-05-23 Thread GitBox
huijunwu opened a new pull request #2908: reorder operations in zk_client destructor URL: https://github.com/apache/incubator-heron/pull/2908 fix https://github.com/apache/incubator-heron/issues/2907 This is an automated

[GitHub] huijunw commented on issue #2907: stuck stmgr due to zk client destructor

2018-05-23 Thread GitBox
huijunw commented on issue #2907: stuck stmgr due to zk client destructor URL: https://github.com/apache/incubator-heron/issues/2907#issuecomment-391510536 For the thread 0x7f616cc62700: It called the GetCompletionWatcher(), when a getting-zk-node operation is done. In the watcher,

[GitHub] westurner opened a new issue #2906: Website: text extends beyond boxes

2018-05-22 Thread GitBox
westurner opened a new issue #2906: Website: text extends beyond boxes URL: https://github.com/apache/incubator-heron/issues/2906 With a 5" phone in portrait mode, the text in the boxes under the "Why heron?" heading extends beyond the bottom border of the boxes.

[GitHub] westurner commented on issue #2906: Website: text extends beyond boxes

2018-05-22 Thread GitBox
westurner commented on issue #2906: Website: text extends beyond boxes URL: https://github.com/apache/incubator-heron/issues/2906#issuecomment-391217102 ![screenshot_20180523-002832](https://user-images.githubusercontent.com/50891/40403586-c4620f20-5e20-11e8-8c5c-0c8865957f89.png)

[GitHub] huijunw commented on issue #2907: stuck stmgr due to zk client destructor

2018-05-23 Thread GitBox
huijunw commented on issue #2907: stuck stmgr due to zk client destructor URL: https://github.com/apache/incubator-heron/issues/2907#issuecomment-391546584 @srkukarni why is zookeeper not single thread ? libzookeeper_mt vs libzookeeper_st If I remember correctly, the stmgr should be

[GitHub] nlu90 commented on issue #2907: stuck stmgr due to zk client destructor

2018-05-23 Thread GitBox
nlu90 commented on issue #2907: stuck stmgr due to zk client destructor URL: https://github.com/apache/incubator-heron/issues/2907#issuecomment-391530890 The comment [here](https://github.com/apache/incubator-heron/blob/master/heron/statemgrs/src/cpp/statemgr/heron-zkstatemgr.cpp#L358)

[GitHub] nlu90 commented on issue #2907: stuck stmgr due to zk client destructor

2018-05-23 Thread GitBox
nlu90 commented on issue #2907: stuck stmgr due to zk client destructor URL: https://github.com/apache/incubator-heron/issues/2907#issuecomment-391530890 [here](https://stackoverflow.com/questions/8248458/pthread-cond-signal-causing-deadlock) is some discussion about the `__lll_lock_wait

[GitHub] maosongfu commented on issue #2908: reorder operations in zk_client destructor

2018-05-23 Thread GitBox
maosongfu commented on issue #2908: reorder operations in zk_client destructor URL: https://github.com/apache/incubator-heron/pull/2908#issuecomment-391549027 Had a discussion with Huijun, and met some new concerns. Hold it for now until we better understand it.

[GitHub] huijunwu closed pull request #2905: log the object when it cannot be serialized when emitting tuples

2018-05-22 Thread GitBox
huijunwu closed pull request #2905: log the object when it cannot be serialized when emitting tuples URL: https://github.com/apache/incubator-heron/pull/2905 This is an automated message from the Apache Git Service. To

[GitHub] nlu90 closed pull request #2692: Making emit, ack, and fail thread safe

2018-05-22 Thread GitBox
nlu90 closed pull request #2692: Making emit, ack, and fail thread safe URL: https://github.com/apache/incubator-heron/pull/2692 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is a

[GitHub] nwangtw commented on issue #2908: reorder operations in zk_client destructor

2018-05-25 Thread GitBox
nwangtw commented on issue #2908: reorder operations in zk_client destructor URL: https://github.com/apache/incubator-heron/pull/2908#issuecomment-392214519 Discussed offline. Update: The fix is valid and helpful in the current implementation. The questions are about the

[GitHub] jerrypeng commented on issue #2692: Making emit, ack, and fail thread safe

2018-05-20 Thread GitBox
jerrypeng commented on issue #2692: Making emit, ack, and fail thread safe URL: https://github.com/apache/incubator-heron/pull/2692#issuecomment-390544343 @maosongfu can you approve? or do you have anymore concerns? This is

[GitHub] sebastienpattyn93 commented on issue #2913: Got UploaderException when submit topology on kubernetes

2018-06-11 Thread GitBox
sebastienpattyn93 commented on issue #2913: Got UploaderException when submit topology on kubernetes URL: https://github.com/apache/incubator-heron/issues/2913#issuecomment-396142312 Hi @cckellogg I'm using the yaml from this [turotial]

[GitHub] kramasamy commented on issue #2917: unable to setup heronpy

2018-06-11 Thread GitBox
kramasamy commented on issue #2917: unable to setup heronpy URL: https://github.com/apache/incubator-heron/issues/2917#issuecomment-396250632 @placeacall - we don't support python3 packages yet. This is an automated message

[GitHub] cckellogg commented on issue #2913: Got UploaderException when submit topology on kubernetes

2018-06-08 Thread GitBox
cckellogg commented on issue #2913: Got UploaderException when submit topology on kubernetes URL: https://github.com/apache/incubator-heron/issues/2913#issuecomment-395788876 @sebastienpattyn93 what version for heron are you running? What is the yaml for apiserver deployment? It looks

[GitHub] cckellogg commented on issue #2913: Got UploaderException when submit topology on kubernetes

2018-06-08 Thread GitBox
cckellogg commented on issue #2913: Got UploaderException when submit topology on kubernetes URL: https://github.com/apache/incubator-heron/issues/2913#issuecomment-395788876 @sebastienpattyn93 what version for heron are you running? What is the yaml for apiserver deployment? It looks

[GitHub] kramasamy commented on issue #2913: Got UploaderException when submit topology on kubernetes

2018-06-08 Thread GitBox
kramasamy commented on issue #2913: Got UploaderException when submit topology on kubernetes URL: https://github.com/apache/incubator-heron/issues/2913#issuecomment-395778065 @cckellogg - can you check this? This is an

[GitHub] kramasamy closed pull request #2914: Add permissive licence to libunwind

2018-06-08 Thread GitBox
kramasamy closed pull request #2914: Add permissive licence to libunwind URL: https://github.com/apache/incubator-heron/pull/2914 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is a

[GitHub] kramasamy closed pull request #2916: Add DISCLAIMER file required by Apache policy

2018-06-08 Thread GitBox
kramasamy closed pull request #2916: Add DISCLAIMER file required by Apache policy URL: https://github.com/apache/incubator-heron/pull/2916 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this

[GitHub] nwangtw opened a new pull request #2916: Add DISCLAIMER file required by Apache policy

2018-06-08 Thread GitBox
nwangtw opened a new pull request #2916: Add DISCLAIMER file required by Apache policy URL: https://github.com/apache/incubator-heron/pull/2916 This is an automated message from the Apache Git Service. To respond to the

[GitHub] cristobalcl opened a new issue #2919: Launch PEX on Kubernetes fails

2018-06-14 Thread GitBox
cristobalcl opened a new issue #2919: Launch PEX on Kubernetes fails URL: https://github.com/apache/incubator-heron/issues/2919 I recently get this error each time I try to launch a topology to Kubernetes: ``` [2018-06-14 12:17:11 +] [DEBUG]: Starting new HTTP connection (1):

[GitHub] kramasamy commented on issue #2922: Fix integer types to avoid warnings

2018-06-18 Thread GitBox
kramasamy commented on issue #2922: Fix integer types to avoid warnings URL: https://github.com/apache/incubator-heron/pull/2922#issuecomment-398047591 @Code0x58 - thanks for the cleanup. This is an automated message from the

[GitHub] kramasamy closed pull request #2920: Correct case of acronyms

2018-06-18 Thread GitBox
kramasamy closed pull request #2920: Correct case of acronyms URL: https://github.com/apache/incubator-heron/pull/2920 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is a foreign pull

[GitHub] Code0x58 closed pull request #2915: [WIP] Use six to make heronpy tests pass in python3

2018-06-18 Thread GitBox
Code0x58 closed pull request #2915: [WIP] Use six to make heronpy tests pass in python3 URL: https://github.com/apache/incubator-heron/pull/2915 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As

[GitHub] kramasamy closed pull request #2921: Add JDK/JAVA_HOME to bazel_configure.py

2018-06-18 Thread GitBox
kramasamy closed pull request #2921: Add JDK/JAVA_HOME to bazel_configure.py URL: https://github.com/apache/incubator-heron/pull/2921 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is a

[GitHub] kramasamy commented on issue #2921: Add JDK/JAVA_HOME to bazel_configure.py

2018-06-18 Thread GitBox
kramasamy commented on issue #2921: Add JDK/JAVA_HOME to bazel_configure.py URL: https://github.com/apache/incubator-heron/pull/2921#issuecomment-398048450 @Code0x58 - there is no need to run bazel configure anymore. It can be used to check whether all the requirements are present.

[GitHub] nlu90 commented on a change in pull request #2923: [healthmgr] Enable runtime toggle for AutoRestartBackpressureContainerPolicy

2018-06-18 Thread GitBox
nlu90 commented on a change in pull request #2923: [healthmgr] Enable runtime toggle for AutoRestartBackpressureContainerPolicy URL: https://github.com/apache/incubator-heron/pull/2923#discussion_r196236440 ## File path:

[GitHub] nlu90 commented on a change in pull request #2923: [healthmgr] Enable runtime toggle for AutoRestartBackpressureContainerPolicy

2018-06-18 Thread GitBox
nlu90 commented on a change in pull request #2923: [healthmgr] Enable runtime toggle for AutoRestartBackpressureContainerPolicy URL: https://github.com/apache/incubator-heron/pull/2923#discussion_r196236723 ## File path:

[GitHub] srkukarni commented on a change in pull request #2891: Refactor StatefulStorage API

2018-06-18 Thread GitBox
srkukarni commented on a change in pull request #2891: Refactor StatefulStorage API URL: https://github.com/apache/incubator-heron/pull/2891#discussion_r196243889 ## File path: heron/proto/ckptmgr.proto ## @@ -171,7 +175,23 @@ message CleanStatefulCheckpointResponse {

[GitHub] huijunw commented on a change in pull request #2923: [healthmgr] Enable runtime toggle for AutoRestartBackpressureContainerPolicy

2018-06-18 Thread GitBox
huijunw commented on a change in pull request #2923: [healthmgr] Enable runtime toggle for AutoRestartBackpressureContainerPolicy URL: https://github.com/apache/incubator-heron/pull/2923#discussion_r196252303 ## File path:

[GitHub] huijunwu opened a new pull request #2923: [healthmgr] Enable runtime toggle for AutoRestartBackpressureContainerPolicy

2018-06-18 Thread GitBox
huijunwu opened a new pull request #2923: [healthmgr] Enable runtime toggle for AutoRestartBackpressureContainerPolicy URL: https://github.com/apache/incubator-heron/pull/2923 Heron supports config update at runtime. This PR enforces toggle config for

[GitHub] nwangtw commented on a change in pull request #2923: [healthmgr] Enable runtime toggle for AutoRestartBackpressureContainerPolicy

2018-06-18 Thread GitBox
nwangtw commented on a change in pull request #2923: [healthmgr] Enable runtime toggle for AutoRestartBackpressureContainerPolicy URL: https://github.com/apache/incubator-heron/pull/2923#discussion_r196243284 ## File path:

[GitHub] nwangtw commented on a change in pull request #2923: [healthmgr] Enable runtime toggle for AutoRestartBackpressureContainerPolicy

2018-06-18 Thread GitBox
nwangtw commented on a change in pull request #2923: [healthmgr] Enable runtime toggle for AutoRestartBackpressureContainerPolicy URL: https://github.com/apache/incubator-heron/pull/2923#discussion_r196239712 ## File path:

[GitHub] srkukarni commented on a change in pull request #2891: Refactor StatefulStorage API

2018-06-18 Thread GitBox
srkukarni commented on a change in pull request #2891: Refactor StatefulStorage API URL: https://github.com/apache/incubator-heron/pull/2891#discussion_r196244013 ## File path: heron/proto/ckptmgr.proto ## @@ -171,7 +175,23 @@ message CleanStatefulCheckpointResponse {

[GitHub] huijunw commented on a change in pull request #2923: [healthmgr] Enable runtime toggle for AutoRestartBackpressureContainerPolicy

2018-06-18 Thread GitBox
huijunw commented on a change in pull request #2923: [healthmgr] Enable runtime toggle for AutoRestartBackpressureContainerPolicy URL: https://github.com/apache/incubator-heron/pull/2923#discussion_r196254210 ## File path:

[GitHub] nwangtw commented on a change in pull request #2923: [healthmgr] Enable runtime toggle for AutoRestartBackpressureContainerPolicy

2018-06-18 Thread GitBox
nwangtw commented on a change in pull request #2923: [healthmgr] Enable runtime toggle for AutoRestartBackpressureContainerPolicy URL: https://github.com/apache/incubator-heron/pull/2923#discussion_r196256952 ## File path:

[GitHub] nwangtw commented on issue #2909: Add ack and fail to Streamlet API

2018-06-12 Thread GitBox
nwangtw commented on issue #2909: Add ack and fail to Streamlet API URL: https://github.com/apache/incubator-heron/issues/2909#issuecomment-396696346 And thanks for your help! :) On Tue, Jun 12, 2018 at 5:24 AM, Michael Schmidt wrote: > Cool. Knowing that we can get this

[GitHub] aahmed-se opened a new issue #2918: Add Vagrant based scripts to build osx binaries on linux hosts

2018-06-13 Thread GitBox
aahmed-se opened a new issue #2918: Add Vagrant based scripts to build osx binaries on linux hosts URL: https://github.com/apache/incubator-heron/issues/2918 https://www.vagrantup.com/ Will probably need to target osx 10.11

[GitHub] Code0x58 opened a new pull request #2920: Correct dag to DAG

2018-06-17 Thread GitBox
Code0x58 opened a new pull request #2920: Correct dag to DAG URL: https://github.com/apache/incubator-heron/pull/2920 [Do you like dags](https://www.youtube.com/watch?v=ZXILzUpVx7A)? This is an automated message from the

[GitHub] kramasamy commented on issue #2920: Correct dag to DAG

2018-06-17 Thread GitBox
kramasamy commented on issue #2920: Correct dag to DAG URL: https://github.com/apache/incubator-heron/pull/2920#issuecomment-397879667 Sure go for it! This is an automated message from the Apache Git Service. To respond to

[GitHub] kramasamy commented on issue #2920: Correct dag to DAG

2018-06-17 Thread GitBox
kramasamy commented on issue #2920: Correct dag to DAG URL: https://github.com/apache/incubator-heron/pull/2920#issuecomment-397932904 @Code0x58 - is this PR ready to merge? This is an automated message from the Apache Git

[GitHub] Code0x58 commented on issue #2920: Correct dag to DAG

2018-06-18 Thread GitBox
Code0x58 commented on issue #2920: Correct dag to DAG URL: https://github.com/apache/incubator-heron/pull/2920#issuecomment-397961335 @kramasamy yep, I think it's good to go now This is an automated message from the Apache

[GitHub] Code0x58 commented on a change in pull request #2920: Correct dag to DAG

2018-06-17 Thread GitBox
Code0x58 commented on a change in pull request #2920: Correct dag to DAG URL: https://github.com/apache/incubator-heron/pull/2920#discussion_r195939946 ## File path: heron/schedulers/src/java/org/apache/heron/scheduler/yarn/HeronMasterDriver.java ## @@ -327,7 +327,7 @@

[GitHub] Code0x58 opened a new pull request #2921: Add JDK/JAVA_HOME to bazel_configure.py

2018-06-18 Thread GitBox
Code0x58 opened a new pull request #2921: Add JDK/JAVA_HOME to bazel_configure.py URL: https://github.com/apache/incubator-heron/pull/2921 I found that `jar` wasn't available when I did `bazel test heron/...`, so I thought it would be good to check for the presence of a JDK in configure.

[GitHub] Code0x58 opened a new pull request #2922: Fix integer types to avoid warnings

2018-06-18 Thread GitBox
Code0x58 opened a new pull request #2922: Fix integer types to avoid warnings URL: https://github.com/apache/incubator-heron/pull/2922 The output was a bit noisy because of signed/unsigned comparisons so I cleaned them up.

[GitHub] placeacall opened a new issue #2917: unable to setup heronpy

2018-06-10 Thread GitBox
placeacall opened a new issue #2917: unable to setup heronpy URL: https://github.com/apache/incubator-heron/issues/2917 i am having issues installing heronpy. See below @DESKTOP-9043623:~$ pip3 install heronpy Collecting heronpy Could not find a version that satisfies the

[GitHub] jerrypeng commented on issue #2909: Add ack and fail to Streamlet API

2018-06-11 Thread GitBox
jerrypeng commented on issue #2909: Add ack and fail to Streamlet API URL: https://github.com/apache/incubator-heron/issues/2909#issuecomment-396338565 @mjschmidt so just to be clear. The streamlet API currently does not have a way for users to explicitly fail a tuple but it will

[GitHub] jerrypeng commented on issue #2909: Add ack and fail to Streamlet API

2018-06-11 Thread GitBox
jerrypeng commented on issue #2909: Add ack and fail to Streamlet API URL: https://github.com/apache/incubator-heron/issues/2909#issuecomment-396338565 @mjschmidt so just to be clear. The streamlet API currently does not have a way for users to explicitly fail a tuple but it will

[GitHub] placeacall commented on issue #2917: unable to setup heronpy

2018-06-11 Thread GitBox
placeacall commented on issue #2917: unable to setup heronpy URL: https://github.com/apache/incubator-heron/issues/2917#issuecomment-396340110 wow, works like a charm (venv) D:\Users\PycharmProjects\Heron\test>pip install heronpy Collecting heronpy Downloading

[GitHub] placeacall commented on issue #2917: unable to setup heronpy

2018-06-11 Thread GitBox
placeacall commented on issue #2917: unable to setup heronpy URL: https://github.com/apache/incubator-heron/issues/2917#issuecomment-396340110 wow, works like a charm (venv) D:\Users\PycharmProjects\Heron\test>pip install heronpy Collecting heronpy Downloading

[GitHub] Code0x58 opened a new issue #2925: Flaky Java integration test

2018-06-19 Thread GitBox
Code0x58 opened a new issue #2925: Flaky Java integration test URL: https://github.com/apache/incubator-heron/issues/2925 This has failed a few times at least recently, and is why the current commit on master is red. File:

[GitHub] huijunwu closed pull request #2908: reorder operations in zk_client destructor

2018-05-29 Thread GitBox
huijunwu closed pull request #2908: reorder operations in zk_client destructor URL: https://github.com/apache/incubator-heron/pull/2908 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] huijunwu closed issue #2907: stuck stmgr due to zk client destructor

2018-05-29 Thread GitBox
huijunwu closed issue #2907: stuck stmgr due to zk client destructor URL: https://github.com/apache/incubator-heron/issues/2907 This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] nwangtw commented on a change in pull request #2910: make LocalFSStorage clean checkpoints before store

2018-05-30 Thread GitBox
nwangtw commented on a change in pull request #2910: make LocalFSStorage clean checkpoints before store URL: https://github.com/apache/incubator-heron/pull/2910#discussion_r191929947 ## File path:

[GitHub] nlu90 commented on a change in pull request #2910: make LocalFSStorage clean checkpoints before store

2018-05-30 Thread GitBox
nlu90 commented on a change in pull request #2910: make LocalFSStorage clean checkpoints before store URL: https://github.com/apache/incubator-heron/pull/2910#discussion_r191938012 ## File path:

[GitHub] nlu90 commented on a change in pull request #2910: make LocalFSStorage clean checkpoints before store

2018-05-30 Thread GitBox
nlu90 commented on a change in pull request #2910: make LocalFSStorage clean checkpoints before store URL: https://github.com/apache/incubator-heron/pull/2910#discussion_r191938042 ## File path:

[GitHub] nwangtw commented on a change in pull request #2910: make LocalFSStorage clean checkpoints before store

2018-05-30 Thread GitBox
nwangtw commented on a change in pull request #2910: make LocalFSStorage clean checkpoints before store URL: https://github.com/apache/incubator-heron/pull/2910#discussion_r191931212 ## File path:

[GitHub] nwangtw commented on a change in pull request #2910: make LocalFSStorage clean checkpoints before store

2018-05-30 Thread GitBox
nwangtw commented on a change in pull request #2910: make LocalFSStorage clean checkpoints before store URL: https://github.com/apache/incubator-heron/pull/2910#discussion_r191931672 ## File path:

[GitHub] nlu90 opened a new pull request #2910: make LocalFSStorage clean checkpoints before store

2018-05-30 Thread GitBox
nlu90 opened a new pull request #2910: make LocalFSStorage clean checkpoints before store URL: https://github.com/apache/incubator-heron/pull/2910 The current implementation of LocalFSStorage would cause unlimited checkpoints to be saved on local disk and thus out of disk space problem.

[GitHub] nlu90 commented on a change in pull request #2910: make LocalFSStorage clean checkpoints before store

2018-05-30 Thread GitBox
nlu90 commented on a change in pull request #2910: make LocalFSStorage clean checkpoints before store URL: https://github.com/apache/incubator-heron/pull/2910#discussion_r191948936 ## File path:

[GitHub] nlu90 commented on issue #2910: make LocalFSStorage clean checkpoints before store

2018-05-30 Thread GitBox
nlu90 commented on issue #2910: make LocalFSStorage clean checkpoints before store URL: https://github.com/apache/incubator-heron/pull/2910#issuecomment-393340979 @kramasamy This change only needed by local filesystem storage. For other storage systems, no change is needed and the

[GitHub] huijunwu opened a new pull request #2911: refactor downloader build

2018-05-30 Thread GitBox
huijunwu opened a new pull request #2911: refactor downloader build URL: https://github.com/apache/incubator-heron/pull/2911 refactor downloader build. make it similar to metricsmgr build. This is an automated message from

[GitHub] nlu90 commented on issue #2910: make LocalFSStorage clean checkpoints before store

2018-05-30 Thread GitBox
nlu90 commented on issue #2910: make LocalFSStorage clean checkpoints before store URL: https://github.com/apache/incubator-heron/pull/2910#issuecomment-393337051 @kramasamy 1. On demand basis cleaning is not working in localfsstorage because the checkpoints are stored locally and

[GitHub] kramasamy commented on issue #2910: make LocalFSStorage clean checkpoints before store

2018-05-30 Thread GitBox
kramasamy commented on issue #2910: make LocalFSStorage clean checkpoints before store URL: https://github.com/apache/incubator-heron/pull/2910#issuecomment-393335902 @nlu90 - Do you do background cleaning of snapshots or on demand basis? It might be easier to do a background cleaning.

[GitHub] kramasamy commented on issue #2910: make LocalFSStorage clean checkpoints before store

2018-05-30 Thread GitBox
kramasamy commented on issue #2910: make LocalFSStorage clean checkpoints before store URL: https://github.com/apache/incubator-heron/pull/2910#issuecomment-393341202 Ok got it. This is an automated message from the Apache

[GitHub] huijunwu opened a new pull request #2912: refactor healthmgr build

2018-05-30 Thread GitBox
huijunwu opened a new pull request #2912: refactor healthmgr build URL: https://github.com/apache/incubator-heron/pull/2912 refactor healthmgr build. make it similar to metricsmgr build. This is an automated message from the

[GitHub] kramasamy commented on issue #2909: Add ack and fail to Streamlet API

2018-05-31 Thread GitBox
kramasamy commented on issue #2909: Add ack and fail to Streamlet API URL: https://github.com/apache/incubator-heron/issues/2909#issuecomment-393643114 @jerrypeng @maosongfu @nwangtw - can you respond? This is an automated

[GitHub] mjschmidt commented on issue #2909: Add ack and fail to Streamlet API

2018-05-31 Thread GitBox
mjschmidt commented on issue #2909: Add ack and fail to Streamlet API URL: https://github.com/apache/incubator-heron/issues/2909#issuecomment-393604027 So lets say I as a Heron analytic developer want to guarantee that all of the data sent from one container is received in the next? In

[GitHub] mjschmidt commented on issue #2909: Add ack and fail to Streamlet API

2018-05-31 Thread GitBox
mjschmidt commented on issue #2909: Add ack and fail to Streamlet API URL: https://github.com/apache/incubator-heron/issues/2909#issuecomment-393604027 @jerrypeng So lets say I as a Heron analytic developer want to guarantee that all of the data sent from one container is received in the

[GitHub] mjschmidt commented on issue #2909: Add ack and fail to Streamlet API

2018-05-31 Thread GitBox
mjschmidt commented on issue #2909: Add ack and fail to Streamlet API URL: https://github.com/apache/incubator-heron/issues/2909#issuecomment-393604027 @jerrypeng So lets say I as a Heron analytic developer want to guarantee that all of the data sent from one container is received in the

[GitHub] nlu90 closed pull request #2910: make LocalFSStorage clean checkpoints before store

2018-06-04 Thread GitBox
nlu90 closed pull request #2910: make LocalFSStorage clean checkpoints before store URL: https://github.com/apache/incubator-heron/pull/2910 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As

[GitHub] kramasamy commented on issue #2909: Add ack and fail to Streamlet API

2018-05-31 Thread GitBox
kramasamy commented on issue #2909: Add ack and fail to Streamlet API URL: https://github.com/apache/incubator-heron/issues/2909#issuecomment-393699760 @mjschmidt - this is due to the underlying bolt implementation that streamlet maps into. Currently these bolts do not ack or fail when

[GitHub] ajorgensen commented on issue #2850: Add SSL support for stream manager connections

2018-06-04 Thread GitBox
ajorgensen commented on issue #2850: Add SSL support for stream manager connections URL: https://github.com/apache/incubator-heron/pull/2850#issuecomment-394549212 It's not complete and it has diverged enough from our implementation that I need to cherry-pick the commits again. I figured

[GitHub] sebastienpattyn93 opened a new issue #2913: Got UploaderException when submit topology on kubernetes

2018-06-07 Thread GitBox
sebastienpattyn93 opened a new issue #2913: Got UploaderException when submit topology on kubernetes URL: https://github.com/apache/incubator-heron/issues/2913 I have a Kubernetes cluster with 3 nodes where Heron is deployed. I am able to visit the heron ui and to curl the heron

[GitHub] ajorgensen closed pull request #2850: Add SSL support for stream manager connections

2018-06-04 Thread GitBox
ajorgensen closed pull request #2850: Add SSL support for stream manager connections URL: https://github.com/apache/incubator-heron/pull/2850 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As

[GitHub] ajorgensen closed pull request #2864: S3Uploader improvements

2018-06-04 Thread GitBox
ajorgensen closed pull request #2864: S3Uploader improvements URL: https://github.com/apache/incubator-heron/pull/2864 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is a foreign pull

[GitHub] ajorgensen closed pull request #2766: Update build-artifacts.sh script path in docs

2018-06-04 Thread GitBox
ajorgensen closed pull request #2766: Update build-artifacts.sh script path in docs URL: https://github.com/apache/incubator-heron/pull/2766 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As

[GitHub] Yitian-Zhang opened a new issue #2944: Where can I find the aurora scheduler logs

2018-07-01 Thread GitBox
Yitian-Zhang opened a new issue #2944: Where can I find the aurora scheduler logs URL: https://github.com/apache/incubator-heron/issues/2944 This is an automated message from the Apache Git Service. To respond to the

[GitHub] Yitian-Zhang closed issue #2944: Where can I find the aurora scheduler logs

2018-07-01 Thread GitBox
Yitian-Zhang closed issue #2944: Where can I find the aurora scheduler logs URL: https://github.com/apache/incubator-heron/issues/2944 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] Yitian-Zhang opened a new issue #2944: Where can I find the aurora scheduler logs

2018-07-01 Thread GitBox
Yitian-Zhang opened a new issue #2944: Where can I find the aurora scheduler logs URL: https://github.com/apache/incubator-heron/issues/2944 This is an automated message from the Apache Git Service. To respond to the

[GitHub] nlu90 closed pull request #2940: modify travis ci to enable integration topology test

2018-06-29 Thread GitBox
nlu90 closed pull request #2940: modify travis ci to enable integration topology test URL: https://github.com/apache/incubator-heron/pull/2940 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As

[GitHub] nlu90 closed pull request #2941: add tmaster physical plan endpoint

2018-06-29 Thread GitBox
nlu90 closed pull request #2941: add tmaster physical plan endpoint URL: https://github.com/apache/incubator-heron/pull/2941 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is a foreign

[GitHub] kramasamy closed pull request #2928: Clean up website gen + website python docs

2018-06-25 Thread GitBox
kramasamy closed pull request #2928: Clean up website gen + website python docs URL: https://github.com/apache/incubator-heron/pull/2928 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is

[GitHub] kramasamy commented on issue #2937: Use latest scala rules to fix tests

2018-06-25 Thread GitBox
kramasamy commented on issue #2937: Use latest scala rules to fix tests URL: https://github.com/apache/incubator-heron/pull/2937#issuecomment-399962684 @Code0x58 @erenavsarogullari - is this good to go? This is an automated

[GitHub] kramasamy commented on issue #2860: Add component config in heron UI and Tracker

2018-06-26 Thread GitBox
kramasamy commented on issue #2860: Add component config in heron UI and Tracker URL: https://github.com/apache/incubator-heron/pull/2860#issuecomment-400334819 @nwangtw - is this ready to be merged? This is an automated

[GitHub] kramasamy closed pull request #2929: Make TopologyBuilder less permissive

2018-06-26 Thread GitBox
kramasamy closed pull request #2929: Make TopologyBuilder less permissive URL: https://github.com/apache/incubator-heron/pull/2929 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is a

[GitHub] nwangtw commented on issue #2860: Add component config in heron UI and Tracker

2018-06-26 Thread GitBox
nwangtw commented on issue #2860: Add component config in heron UI and Tracker URL: https://github.com/apache/incubator-heron/pull/2860#issuecomment-400401945 Sorry I haven't got chance to test it yet. This is an automated

[GitHub] nlu90 commented on a change in pull request #2923: [healthmgr] Enable runtime toggle for AutoRestartBackpressureContainerPolicy

2018-06-27 Thread GitBox
nlu90 commented on a change in pull request #2923: [healthmgr] Enable runtime toggle for AutoRestartBackpressureContainerPolicy URL: https://github.com/apache/incubator-heron/pull/2923#discussion_r198518443 ## File path:

[GitHub] nlu90 commented on a change in pull request #2923: [healthmgr] Enable runtime toggle for AutoRestartBackpressureContainerPolicy

2018-06-27 Thread GitBox
nlu90 commented on a change in pull request #2923: [healthmgr] Enable runtime toggle for AutoRestartBackpressureContainerPolicy URL: https://github.com/apache/incubator-heron/pull/2923#discussion_r198517681 ## File path:

  1   2   3   4   5   6   7   8   9   10   >