[GitHub] [incubator-heron] nicknezis commented on pull request #3555: zookeeper to 3.5.8

[GitBox]

nicknezis commented on pull request #3555:
URL: https://github.com/apache/incubator-heron/pull/3555#issuecomment-653363238


   We will need to also update the Zookeeper included in the Dockerfiles. Also, 
do we know if the version of Bookkeeper used in the Helm chart will work with 
this version of Zookeeper?



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [incubator-heron] huijunwu opened a new pull request #3555: zookeeper to 3.5.8

[GitBox]

huijunwu opened a new pull request #3555:
URL: https://github.com/apache/incubator-heron/pull/3555


   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[incubator-heron] branch huijunwu/20200702 updated: change tab to space

[huijun]

This is an automated email from the ASF dual-hosted git repository.

huijun pushed a commit to branch huijunwu/20200702
in repository https://gitbox.apache.org/repos/asf/incubator-heron.git


The following commit(s) were added to refs/heads/huijunwu/20200702 by this push:
 new 512cc05  change tab to space
512cc05 is described below

commit 512cc05161053e2c2ab4338c6bbc8bfcc1c07804
Author: bed debug 
AuthorDate: Thu Jul 2 19:22:57 2020 -0700

change tab to space
---
 third_party/zookeeper/BUILD | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)

diff --git a/third_party/zookeeper/BUILD b/third_party/zookeeper/BUILD
index f55b0e2..9fc7899 100644
--- a/third_party/zookeeper/BUILD
+++ b/third_party/zookeeper/BUILD
@@ -40,8 +40,8 @@ genrule(
 "mkdir -p $$TMP_DIR",
 "cp -R $$(pwd)/external/org_apache_zookeeper/* $$TMP_DIR",
 "cd $$TMP_DIR",
-   "ant compile_jute",
-   "cd $$TMP_DIR/zookeeper-client/zookeeper-client-c",
+"ant compile_jute",
+"cd $$TMP_DIR/zookeeper-client/zookeeper-client-c",
 "autoreconf -if",
 "./configure --prefix=$$INSTALL_DIR --enable-shared=no",
 "make install",

[incubator-heron] 01/01: upgradezookeeper3.5.8

[huijun]

This is an automated email from the ASF dual-hosted git repository.

huijun pushed a commit to branch huijunwu/20200702
in repository https://gitbox.apache.org/repos/asf/incubator-heron.git

commit 1e0f8eeb0d82304dbb26a842c5fecaae7beec757
Author: huijunwu 
AuthorDate: Fri Jul 3 02:01:31 2020 +

upgradezookeeper3.5.8
---
 WORKSPACE |  9 +++--
 third_party/zookeeper/BUILD   |  4 +++-
 third_party/zookeeper/pkgconfig.patch | 12 
 3 files changed, 6 insertions(+), 19 deletions(-)

diff --git a/WORKSPACE b/WORKSPACE
index 41cb1db..7cf11da 100644
--- a/WORKSPACE
+++ b/WORKSPACE
@@ -66,7 +66,7 @@ maven_install(
 name = "maven",
 artifacts = [
 "antlr:antlr:2.7.7",
-"org.apache.zookeeper:zookeeper:3.4.14",
+"org.apache.zookeeper:zookeeper:3.5.8",
 "io.kubernetes:client-java:" + kubernetes_client_version,
 "com.esotericsoftware:kryo:3.0.3",
 "org.apache.avro:avro:1.7.4",
@@ -282,11 +282,8 @@ http_archive(
 http_archive(
 name = "org_apache_zookeeper",
 build_file = "@//:third_party/zookeeper/BUILD",
-patch_args = ["-p2"],
-patches = ["//third_party/zookeeper:pkgconfig.patch"],
-sha256 = 
"b14f7a0fece8bd34c7fffa46039e563ac5367607c612517aa7bd37306afbd1cd",
-strip_prefix = "zookeeper-3.4.14",
-urls = 
["https://archive.apache.org/dist/zookeeper/zookeeper-3.4.14/zookeeper-3.4.14.tar.gz;],
+strip_prefix = "apache-zookeeper-3.5.8",
+urls = 
["https://archive.apache.org/dist/zookeeper/stable/apache-zookeeper-3.5.8.tar.gz;],
 )
 
 http_archive(
diff --git a/third_party/zookeeper/BUILD b/third_party/zookeeper/BUILD
index 00ec56d..f55b0e2 100644
--- a/third_party/zookeeper/BUILD
+++ b/third_party/zookeeper/BUILD
@@ -39,7 +39,9 @@ genrule(
 "export CFLAGS=-Wno-error",
 "mkdir -p $$TMP_DIR",
 "cp -R $$(pwd)/external/org_apache_zookeeper/* $$TMP_DIR",
-"cd $$TMP_DIR/zookeeper-client/zookeeper-client-c",
+"cd $$TMP_DIR",
+   "ant compile_jute",
+   "cd $$TMP_DIR/zookeeper-client/zookeeper-client-c",
 "autoreconf -if",
 "./configure --prefix=$$INSTALL_DIR --enable-shared=no",
 "make install",
diff --git a/third_party/zookeeper/pkgconfig.patch 
b/third_party/zookeeper/pkgconfig.patch
deleted file mode 100644
index 472fe6c..000
--- a/third_party/zookeeper/pkgconfig.patch
+++ /dev/null
@@ -1,12 +0,0 @@
-diff -Naur /tmp/zookeeper-client/zookeeper-client-c/configure.ac 
/tmp/zookeeper-client/zookeeper-client-c/configure.ac
 /tmp/zookeeper-client/zookeeper-client-c/configure.ac  2019-03-06 
16:50:47.0 +
-+++ /tmp/zookeeper-client/zookeeper-client-c/configure.ac  2020-04-04 
23:44:40.442252000 +
-@@ -34,7 +34,7 @@
-CPPUNIT_INCLUDE=
-CPPUNIT_LIBS=
- else
--   AM_PATH_CPPUNIT(1.10.2)
-+   PKG_CHECK_MODULES([CPPUNIT], [cppunit >= 1.10.2])
- fi
- 
- if test "$CALLER" = "ANT" ; then

[incubator-heron] branch huijunwu/20200702 created (now 1e0f8ee)

[huijun]

This is an automated email from the ASF dual-hosted git repository.

huijun pushed a change to branch huijunwu/20200702
in repository https://gitbox.apache.org/repos/asf/incubator-heron.git.


  at 1e0f8ee  upgradezookeeper3.5.8

This branch includes the following new commits:

 new 1e0f8ee  upgradezookeeper3.5.8

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.

[incubator-heron] branch master updated: Revert "upgradezookeeper3.5.8"

[huijun]

This is an automated email from the ASF dual-hosted git repository.

huijun pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-heron.git


The following commit(s) were added to refs/heads/master by this push:
 new 897df21  Revert "upgradezookeeper3.5.8"
897df21 is described below

commit 897df21a8aa0df1506d155f98e5f26c6ca590b98
Author: huijunwu 
AuthorDate: Fri Jul 3 02:11:21 2020 +

Revert "upgradezookeeper3.5.8"

This reverts commit 00e4e81d77153ac4017967e78c59a3b9b72e5609.
---
 WORKSPACE |  9 ++---
 third_party/zookeeper/BUILD   |  4 +---
 third_party/zookeeper/pkgconfig.patch | 12 
 3 files changed, 19 insertions(+), 6 deletions(-)

diff --git a/WORKSPACE b/WORKSPACE
index 7cf11da..41cb1db 100644
--- a/WORKSPACE
+++ b/WORKSPACE
@@ -66,7 +66,7 @@ maven_install(
 name = "maven",
 artifacts = [
 "antlr:antlr:2.7.7",
-"org.apache.zookeeper:zookeeper:3.5.8",
+"org.apache.zookeeper:zookeeper:3.4.14",
 "io.kubernetes:client-java:" + kubernetes_client_version,
 "com.esotericsoftware:kryo:3.0.3",
 "org.apache.avro:avro:1.7.4",
@@ -282,8 +282,11 @@ http_archive(
 http_archive(
 name = "org_apache_zookeeper",
 build_file = "@//:third_party/zookeeper/BUILD",
-strip_prefix = "apache-zookeeper-3.5.8",
-urls = 
["https://archive.apache.org/dist/zookeeper/stable/apache-zookeeper-3.5.8.tar.gz;],
+patch_args = ["-p2"],
+patches = ["//third_party/zookeeper:pkgconfig.patch"],
+sha256 = 
"b14f7a0fece8bd34c7fffa46039e563ac5367607c612517aa7bd37306afbd1cd",
+strip_prefix = "zookeeper-3.4.14",
+urls = 
["https://archive.apache.org/dist/zookeeper/zookeeper-3.4.14/zookeeper-3.4.14.tar.gz;],
 )
 
 http_archive(
diff --git a/third_party/zookeeper/BUILD b/third_party/zookeeper/BUILD
index f55b0e2..00ec56d 100644
--- a/third_party/zookeeper/BUILD
+++ b/third_party/zookeeper/BUILD
@@ -39,9 +39,7 @@ genrule(
 "export CFLAGS=-Wno-error",
 "mkdir -p $$TMP_DIR",
 "cp -R $$(pwd)/external/org_apache_zookeeper/* $$TMP_DIR",
-"cd $$TMP_DIR",
-   "ant compile_jute",
-   "cd $$TMP_DIR/zookeeper-client/zookeeper-client-c",
+"cd $$TMP_DIR/zookeeper-client/zookeeper-client-c",
 "autoreconf -if",
 "./configure --prefix=$$INSTALL_DIR --enable-shared=no",
 "make install",
diff --git a/third_party/zookeeper/pkgconfig.patch 
b/third_party/zookeeper/pkgconfig.patch
new file mode 100644
index 000..472fe6c
--- /dev/null
+++ b/third_party/zookeeper/pkgconfig.patch
@@ -0,0 +1,12 @@
+diff -Naur /tmp/zookeeper-client/zookeeper-client-c/configure.ac 
/tmp/zookeeper-client/zookeeper-client-c/configure.ac
+--- /tmp/zookeeper-client/zookeeper-client-c/configure.ac  2019-03-06 
16:50:47.0 +
 /tmp/zookeeper-client/zookeeper-client-c/configure.ac  2020-04-04 
23:44:40.442252000 +
+@@ -34,7 +34,7 @@
+CPPUNIT_INCLUDE=
+CPPUNIT_LIBS=
+ else
+-   AM_PATH_CPPUNIT(1.10.2)
++   PKG_CHECK_MODULES([CPPUNIT], [cppunit >= 1.10.2])
+ fi
+ 
+ if test "$CALLER" = "ANT" ; then

[incubator-heron] branch master updated: upgradezookeeper3.5.8

[huijun]

This is an automated email from the ASF dual-hosted git repository.

huijun pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-heron.git


The following commit(s) were added to refs/heads/master by this push:
 new 00e4e81  upgradezookeeper3.5.8
00e4e81 is described below

commit 00e4e81d77153ac4017967e78c59a3b9b72e5609
Author: huijunwu 
AuthorDate: Fri Jul 3 02:01:31 2020 +

upgradezookeeper3.5.8
---
 WORKSPACE |  9 +++--
 third_party/zookeeper/BUILD   |  4 +++-
 third_party/zookeeper/pkgconfig.patch | 12 
 3 files changed, 6 insertions(+), 19 deletions(-)

diff --git a/WORKSPACE b/WORKSPACE
index 41cb1db..7cf11da 100644
--- a/WORKSPACE
+++ b/WORKSPACE
@@ -66,7 +66,7 @@ maven_install(
 name = "maven",
 artifacts = [
 "antlr:antlr:2.7.7",
-"org.apache.zookeeper:zookeeper:3.4.14",
+"org.apache.zookeeper:zookeeper:3.5.8",
 "io.kubernetes:client-java:" + kubernetes_client_version,
 "com.esotericsoftware:kryo:3.0.3",
 "org.apache.avro:avro:1.7.4",
@@ -282,11 +282,8 @@ http_archive(
 http_archive(
 name = "org_apache_zookeeper",
 build_file = "@//:third_party/zookeeper/BUILD",
-patch_args = ["-p2"],
-patches = ["//third_party/zookeeper:pkgconfig.patch"],
-sha256 = 
"b14f7a0fece8bd34c7fffa46039e563ac5367607c612517aa7bd37306afbd1cd",
-strip_prefix = "zookeeper-3.4.14",
-urls = 
["https://archive.apache.org/dist/zookeeper/zookeeper-3.4.14/zookeeper-3.4.14.tar.gz;],
+strip_prefix = "apache-zookeeper-3.5.8",
+urls = 
["https://archive.apache.org/dist/zookeeper/stable/apache-zookeeper-3.5.8.tar.gz;],
 )
 
 http_archive(
diff --git a/third_party/zookeeper/BUILD b/third_party/zookeeper/BUILD
index 00ec56d..f55b0e2 100644
--- a/third_party/zookeeper/BUILD
+++ b/third_party/zookeeper/BUILD
@@ -39,7 +39,9 @@ genrule(
 "export CFLAGS=-Wno-error",
 "mkdir -p $$TMP_DIR",
 "cp -R $$(pwd)/external/org_apache_zookeeper/* $$TMP_DIR",
-"cd $$TMP_DIR/zookeeper-client/zookeeper-client-c",
+"cd $$TMP_DIR",
+   "ant compile_jute",
+   "cd $$TMP_DIR/zookeeper-client/zookeeper-client-c",
 "autoreconf -if",
 "./configure --prefix=$$INSTALL_DIR --enable-shared=no",
 "make install",
diff --git a/third_party/zookeeper/pkgconfig.patch 
b/third_party/zookeeper/pkgconfig.patch
deleted file mode 100644
index 472fe6c..000
--- a/third_party/zookeeper/pkgconfig.patch
+++ /dev/null
@@ -1,12 +0,0 @@
-diff -Naur /tmp/zookeeper-client/zookeeper-client-c/configure.ac 
/tmp/zookeeper-client/zookeeper-client-c/configure.ac
 /tmp/zookeeper-client/zookeeper-client-c/configure.ac  2019-03-06 
16:50:47.0 +
-+++ /tmp/zookeeper-client/zookeeper-client-c/configure.ac  2020-04-04 
23:44:40.442252000 +
-@@ -34,7 +34,7 @@
-CPPUNIT_INCLUDE=
-CPPUNIT_LIBS=
- else
--   AM_PATH_CPPUNIT(1.10.2)
-+   PKG_CHECK_MODULES([CPPUNIT], [cppunit >= 1.10.2])
- fi
- 
- if test "$CALLER" = "ANT" ; then

[GitHub] [incubator-heron] nwangtw commented on issue #3554: Kubernetes Scheduler does not scale properly

[GitBox]

nwangtw commented on issue #3554:
URL: 
https://github.com/apache/incubator-heron/issues/3554#issuecomment-653135194


   Hmm. This is strange. It looks like a Json issue with 20 and a calculation
   issue with 5?
   
   On Thu, Jul 2, 2020 at 10:03 AM Nicholas Nezis 
   wrote:
   
   > *Describe the bug*
   > On the Heron 20 cluster, I'm unable to use the update command to increase
   > the parallelism of the FilterBolt
   >
   > heron update heron analytic-name --service-url  
--component-parallelism FilterBolt:20
   >
   > Error message is "json: cannot unmarshal object into Go value of type
   > jsonpatchPatch (edited)
   >
   > The command works fine with heron 17
   >
   > Interestingly if I submit the command with parallelism of 5, it tells me
   > that is the current parallelism. Its not, the gui reports a parallelism of
   > 10.
   >
   > *Expected behavior*
   > Heron UI should show proper parallelism value. Heron Kubernetes scheduler
   > should allow ability to scale components up/down.
   >
   > —
   > You are receiving this because you are subscribed to this thread.
   > Reply to this email directly, view it on GitHub
   > , or unsubscribe
   > 

   > .
   >
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [incubator-heron] nicknezis opened a new issue #3554: Kubernetes Scheduler does not scale properly

[GitBox]

nicknezis opened a new issue #3554:
URL: https://github.com/apache/incubator-heron/issues/3554


   **Describe the bug**
   On the Heron 20 cluster, I'm unable to use the update command to increase 
the parallelism of the FilterBolt
   
   ```
   heron update heron analytic-name --service-url  --component-parallelism 
FilterBolt:20
   ```
   
   Error message is "json: cannot unmarshal object into Go value of type 
jsonpatchPatch (edited) 
   
   The command works fine with heron 17
   
   Interestingly if I submit the command with parallelism of 5, it tells me 
that is the current parallelism. Its not, the gui reports a parallelism of 10.
   
   **Expected behavior**
   Heron UI should show proper parallelism value. Heron Kubernetes scheduler 
should allow ability to scale components up/down.
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org