[jira] [Updated] (STORM-3687) Add a warning about possible issues on a mixed cluster if the StormCommon.systemTopology implementation is changed
[
https://issues.apache.org/jira/browse/STORM-3687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ethan Li updated STORM-3687:
Issue Type: Comment (was: Task)
> Add a warning about possible issues on a mixed cluster if the
> StormCommon.systemTopology implementation is changed
> --
>
> Key: STORM-3687
> URL: https://issues.apache.org/jira/browse/STORM-3687
> Project: Apache Storm
> Issue Type: Comment
>Reporter: Ethan Li
>Assignee: Ethan Li
>Priority: Minor
> Fix For: 2.3.0
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> During rolling upgrade, some supervisors are still at 2.2, and others are
> running on 2.3. So some workers are running with storm-client-2.2.jar and
> others are on 2.3.
> Because of
> https://github.com/apache/storm/commit/93a7f770d508668bc7af183e08535813fff6f805
> (STORM-3660)
> the "_credentials" stream is removed.
> So the map of streamId to streamName for system component is changed
> refer to the code at:
> https://github.com/apache/storm/blob/v2.2.0/storm-client/src/jvm/org/apache/storm/serialization/SerializationFactory.java#L218-L222
> So a worker running on storm-client-2.2 might send out __metrics from its
> systembolt, while the MetricsConsumer running with storm-client-2.3
> interprets it as "__metrics_tick" because the mapping is different:
> {code:java}
> o.a.s.s.SerializationFactory Thread-15-__system-executor[-1, -1] [INFO] idmap
> for system comp {__tick=6, __system=5, __metrics_tick=4, __credentials=1,
> __flush=2, __metrics=3}
> {code}
> vs
> {code:java}
> o.a.s.s.SerializationFactory Netty-server-localhost-6703-worker-1 [INFO]
> idmap for system comp {__tick=5, __system=4, __metrics_tick=3, __flush=1,
> __metrics=2}
> {code}
> Hence we see
> {code:java}
> Caused by: java.lang.RuntimeException: java.lang.ClassCastException:
> org.apache.storm.metric.api.IMetricsConsumer$TaskInfo cannot be cast to
> java.lang.Integer
> at org.apache.storm.executor.Executor.accept(Executor.java:293)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.utils.JCQueue.consumeImpl(JCQueue.java:113)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.utils.JCQueue.consume(JCQueue.java:89)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at
> org.apache.storm.executor.bolt.BoltExecutor$1.call(BoltExecutor.java:167)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at
> org.apache.storm.executor.bolt.BoltExecutor$1.call(BoltExecutor.java:153)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.utils.Utils$1.run(Utils.java:398)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> ... 1 more
> Caused by: java.lang.ClassCastException:
> org.apache.storm.metric.api.IMetricsConsumer$TaskInfo cannot be cast to
> java.lang.Integer
> at org.apache.storm.tuple.TupleImpl.getInteger(TupleImpl.java:121)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.executor.Executor.metricsTick(Executor.java:320)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at
> org.apache.storm.executor.bolt.BoltExecutor.tupleActionFn(BoltExecutor.java:213)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.executor.Executor.accept(Executor.java:286)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.utils.JCQueue.consumeImpl(JCQueue.java:113)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.utils.JCQueue.consume(JCQueue.java:89)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at
> org.apache.storm.executor.bolt.BoltExecutor$1.call(BoltExecutor.java:167)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at
> org.apache.storm.executor.bolt.BoltExecutor$1.call(BoltExecutor.java:153)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.utils.Utils$1.run(Utils.java:398)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> ... 1 more
> 2020-08-04 18:26:08.017 o.a.s.m.c
> 2020-08-04 18:26:08.027 o.a.s.u.Utils
> Thread-19-__metrics_org.apache.storm.metric.LoggingMetricsConsumer-executor[1555,
> 1555] [ERROR] Halting process: Worker died
> java.lang.RuntimeException: Halting process: Worker died
> at org.apache.storm.utils.Utils.exitProcess(Utils.java:518)
> [storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.utils.Utils$3.run(Utils.java:870)
> [storm-client-2.3.0.y.jar:2.3.0.y]
> at
> org.apache.storm.executor.error.ReportErrorAndDie.uncaughtException(ReportErrorAndDie.java:41)
> [storm-client-2.3.0.y.jar:2.3.0.y]
> at java.lang.Thread.dispatchUncaughtException(Thread.java:1959)
> [?:1.8.0_242]
> 2020-08-04 18:26:08.027 o.a.s.u.Utils
> Thread-18-__metrics_org.apache.storm.metric.LoggingMetricsConsumer-executor[1553,
> 1553] [ERROR] Halting
[jira] [Commented] (STORM-3687) Add a warning about possible issues on a mixed cluster if the StormCommon.systemTopology implementation is changed
[
https://issues.apache.org/jira/browse/STORM-3687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17172024#comment-17172024
]
Ethan Li commented on STORM-3687:
-
Merged to master (c9276d228426ba076e9a4690998ab9c4570e16f2)
> Add a warning about possible issues on a mixed cluster if the
> StormCommon.systemTopology implementation is changed
> --
>
> Key: STORM-3687
> URL: https://issues.apache.org/jira/browse/STORM-3687
> Project: Apache Storm
> Issue Type: Task
>Reporter: Ethan Li
>Priority: Minor
> Fix For: 2.3.0
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> During rolling upgrade, some supervisors are still at 2.2, and others are
> running on 2.3. So some workers are running with storm-client-2.2.jar and
> others are on 2.3.
> Because of
> https://github.com/apache/storm/commit/93a7f770d508668bc7af183e08535813fff6f805
> (STORM-3660)
> the "_credentials" stream is removed.
> So the map of streamId to streamName for system component is changed
> refer to the code at:
> https://github.com/apache/storm/blob/v2.2.0/storm-client/src/jvm/org/apache/storm/serialization/SerializationFactory.java#L218-L222
> So a worker running on storm-client-2.2 might send out __metrics from its
> systembolt, while the MetricsConsumer running with storm-client-2.3
> interprets it as "__metrics_tick" because the mapping is different:
> {code:java}
> o.a.s.s.SerializationFactory Thread-15-__system-executor[-1, -1] [INFO] idmap
> for system comp {__tick=6, __system=5, __metrics_tick=4, __credentials=1,
> __flush=2, __metrics=3}
> {code}
> vs
> {code:java}
> o.a.s.s.SerializationFactory Netty-server-localhost-6703-worker-1 [INFO]
> idmap for system comp {__tick=5, __system=4, __metrics_tick=3, __flush=1,
> __metrics=2}
> {code}
> Hence we see
> {code:java}
> Caused by: java.lang.RuntimeException: java.lang.ClassCastException:
> org.apache.storm.metric.api.IMetricsConsumer$TaskInfo cannot be cast to
> java.lang.Integer
> at org.apache.storm.executor.Executor.accept(Executor.java:293)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.utils.JCQueue.consumeImpl(JCQueue.java:113)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.utils.JCQueue.consume(JCQueue.java:89)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at
> org.apache.storm.executor.bolt.BoltExecutor$1.call(BoltExecutor.java:167)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at
> org.apache.storm.executor.bolt.BoltExecutor$1.call(BoltExecutor.java:153)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.utils.Utils$1.run(Utils.java:398)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> ... 1 more
> Caused by: java.lang.ClassCastException:
> org.apache.storm.metric.api.IMetricsConsumer$TaskInfo cannot be cast to
> java.lang.Integer
> at org.apache.storm.tuple.TupleImpl.getInteger(TupleImpl.java:121)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.executor.Executor.metricsTick(Executor.java:320)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at
> org.apache.storm.executor.bolt.BoltExecutor.tupleActionFn(BoltExecutor.java:213)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.executor.Executor.accept(Executor.java:286)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.utils.JCQueue.consumeImpl(JCQueue.java:113)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.utils.JCQueue.consume(JCQueue.java:89)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at
> org.apache.storm.executor.bolt.BoltExecutor$1.call(BoltExecutor.java:167)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at
> org.apache.storm.executor.bolt.BoltExecutor$1.call(BoltExecutor.java:153)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.utils.Utils$1.run(Utils.java:398)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> ... 1 more
> 2020-08-04 18:26:08.017 o.a.s.m.c
> 2020-08-04 18:26:08.027 o.a.s.u.Utils
> Thread-19-__metrics_org.apache.storm.metric.LoggingMetricsConsumer-executor[1555,
> 1555] [ERROR] Halting process: Worker died
> java.lang.RuntimeException: Halting process: Worker died
> at org.apache.storm.utils.Utils.exitProcess(Utils.java:518)
> [storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.utils.Utils$3.run(Utils.java:870)
> [storm-client-2.3.0.y.jar:2.3.0.y]
> at
> org.apache.storm.executor.error.ReportErrorAndDie.uncaughtException(ReportErrorAndDie.java:41)
> [storm-client-2.3.0.y.jar:2.3.0.y]
> at java.lang.Thread.dispatchUncaughtException(Thread.java:1959)
> [?:1.8.0_242]
> 2020-08-04 18:26:08.027 o.a.s.u.Utils
>
[jira] [Resolved] (STORM-3687) Add a warning about possible issues on a mixed cluster if the StormCommon.systemTopology implementation is changed
[
https://issues.apache.org/jira/browse/STORM-3687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ethan Li resolved STORM-3687.
-
Fix Version/s: 2.3.0
Resolution: Fixed
> Add a warning about possible issues on a mixed cluster if the
> StormCommon.systemTopology implementation is changed
> --
>
> Key: STORM-3687
> URL: https://issues.apache.org/jira/browse/STORM-3687
> Project: Apache Storm
> Issue Type: Task
>Reporter: Ethan Li
>Priority: Minor
> Fix For: 2.3.0
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> During rolling upgrade, some supervisors are still at 2.2, and others are
> running on 2.3. So some workers are running with storm-client-2.2.jar and
> others are on 2.3.
> Because of
> https://github.com/apache/storm/commit/93a7f770d508668bc7af183e08535813fff6f805
> (STORM-3660)
> the "_credentials" stream is removed.
> So the map of streamId to streamName for system component is changed
> refer to the code at:
> https://github.com/apache/storm/blob/v2.2.0/storm-client/src/jvm/org/apache/storm/serialization/SerializationFactory.java#L218-L222
> So a worker running on storm-client-2.2 might send out __metrics from its
> systembolt, while the MetricsConsumer running with storm-client-2.3
> interprets it as "__metrics_tick" because the mapping is different:
> {code:java}
> o.a.s.s.SerializationFactory Thread-15-__system-executor[-1, -1] [INFO] idmap
> for system comp {__tick=6, __system=5, __metrics_tick=4, __credentials=1,
> __flush=2, __metrics=3}
> {code}
> vs
> {code:java}
> o.a.s.s.SerializationFactory Netty-server-localhost-6703-worker-1 [INFO]
> idmap for system comp {__tick=5, __system=4, __metrics_tick=3, __flush=1,
> __metrics=2}
> {code}
> Hence we see
> {code:java}
> Caused by: java.lang.RuntimeException: java.lang.ClassCastException:
> org.apache.storm.metric.api.IMetricsConsumer$TaskInfo cannot be cast to
> java.lang.Integer
> at org.apache.storm.executor.Executor.accept(Executor.java:293)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.utils.JCQueue.consumeImpl(JCQueue.java:113)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.utils.JCQueue.consume(JCQueue.java:89)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at
> org.apache.storm.executor.bolt.BoltExecutor$1.call(BoltExecutor.java:167)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at
> org.apache.storm.executor.bolt.BoltExecutor$1.call(BoltExecutor.java:153)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.utils.Utils$1.run(Utils.java:398)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> ... 1 more
> Caused by: java.lang.ClassCastException:
> org.apache.storm.metric.api.IMetricsConsumer$TaskInfo cannot be cast to
> java.lang.Integer
> at org.apache.storm.tuple.TupleImpl.getInteger(TupleImpl.java:121)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.executor.Executor.metricsTick(Executor.java:320)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at
> org.apache.storm.executor.bolt.BoltExecutor.tupleActionFn(BoltExecutor.java:213)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.executor.Executor.accept(Executor.java:286)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.utils.JCQueue.consumeImpl(JCQueue.java:113)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.utils.JCQueue.consume(JCQueue.java:89)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at
> org.apache.storm.executor.bolt.BoltExecutor$1.call(BoltExecutor.java:167)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at
> org.apache.storm.executor.bolt.BoltExecutor$1.call(BoltExecutor.java:153)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.utils.Utils$1.run(Utils.java:398)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> ... 1 more
> 2020-08-04 18:26:08.017 o.a.s.m.c
> 2020-08-04 18:26:08.027 o.a.s.u.Utils
> Thread-19-__metrics_org.apache.storm.metric.LoggingMetricsConsumer-executor[1555,
> 1555] [ERROR] Halting process: Worker died
> java.lang.RuntimeException: Halting process: Worker died
> at org.apache.storm.utils.Utils.exitProcess(Utils.java:518)
> [storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.utils.Utils$3.run(Utils.java:870)
> [storm-client-2.3.0.y.jar:2.3.0.y]
> at
> org.apache.storm.executor.error.ReportErrorAndDie.uncaughtException(ReportErrorAndDie.java:41)
> [storm-client-2.3.0.y.jar:2.3.0.y]
> at java.lang.Thread.dispatchUncaughtException(Thread.java:1959)
> [?:1.8.0_242]
> 2020-08-04 18:26:08.027 o.a.s.u.Utils
> Thread-18-__metrics_org.apache.storm.metric.LoggingMetricsConsumer-executor[1553,
> 1553] [ERROR] Halting process: Worker died
[jira] [Assigned] (STORM-3687) Add a warning about possible issues on a mixed cluster if the StormCommon.systemTopology implementation is changed
[
https://issues.apache.org/jira/browse/STORM-3687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ethan Li reassigned STORM-3687:
---
Assignee: Ethan Li
> Add a warning about possible issues on a mixed cluster if the
> StormCommon.systemTopology implementation is changed
> --
>
> Key: STORM-3687
> URL: https://issues.apache.org/jira/browse/STORM-3687
> Project: Apache Storm
> Issue Type: Task
>Reporter: Ethan Li
>Assignee: Ethan Li
>Priority: Minor
> Fix For: 2.3.0
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> During rolling upgrade, some supervisors are still at 2.2, and others are
> running on 2.3. So some workers are running with storm-client-2.2.jar and
> others are on 2.3.
> Because of
> https://github.com/apache/storm/commit/93a7f770d508668bc7af183e08535813fff6f805
> (STORM-3660)
> the "_credentials" stream is removed.
> So the map of streamId to streamName for system component is changed
> refer to the code at:
> https://github.com/apache/storm/blob/v2.2.0/storm-client/src/jvm/org/apache/storm/serialization/SerializationFactory.java#L218-L222
> So a worker running on storm-client-2.2 might send out __metrics from its
> systembolt, while the MetricsConsumer running with storm-client-2.3
> interprets it as "__metrics_tick" because the mapping is different:
> {code:java}
> o.a.s.s.SerializationFactory Thread-15-__system-executor[-1, -1] [INFO] idmap
> for system comp {__tick=6, __system=5, __metrics_tick=4, __credentials=1,
> __flush=2, __metrics=3}
> {code}
> vs
> {code:java}
> o.a.s.s.SerializationFactory Netty-server-localhost-6703-worker-1 [INFO]
> idmap for system comp {__tick=5, __system=4, __metrics_tick=3, __flush=1,
> __metrics=2}
> {code}
> Hence we see
> {code:java}
> Caused by: java.lang.RuntimeException: java.lang.ClassCastException:
> org.apache.storm.metric.api.IMetricsConsumer$TaskInfo cannot be cast to
> java.lang.Integer
> at org.apache.storm.executor.Executor.accept(Executor.java:293)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.utils.JCQueue.consumeImpl(JCQueue.java:113)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.utils.JCQueue.consume(JCQueue.java:89)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at
> org.apache.storm.executor.bolt.BoltExecutor$1.call(BoltExecutor.java:167)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at
> org.apache.storm.executor.bolt.BoltExecutor$1.call(BoltExecutor.java:153)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.utils.Utils$1.run(Utils.java:398)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> ... 1 more
> Caused by: java.lang.ClassCastException:
> org.apache.storm.metric.api.IMetricsConsumer$TaskInfo cannot be cast to
> java.lang.Integer
> at org.apache.storm.tuple.TupleImpl.getInteger(TupleImpl.java:121)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.executor.Executor.metricsTick(Executor.java:320)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at
> org.apache.storm.executor.bolt.BoltExecutor.tupleActionFn(BoltExecutor.java:213)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.executor.Executor.accept(Executor.java:286)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.utils.JCQueue.consumeImpl(JCQueue.java:113)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.utils.JCQueue.consume(JCQueue.java:89)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at
> org.apache.storm.executor.bolt.BoltExecutor$1.call(BoltExecutor.java:167)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at
> org.apache.storm.executor.bolt.BoltExecutor$1.call(BoltExecutor.java:153)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.utils.Utils$1.run(Utils.java:398)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> ... 1 more
> 2020-08-04 18:26:08.017 o.a.s.m.c
> 2020-08-04 18:26:08.027 o.a.s.u.Utils
> Thread-19-__metrics_org.apache.storm.metric.LoggingMetricsConsumer-executor[1555,
> 1555] [ERROR] Halting process: Worker died
> java.lang.RuntimeException: Halting process: Worker died
> at org.apache.storm.utils.Utils.exitProcess(Utils.java:518)
> [storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.utils.Utils$3.run(Utils.java:870)
> [storm-client-2.3.0.y.jar:2.3.0.y]
> at
> org.apache.storm.executor.error.ReportErrorAndDie.uncaughtException(ReportErrorAndDie.java:41)
> [storm-client-2.3.0.y.jar:2.3.0.y]
> at java.lang.Thread.dispatchUncaughtException(Thread.java:1959)
> [?:1.8.0_242]
> 2020-08-04 18:26:08.027 o.a.s.u.Utils
> Thread-18-__metrics_org.apache.storm.metric.LoggingMetricsConsumer-executor[1553,
> 1553] [ERROR] Halting process:
[jira] [Updated] (STORM-3687) Add a warning about possible issues on a mixed cluster if the StormCommon.systemTopology implementation is changed
[
https://issues.apache.org/jira/browse/STORM-3687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ethan Li updated STORM-3687:
Summary: Add a warning about possible issues on a mixed cluster if the
StormCommon.systemTopology implementation is changed (was: MetricsConsumer has
ClassCastException on a mixed cluster)
> Add a warning about possible issues on a mixed cluster if the
> StormCommon.systemTopology implementation is changed
> --
>
> Key: STORM-3687
> URL: https://issues.apache.org/jira/browse/STORM-3687
> Project: Apache Storm
> Issue Type: Bug
>Reporter: Ethan Li
>Priority: Minor
> Time Spent: 20m
> Remaining Estimate: 0h
>
> During rolling upgrade, some supervisors are still at 2.2, and others are
> running on 2.3. So some workers are running with storm-client-2.2.jar and
> others are on 2.3.
> Because of
> https://github.com/apache/storm/commit/93a7f770d508668bc7af183e08535813fff6f805
> (STORM-3660)
> the "_credentials" stream is removed.
> So the map of streamId to streamName for system component is changed
> refer to the code at:
> https://github.com/apache/storm/blob/v2.2.0/storm-client/src/jvm/org/apache/storm/serialization/SerializationFactory.java#L218-L222
> So a worker running on storm-client-2.2 might send out __metrics from its
> systembolt, while the MetricsConsumer running with storm-client-2.3
> interprets it as "__metrics_tick" because the mapping is different:
> {code:java}
> o.a.s.s.SerializationFactory Thread-15-__system-executor[-1, -1] [INFO] idmap
> for system comp {__tick=6, __system=5, __metrics_tick=4, __credentials=1,
> __flush=2, __metrics=3}
> {code}
> vs
> {code:java}
> o.a.s.s.SerializationFactory Netty-server-localhost-6703-worker-1 [INFO]
> idmap for system comp {__tick=5, __system=4, __metrics_tick=3, __flush=1,
> __metrics=2}
> {code}
> Hence we see
> {code:java}
> Caused by: java.lang.RuntimeException: java.lang.ClassCastException:
> org.apache.storm.metric.api.IMetricsConsumer$TaskInfo cannot be cast to
> java.lang.Integer
> at org.apache.storm.executor.Executor.accept(Executor.java:293)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.utils.JCQueue.consumeImpl(JCQueue.java:113)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.utils.JCQueue.consume(JCQueue.java:89)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at
> org.apache.storm.executor.bolt.BoltExecutor$1.call(BoltExecutor.java:167)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at
> org.apache.storm.executor.bolt.BoltExecutor$1.call(BoltExecutor.java:153)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.utils.Utils$1.run(Utils.java:398)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> ... 1 more
> Caused by: java.lang.ClassCastException:
> org.apache.storm.metric.api.IMetricsConsumer$TaskInfo cannot be cast to
> java.lang.Integer
> at org.apache.storm.tuple.TupleImpl.getInteger(TupleImpl.java:121)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.executor.Executor.metricsTick(Executor.java:320)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at
> org.apache.storm.executor.bolt.BoltExecutor.tupleActionFn(BoltExecutor.java:213)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.executor.Executor.accept(Executor.java:286)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.utils.JCQueue.consumeImpl(JCQueue.java:113)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.utils.JCQueue.consume(JCQueue.java:89)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at
> org.apache.storm.executor.bolt.BoltExecutor$1.call(BoltExecutor.java:167)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at
> org.apache.storm.executor.bolt.BoltExecutor$1.call(BoltExecutor.java:153)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.utils.Utils$1.run(Utils.java:398)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> ... 1 more
> 2020-08-04 18:26:08.017 o.a.s.m.c
> 2020-08-04 18:26:08.027 o.a.s.u.Utils
> Thread-19-__metrics_org.apache.storm.metric.LoggingMetricsConsumer-executor[1555,
> 1555] [ERROR] Halting process: Worker died
> java.lang.RuntimeException: Halting process: Worker died
> at org.apache.storm.utils.Utils.exitProcess(Utils.java:518)
> [storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.utils.Utils$3.run(Utils.java:870)
> [storm-client-2.3.0.y.jar:2.3.0.y]
> at
> org.apache.storm.executor.error.ReportErrorAndDie.uncaughtException(ReportErrorAndDie.java:41)
> [storm-client-2.3.0.y.jar:2.3.0.y]
> at java.lang.Thread.dispatchUncaughtException(Thread.java:1959)
> [?:1.8.0_242]
> 2020-08-04 18:26:08.027 o.a.s.u.Utils
>
[jira] [Updated] (STORM-3687) Add a warning about possible issues on a mixed cluster if the StormCommon.systemTopology implementation is changed
[
https://issues.apache.org/jira/browse/STORM-3687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ethan Li updated STORM-3687:
Issue Type: Task (was: Bug)
> Add a warning about possible issues on a mixed cluster if the
> StormCommon.systemTopology implementation is changed
> --
>
> Key: STORM-3687
> URL: https://issues.apache.org/jira/browse/STORM-3687
> Project: Apache Storm
> Issue Type: Task
>Reporter: Ethan Li
>Priority: Minor
> Time Spent: 20m
> Remaining Estimate: 0h
>
> During rolling upgrade, some supervisors are still at 2.2, and others are
> running on 2.3. So some workers are running with storm-client-2.2.jar and
> others are on 2.3.
> Because of
> https://github.com/apache/storm/commit/93a7f770d508668bc7af183e08535813fff6f805
> (STORM-3660)
> the "_credentials" stream is removed.
> So the map of streamId to streamName for system component is changed
> refer to the code at:
> https://github.com/apache/storm/blob/v2.2.0/storm-client/src/jvm/org/apache/storm/serialization/SerializationFactory.java#L218-L222
> So a worker running on storm-client-2.2 might send out __metrics from its
> systembolt, while the MetricsConsumer running with storm-client-2.3
> interprets it as "__metrics_tick" because the mapping is different:
> {code:java}
> o.a.s.s.SerializationFactory Thread-15-__system-executor[-1, -1] [INFO] idmap
> for system comp {__tick=6, __system=5, __metrics_tick=4, __credentials=1,
> __flush=2, __metrics=3}
> {code}
> vs
> {code:java}
> o.a.s.s.SerializationFactory Netty-server-localhost-6703-worker-1 [INFO]
> idmap for system comp {__tick=5, __system=4, __metrics_tick=3, __flush=1,
> __metrics=2}
> {code}
> Hence we see
> {code:java}
> Caused by: java.lang.RuntimeException: java.lang.ClassCastException:
> org.apache.storm.metric.api.IMetricsConsumer$TaskInfo cannot be cast to
> java.lang.Integer
> at org.apache.storm.executor.Executor.accept(Executor.java:293)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.utils.JCQueue.consumeImpl(JCQueue.java:113)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.utils.JCQueue.consume(JCQueue.java:89)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at
> org.apache.storm.executor.bolt.BoltExecutor$1.call(BoltExecutor.java:167)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at
> org.apache.storm.executor.bolt.BoltExecutor$1.call(BoltExecutor.java:153)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.utils.Utils$1.run(Utils.java:398)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> ... 1 more
> Caused by: java.lang.ClassCastException:
> org.apache.storm.metric.api.IMetricsConsumer$TaskInfo cannot be cast to
> java.lang.Integer
> at org.apache.storm.tuple.TupleImpl.getInteger(TupleImpl.java:121)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.executor.Executor.metricsTick(Executor.java:320)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at
> org.apache.storm.executor.bolt.BoltExecutor.tupleActionFn(BoltExecutor.java:213)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.executor.Executor.accept(Executor.java:286)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.utils.JCQueue.consumeImpl(JCQueue.java:113)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.utils.JCQueue.consume(JCQueue.java:89)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at
> org.apache.storm.executor.bolt.BoltExecutor$1.call(BoltExecutor.java:167)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at
> org.apache.storm.executor.bolt.BoltExecutor$1.call(BoltExecutor.java:153)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.utils.Utils$1.run(Utils.java:398)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> ... 1 more
> 2020-08-04 18:26:08.017 o.a.s.m.c
> 2020-08-04 18:26:08.027 o.a.s.u.Utils
> Thread-19-__metrics_org.apache.storm.metric.LoggingMetricsConsumer-executor[1555,
> 1555] [ERROR] Halting process: Worker died
> java.lang.RuntimeException: Halting process: Worker died
> at org.apache.storm.utils.Utils.exitProcess(Utils.java:518)
> [storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.utils.Utils$3.run(Utils.java:870)
> [storm-client-2.3.0.y.jar:2.3.0.y]
> at
> org.apache.storm.executor.error.ReportErrorAndDie.uncaughtException(ReportErrorAndDie.java:41)
> [storm-client-2.3.0.y.jar:2.3.0.y]
> at java.lang.Thread.dispatchUncaughtException(Thread.java:1959)
> [?:1.8.0_242]
> 2020-08-04 18:26:08.027 o.a.s.u.Utils
> Thread-18-__metrics_org.apache.storm.metric.LoggingMetricsConsumer-executor[1553,
> 1553] [ERROR] Halting process: Worker died
> java.lang.RuntimeException: Halting process:
[jira] [Updated] (STORM-3687) MetricsConsumer has ClassCastException on a mixed cluster
[
https://issues.apache.org/jira/browse/STORM-3687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ethan Li updated STORM-3687:
Priority: Minor (was: Major)
> MetricsConsumer has ClassCastException on a mixed cluster
> -
>
> Key: STORM-3687
> URL: https://issues.apache.org/jira/browse/STORM-3687
> Project: Apache Storm
> Issue Type: Bug
>Reporter: Ethan Li
>Priority: Minor
> Time Spent: 10m
> Remaining Estimate: 0h
>
> During rolling upgrade, some supervisors are still at 2.2, and others are
> running on 2.3. So some workers are running with storm-client-2.2.jar and
> others are on 2.3.
> Because of
> https://github.com/apache/storm/commit/93a7f770d508668bc7af183e08535813fff6f805
> (STORM-3660)
> the "_credentials" stream is removed.
> So the map of streamId to streamName for system component is changed
> refer to the code at:
> https://github.com/apache/storm/blob/v2.2.0/storm-client/src/jvm/org/apache/storm/serialization/SerializationFactory.java#L218-L222
> So a worker running on storm-client-2.2 might send out __metrics from its
> systembolt, while the MetricsConsumer running with storm-client-2.3
> interprets it as "__metrics_tick" because the mapping is different:
> {code:java}
> o.a.s.s.SerializationFactory Thread-15-__system-executor[-1, -1] [INFO] idmap
> for system comp {__tick=6, __system=5, __metrics_tick=4, __credentials=1,
> __flush=2, __metrics=3}
> {code}
> vs
> {code:java}
> o.a.s.s.SerializationFactory Netty-server-localhost-6703-worker-1 [INFO]
> idmap for system comp {__tick=5, __system=4, __metrics_tick=3, __flush=1,
> __metrics=2}
> {code}
> Hence we see
> {code:java}
> Caused by: java.lang.RuntimeException: java.lang.ClassCastException:
> org.apache.storm.metric.api.IMetricsConsumer$TaskInfo cannot be cast to
> java.lang.Integer
> at org.apache.storm.executor.Executor.accept(Executor.java:293)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.utils.JCQueue.consumeImpl(JCQueue.java:113)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.utils.JCQueue.consume(JCQueue.java:89)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at
> org.apache.storm.executor.bolt.BoltExecutor$1.call(BoltExecutor.java:167)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at
> org.apache.storm.executor.bolt.BoltExecutor$1.call(BoltExecutor.java:153)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.utils.Utils$1.run(Utils.java:398)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> ... 1 more
> Caused by: java.lang.ClassCastException:
> org.apache.storm.metric.api.IMetricsConsumer$TaskInfo cannot be cast to
> java.lang.Integer
> at org.apache.storm.tuple.TupleImpl.getInteger(TupleImpl.java:121)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.executor.Executor.metricsTick(Executor.java:320)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at
> org.apache.storm.executor.bolt.BoltExecutor.tupleActionFn(BoltExecutor.java:213)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.executor.Executor.accept(Executor.java:286)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.utils.JCQueue.consumeImpl(JCQueue.java:113)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.utils.JCQueue.consume(JCQueue.java:89)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at
> org.apache.storm.executor.bolt.BoltExecutor$1.call(BoltExecutor.java:167)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at
> org.apache.storm.executor.bolt.BoltExecutor$1.call(BoltExecutor.java:153)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.utils.Utils$1.run(Utils.java:398)
> ~[storm-client-2.3.0.y.jar:2.3.0.y]
> ... 1 more
> 2020-08-04 18:26:08.017 o.a.s.m.c
> 2020-08-04 18:26:08.027 o.a.s.u.Utils
> Thread-19-__metrics_org.apache.storm.metric.LoggingMetricsConsumer-executor[1555,
> 1555] [ERROR] Halting process: Worker died
> java.lang.RuntimeException: Halting process: Worker died
> at org.apache.storm.utils.Utils.exitProcess(Utils.java:518)
> [storm-client-2.3.0.y.jar:2.3.0.y]
> at org.apache.storm.utils.Utils$3.run(Utils.java:870)
> [storm-client-2.3.0.y.jar:2.3.0.y]
> at
> org.apache.storm.executor.error.ReportErrorAndDie.uncaughtException(ReportErrorAndDie.java:41)
> [storm-client-2.3.0.y.jar:2.3.0.y]
> at java.lang.Thread.dispatchUncaughtException(Thread.java:1959)
> [?:1.8.0_242]
> 2020-08-04 18:26:08.027 o.a.s.u.Utils
> Thread-18-__metrics_org.apache.storm.metric.LoggingMetricsConsumer-executor[1553,
> 1553] [ERROR] Halting process: Worker died
> java.lang.RuntimeException: Halting process: Worker died
> at org.apache.storm.utils.Utils.exitProcess(Utils.java:518)
> [storm-client-2.3.0.y.jar:2.3.0.y]
[jira] [Created] (STORM-3687) MetricsConsumer has ClassCastException on a mixed cluster
Ethan Li created STORM-3687:
---
Summary: MetricsConsumer has ClassCastException on a mixed cluster
Key: STORM-3687
URL: https://issues.apache.org/jira/browse/STORM-3687
Project: Apache Storm
Issue Type: Bug
Reporter: Ethan Li
During rolling upgrade, some supervisors are still at 2.2, and others are
running on 2.3. So some workers are running with storm-client-2.2.jar and
others are on 2.3.
Because of
https://github.com/apache/storm/commit/93a7f770d508668bc7af183e08535813fff6f805
(STORM-3660)
the "_credentials" stream is removed.
So the map of streamId to streamName for system component is changed
refer to the code at:
https://github.com/apache/storm/blob/v2.2.0/storm-client/src/jvm/org/apache/storm/serialization/SerializationFactory.java#L218-L222
So a worker running on storm-client-2.2 might send out __metrics from its
systembolt, while the MetricsConsumer running with storm-client-2.3 interprets
it as "__metrics_tick" because the mapping is different:
{code:java}
o.a.s.s.SerializationFactory Thread-15-__system-executor[-1, -1] [INFO] idmap
for system comp {__tick=6, __system=5, __metrics_tick=4, __credentials=1,
__flush=2, __metrics=3}
{code}
vs
{code:java}
o.a.s.s.SerializationFactory Netty-server-localhost-6703-worker-1 [INFO] idmap
for system comp {__tick=5, __system=4, __metrics_tick=3, __flush=1, __metrics=2}
{code}
Hence we see
{code:java}
Caused by: java.lang.RuntimeException: java.lang.ClassCastException:
org.apache.storm.metric.api.IMetricsConsumer$TaskInfo cannot be cast to
java.lang.Integer
at org.apache.storm.executor.Executor.accept(Executor.java:293)
~[storm-client-2.3.0.y.jar:2.3.0.y]
at org.apache.storm.utils.JCQueue.consumeImpl(JCQueue.java:113)
~[storm-client-2.3.0.y.jar:2.3.0.y]
at org.apache.storm.utils.JCQueue.consume(JCQueue.java:89)
~[storm-client-2.3.0.y.jar:2.3.0.y]
at
org.apache.storm.executor.bolt.BoltExecutor$1.call(BoltExecutor.java:167)
~[storm-client-2.3.0.y.jar:2.3.0.y]
at
org.apache.storm.executor.bolt.BoltExecutor$1.call(BoltExecutor.java:153)
~[storm-client-2.3.0.y.jar:2.3.0.y]
at org.apache.storm.utils.Utils$1.run(Utils.java:398)
~[storm-client-2.3.0.y.jar:2.3.0.y]
... 1 more
Caused by: java.lang.ClassCastException:
org.apache.storm.metric.api.IMetricsConsumer$TaskInfo cannot be cast to
java.lang.Integer
at org.apache.storm.tuple.TupleImpl.getInteger(TupleImpl.java:121)
~[storm-client-2.3.0.y.jar:2.3.0.y]
at org.apache.storm.executor.Executor.metricsTick(Executor.java:320)
~[storm-client-2.3.0.y.jar:2.3.0.y]
at
org.apache.storm.executor.bolt.BoltExecutor.tupleActionFn(BoltExecutor.java:213)
~[storm-client-2.3.0.y.jar:2.3.0.y]
at org.apache.storm.executor.Executor.accept(Executor.java:286)
~[storm-client-2.3.0.y.jar:2.3.0.y]
at org.apache.storm.utils.JCQueue.consumeImpl(JCQueue.java:113)
~[storm-client-2.3.0.y.jar:2.3.0.y]
at org.apache.storm.utils.JCQueue.consume(JCQueue.java:89)
~[storm-client-2.3.0.y.jar:2.3.0.y]
at
org.apache.storm.executor.bolt.BoltExecutor$1.call(BoltExecutor.java:167)
~[storm-client-2.3.0.y.jar:2.3.0.y]
at
org.apache.storm.executor.bolt.BoltExecutor$1.call(BoltExecutor.java:153)
~[storm-client-2.3.0.y.jar:2.3.0.y]
at org.apache.storm.utils.Utils$1.run(Utils.java:398)
~[storm-client-2.3.0.y.jar:2.3.0.y]
... 1 more
2020-08-04 18:26:08.017 o.a.s.m.c
2020-08-04 18:26:08.027 o.a.s.u.Utils
Thread-19-__metrics_org.apache.storm.metric.LoggingMetricsConsumer-executor[1555,
1555] [ERROR] Halting process: Worker died
java.lang.RuntimeException: Halting process: Worker died
at org.apache.storm.utils.Utils.exitProcess(Utils.java:518)
[storm-client-2.3.0.y.jar:2.3.0.y]
at org.apache.storm.utils.Utils$3.run(Utils.java:870)
[storm-client-2.3.0.y.jar:2.3.0.y]
at
org.apache.storm.executor.error.ReportErrorAndDie.uncaughtException(ReportErrorAndDie.java:41)
[storm-client-2.3.0.y.jar:2.3.0.y]
at java.lang.Thread.dispatchUncaughtException(Thread.java:1959)
[?:1.8.0_242]
2020-08-04 18:26:08.027 o.a.s.u.Utils
Thread-18-__metrics_org.apache.storm.metric.LoggingMetricsConsumer-executor[1553,
1553] [ERROR] Halting process: Worker died
java.lang.RuntimeException: Halting process: Worker died
at org.apache.storm.utils.Utils.exitProcess(Utils.java:518)
[storm-client-2.3.0.y.jar:2.3.0.y]
at org.apache.storm.utils.Utils$3.run(Utils.java:870)
[storm-client-2.3.0.y.jar:2.3.0.y]
at
org.apache.storm.executor.error.ReportErrorAndDie.uncaughtException(ReportErrorAndDie.java:41)
[storm-client-2.3.0.y.jar:2.3.0.y]
at java.lang.Thread.dispatchUncaughtException(Thread.java:1959)
[?:1.8.0_242]
2020-08-04 18:26:08.028 o.a.s.u.Utils ShutdownHook-sleepKill-3s [INFO] Halting
after 3 seconds
{code}
Since mixed cluster is
[jira] [Updated] (STORM-3674) explicitly specify pip2 and pip3 in travis-install.sh
[
https://issues.apache.org/jira/browse/STORM-3674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ethan Li updated STORM-3674:
Fix Version/s: 2.3.0
> explicitly specify pip2 and pip3 in travis-install.sh
> -
>
> Key: STORM-3674
> URL: https://issues.apache.org/jira/browse/STORM-3674
> Project: Apache Storm
> Issue Type: Sub-task
>Reporter: liusheng
>Assignee: liusheng
>Priority: Major
> Fix For: 2.3.0
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> When I try to run Storm tests in Travis ARM containers, it will raise error
> about python packages installation, because in Travis ARM containers, the
> "pip" command refer to pip3 binary, so the following commands in
> travis-install.sh will not install required packages of Python2.
> {code:java}
> pip install --user -r ${TRAVIS_SCRIPT_DIR}/requirements.txt
> pip3 install --user -r ${TRAVIS_SCRIPT_DIR}/requirements.txt
> {code}
> it is better to explicitly specify pip2 and pip3 in the script.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Resolved] (STORM-3681) Enable basic Travis ARM CI job
[ https://issues.apache.org/jira/browse/STORM-3681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Li resolved STORM-3681. - Fix Version/s: 2.3.0 Resolution: Fixed Thanks [~seanlau]. I merged this to master (9986a335584d322f6cf632bcc8326f974583ece1) > Enable basic Travis ARM CI job > -- > > Key: STORM-3681 > URL: https://issues.apache.org/jira/browse/STORM-3681 > Project: Apache Storm > Issue Type: Sub-task >Reporter: liusheng >Assignee: liusheng >Priority: Major > Fix For: 2.3.0 > > Time Spent: 1h 20m > Remaining Estimate: 0h > > Until now, we have tried many times about adding Travis ARM CI jobs for > Storm, and have made some small fixes. For Storm itself, we have tested > building and running tests, it looks there isn't any block issue for ARM64 > platform. But in my testing, the Travis CI system seems have some problems > about supporting ARM, there are some existed issues in Travis community about > this, for example: > # ARM CI job hang no reason: > [https://travis-ci.community/t/output-is-truncated-heavily-in-arm64-when-a-command-hangs/7630] > # Disk quota exceeded in ARM CI job: > [https://travis-ci.community/t/disk-quota-exceeded-on-ppc64le/8006/4] > But it is OK to enable basic ARM CI just like *s390x* support does see: > https://issues.apache.org/jira/browse/STORM-3401 > We have verfied and it run OK, see: [https://github.com/liusheng/storm/pulls] -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (STORM-3686) o.a.s.t.s.AbstractNonblockingServer$FrameBuffer pool-14-thread-10 [ERROR] Unexpected throwable while invoking! java.lang.NullPointerException: null
[ https://issues.apache.org/jira/browse/STORM-3686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17171538#comment-17171538 ] Saurav Suman commented on STORM-3686: - Hi Team, Any help and solution for this issue. > o.a.s.t.s.AbstractNonblockingServer$FrameBuffer pool-14-thread-10 [ERROR] > Unexpected throwable while invoking! java.lang.NullPointerException: null > --- > > Key: STORM-3686 > URL: https://issues.apache.org/jira/browse/STORM-3686 > Project: Apache Storm > Issue Type: Bug >Affects Versions: 1.2.2 > Environment: PROD >Reporter: Saurav Suman >Priority: Blocker > Attachments: Storm_ui.log, storm_nimbus.log > > > Hi Team, > > Very often I am getting below error in storm nimbus and after that the storm > UI loads only with some content. > > 2020-08-05 02:45:01.802 o.a.s.t.s.AbstractNonblockingServer$FrameBuffer > pool-14-thread-10 [ERROR] Unexpected throwable while invoking! > java.lang.NullPointerException: null > > Attached the storm nimbus and ui error from their logs. > > Please advise. -- This message was sent by Atlassian Jira (v8.3.4#803005)
