This is an automated email from the ASF dual-hosted git repository.
yuanbo pushed a change to branch TUBEMQ-421
in repository https://gitbox.apache.org/repos/asf/incubator-tubemq.git.
from 3acac1a [TUBEMQ-531] delete cluster (#407)
new 45f70fc [TUBEMQ-433] add tubemq perf-consumer/producer scripts (#330)
new df95aac [TUBEMQ-440] Add feature package tube-manager to zip (#337)
new 9598a42 [TUBEMQ-430]Optimizing the implementation of HTTP API for
broker (#338)
new b2177f1 [TUBEMQ-441]An error occurred when using the Tubemq class to
create a sink table (#339)
new a835a50 [TUBEMQ-442]Modifying the jvm parameters when the broker
starts does not take effect (#340)
new ea901b7 [TUBEMQ-428] Bumped version to 0.8.0-SNAPSHOT (#341)
new 86ccc70 [TUBEMQ-437] Fix tubemq table source sink factory instance
creating problem (#342)
new aec25b5 [TUBEMQ-443] TubemqSourceFunction class prints too many logs
problem (#344)
new 6ce60a8 [TUBEMQ-444]Add consume and produce Cli commands (#343)
new 7a1d7cb [TUBEMQ-445]Adjust the status check default sleep interval of
pullConsumeReadyChkSliceMs (#345)
new 40a3491 [TUBEMQ-446]Small bugs fix that do not affect the main logics
(#346)
new 9565483 [TUBEMQ-447] Add Broker-Admin Cli (#347)
new 8acad06 [TUBEMQ-449]Adjust Example implementation (#348)
new 3b6d610 [TUBEMQ-453] TubemqSourceFunction class prints too many logs
problem (#350)
new ea22d0b [TUBEMQ-450]TubeClientException: Generate producer id failed
(#351)
new bd132b1 [TUBEMQ-457] There is no need to return StringBuilder in
Master.java (#352)
new 9e184b1 [TUBEMQ-451]Replace ConsumeTupleInfo with Tuple2 (#349)
new 380436e [TUBEMQ-463]Adjust Master rebalance process implementation
(#355)
new 8e0b01d [TUBEMQ-470] Add query API of TopicName and BrokerId
collection
new 4920c51 [TUBEMQ-472]Adjust Broker's AbstractWebHandler class
implementation
new cc5796a [TUBEMQ-475] add the offset clone api of the consume group
new d8580f2 [TUBEMQ-482] Add offset query api
new 868b04c [TUBEMQ-484]Add query API for topic publication information
new 1b854fb [TUBEMQ-485]Add the batch setting API of consume group offset
new e3d818c [TUBEMQ-486]Add the delete API of consumer group offset
new 7dd7268 [TUBEMQ-486]Add the delete API of consumer group offset
new e8bd45a [TUBEMQ-495]Code implementation adjustment based on SpotBugs
check
new f5ae304 [TUBEMQ-499] Add configure store
new 8762bd1 [TUBEMQ-504]Adjust the WebMethodMapper class interfaces (#388)
new 20c4602 [TUBEMQ-500] Add setting operate API (#389)
new 78ced32 [TUBEMQ-505] Remove the "WIP" label of the DISCLAIMER file
(#390)
new 6ca161c [TUBEMQ-501] Adjust max message size check logic
new fb22584 [TUBEMQ-508] Optimize Broker's PB parameter check processing
logic (#392)
new 1b7ca30 [TUBEMQ-509] Adjust the packet length check when data is
loaded
new d25d00c [TUBEMQ-509] Adjust the packet length check when data is
loaded
new a7ae74e [TUBEMQ-510] Found a bug in MessageProducerExample class
new eaf0f10 rm -Werror
new 72213f2 add change
new 78e3685 [TUBEMQ-511]Replace the conditional operator (?:) with mid()
new 5e4129e [TUBEMQ-512] Add package length control based on Topic
new a343a3f [TUBEMQ-518] fix parameter pass error
new 4b138de [TUBEMQ-515]Add cluster Topic view web api
new 0130748 [TUBEMQ-517] Add 0.8.0 version release modification to
CHANGES.md (#399)
new 2b34005 [TUBEMQ-526] Adjust the packaging script and version check
list, remove the "-WIP" tag
new 3fcbb38 [TUBEMQ-529] Update CHANGE.md
new f1bcd20 [TUBEMQ-544]Adjust the LICENSE statement in the client.conf
files of Python and C/C++ SDK
new 9530cae [TUBEMQ-546]Restore the original license header of the
referenced external source files
new 56cb40b [TUBEMQ-551] Adjust NOTICE file content
new e69631b [TUBEMQ-547]Recode the implementation of the *Startup.java
classes in the Tool package
The 49 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
CHANGES.md | 68 ++
DISCLAIMER | 6 +
DISCLAIMER-WIP | 18 -
LICENSE | 1 -
NOTICE | 155 ++-
bin/env.sh | 2 +-
bin/{groupAdmin.sh => tubemq-broker-admin.sh} | 5 +-
bin/{groupAdmin.sh => tubemq-consumer-test.sh} | 5 +-
bin/{groupAdmin.sh => tubemq-producer-test.sh} | 5 +-
pom.xml | 26 +-
resources/assets/scripts/topicList.js | 8 +-
.../tubemq-client-cpp/CMakeLists.txt | 2 +-
.../tubemq-client-cpp/conf/client.conf | 22 +-
tubemq-client-twins/tubemq-client-cpp/src/any.h | 21 +-
tubemq-client-twins/tubemq-client-cpp/src/buffer.h | 22 +-
.../src/python/tubemq/client.conf | 22 +-
tubemq-client/pom.xml | 2 +-
tubemq-client/src/main/assembly/assembly.xml | 2 +-
.../tubemq/client/common/TClientConstants.java | 2 +-
.../tubemq/client/config/ConsumerConfig.java | 12 +
.../tubemq/client/config/TubeClientConfig.java | 9 +-
.../client/consumer/MessageFetchManager.java | 5 +-
.../client/consumer/PullMessageConsumer.java | 7 +
.../tubemq/client/consumer/RmtDataCache.java | 4 +-
.../client/consumer/SimplePullMessageConsumer.java | 4 +-
.../tubemq/client/producer/AllowedSetting.java | 61 ++
.../tubemq/client/producer/ProducerManager.java | 48 +-
.../client/producer/SimpleMessageProducer.java | 25 +-
tubemq-connectors/pom.xml | 2 +-
tubemq-connectors/tubemq-connector-flink/pom.xml | 2 +-
.../org/apache/flink/connectors/tubemq/Tubemq.java | 28 +-
.../connectors/tubemq/TubemqSourceFunction.java | 19 +-
.../tubemq/TubemqTableSourceSinkFactory.java | 2 +-
.../org.apache.flink.table.factories.TableFactory | 2 +-
tubemq-connectors/tubemq-connector-flume/pom.xml | 2 +-
tubemq-connectors/tubemq-connector-spark/pom.xml | 2 +-
tubemq-core/pom.xml | 2 +-
.../org/apache/tubemq/corebase/TBaseConstants.java | 17 +-
.../apache/tubemq/corebase/TErrCodeConstants.java | 6 +
.../apache/tubemq/corebase/utils/AddressUtils.java | 107 +-
.../apache/tubemq/corebase/utils/MixedUtils.java | 69 ++
.../org/apache/tubemq/corebase/utils/RegexDef.java | 60 ++
...ncurrentHashSet.java => SettingValidUtils.java} | 84 +-
.../apache/tubemq/corebase/utils/TStringUtils.java | 27 +-
.../org/apache/tubemq/corebase/utils/Tuple2.java | 114 ++-
.../utils/{ConcurrentHashSet.java => Tuple3.java} | 106 +-
.../tubemq/corerpc/AbstractServiceInvoker.java | 2 +-
.../org/apache/tubemq/corerpc/RpcConstants.java | 6 +-
.../apache/tubemq/corerpc/RpcServiceFactory.java | 4 +-
tubemq-core/src/main/proto/MasterService.proto | 18 +
tubemq-docker/pom.xml | 2 +-
tubemq-docker/tubemq-all/pom.xml | 2 +-
tubemq-docker/tubemq-build/pom.xml | 2 +-
tubemq-example/pom.xml | 2 +-
tubemq-example/src/main/assembly/assembly.xml | 2 +-
.../tubemq/example/MAMessageProducerExample.java | 158 +--
.../tubemq/example/MessageConsumerExample.java | 60 +-
.../tubemq/example/MessageProducerExample.java | 131 ++-
.../tubemq/example/MessagePullConsumerExample.java | 63 +-
.../example/MessagePullSetConsumerExample.java | 62 +-
tubemq-manager/conf/logback.xml | 64 ++
tubemq-manager/pom.xml | 31 +-
tubemq-manager/src/main/assembly/assembly.xml | 61 ++
tubemq-server/pom.xml | 8 +-
tubemq-server/src/main/assembly/assembly.xml | 2 +-
.../tubemq/server/broker/BrokerServiceServer.java | 191 ++--
.../apache/tubemq/server/broker/TubeBroker.java | 270 +++--
.../broker/metadata/BrokerMetadataManager.java | 3 +-
.../broker/metadata/ClusterConfigHolder.java | 81 ++
.../server/broker/metadata/MetadataManager.java | 2 +
.../server/broker/metadata/TopicMetadata.java | 88 +-
.../server/broker/msgstore/MessageStore.java | 34 +-
.../broker/msgstore/MessageStoreManager.java | 62 +-
.../server/broker/msgstore/StoreService.java | 6 +
.../server/broker/msgstore/mem/MsgMemStore.java | 3 +-
.../server/broker/offset/DefaultOffsetManager.java | 288 +++++-
.../tubemq/server/broker/offset/OffsetService.java | 25 +
.../server/broker/stats/GroupCountService.java | 2 +-
.../tubemq/server/broker/utils/DataStoreUtils.java | 7 +-
.../server/broker/utils/GroupOffsetInfo.java | 85 ++
.../server/broker/utils/TopicPubStoreInfo.java | 55 +
.../server/broker/web/AbstractWebHandler.java | 92 ++
.../server/broker/web/BrokerAdminServlet.java | 1050 ++++++++++++++++----
.../tubemq/server/common/TServerConstants.java | 3 +
.../tubemq/server/common/fielddef/CliArgDef.java | 131 +++
.../tubemq/server/common/fielddef/WebFieldDef.java | 205 ++++
.../tubemq/server/common/fileconfig/ZKConfig.java | 1 -
.../server/common/offsetstorage/OffsetStorage.java | 14 +-
.../common/offsetstorage/ZkOffsetStorage.java | 194 +++-
.../common/offsetstorage/zookeeper/ZKUtil.java | 33 +
.../server/common/paramcheck/PBParameterUtils.java | 193 ++--
.../tubemq/server/common/utils/HttpUtils.java | 112 +++
.../ProcessResult.java} | 122 +--
.../server/common/utils/WebParameterUtils.java | 553 ++++++++++-
.../tubemq/server/common/webbase/WebFieldType.java | 130 ++-
.../webbase/WebMethodMapper.java} | 53 +-
.../apache/tubemq/server/master/MasterConfig.java | 11 +
.../org/apache/tubemq/server/master/TMaster.java | 280 ++++--
.../server/master/bdbstore/BdbStoreService.java | 7 +
.../master/bdbstore/DefaultBdbStoreService.java | 99 +-
.../bdbentitys/BdbClusterSettingEntity.java | 340 +++++++
.../bdbstore/bdbentitys/BdbTopicConfEntity.java | 18 +
.../nodemanage/nodebroker/BrokerConfManager.java | 134 ++-
.../nodemanage/nodebroker/BrokerInfoHolder.java | 4 +-
.../nodebroker/BrokerSyncStatusInfo.java | 15 +
.../nodeconsumer/ConsumerInfoHolder.java | 14 +-
.../server/master/web/action/screen/Master.java | 32 +-
.../server/master/web/action/screen/Webapi.java | 12 +-
.../master/web/handler/AbstractWebHandler.java | 16 +-
.../web/handler/WebBrokerTopicConfHandler.java | 179 +++-
.../master/web/handler/WebMasterInfoHandler.java | 233 ++++-
.../apache/tubemq/server/tools/BrokerStartup.java | 24 +-
.../org/apache/tubemq/server/tools/CliUtils.java | 72 ++
.../apache/tubemq/server/tools/MasterStartup.java | 21 +-
.../org/apache/tubemq/server/tools/ToolUtils.java | 78 --
.../tubemq/server/tools/cli/CliAbstractBase.java | 76 ++
.../tubemq/server/tools/cli/CliBrokerAdmin.java | 113 +++
.../tubemq/server/tools/cli/CliConsumer.java | 395 ++++++++
.../tubemq/server/tools/cli/CliProducer.java | 373 +++++++
119 files changed, 6996 insertions(+), 1538 deletions(-)
create mode 100644 DISCLAIMER
delete mode 100644 DISCLAIMER-WIP
copy bin/{groupAdmin.sh => tubemq-broker-admin.sh} (92%)
copy bin/{groupAdmin.sh => tubemq-consumer-test.sh} (92%)
copy bin/{groupAdmin.sh => tubemq-producer-test.sh} (92%)
create mode 100644
tubemq-client/src/main/java/org/apache/tubemq/client/producer/AllowedSetting.java
create mode 100644
tubemq-core/src/main/java/org/apache/tubemq/corebase/utils/RegexDef.java
copy
tubemq-core/src/main/java/org/apache/tubemq/corebase/utils/{ConcurrentHashSet.java
=> SettingValidUtils.java} (56%)
copy
tubemq-server/src/main/java/org/apache/tubemq/server/common/offsetstorage/zookeeper/ZooKeeperConnectionException.java
=> tubemq-core/src/main/java/org/apache/tubemq/corebase/utils/Tuple2.java (51%)
copy
tubemq-core/src/main/java/org/apache/tubemq/corebase/utils/{ConcurrentHashSet.java
=> Tuple3.java} (50%)
create mode 100644 tubemq-manager/conf/logback.xml
create mode 100644 tubemq-manager/src/main/assembly/assembly.xml
create mode 100644
tubemq-server/src/main/java/org/apache/tubemq/server/broker/metadata/ClusterConfigHolder.java
create mode 100644
tubemq-server/src/main/java/org/apache/tubemq/server/broker/utils/GroupOffsetInfo.java
create mode 100644
tubemq-server/src/main/java/org/apache/tubemq/server/broker/utils/TopicPubStoreInfo.java
create mode 100644
tubemq-server/src/main/java/org/apache/tubemq/server/broker/web/AbstractWebHandler.java
create mode 100644
tubemq-server/src/main/java/org/apache/tubemq/server/common/fielddef/CliArgDef.java
create mode 100644
tubemq-server/src/main/java/org/apache/tubemq/server/common/fielddef/WebFieldDef.java
create mode 100644
tubemq-server/src/main/java/org/apache/tubemq/server/common/utils/HttpUtils.java
copy
tubemq-server/src/main/java/org/apache/tubemq/server/common/{paramcheck/ParamCheckResult.java
=> utils/ProcessResult.java} (51%)
copy
tubemq-core/src/main/java/org/apache/tubemq/corebase/balance/EventStatus.java
=>
tubemq-server/src/main/java/org/apache/tubemq/server/common/webbase/WebFieldType.java
(56%)
rename
tubemq-server/src/main/java/org/apache/tubemq/server/{master/web/handler/WebApiMapper.java
=> common/webbase/WebMethodMapper.java} (57%)
create mode 100644
tubemq-server/src/main/java/org/apache/tubemq/server/master/bdbstore/bdbentitys/BdbClusterSettingEntity.java
create mode 100644
tubemq-server/src/main/java/org/apache/tubemq/server/tools/CliUtils.java
delete mode 100644
tubemq-server/src/main/java/org/apache/tubemq/server/tools/ToolUtils.java
create mode 100644
tubemq-server/src/main/java/org/apache/tubemq/server/tools/cli/CliAbstractBase.java
create mode 100644
tubemq-server/src/main/java/org/apache/tubemq/server/tools/cli/CliBrokerAdmin.java
create mode 100644
tubemq-server/src/main/java/org/apache/tubemq/server/tools/cli/CliConsumer.java
create mode 100644
tubemq-server/src/main/java/org/apache/tubemq/server/tools/cli/CliProducer.java
