This is an automated email from the ASF dual-hosted git repository.
peacewong pushed a change to branch dev-1.0.3
in repository https://gitbox.apache.org/repos/asf/incubator-linkis.git.
from b85d449 ignore target for parent pom
new 7842b70 Resolve the problem of fetching progress with no information.
new f8d4271 Resolve the problem of deploying flink application without
yarn appId.
new 756eb87 Enhance the FlinkOnceJob, support to execute set, show
grammar of flinKSQL.
new f2bacc1 Enhance the FlinkOnceJobTest, add the support of using
onceJob operators.
new 9b5e2d9 Since both ECM and EC need Operator module, so the Operator
module has been moved to linkis-manager-common.
new 2b13129 Since both ECM and EC need Operator module, so the Operator
module has been moved to linkis-manager-common.
new dd46508 Add the capability of Operator to ECM, so LinkisManager can
request to execute ECM Operators by RPC.
new 7eab04b Add the capability of fetch EC logs from ECM, now we can get
all logs of all ECs whenever the EC is running or stopped.
new bead7e1 Optimize the architecture of LinkisManager, so
linkis-computation-client can request LinkisManager to route operator request
to ECM.
new e5bec14 Optimize the logic of EC creation, and fill in more EC
information when EC is creating.
new 8314db4 Delete the EngineConnLogOperator in accessible-executor,
since some errors will be throws when the EC is starting or stopped. The EC log
fetch feature has been moved to ECM.
new 9b27740 Optimize the logic of EC creation, and fill in more EC
information when EC is creating.
new 736520d Add the capability of executing Operators to ECM in
linkis-computation-client.
new a1fefc2 Add the capability of fetching EC logs, this operator will
ask LinkisManager to redirect log operator to ECM to fetch EC logs.
new 1d67577 Merge branch 'apache:dev-1.0.3' into dev-1.0.3
new fc946d5 Merge branch 'dev-1.0.3' of github.com:/wushengyeyouya/Linkis
into dev-1.0.3
new b8e7ba0 Fixes some bugs to help compilation.
new 386a40b Remove author information and WeBank copyright.
new adabaac Update Apache license.
new 69fd252 Merge pull request #1248 from wushengyeyouya/dev-1.0.3
The 1726 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../common/errorcode/LinkisErrorCodeSummary.java | 2 +-
.../linkis/protocol/utils/ZuulEntranceUtils.scala | 2 +-
.../linkis/rpc/exception/DWCURIException.scala | 3 -
.../org/apache/linkis/scheduler/queue/Job.scala | 1 -
.../apache/linkis/scheduler/queue/JobInfo.scala | 1 -
.../org/apache/linkis/storage/io/IOClient.scala | 1 -
.../linkis/storage/script/VariableParser.scala | 2 +-
.../application/constants/LinkisClientKeys.java | 2 +-
.../computation/client/job/AbstractLinkisJob.scala | 1 +
.../linkis/computation/client/once/OnceJob.scala | 12 +-
...gineConnAction.scala => ECMOperateAction.scala} | 33 +++--
.../once/action/EngineConnOperateAction.scala | 7 +-
...gineConnResult.scala => ECMOperateResult.scala} | 17 ++-
.../once/result/EngineConnOperateResult.scala | 6 +-
.../client/once/simple/SimpleOnceJob.scala | 26 ++--
.../client/operator/OnceJobOperator.scala | 30 ++--
.../computation/client/operator/Operator.scala | 4 +
.../operator/impl/EngineConnLogOperator.scala | 64 +++++++--
.../operator/impl/EngineConnProgressOperator.scala | 2 +-
.../computation/client/FlinkOnceJobTest.java | 10 ++
.../governance/common/paser/CodeParser.scala | 2 +-
.../ecm/server/exception}/ECMErrorCode.scala | 13 +-
.../server/operator/EngineConnLogOperator.scala | 153 +++++++++++++++++++++
...gCallbackService.scala => OperateService.scala} | 15 +-
.../service/impl}/DefaultOperateService.scala | 36 +++--
.../operator/OperableOnceEngineConnOperator.scala | 9 +-
.../computation/executor/cs/CSResourceParser.scala | 2 +-
.../executor/execute/EngineExecutionContext.scala | 6 +-
.../impl/EngineConnApplicationInfoOperator.scala | 2 +-
.../operator/impl/EngineConnLogOperator.scala | 81 -----------
.../executor/service/DefaultOperateService.scala | 9 +-
.../entrance/conf/EntranceSpringConfiguration.java | 2 +-
.../persistence/QueryPersistenceManager.java | 2 +-
.../entrance/conf/EntranceConfiguration.scala | 2 +-
.../entrance/execute/EntranceExecutorManager.scala | 2 +-
.../org/apache/linkis/ujes/jdbc/JDBCSpiTest.java | 2 +-
.../ujes/jdbc/UJESSQLPreparedStatementTest.java | 12 +-
.../linkis/ujes/jdbc/UJESSQLStatementTest.java | 8 +-
.../linkis/manager/am/restful/EMRestfulApi.java | 106 ++++++++++++++
.../manager/am/restful/EngineRestfulApi.java | 53 +++----
.../linkis/manager/am/conf/AMConfiguration.scala | 6 +
.../manager/am/manager/DefaultEMNodeManager.scala | 4 +
.../linkis/manager/am/manager/EMNodeManager.scala | 3 +
.../manager/am/pointer/DefaultEMNodPointer.scala | 13 +-
...ervice.scala => DefaultECMOperateService.scala} | 30 ++--
.../am/service/em/DefaultEMInfoService.scala | 5 +-
...gisterService.scala => ECMOperateService.scala} | 17 ++-
.../engine/DefaultEngineCreateService.scala | 1 +
.../manager/common/entity/node/AMEngineNode.java | 13 +-
.../manager/common/entity/node/EngineNode.java | 2 +
.../linkis/manager/common}/operator/Operator.scala | 24 ++--
.../manager/common}/operator/OperatorFactory.scala | 31 ++---
.../manager/common/protocol/OperateRequest.scala | 46 ++++---
...iceHealthReport.scala => OperateResponse.scala} | 22 ++-
...terEMResponse.scala => ECMOperateRequest.scala} | 23 +++-
...erEMResponse.scala => ECMOperateResponse.scala} | 18 ++-
.../protocol/engine/EngineOperateRequest.scala | 26 ++--
.../protocol/engine/EngineOperateResponse.scala | 18 ++-
.../service/common/pointer/EMNodPointer.scala | 3 +
.../src/test/java/PersistenceTest.java | 2 +-
.../deployment/ClusterDescriptorAdapter.java | 52 ++++++-
.../YarnApplicationClusterDescriptorAdapter.java | 2 +-
.../YarnPerJobClusterDescriptorAdapter.java | 3 +-
.../YarnSessionClusterDescriptorAdapter.scala | 1 +
.../flink/executor/FlinkCodeOnceExecutor.scala | 37 ++++-
.../hive/creation/HiveEngineConnFactory.scala | 4 +-
.../engineplugin/spark/cs/CSTableParser.scala | 2 +-
.../engineplugin/spark/executor/SQLSession.scala | 2 +-
.../org/apache/linkis/bml/common/Constant.java | 2 +-
.../apache/linkis/bml/restful/BmlRestfulApi.java | 2 +-
.../apache/linkis/bml/restful/RestfulUtils.java | 2 +-
.../test/service/TestContextCacheService.java | 2 +-
.../cs/client/test/bean/ClientTestContextKey.java | 2 +-
.../test/ContextSerializationHelperTest.java | 14 +-
.../apache/linkis/cs/persistence/AContextID.java | 2 +-
.../linkis/cs/persistence/ContextIDTest.java | 2 +-
.../linkis/cs/persistence/ContextMapTest.java | 4 +-
.../linkis/cs/server/ContextIDRestfulApi.java | 4 +-
.../apache/linkis/cs/server/ContextRestfulApi.java | 4 +-
.../org/apache/linkis/cs/server/SchedulerTest.java | 2 +-
.../server/src/main/resources/linkis.properties | 2 +-
.../impl/JobHistoryDetailQueryServiceImpl.scala | 4 +-
.../service/impl/JobHistoryQueryServiceImpl.scala | 2 +-
.../filesystem/restful/api/FsRestfulApi.java | 5 +-
.../java/org/apache/linkis/udf/TestUDFTree.java | 2 +-
.../eureka/SpringCloudEurekaApplication.java | 4 +-
.../linkis/eureka/conf/EurekaSecurityConfig.java | 5 +-
.../apache/linkis/gateway/http/GatewayRoute.scala | 4 +-
web/src/common/util/ras.js | 9 +-
89 files changed, 818 insertions(+), 414 deletions(-)
copy
linkis-computation-governance/linkis-client/linkis-computation-client/src/main/scala/org/apache/linkis/computation/client/once/action/{KillEngineConnAction.scala
=> ECMOperateAction.scala} (55%)
copy
linkis-computation-governance/linkis-client/linkis-computation-client/src/main/scala/org/apache/linkis/computation/client/once/result/{CreateEngineConnResult.scala
=> ECMOperateResult.scala} (72%)
copy
linkis-computation-governance/linkis-engineconn-manager/{linkis-engineconn-manager-core/src/main/scala/org/apache/linkis/ecm/core/conf
=>
linkis-engineconn-manager-server/src/main/scala/org/apache/linkis/ecm/server/exception}/ECMErrorCode.scala
(84%)
create mode 100644
linkis-computation-governance/linkis-engineconn-manager/linkis-engineconn-manager-server/src/main/scala/org/apache/linkis/ecm/server/operator/EngineConnLogOperator.scala
copy
linkis-computation-governance/linkis-engineconn-manager/linkis-engineconn-manager-server/src/main/scala/org/apache/linkis/ecm/server/service/{LogCallbackService.scala
=> OperateService.scala} (76%)
copy
linkis-computation-governance/{linkis-engineconn/linkis-engineconn-executor/accessible-executor/src/main/scala/org/apache/linkis/engineconn/acessible/executor/service
=>
linkis-engineconn-manager/linkis-engineconn-manager-server/src/main/scala/org/apache/linkis/ecm/server/service/impl}/DefaultOperateService.scala
(56%)
delete mode 100644
linkis-computation-governance/linkis-engineconn/linkis-engineconn-executor/accessible-executor/src/main/scala/org/apache/linkis/engineconn/acessible/executor/operator/impl/EngineConnLogOperator.scala
copy
linkis-computation-governance/linkis-manager/linkis-application-manager/src/main/scala/org/apache/linkis/manager/am/service/em/{EMInfoService.scala
=> DefaultECMOperateService.scala} (59%)
copy
linkis-computation-governance/linkis-manager/linkis-application-manager/src/main/scala/org/apache/linkis/manager/am/service/em/{EMUnregisterService.scala
=> ECMOperateService.scala} (71%)
rename
linkis-computation-governance/{linkis-engineconn/linkis-engineconn-executor/accessible-executor/src/main/scala/org/apache/linkis/engineconn/acessible/executor
=>
linkis-manager/linkis-manager-commons/linkis-manager-common/src/main/scala/org/apache/linkis/manager/common}/operator/Operator.scala
(57%)
rename
linkis-computation-governance/{linkis-engineconn/linkis-engineconn-executor/accessible-executor/src/main/scala/org/apache/linkis/engineconn/acessible/executor
=>
linkis-manager/linkis-manager-commons/linkis-manager-common/src/main/scala/org/apache/linkis/manager/common}/operator/OperatorFactory.scala
(64%)
copy
linkis-commons/linkis-scheduler/src/main/scala/org/apache/linkis/scheduler/queue/parallelqueue/ParallelGroup.scala
=>
linkis-computation-governance/linkis-manager/linkis-manager-commons/linkis-manager-common/src/main/scala/org/apache/linkis/manager/common/protocol/OperateRequest.scala
(51%)
copy
linkis-computation-governance/linkis-manager/linkis-manager-commons/linkis-manager-common/src/main/scala/org/apache/linkis/manager/common/protocol/{ServiceHealthReport.scala
=> OperateResponse.scala} (79%)
copy
linkis-computation-governance/linkis-manager/linkis-manager-commons/linkis-manager-common/src/main/scala/org/apache/linkis/manager/common/protocol/em/{RegisterEMResponse.scala
=> ECMOperateRequest.scala} (58%)
copy
linkis-computation-governance/linkis-manager/linkis-manager-commons/linkis-manager-common/src/main/scala/org/apache/linkis/manager/common/protocol/em/{RegisterEMResponse.scala
=> ECMOperateResponse.scala} (64%)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
