This is an automated email from the ASF dual-hosted git repository.
morningman pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-doris.git.
from f218327 [Mysql Compatibility] Support convert() and signed/unsigned
interger cast (#4364)
add 8c38c79 [SparkLoad]Use the yarn command to get status and kill the
application (#4383)
No new revisions were added by this update.
Summary of changes:
.../org/apache/doris/catalog/SparkResource.java | 43 +++-
.../main/java/org/apache/doris/common/Config.java | 14 ++
.../{LoadTaskCallback.java => ConfigFile.java} | 14 +-
.../doris/load/loadv2/SparkEtlJobHandler.java | 193 +++++++--------
.../doris/load/loadv2/SparkLauncherMonitor.java | 231 ++++++++++++++++++
.../doris/load/loadv2/SparkLoadAppHandle.java | 165 +++++++++++++
.../org/apache/doris/load/loadv2/SparkLoadJob.java | 24 +-
.../load/loadv2/SparkPendingTaskAttachment.java | 8 +-
.../apache/doris/load/loadv2/SparkRepository.java | 2 +-
.../doris/load/loadv2/SparkYarnConfigFiles.java | 245 +++++++++++++++++++
.../doris/load/loadv2/YarnApplicationReport.java | 121 ++++++++++
.../doris/load/loadv2/SparkEtlJobHandlerTest.java | 210 ++++++++++++----
.../load/loadv2/SparkLauncherMonitorTest.java | 74 ++++++
.../apache/doris/load/loadv2/SparkLoadJobTest.java | 22 +-
.../load/loadv2/SparkYarnConfigFilesTest.java | 72 ++++++
.../load/loadv2/YarnApplicationReportTest.java | 50 ++++
.../src/test/resources/spark_launcher_monitor.log | 264 +++++++++++++++++++++
17 files changed, 1558 insertions(+), 194 deletions(-)
copy
fe/fe-core/src/main/java/org/apache/doris/load/loadv2/{LoadTaskCallback.java =>
ConfigFile.java} (70%)
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/load/loadv2/SparkLauncherMonitor.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/load/loadv2/SparkLoadAppHandle.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/load/loadv2/SparkYarnConfigFiles.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/load/loadv2/YarnApplicationReport.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/load/loadv2/SparkLauncherMonitorTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/load/loadv2/SparkYarnConfigFilesTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/load/loadv2/YarnApplicationReportTest.java
create mode 100644 fe/fe-core/src/test/resources/spark_launcher_monitor.log
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
