This is an automated email from the ASF dual-hosted git repository.
morningman pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-doris.git.
from 5b15894 [Bug] Fix SchemaChangeJobV2's meta persist bug (#3804)
add edfa668 Add create spark load job
add 7f6a7c6 Remove unused import
new 4fa9d8c [Spark load][Fe 3/5] Fe create job (#3715)
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
fe/pom.xml | 20 ++
fe/src/main/cup/sql_parser.cup | 28 +-
.../java/org/apache/doris/analysis/BrokerDesc.java | 11 +-
.../java/org/apache/doris/analysis/LoadStmt.java | 83 +++++-
.../{BrokerDesc.java => ResourceDesc.java} | 68 +++--
.../org/apache/doris/catalog/SparkResource.java | 4 +-
.../main/java/org/apache/doris/common/Config.java | 6 +
.../java/org/apache/doris/load/EtlJobType.java | 4 +-
.../apache/doris/load/loadv2/BrokerLoadJob.java | 266 +----------------
.../org/apache/doris/load/loadv2/BulkLoadJob.java | 328 +++++++++++++++++++++
.../org/apache/doris/load/loadv2/JobState.java | 1 +
.../org/apache/doris/load/loadv2/LoadManager.java | 7 +-
.../org/apache/doris/load/loadv2/SparkLoadJob.java | 248 ++++++++++++++++
.../main/java/org/apache/doris/qe/DdlExecutor.java | 16 +-
.../org/apache/doris/analysis/LoadStmtTest.java | 28 +-
.../apache/doris/analysis/ResourceDescTest.java | 80 +++++
.../apache/doris/catalog/SparkResourceTest.java | 4 +-
.../doris/load/loadv2/BrokerLoadJobTest.java | 11 +-
18 files changed, 872 insertions(+), 341 deletions(-)
copy fe/src/main/java/org/apache/doris/analysis/{BrokerDesc.java =>
ResourceDesc.java} (55%)
create mode 100644
fe/src/main/java/org/apache/doris/load/loadv2/BulkLoadJob.java
create mode 100644
fe/src/main/java/org/apache/doris/load/loadv2/SparkLoadJob.java
create mode 100644
fe/src/test/java/org/apache/doris/analysis/ResourceDescTest.java
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]