This is an automated email from the ASF dual-hosted git repository.
kunwp1 pushed a change to branch chris-big-object-version-0
in repository https://gitbox.apache.org/repos/asf/texera.git
discard 38b8d6485e Add websocket event BigObjectUpdateEvent
discard 33180db969 create() API for python + cleanup the parameters
discard 4c844a427c create() function for python udf
discard beb8bcdbe9 Add operator id to the table
discard d3e63db9f5 Big Object Read for R UDF Operators
discard 9a8c1fac0f Big Object Read for Python UDF Operators
discard 8c68c05bac Big Object for Java Native Operators
add ddad0157d0 fix: restructure bin/deployment and update Dockerfiles for
new repository structure (#3892)
add b7d72c717f feat(frontend): introduce dropdown menu for layers (#3898)
add f03947ceda feat(bin): add some helper scripts (#3890)
add f29b0be5f5 fix(deployment): add image tag for MinIO image in helm
chart (#3903)
add 7932f34a98 chore(doc): create pull request template for contributors
(#3899)
add d217b8c20e feat(op): add Substring Search operator with case
sensitivity support (#3780)
add 9322ae62db feat(gui): Display the number of workers for each operator
during execution (#3911)
add 38d94adbdd feat: add feature request issue template (#3910)
add d0c2ed12c4 refactor: update workflow result export functions for
local/dataset to be separate and symmetric (#3916)
add 8a4ee99e06 chore: add task issue template (#3918)
add 9945e3dea0 chore: simplify issue reporting with a markdown on code of
conduct (#3920)
add 2780caa2b3 feat(operator): add Stable Incremental Merge Sort (Scala)
(#3774)
add 4da3c26d59 fix(ui): file upload section border (#3906)
add 2e03207f2a chore: Remove publish section with whoami from .asf.yaml
(#3927)
add 84976e9439 feat(dockerfile): add build argument to toggle R support in
computing unit images (#3929)
add 870a9e045c chore: add test-ci branch protection rules (#3937)
add 927c9b262a chore(ci): explicitly declare main branch's CI rules (#3938)
add 3e833f5d0e chore(ci): rename CI names for `test-ci` rules (#3940)
add da679689c4 chore(ci): add CI with new names (#3941)
add b3317c1fad feat(operator): Add strip chart visualization operator
(#3913)
add 7b8b48463f chore: redirect GitHub emails (#3932)
add bfca0024e8 feat(gui): show region layer on workflow editor (#3753)
add 014b59bb48 fix(gui): enlarge active ring size on admin dashboard
(#3924)
add 5c2bd88107 fix: make sub-string name search feature in admin dashboard
case-insensitive (#3926)
add 54ad59bae2 fix(frontend): Update labels in layer menu for clarity
(#3958)
add 4b9e0d08e3 feat: introduce sort by activeness to admin dashboard
(#3960)
add 316675294e fix(amber): add temporary fixes for e2e tests in Amber
(#3962)
add 797fde518e chore(ci): cleanup ci (#3942)
add 1f465195ce fix(frontend): update the about page's workflow gui image
with latest texera logo (#4002)
add ea290c3a47 fix: run button is enabled when an operator is unconfigured
(#3914)
add b7944f3129 feat(amber): add pyproject.toml for PyAmber formatter and
linter config (#4005)
add 3ff3c54899 fix(helm-chart): replace regex with wildcard in the ingress
rules (#4011)
add 768e349f65 feat(frontend): region state color (#3999)
add bb63a06437 fix(gui): enforce cursor to be pointer type when hovering
over resources (#4017)
add 039040085a feat(sort): add BINARY type support in sort operator (#4014)
add 5695cbbbcb fix(scatterplot): avoid malformed Python when optionals are
absent (#4023)
new 2710f7c1cb Big Object for Java Native Operators
new e30bd1c440 Big Object Read for Python UDF Operators
new 6f4fee0268 Big Object Read for R UDF Operators
new a3fbacc6c4 Add operator id to the table
new 8dd3cf581f create() function for python udf
new 85134ffab1 create() API for python + cleanup the parameters
new 020d958570 Add websocket event BigObjectUpdateEvent
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (38b8d6485e)
\
N -- N -- N refs/heads/chris-big-object-version-0 (020d958570)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 7 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.asf.yaml | 20 +-
.github/ISSUE_TEMPLATE/bug-template.yaml | 11 +-
.github/ISSUE_TEMPLATE/feature-template.yaml | 76 ++
.github/ISSUE_TEMPLATE/task-template.yaml | 63 ++
.github/PULL_REQUEST_TEMPLATE | 53 ++
.github/workflows/github-action-build.yml | 6 +-
.licenserc.yaml | 1 +
amber/requirements.txt | 1 +
amber/src/main/python/{.flake8 => pyproject.toml} | 21 +-
.../architecture/controller/Controller.scala | 12 +
.../controller/WorkflowScheduler.scala | 2 +
.../scheduling/RegionExecutionCoordinator.scala | 15 +-
.../engine/architecture/scheduling/Schedule.scala | 2 +
...flowStateEvent.scala => RegionStateEvent.scala} | 2 +-
...usUpdateEvent.scala => RegionUpdateEvent.scala} | 2 +-
.../amber/engine/e2e/DataProcessingSpec.scala | 13 +-
.../org/apache/amber/engine/e2e/PauseSpec.scala | 17 +-
bin/{deployment => }/README.md | 18 +-
.../access-control-service.dockerfile | 24 +-
bin/{deployment/build-all.sh => build-images.sh} | 0
bin/computing-unit-master.dockerfile | 124 ++++
bin/computing-unit-worker.dockerfile | 125 ++++
bin/{deployment => }/config-service.dockerfile | 26 +-
bin/deployment/computing-unit-master.dockerfile | 112 ---
bin/deployment/computing-unit-worker.dockerfile | 72 --
.../files/iceberg_postgres_catalog.sql | 1 -
.../k8s/texera-helmchart/files/texera_ddl.sql | 1 -
.../k8s/texera-helmchart/files/texera_lakefs.sql | 1 -
bin/{deployment => }/file-service.dockerfile | 22 +-
bin/fix-format.sh | 110 +++
.../k8s/texera-helmchart => k8s}/Chart.yaml | 0
bin/{deployment => }/k8s/README.md | 0
bin/k8s/files/iceberg_postgres_catalog.sql | 1 +
bin/k8s/files/texera_ddl.sql | 1 +
bin/k8s/files/texera_lakefs.sql | 1 +
.../access-control-service-deployment.yaml | 0
.../templates/access-control-service-service.yaml | 0
.../templates/config-service-deployment.yaml | 0
.../templates/config-service-service.yaml | 0
.../templates/envoy-config.yaml | 0
.../templates/envoy-deployment.yaml | 0
.../templates/envoy-service.yaml | 0
.../templates/example-data-loader-job.yaml | 0
.../templates/external-names.yaml | 0
.../templates/file-service-deployment.yaml | 0
.../templates/file-service-service.yaml | 0
.../templates/ingress.yaml | 0
.../templates/lakefs-secret.yaml | 0
.../templates/lakefs-setup-job.yaml | 0
.../templates/minio-ingress.yaml | 0
.../templates/minio-persistence.yaml | 0
.../templates/postgresql-init-script-config.yaml | 0
.../templates/postgresql-persistence.yaml | 0
.../texera-helmchart => k8s}/templates/pylsp.yaml | 0
.../templates/shared-editing-server.yaml | 0
.../templates/webserver-deployment.yaml | 0
.../templates/webserver-service.yaml | 0
.../workflow-compiling-service-deployment.yaml | 0
.../workflow-compiling-service-service.yaml | 0
...workflow-computing-unit-manager-deployment.yaml | 0
...low-computing-unit-manager-service-account.yaml | 0
.../workflow-computing-unit-manager-service.yaml | 0
...ow-computing-unit-master-prepull-daemonset.yaml | 0
.../workflow-computing-unit-resource-quota.yaml | 0
.../workflow-computing-units-namespace.yaml | 0
.../workflow-computing-units-service.yaml | 0
.../k8s/texera-helmchart => k8s}/values.yaml | 5 +-
bin/{deployment => }/merge-image-tags.sh | 0
.../postgres17-pgroonga.dockerfile | 0
bin/{deployment => }/pylsp/Dockerfile | 0
.../pylsp/python-language-server.yaml | 0
bin/{deployment => }/pylsp/run_pylsp.sh | 0
bin/{deployment => }/single-node/.env | 0
bin/{deployment => }/single-node/README.md | 0
.../single-node/docker-compose.yml | 0
bin/{deployment => }/single-node/nginx.conf | 0
.../texera-web-application.dockerfile | 42 +-
bin/utils/resolve-texera-home.sh | 83 +++
bin/utils/texera-logging.sh | 80 +++
.../workflow-compiling-service.dockerfile | 24 +-
...flow-computing-unit-managing-service.dockerfile | 26 +-
bin/{deployment => }/y-websocket-server/Dockerfile | 0
.../y-websocket-server/package.json | 0
.../org/apache/amber/operator/LogicalOp.scala | 7 +-
.../StableMergeSortOpDesc.scala} | 42 +-
.../operator/sort/StableMergeSortOpExec.scala | 277 ++++++++
.../SubstringSearchOpDesc.scala} | 23 +-
.../SubstringSearchOpExec.scala} | 24 +-
.../scatterplot/ScatterplotOpDesc.scala | 23 +-
.../StripChartOpDesc.scala} | 100 +--
.../operator/sort/StableMergeSortOpExecSpec.scala | 782 +++++++++++++++++++++
frontend/package.json | 4 +
frontend/src/app/app.module.ts | 2 +
.../component/admin/user/admin-user.component.html | 6 +-
.../component/admin/user/admin-user.component.scss | 2 +-
.../component/admin/user/admin-user.component.ts | 11 +-
.../user/list-item/list-item.component.scss | 4 +
.../dataset-detail.component.scss | 7 +
.../service/user/download/download.service.ts | 5 +-
.../component/left-panel/left-panel.component.scss | 1 -
.../workspace/component/menu/menu.component.html | 46 +-
.../app/workspace/component/menu/menu.component.ts | 23 +-
.../property-editor/property-editor.component.scss | 1 -
.../result-panel/result-panel.component.scss | 1 -
.../workflow-editor/workflow-editor.component.scss | 13 +-
.../workflow-editor/workflow-editor.component.ts | 76 ++
.../workspace/component/workspace.component.scss | 1 -
.../execute-workflow/execute-workflow.service.ts | 19 +
.../workspace/service/joint-ui/joint-ui.service.ts | 10 +
.../validation/validation-workflow.service.ts | 6 +-
.../workflow-graph/model/joint-graph-wrapper.ts | 23 +-
.../model/workflow-action.service.ts | 2 +
.../workflow-result-export.service.ts | 2 +-
.../workspace/types/execute-workflow.interface.ts | 1 +
.../types/workflow-websocket.interface.ts | 11 +
.../{Sort.png => StableMergeSort.png} | Bin
frontend/src/assets/operator_images/StripChart.png | Bin 0 -> 45788 bytes
.../src/assets/operator_images/SubstringSearch.png | Bin 0 -> 507231 bytes
frontend/src/assets/workflow_gui.png | Bin 472795 -> 247141 bytes
frontend/src/styles.scss | 4 +
frontend/tsconfig.json | 1 +
frontend/yarn.lock | 417 ++++++++++-
122 files changed, 2727 insertions(+), 466 deletions(-)
create mode 100644 .github/ISSUE_TEMPLATE/feature-template.yaml
create mode 100644 .github/ISSUE_TEMPLATE/task-template.yaml
create mode 100644 .github/PULL_REQUEST_TEMPLATE
rename amber/src/main/python/{.flake8 => pyproject.toml} (78%)
copy
amber/src/main/scala/org/apache/texera/web/model/websocket/event/{WorkflowStateEvent.scala
=> RegionStateEvent.scala} (91%)
copy
amber/src/main/scala/org/apache/texera/web/model/websocket/response/{ClusterStatusUpdateEvent.scala
=> RegionUpdateEvent.scala} (90%)
rename bin/{deployment => }/README.md (55%)
rename bin/{deployment => }/access-control-service.dockerfile (68%)
rename bin/{deployment/build-all.sh => build-images.sh} (100%)
create mode 100644 bin/computing-unit-master.dockerfile
create mode 100644 bin/computing-unit-worker.dockerfile
rename bin/{deployment => }/config-service.dockerfile (67%)
delete mode 100644 bin/deployment/computing-unit-master.dockerfile
delete mode 100644 bin/deployment/computing-unit-worker.dockerfile
delete mode 120000
bin/deployment/k8s/texera-helmchart/files/iceberg_postgres_catalog.sql
delete mode 120000 bin/deployment/k8s/texera-helmchart/files/texera_ddl.sql
delete mode 120000 bin/deployment/k8s/texera-helmchart/files/texera_lakefs.sql
rename bin/{deployment => }/file-service.dockerfile (72%)
create mode 100755 bin/fix-format.sh
rename bin/{deployment/k8s/texera-helmchart => k8s}/Chart.yaml (100%)
rename bin/{deployment => }/k8s/README.md (100%)
create mode 120000 bin/k8s/files/iceberg_postgres_catalog.sql
create mode 120000 bin/k8s/files/texera_ddl.sql
create mode 120000 bin/k8s/files/texera_lakefs.sql
rename bin/{deployment/k8s/texera-helmchart =>
k8s}/templates/access-control-service-deployment.yaml (100%)
rename bin/{deployment/k8s/texera-helmchart =>
k8s}/templates/access-control-service-service.yaml (100%)
rename bin/{deployment/k8s/texera-helmchart =>
k8s}/templates/config-service-deployment.yaml (100%)
rename bin/{deployment/k8s/texera-helmchart =>
k8s}/templates/config-service-service.yaml (100%)
rename bin/{deployment/k8s/texera-helmchart =>
k8s}/templates/envoy-config.yaml (100%)
rename bin/{deployment/k8s/texera-helmchart =>
k8s}/templates/envoy-deployment.yaml (100%)
rename bin/{deployment/k8s/texera-helmchart =>
k8s}/templates/envoy-service.yaml (100%)
rename bin/{deployment/k8s/texera-helmchart =>
k8s}/templates/example-data-loader-job.yaml (100%)
rename bin/{deployment/k8s/texera-helmchart =>
k8s}/templates/external-names.yaml (100%)
rename bin/{deployment/k8s/texera-helmchart =>
k8s}/templates/file-service-deployment.yaml (100%)
rename bin/{deployment/k8s/texera-helmchart =>
k8s}/templates/file-service-service.yaml (100%)
rename bin/{deployment/k8s/texera-helmchart => k8s}/templates/ingress.yaml
(100%)
rename bin/{deployment/k8s/texera-helmchart =>
k8s}/templates/lakefs-secret.yaml (100%)
rename bin/{deployment/k8s/texera-helmchart =>
k8s}/templates/lakefs-setup-job.yaml (100%)
rename bin/{deployment/k8s/texera-helmchart =>
k8s}/templates/minio-ingress.yaml (100%)
rename bin/{deployment/k8s/texera-helmchart =>
k8s}/templates/minio-persistence.yaml (100%)
rename bin/{deployment/k8s/texera-helmchart =>
k8s}/templates/postgresql-init-script-config.yaml (100%)
rename bin/{deployment/k8s/texera-helmchart =>
k8s}/templates/postgresql-persistence.yaml (100%)
rename bin/{deployment/k8s/texera-helmchart => k8s}/templates/pylsp.yaml (100%)
rename bin/{deployment/k8s/texera-helmchart =>
k8s}/templates/shared-editing-server.yaml (100%)
rename bin/{deployment/k8s/texera-helmchart =>
k8s}/templates/webserver-deployment.yaml (100%)
rename bin/{deployment/k8s/texera-helmchart =>
k8s}/templates/webserver-service.yaml (100%)
rename bin/{deployment/k8s/texera-helmchart =>
k8s}/templates/workflow-compiling-service-deployment.yaml (100%)
rename bin/{deployment/k8s/texera-helmchart =>
k8s}/templates/workflow-compiling-service-service.yaml (100%)
rename bin/{deployment/k8s/texera-helmchart =>
k8s}/templates/workflow-computing-unit-manager-deployment.yaml (100%)
rename bin/{deployment/k8s/texera-helmchart =>
k8s}/templates/workflow-computing-unit-manager-service-account.yaml (100%)
rename bin/{deployment/k8s/texera-helmchart =>
k8s}/templates/workflow-computing-unit-manager-service.yaml (100%)
rename bin/{deployment/k8s/texera-helmchart =>
k8s}/templates/workflow-computing-unit-master-prepull-daemonset.yaml (100%)
rename bin/{deployment/k8s/texera-helmchart =>
k8s}/templates/workflow-computing-unit-resource-quota.yaml (100%)
rename bin/{deployment/k8s/texera-helmchart =>
k8s}/templates/workflow-computing-units-namespace.yaml (100%)
rename bin/{deployment/k8s/texera-helmchart =>
k8s}/templates/workflow-computing-units-service.yaml (100%)
rename bin/{deployment/k8s/texera-helmchart => k8s}/values.yaml (98%)
rename bin/{deployment => }/merge-image-tags.sh (100%)
rename bin/{deployment => }/postgres17-pgroonga.dockerfile (100%)
rename bin/{deployment => }/pylsp/Dockerfile (100%)
rename bin/{deployment => }/pylsp/python-language-server.yaml (100%)
rename bin/{deployment => }/pylsp/run_pylsp.sh (100%)
rename bin/{deployment => }/single-node/.env (100%)
rename bin/{deployment => }/single-node/README.md (100%)
rename bin/{deployment => }/single-node/docker-compose.yml (100%)
rename bin/{deployment => }/single-node/nginx.conf (100%)
rename bin/{deployment => }/texera-web-application.dockerfile (61%)
create mode 100755 bin/utils/resolve-texera-home.sh
create mode 100755 bin/utils/texera-logging.sh
rename bin/{deployment => }/workflow-compiling-service.dockerfile (69%)
rename bin/{deployment =>
}/workflow-computing-unit-managing-service.dockerfile (63%)
rename bin/{deployment => }/y-websocket-server/Dockerfile (100%)
rename bin/{deployment => }/y-websocket-server/package.json (100%)
copy
common/workflow-operator/src/main/scala/org/apache/amber/operator/{keywordSearch/KeywordSearchOpDesc.scala
=> sort/StableMergeSortOpDesc.scala} (64%)
create mode 100644
common/workflow-operator/src/main/scala/org/apache/amber/operator/sort/StableMergeSortOpExec.scala
copy
common/workflow-operator/src/main/scala/org/apache/amber/operator/{keywordSearch/KeywordSearchOpDesc.scala
=> substringSearch/SubstringSearchOpDesc.scala} (77%)
copy
common/workflow-operator/src/main/scala/org/apache/amber/operator/{regex/RegexOpExec.scala
=> substringSearch/SubstringSearchOpExec.scala} (63%)
copy
common/workflow-operator/src/main/scala/org/apache/amber/operator/visualization/{contourPlot/ContourPlotOpDesc.scala
=> stripChart/StripChartOpDesc.scala} (52%)
create mode 100644
common/workflow-operator/src/test/scala/org/apache/amber/operator/sort/StableMergeSortOpExecSpec.scala
copy frontend/src/assets/operator_images/{Sort.png => StableMergeSort.png}
(100%)
create mode 100644 frontend/src/assets/operator_images/StripChart.png
create mode 100644 frontend/src/assets/operator_images/SubstringSearch.png
