This is an automated email from the ASF dual-hosted git repository.
vogievetsky pushed a change to branch segment_timeline2
in repository https://gitbox.apache.org/repos/asf/druid.git
discard 224ca761175 improve segment view
discard 6b9cc0d59a2 fix
discard 0314aa5697a step
discard 2987bea12d6 check in
discard 52b02d9fc0e small fixes
discard d3a53716750 more cleanup
discard 22043fc67cf init refactor of segment timeline
omit cb82983a4f9 fix snapshots
omit 1625a3e3c99 more splitter layout
omit 8b9e045408e better key
omit 0ef44f8d573 update default size
omit 1ce04978056 better positioning
omit ee01cc89cca added splitterSize option
omit 273e2b60b2b better defaults
omit 61528e273c1 update licenses
omit 0b9109ee9f4 better v splitter
omit 2bf1b7d0dcc init lookups big
omit 20d42f68605 some query tab fixes
add 9dfb3787116 Remove unused coordinator dynamic configs
mergeSegmentsLimit, mergeBytesLimit (#17384)
add 1157ecdec37 abstract common base of SQL micro-benchmarks to reduce
boilerplate and standardize parameters (#17383)
add 60daddedf8b SeekableStreamSupervisor: Use workerExec as the client
connectExec. (#17394)
add 43b325b6aaf Add missing `@Nullable` annotations to SqlQuery (#17398)
add 1e96c85b383 WindowOperatorQueryFrameProcessor: Avoid writing multiple
frames to output channel in runIncrementally() (#17373)
add 7e8671caa99 GroupByQueryConfig: Skip unnecessary toString. (#17396)
add c4b513e5990 SeekableStreamSupervisor: Don't await task futures in
workerExec. (#17403)
add fe0f4150c9a MSQ ingestion: Improve error message on encountering
non-long timestamp column (#17411)
add b59317e42b5 Fix typo in security.md (#17413)
add 7306d280cc0 Migrate jaxb bind dependency to jakarta (#17370)
add 65acc86756b Capture more dumps on failure. (#17412)
add 73675d06712 clean up some thread pools in tests (#17421)
add 446a8f466f2 Update errorprone, mockito, jacoco, checkerframework.
(#17414)
add 6a9c050095d DruidOverlord: Move becomeLeader/stopBeingLeader earlier.
(#17415)
add b7c661b8013 Make tempStorageDirectory configuration optional and rely
on task dir instead (#17015)
add 1be2b852e9d [Kafka Ingestion Tutorial] Update docs for Schema Config
(#17409)
add 10208baab24 use big endian for compressed complex column values to fit
object strategy expectations (#17422)
add 66eb365e4d5 Revert "always set taskLocation (#17350)" (#17417)
add 63c91ad813e Fix backward compatibility issues in
WindowOperatorQueryFrameProcessorFactory and WindowOperatorQueryFrameProcessor
(#17433)
add 21e7e5cddd2 Add benchmark suite for MSQ window functions (#17377)
add d5bb7de5cf4 Fix Map Lookup Introspection Endpoints and update doc for
Globally Cached Lookups (#17436)
add 4b7902e74af Web console: Improve workbench view with resizable side
panels (#17387)
add 5fcf4205e4b Handle empty values for task and datasource conditions in
pod template selector (#17400)
new fb7371370a3 init refactor of segment timeline
new cf8f1d8f0b1 more cleanup
new 88f993c4d18 small fixes
new 289d95c7d09 check in
new dca621c02e7 step
new b0c756fea07 fix
new c89e0588747 improve segment view
new 5c430de66ce progress
new ded6fc2a0d6 checkpoint
new 8ff3f44ec39 better timezone menu
new 17051be2648 add file
new f08a337e445 auto trimming
new 6a1821a571f no highlight
new 1b68c63d47c goodies
new 15885be68a3 cleaner normalization
new 2243da03823 simple bubble
new f320470b244 fix supervisor view
new 7e8003112cc fixes
new f33a31aff4f fixes
new 883e0f9a7c2 segment wheel fixes
new 952b0fb2608 api
new d80b2beb956 preogress
new 91af28e7299 more fixes
new 109022c4c4e normalize to days
new cac4f78be40 good fixes
new b865422cc54 now line and fixes
new dc1a507081b fixes
new 2036585da68 init datasource
new 02b963d8188 fixes
new 9c5875555e8 fix zooming
new 80149630a9e better controlls
new 06562491fda misc fixes
new 6278d3d2ff3 fix
new 020d7ac5477 fixes
new b6b52962499 add unnest
new 797fabae237 increment store only on appropriate engine
new 4a1286048a6 portal bubble
new 7fe805aeb0b goodies
new ad0517a3cb3 progress
new 7513ec5c4f0 fix todo
new bc202c9e492 fixes
new 5855a5bb7ff fix render spamming
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (224ca761175)
\
N -- N -- N refs/heads/segment_timeline2 (5855a5bb7ff)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 42 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.github/workflows/reusable-unit-tests.yml | 27 +-
LABELS | 5 -
benchmarks/pom.xml | 17 +
.../lookup/SqlReverseLookupBenchmark.java | 8 +-
.../query/MSQWindowFunctionsBenchmark.java | 224 +++++
.../druid/benchmark/query/SqlBaseBenchmark.java | 559 ++++++++++++
.../benchmark/query/SqlBasePlanBenchmark.java | 52 ++
.../benchmark/query/SqlBaseQueryBenchmark.java | 50 ++
.../apache/druid/benchmark/query/SqlBenchmark.java | 513 ++---------
.../benchmark/query/SqlBenchmarkDatasets.java | 423 +++++++++
.../query/SqlComplexMetricsColumnsBenchmark.java | 72 ++
.../benchmark/query/SqlExpressionBenchmark.java | 346 ++-----
.../druid/benchmark/query/SqlGroupByBenchmark.java | 310 +------
.../benchmark/query/SqlNestedDataBenchmark.java | 405 ++-------
.../druid/benchmark/query/SqlPlanBenchmark.java | 95 ++
.../benchmark/query/SqlProjectionsBenchmark.java | 80 ++
.../query/SqlWindowFunctionsBenchmark.java | 408 +--------
docs/api-reference/dynamic-configuration-api.md | 8 +-
docs/assets/tutorial-kafka-data-loader-05.png | Bin 206028 -> 506701 bytes
docs/assets/tutorial-kafka-data-loader-05b.png | Bin 202167 -> 0 bytes
docs/configuration/index.md | 2 -
docs/multi-stage-query/reference.md | 14 +-
docs/multi-stage-query/security.md | 4 +-
docs/querying/lookups-cached-global.md | 2 +-
docs/tutorials/tutorial-kafka.md | 11 +-
.../k8s/overlord/KubernetesPeonLifecycle.java | 51 +-
.../druid/k8s/overlord/execution/Selector.java | 8 +-
.../k8s/overlord/KubernetesPeonLifecycleTest.java | 118 ++-
.../druid/k8s/overlord/execution/SelectorTest.java | 57 ++
.../RabbitStreamIndexTaskClientFactory.java | 6 +-
.../storage/azure/output/AzureOutputConfig.java | 17 +-
.../output/AzureStorageConnectorProvider.java | 8 +-
.../azure/output/AzureOutputConfigTest.java | 3 +-
.../storage/azure/output/AzureOutputSerdeTest.java | 12 -
.../output/AzureStorageConnectorProviderTest.java | 41 +-
.../hll/HllSketchAggregatorFactoryTest.java | 7 +-
.../google/output/GoogleExportStorageProvider.java | 13 +-
.../storage/google/output/GoogleOutputConfig.java | 9 +-
.../output/GoogleStorageConnectorProvider.java | 7 +-
.../output/GoogleExportStorageProviderTest.java | 6 +-
.../output/GoogleStorageConnectorProviderTest.java | 10 +-
.../kafka/KafkaIndexTaskClientFactory.java | 6 +-
.../kafkainput/KafkaStringHeaderFormatTest.java | 13 +-
.../kafka/supervisor/KafkaSupervisorTest.java | 999 +++++++++++++++------
.../kinesis/KinesisIndexTaskClientFactory.java | 6 +-
.../kinesis/supervisor/KinesisSupervisorTest.java | 24 +-
extensions-core/multi-stage-query/pom.xml | 11 +
.../apache/druid/msq/exec/ControllerContext.java | 10 +
.../org/apache/druid/msq/exec/ControllerImpl.java | 28 +-
.../druid/msq/exec/ExportMetadataManager.java | 7 +-
.../java/org/apache/druid/msq/exec/MSQTasks.java | 8 +-
.../druid/msq/guice/MSQDurableStorageModule.java | 12 +-
.../msq/indexing/IndexerControllerContext.java | 16 +-
.../druid/msq/indexing/IndexerWorkerContext.java | 9 +-
.../indexing/cleaner/DurableStorageCleaner.java | 5 +-
.../WindowOperatorQueryFrameProcessor.java | 41 +-
.../WindowOperatorQueryFrameProcessorFactory.java | 34 +-
.../druid/msq/querykit/WindowOperatorQueryKit.java | 50 +-
.../ExportResultsFrameProcessorFactory.java | 2 +-
.../msq/sql/resources/SqlStatementResource.java | 5 +-
.../org/apache/druid/msq/exec/MSQTasksTest.java | 39 +
.../msq/indexing/DurableStorageCleanerTest.java | 5 +-
.../msq/indexing/IndexerWorkerContextTest.java | 6 +
...ndowOperatorQueryFrameProcessorFactoryTest.java | 8 +-
.../WindowOperatorQueryFrameProcessorTest.java | 84 ++
.../resources/SqlMSQStatementResourcePostTest.java | 5 +-
.../sql/resources/SqlStatementResourceTest.java | 5 +-
.../druid/msq/test/CalciteMSQTestsHelper.java | 3 +
.../druid/msq/test/ExtractResultsFactory.java | 2 -
.../druid/msq/test/MSQTestControllerContext.java | 9 +
.../msq/test/StandardMSQComponentSupplier.java | 2 +-
extensions-core/orc-extensions/pom.xml | 8 +-
.../druid/storage/s3/output/S3ExportConfig.java | 3 +-
.../storage/s3/output/S3ExportStorageProvider.java | 14 +-
.../druid/storage/s3/output/S3OutputConfig.java | 10 +-
.../s3/output/S3StorageConnectorProvider.java | 8 +-
.../storage/s3/S3StorageConnectorProviderTest.java | 16 +-
.../druid/storage/s3/output/S3OutputSerdeTest.java | 14 -
indexing-hadoop/pom.xml | 5 +
.../indexer/DataSegmentAndIndexZipFilePath.java | 17 +-
.../DataSegmentAndIndexZipFilePathTest.java | 13 +-
.../druid/indexing/overlord/DruidOverlord.java | 25 +-
.../apache/druid/indexing/overlord/TaskMaster.java | 74 +-
.../SeekableStreamIndexTaskClientFactory.java | 27 +-
.../supervisor/SeekableStreamSupervisor.java | 197 ++--
.../compact/OverlordCompactionSchedulerTest.java | 14 +-
.../SeekableStreamSupervisorStateTest.java | 2 +-
licenses.yaml | 121 +--
pom.xml | 16 +-
processing/pom.xml | 4 +-
.../druid/query/groupby/GroupByQueryConfig.java | 2 +-
.../druid/query/operator/ScanOperatorFactory.java | 14 +-
.../druid/segment/data/CompressedBlockReader.java | 23 +-
.../druid/segment/data/CompressedLongsReader.java | 7 +-
.../CompressedVariableSizedBlobColumnSupplier.java | 24 +-
.../segment/generator/GeneratorSchemaInfo.java | 16 +
.../segment/nested/NestedDataColumnSupplier.java | 1 +
.../segment/nested/NestedDataColumnSupplierV4.java | 1 +
.../segment/serde/CompressedComplexColumn.java | 8 +-
.../serde/CompressedComplexColumnSupplier.java | 18 +-
.../druid/storage/ExportStorageProvider.java | 7 +-
.../druid/storage/StorageConnectorProvider.java | 15 +-
.../local/LocalFileExportStorageProvider.java | 2 +-
.../local/LocalFileStorageConnectorProvider.java | 2 +-
.../apache/druid/common/guava/GuavaUtilsTest.java | 77 +-
.../java/util/emitter/core/HttpEmitterTest.java | 36 +-
.../core/HttpPostEmitterLoggerStressTest.java | 96 +-
.../emitter/core/HttpPostEmitterStressTest.java | 273 +++---
.../util/emitter/core/HttpPostEmitterTest.java | 32 +-
.../metrics/AllocationMetricCollectorTest.java | 1 -
.../util/metrics/BasicMonitorSchedulerTest.java | 7 +
.../java/util/metrics/JvmPidDiscovererTest.java | 8 +-
.../epinephelinae/ConcurrentGrouperTest.java | 210 +++--
.../query/operator/ScanOperatorFactoryTest.java | 20 +-
.../java/org/apache/druid/segment/TestHelper.java | 15 +
.../apache/druid/segment/VirtualColumnsTest.java | 31 +-
.../data/CompressedVariableSizeBlobColumnTest.java | 64 ++
.../druid/segment/generator/SegmentGenerator.java | 175 +++-
.../nested/NestedDataColumnSupplierTest.java | 45 +-
.../nested/NestedDataColumnSupplierV4Test.java | 45 +-
.../nested/ScalarDoubleColumnSupplierTest.java | 45 +-
.../nested/ScalarLongColumnSupplierTest.java | 45 +-
.../nested/ScalarStringColumnSupplierTest.java | 45 +-
.../segment/nested/VariantColumnSupplierTest.java | 43 +-
.../druid/storage/StorageConnectorModuleTest.java | 5 +-
.../local/LocalFileStorageConnectorTest.java | 20 +-
.../query/lookup/MapLookupExtractorFactory.java | 4 +-
.../coordinator/CoordinatorDynamicConfig.java | 38 +-
.../druid/catalog/model/TableMetadataTest.java | 1 -
.../lookup/LookupIntrospectionResourceTest.java | 4 +-
.../server/http/CoordinatorDynamicConfigTest.java | 88 +-
services/pom.xml | 12 +-
.../java/org/apache/druid/sql/http/SqlQuery.java | 7 +-
.../druid/sql/avatica/DruidAvaticaHandlerTest.java | 1 -
.../druid/sql/calcite/BaseCalciteQueryTest.java | 7 +-
.../apache/druid/sql/calcite/QueryTestRunner.java | 7 +-
.../druid/sql/calcite/SqlTestFrameworkConfig.java | 11 +-
.../druid/sql/calcite/util/CalciteTests.java | 1 +
.../druid/sql/calcite/util/TestDataBuilder.java | 59 ++
web-console/jest.common.config.js | 2 +
web-console/package-lock.json | 119 +--
web-console/package.json | 2 +-
web-console/script/create-sql-docs.mjs | 6 +
web-console/script/licenses | 1 +
web-console/src/components/auto-form/auto-form.tsx | 1 -
.../src/components/rule-editor/rule-editor.scss | 4 +
.../src/components/rule-editor/rule-editor.tsx | 2 +-
.../__snapshots__/bar-unit.spec.tsx.snap | 13 -
.../__snapshots__/segment-timeline.spec.tsx.snap | 293 +++---
.../src/components/segment-timeline/common.ts | 68 +-
.../{segment-timeline.scss => portal-bubble.scss} | 60 +-
.../components/segment-timeline/portal-bubble.tsx | 74 ++
.../segment-timeline/segment-bar-chart-render.scss | 100 ++-
.../segment-timeline/segment-bar-chart-render.tsx | 750 +++++++++++++---
.../segment-timeline/segment-bar-chart.tsx | 271 ++----
.../segment-timeline/segment-timeline.scss | 41 +-
.../segment-timeline/segment-timeline.spec.tsx | 4 +-
.../segment-timeline/segment-timeline.tsx | 422 ++++++---
.../supervisor-history-panel.tsx | 13 +-
.../table-clickable-cell/table-clickable-cell.tsx | 5 +-
.../table-filterable-cell.tsx | 2 +-
web-console/src/console-application.tsx | 15 +-
.../compaction-history-dialog.tsx | 7 +-
.../coordinator-dynamic-config-dialog.tsx | 7 +-
.../overlord-dynamic-config-dialog.tsx | 7 +-
.../dialogs/retention-dialog/retention-dialog.tsx | 15 +-
.../src/dialogs/status-dialog/status-dialog.tsx | 3 +-
.../supervisor-reset-offsets-dialog.tsx | 11 +-
.../coordinator-dynamic-config.mock.ts | 2 -
.../coordinator-dynamic-config.tsx | 14 -
.../datasource/datasource.ts} | 36 +-
web-console/src/druid-models/index.ts | 2 +
.../src/druid-models/load-rule/load-rule.ts | 1 +
.../segment/segment.ts} | 53 +-
web-console/src/entry.scss | 1 +
web-console/src/hooks/use-clock.ts | 18 +-
.../src/react-table/react-table-utils.spec.ts | 4 +
web-console/src/react-table/react-table-utils.ts | 50 +-
.../date-floor-shift-ceil-utc.spec.ts | 169 ++++
.../date-floor-shift-ceil.spec.ts | 181 ++++
.../date-floor-shift-ceil/date-floor-shift-ceil.ts | 296 ++++++
web-console/src/utils/date.spec.ts | 9 -
web-console/src/utils/date.ts | 89 +-
web-console/src/utils/druid-query.ts | 6 +
web-console/src/utils/duration/duration.spec.ts | 505 +++++++++++
web-console/src/utils/duration/duration.ts | 388 ++++++++
web-console/src/utils/general.spec.ts | 7 -
web-console/src/utils/general.tsx | 16 +-
web-console/src/utils/index.tsx | 2 +
.../src/utils/query-manager/query-manager.ts | 2 +-
web-console/src/utils/table-helpers.ts | 11 +
web-console/src/variables.scss | 8 +
.../__snapshots__/datasources-view.spec.tsx.snap | 15 +-
.../views/datasources-view/datasources-view.scss | 15 +-
.../views/datasources-view/datasources-view.tsx | 112 ++-
.../components/source-pane/source-pane.tsx | 4 +-
.../modules/multi-axis-chart-module.tsx | 12 +-
.../explore-view/modules/time-chart-module.tsx | 17 +-
.../src/views/explore-view/utils/duration.spec.ts | 39 -
.../src/views/explore-view/utils/duration.ts | 46 -
.../explore-view/utils/filter-pattern-helpers.ts | 8 +-
.../explore-view/utils/get-auto-granularity.ts | 85 +-
web-console/src/views/explore-view/utils/index.ts | 2 -
.../explore-view/utils/snap-to-granularity.ts | 57 --
.../src/views/explore-view/utils/table-query.ts | 7 +-
.../datasources-card/datasources-card.tsx | 10 +-
.../home-view/segments-card/segments-card.tsx | 7 +-
.../home-view/services-card/services-card.tsx | 13 +-
.../supervisors-card/supervisors-card.tsx | 15 +-
.../src/views/home-view/tasks-card/tasks-card.tsx | 17 +-
.../src/views/load-data-view/load-data-view.tsx | 4 +-
.../src/views/lookups-view/lookups-view.tsx | 10 +-
.../__snapshots__/segments-view.spec.tsx.snap | 50 +-
.../src/views/segments-view/segments-view.scss | 2 +
.../src/views/segments-view/segments-view.tsx | 343 +++----
.../src/views/services-view/services-view.tsx | 44 +-
.../views/supervisors-view/supervisors-view.tsx | 115 ++-
web-console/src/views/tasks-view/tasks-view.tsx | 33 +-
.../time-menu-items/time-menu-items.tsx | 28 +-
.../current-dart-panel/current-dart-panel.tsx | 12 +-
.../execution-stages-pane.tsx | 2 +-
.../views/workbench-view/query-tab/query-tab.tsx | 13 +-
.../recent-query-task-panel.tsx | 18 +-
.../views/workbench-view/run-panel/run-panel.tsx | 71 +-
.../timezone-menu-items.spec.tsx.snap | 563 ++++++++++++
.../timezone-menu-items.spec.tsx} | 24 +-
.../timezone-menu-items/timezone-menu-items.tsx | 135 +++
.../src/views/workbench-view/work-state-store.ts | 22 +-
228 files changed, 8926 insertions(+), 5000 deletions(-)
create mode 100644
benchmarks/src/test/java/org/apache/druid/benchmark/query/MSQWindowFunctionsBenchmark.java
create mode 100644
benchmarks/src/test/java/org/apache/druid/benchmark/query/SqlBaseBenchmark.java
create mode 100644
benchmarks/src/test/java/org/apache/druid/benchmark/query/SqlBasePlanBenchmark.java
create mode 100644
benchmarks/src/test/java/org/apache/druid/benchmark/query/SqlBaseQueryBenchmark.java
create mode 100644
benchmarks/src/test/java/org/apache/druid/benchmark/query/SqlBenchmarkDatasets.java
create mode 100644
benchmarks/src/test/java/org/apache/druid/benchmark/query/SqlComplexMetricsColumnsBenchmark.java
create mode 100644
benchmarks/src/test/java/org/apache/druid/benchmark/query/SqlPlanBenchmark.java
create mode 100644
benchmarks/src/test/java/org/apache/druid/benchmark/query/SqlProjectionsBenchmark.java
delete mode 100644 docs/assets/tutorial-kafka-data-loader-05b.png
delete mode 100644
web-console/src/components/segment-timeline/__snapshots__/bar-unit.spec.tsx.snap
copy web-console/src/components/segment-timeline/{segment-timeline.scss =>
portal-bubble.scss} (58%)
create mode 100644
web-console/src/components/segment-timeline/portal-bubble.tsx
copy web-console/src/{components/rule-editor/rule-editor.scss =>
druid-models/datasource/datasource.ts} (64%)
copy web-console/src/{components/segment-timeline/segment-timeline.scss =>
druid-models/segment/segment.ts} (50%)
create mode 100755
web-console/src/utils/date-floor-shift-ceil/date-floor-shift-ceil-utc.spec.ts
create mode 100755
web-console/src/utils/date-floor-shift-ceil/date-floor-shift-ceil.spec.ts
create mode 100755
web-console/src/utils/date-floor-shift-ceil/date-floor-shift-ceil.ts
create mode 100755 web-console/src/utils/duration/duration.spec.ts
create mode 100755 web-console/src/utils/duration/duration.ts
delete mode 100644 web-console/src/views/explore-view/utils/duration.spec.ts
delete mode 100644 web-console/src/views/explore-view/utils/duration.ts
delete mode 100644
web-console/src/views/explore-view/utils/snap-to-granularity.ts
create mode 100644
web-console/src/views/workbench-view/timezone-menu-items/__snapshots__/timezone-menu-items.spec.tsx.snap
copy web-console/src/{components/segment-timeline/segment-timeline.spec.tsx =>
views/workbench-view/timezone-menu-items/timezone-menu-items.spec.tsx} (61%)
create mode 100644
web-console/src/views/workbench-view/timezone-menu-items/timezone-menu-items.tsx
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
