This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch dependabot/maven/jetty.version-11.0.11
in repository https://gitbox.apache.org/repos/asf/druid.git
omit e1657164e4 Bump jetty.version from 9.4.41.v20210516 to 11.0.11
add 4574dea5e9 Use MXBeans to get GC metrics #12476 (#12481)
add 378fea9517 Retain CSP configuration in ServerConfig constructor.
(#12755)
add bcff35f798 Pushdown join filter with right side referencing columns
(#12749)
add 9c925b4f09 Frame format for data transfer and short-term storage.
(#12745)
add edfbcc8455 Preserve column order in DruidSchema, SegmentMetadataQuery.
(#12754)
add 48fd2e6400 Add missing metrics into statsd-reporter. (#12762)
add 1558ef471c Add some debug tips for debugging peons (#12697)
add 8dc4a155c7 Fix flaky IT: ITPerfectRollupParallelBatchIndexTest (#12737)
add 864b77e91a SpillingGrouper: Make DISK_FULL sticky. (#12764)
add 32946216d0 Debugs Flaky License dependency Reports generation (#12744)
add d2576584a0 Consolidate the two TaskStatus classes. (#12765)
add 97207cdcc7 Automatic sizing for GroupBy dictionaries. (#12763)
add cebf2ba9c7 [Flaky unit test] Adding file based uri. (#12671)
add bb953be09b Refactor usage of JoinableFactoryWrapper + more test
coverage (#12767)
add 8c02880d5f Emit metrics for distribution of number of rows per segment
(#12730)
add 2ab20c9fc9 Surface more information about task status in tests (#12759)
add c1c2104bd6 fix ordering in e2e test (#12775)
add 8c33508eaf run web-console e2e tests for java changes too (#12776)
add d8f8c56f94 Docs: Index page with all SQL functions (#12771)
add c0380e7b0a * fix duplicate dimension (#12778)
add a544aff761 Document missed simple granularities (#12768)
add 05b2e967ed druid nested data column type (#12753)
add e25ba00470 fix bug in ObjectFlatteners.toMap which caused null values
in avro-stream/avro-ocf/parquet/orc to be converted to {} instead of null in
web-console sampler UI (#12785)
add 14e5b8325c make tick formatting more robust (#12788)
add 82315779ff fix segment timeline bar chart (#12782)
add 50f1f5840d show json and add search box (#12784)
add ee15c238cc Clone Calcite planner to access validator (#12708)
add 1e0542626b add nested column query benchmarks (#12786)
add f2a7970a6c reindex flow should take order from Druid (#12790)
add d4403c15aa Upgrade prometheus version, add more labels to
PrometheusEmitter (#12769)
add 75045970cd S3 Ingestion from non-default endpoints (#11798)
add cc1ff56ca5 Unregisters `RealtimeMetricsMonitor`,
`TaskRealtimeMetricsMonitor` on Indexers after task completion (#12743)
add f3272a25f9 Add check for sqlOuterLimit to ingest queries (#12799)
add 809bf161ce Add a note about setting the value of
maxNumConcurrentSubTasks (#12772)
add 3bf1e699ff GREATEST/LEAST function is incorrectly specifying that it
cannot return null (#12804)
add a2be685824 Remove the time bit, fix headings (#12808)
add 9e5f0109fd Fix CVE-2022-2048 (jetty) and CVE-2022-31159
(aws-java-sdk-s3) (#12807)
add e914e4fe40 Bump jetty.version from 9.4.41.v20210516 to 11.0.11
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (e1657164e4)
\
N -- N -- N refs/heads/dependabot/maven/jetty.version-11.0.11
(e914e4fe40)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.travis.yml | 47 +-
.../DruidSchemaInternRowSignatureBenchmark.java | 5 +-
.../query/CachingClusteredClientBenchmark.java | 5 +-
.../apache/druid/benchmark/query/SqlBenchmark.java | 59 +-
.../benchmark/query/SqlNestedDataBenchmark.java | 317 +++
check_test_suite.py | 28 +-
check_test_suite_test.py | 79 +-
.../apache/druid/common/aws/AWSClientConfig.java | 11 +
.../apache/druid/common/aws/AWSEndpointConfig.java | 9 +
.../apache/druid/common/aws/AWSProxyConfig.java | 10 +
.../org/apache/druid/common/guava/GuavaUtils.java | 13 +-
.../apache/druid/data/input/impl/JsonReader.java | 2 +-
.../java/org/apache/druid/indexer/TaskStatus.java | 4 +-
.../util/common/granularity/GranularityType.java | 3 +
.../druid/java/util/common/guava/Sequence.java | 12 +
.../java/util/common/parsers/ObjectFlattener.java | 15 +
.../java/util/common/parsers/ObjectFlatteners.java | 4 +-
.../druid/java/util/metrics/AbstractMonitor.java | 5 +
.../apache/druid/java/util/metrics/JvmMonitor.java | 304 +--
.../druid/data/input/impl/HttpEntityTest.java | 52 +-
.../java/util/common/guava/SequenceTestHelper.java | 23 +-
.../util/common/parsers/ObjectFlattenersTest.java | 61 +
.../druid/java/util/metrics/JvmMonitorTest.java | 39 +-
dev/intellij-setup.md | 15 +
.../bin/generate-license-dependency-reports.py | 3 +
docs/configuration/index.md | 1 +
docs/design/segments.md | 15 +-
docs/development/extensions-contrib/prometheus.md | 2 +
docs/ingestion/native-batch-input-source.md | 134 +-
docs/ingestion/native-batch.md | 2 +-
docs/operations/metrics.md | 52 +-
docs/querying/granularities.md | 26 +-
docs/querying/groupbyquery.md | 7 +-
docs/querying/sql-functions.md | 1325 ++++++++++++
.../movingaverage/MovingAverageQueryTest.java | 3 +-
extensions-contrib/prometheus-emitter/pom.xml | 6 +-
.../apache/druid/emitter/prometheus/Metrics.java | 14 +-
.../emitter/prometheus/PrometheusEmitter.java | 19 +-
.../prometheus/PrometheusEmitterConfig.java | 22 +-
.../druid/emitter/prometheus/MetricsTest.java | 10 +-
.../emitter/prometheus/PrometheusEmitterTest.java | 54 +-
.../main/resources/defaultMetricDimensions.json | 36 +-
.../input/parquet/CompatParquetReaderTest.java | 22 +-
.../apache/druid/data/input/s3/S3InputSource.java | 142 +-
.../druid/storage/s3/S3StorageDruidModule.java | 58 +-
.../java/org/apache/druid/storage/s3/S3Utils.java | 58 +
.../druid/data/input/s3/S3InputSourceTest.java | 179 +-
.../common/stats/TaskRealtimeMetricsMonitor.java | 23 +
.../druid/indexing/common/task/IndexTask.java | 15 +-
.../batch/parallel/PartialSegmentGenerateTask.java | 10 +-
.../task/batch/parallel/SinglePhaseSubTask.java | 10 +-
.../SeekableStreamIndexTaskRunner.java | 6 +-
.../shuffle/LocalIntermediaryDataManager.java | 2 +-
.../stats/TaskRealtimeMetricsMonitorTest.java | 83 +
.../AbstractMultiPhaseParallelIndexingTest.java | 2 +-
.../AbstractParallelIndexSupervisorTaskTest.java | 5 +-
.../druid/indexing/overlord/TaskLifecycleTest.java | 3 +-
...ocalIntermediaryDataManagerAutoCleanupTest.java | 24 +-
.../worker/shuffle/ShuffleResourceTest.java | 4 +-
integration-tests/README.md | 1 +
.../docker/environment-configs/middlemanager | 3 +-
.../ServerManagerForQueryErrorTest.java | 6 +-
licenses.yaml | 4 +-
pom.xml | 15 +-
processing/pom.xml | 6 +-
.../main/java/org/apache/druid/frame/Frame.java | 478 +++++
.../java/org/apache/druid/frame/FrameType.java | 70 +
.../druid/frame/allocation/AppendableMemory.java | 328 +++
.../frame/allocation/ArenaMemoryAllocator.java | 115 ++
.../frame/allocation/HeapMemoryAllocator.java | 99 +
.../druid/frame/allocation/MemoryAllocator.java | 56 +
.../apache/druid/frame/allocation/MemoryRange.java | 66 +
.../druid/frame/field/ComplexFieldReader.java | 141 ++
.../druid/frame/field/ComplexFieldWriter.java | 84 +
.../druid/frame/field/ConstantFieldPointer.java | 19 +-
.../druid/frame/field/DoubleFieldReader.java | 109 +
.../druid/frame/field/DoubleFieldWriter.java | 89 +
.../org/apache/druid/frame/field/FieldReader.java | 59 +
.../org/apache/druid/frame/field/FieldReaders.java | 73 +
.../org/apache/druid/frame/field/FieldWriter.java | 53 +
.../org/apache/druid/frame/field/FieldWriters.java | 154 ++
.../apache/druid/frame/field/FloatFieldReader.java | 106 +
.../apache/druid/frame/field/FloatFieldWriter.java | 89 +
.../apache/druid/frame/field/LongFieldReader.java | 109 +
.../apache/druid/frame/field/LongFieldWriter.java | 70 +
.../druid/frame/field/ReadableFieldPointer.java | 19 +-
.../druid/frame/field/RowMemoryFieldPointer.java | 60 +
.../org/apache/druid/frame/field/RowReader.java | 93 +
.../druid/frame/field/StringArrayFieldWriter.java | 59 +
.../druid/frame/field/StringFieldReader.java | 292 +++
.../druid/frame/field/StringFieldWriter.java | 120 ++
.../org/apache/druid/frame/file/FrameFile.java | 359 ++++
.../apache/druid/frame/file/FrameFileWriter.java | 216 ++
.../druid/frame/key/FrameComparisonWidget.java | 49 +
.../druid/frame/key/FrameComparisonWidgetImpl.java | 252 +++
.../java/org/apache/druid/frame/key/RowKey.java | 111 +
.../apache/druid/frame/key/RowKeyComparator.java | 144 ++
.../org/apache/druid/frame/key/RowKeyReader.java | 179 ++
.../org/apache/druid/frame/key/SortColumn.java | 89 +
.../org/apache/druid/frame/read/FrameReader.java | 171 ++
.../apache/druid/frame/read/FrameReaderUtils.java | 217 ++
.../druid/frame/read/columnar/ColumnPlus.java | 79 +
.../read/columnar/ComplexFrameColumnReader.java | 211 ++
.../read/columnar/DoubleFrameColumnReader.java | 261 +++
.../read/columnar/FloatFrameColumnReader.java | 261 +++
.../frame/read/columnar/FrameColumnReader.java | 36 +-
.../frame/read/columnar/FrameColumnReaders.java | 61 +
.../frame/read/columnar/LongFrameColumnReader.java | 259 +++
.../read/columnar/StringFrameColumnReader.java | 617 ++++++
.../apache/druid/frame/segment/FrameCursor.java | 88 +
.../druid/frame/segment/FrameCursorUtils.java | 70 +
.../druid/frame/segment/FrameFilteredOffset.java | 116 ++
.../apache/druid/frame/segment/FrameSegment.java | 80 +
.../druid/frame/segment/FrameStorageAdapter.java | 195 ++
.../frame/segment/columnar/FrameCursorFactory.java | 193 ++
.../segment/columnar/FrameQueryableIndex.java | 127 ++
.../frame/segment/columnar/FrameVectorCursor.java | 100 +
.../apache/druid/frame/segment/package-info.java | 12 +-
.../frame/segment/row/ConstantFrameRowPointer.java | 33 +-
.../frame/segment/row/CursorFrameRowPointer.java | 87 +
.../segment/row/FrameColumnSelectorFactory.java | 212 ++
.../frame/segment/row/FrameCursorFactory.java | 128 ++
.../frame/segment/row/ReadableFrameRowPointer.java | 35 +-
.../frame/util/SettableLongVirtualColumn.java | 120 ++
.../frame/write/FrameRowTooLargeException.java | 36 +-
.../org/apache/druid/frame/write/FrameSort.java | 90 +
.../org/apache/druid/frame/write/FrameWriter.java | 83 +
.../druid/frame/write/FrameWriterFactory.java | 34 +-
.../apache/druid/frame/write/FrameWriterUtils.java | 294 +++
.../org/apache/druid/frame/write/FrameWriters.java | 102 +
.../frame/write/InvalidNullByteException.java | 13 +-
.../druid/frame/write/RowBasedFrameWriter.java | 320 +++
.../frame/write/RowBasedFrameWriterFactory.java | 107 +
.../write/UnsupportedColumnTypeException.java | 57 +
.../frame/write/columnar/ColumnarFrameWriter.java | 207 ++
.../write/columnar/ColumnarFrameWriterFactory.java | 110 +
.../write/columnar/ComplexFrameColumnWriter.java | 157 ++
.../write/columnar/DoubleFrameColumnWriter.java | 111 +
.../write/columnar/FloatFrameColumnWriter.java | 111 +
.../frame/write/columnar/FrameColumnWriter.java | 19 +-
.../frame/write/columnar/FrameColumnWriters.java | 184 ++
.../write/columnar/LongFrameColumnWriter.java | 111 +
.../write/columnar/StringFrameColumnWriter.java | 282 +++
.../org/apache/druid/guice/NestedDataModule.java | 79 +
.../query/expression/NestedDataExpressions.java | 669 ++++++
.../druid/query/groupby/GroupByQueryConfig.java | 117 +-
.../epinephelinae/GroupByMergingQueryRunnerV2.java | 5 +
.../epinephelinae/GroupByQueryEngineV2.java | 21 +-
.../groupby/epinephelinae/GroupByRowProcessor.java | 4 +-
.../query/groupby/epinephelinae/Groupers.java | 17 +-
.../epinephelinae/RowBasedGrouperHelper.java | 11 +-
.../groupby/epinephelinae/SpillingGrouper.java | 9 +
.../epinephelinae/vector/VectorGroupByEngine.java | 12 +-
.../query/groupby/strategy/GroupByStrategyV2.java | 5 +
.../druid/query/metadata/SegmentAnalyzer.java | 5 +-
.../SegmentMetadataQueryQueryToolChest.java | 34 +-
.../SegmentMetadataQueryRunnerFactory.java | 4 +-
.../query/metadata/metadata/SegmentAnalysis.java | 12 +-
.../segment/ComparatorDimensionDictionary.java | 157 ++
.../ComparatorSortedDimensionDictionary.java | 78 +
.../java/org/apache/druid/segment/IndexIO.java | 5 +-
.../java/org/apache/druid/segment/IndexSpec.java | 34 +-
.../druid/segment/NestedDataColumnIndexer.java | 271 +++
.../druid/segment/NestedDataColumnMerger.java | 272 +++
.../druid/segment/NestedDataDimensionHandler.java | 105 +
.../druid/segment/NestedDataDimensionSchema.java | 43 +-
.../segment/QueryableIndexStorageAdapter.java | 16 +-
.../druid/segment/RowBasedStorageAdapter.java | 2 +-
.../org/apache/druid/segment/StorageAdapter.java | 19 +-
.../apache/druid/segment/column/ColumnBuilder.java | 1 -
.../apache/druid/segment/column/RowSignature.java | 11 +-
.../druid/segment/data/CompressedBlockReader.java | 248 +++
.../segment/data/CompressedBlockSerializer.java | 177 ++
.../druid/segment/data/CompressedLongsReader.java | 65 +
.../segment/data/CompressedLongsSerializer.java | 70 +
.../data/CompressedVariableSizedBlobColumn.java | 77 +
...ompressedVariableSizedBlobColumnSerializer.java | 131 ++
.../CompressedVariableSizedBlobColumnSupplier.java | 83 +
.../apache/druid/segment/data/FixedIndexed.java | 180 ++
.../druid/segment/data/FixedIndexedIntWriter.java | 145 ++
.../druid/segment/data/FixedIndexedWriter.java | 201 ++
.../incremental/IncrementalIndexAdapter.java | 1 -
.../IncrementalIndexStorageAdapter.java | 6 +-
.../apache/druid/segment/join/HashJoinSegment.java | 12 +
.../druid/segment/join/InlineJoinableFactory.java | 0
.../druid/segment/join/JoinableFactoryWrapper.java | 24 +-
.../nested/CompressedNestedDataComplexColumn.java | 473 +++++
.../segment/nested/GlobalDictionaryIdLookup.java | 128 ++
.../nested/GlobalDictionarySortedCollector.java | 66 +
.../segment/nested/GlobalDimensionDictionary.java | 213 ++
.../segment/nested/LocalDimensionDictionary.java | 45 +-
.../segment/nested/NestedDataColumnMetadata.java | 73 +
.../segment/nested/NestedDataColumnSerializer.java | 710 +++++++
.../segment/nested/NestedDataColumnSupplier.java | 151 ++
.../segment/nested/NestedDataComplexColumn.java | 137 ++
.../segment/nested/NestedDataComplexTypeSerde.java | 144 ++
.../NestedFieldLiteralColumnIndexSupplier.java | 1007 +++++++++
.../NestedFieldLiteralDictionaryEncodedColumn.java | 753 +++++++
.../segment/nested/NestedLiteralTypeInfo.java | 229 +++
.../segment/nested/NestedPathArrayElement.java | 97 +
.../druid/segment/nested/NestedPathField.java | 88 +
.../druid/segment/nested/NestedPathFinder.java | 368 ++++
.../druid/segment/nested/NestedPathPart.java | 33 +-
.../druid/segment/nested/StructuredData.java | 182 ++
.../nested/StructuredDataJsonSerializer.java | 41 +-
.../segment/nested/StructuredDataProcessor.java | 237 +++
.../segment/virtual/NestedFieldVirtualColumn.java | 750 +++++++
.../java/org/apache/druid/frame/FrameTest.java | 469 +++++
.../druid/frame/TestArrayStorageAdapter.java | 56 +
.../druid/frame/field/ComplexFieldReaderTest.java | 188 ++
.../druid/frame/field/DoubleFieldReaderTest.java | 201 ++
.../druid/frame/field/FloatFieldReaderTest.java | 201 ++
.../druid/frame/field/LongFieldReaderTest.java | 201 ++
.../druid/frame/field/StringFieldReaderTest.java | 230 +++
.../druid/frame/field/StringFieldWriterTest.java | 192 ++
.../org/apache/druid/frame/file/FrameFileTest.java | 399 ++++
.../druid/frame/file/FrameFileWriterTest.java | 85 +
.../frame/key/FrameComparisonWidgetImplTest.java | 162 ++
.../org/apache/druid/frame/key/KeyTestUtils.java | 111 +
.../druid/frame/key/RowKeyComparatorTest.java | 176 ++
.../apache/druid/frame/key/RowKeyReaderTest.java | 147 ++
.../org/apache/druid/frame/key/RowKeyTest.java | 94 +
.../org/apache/druid/frame/key/SortColumnTest.java | 15 +-
.../apache/druid/frame/read/FrameReaderTest.java | 97 +
.../frame/segment/FrameStorageAdapterTest.java | 429 ++++
.../druid/frame/testutil/FrameSequenceBuilder.java | 187 ++
.../apache/druid/frame/testutil/FrameTestUtil.java | 322 +++
.../frame/testutil/RowNumberUpdatingCursor.java | 85 +
.../RowReadingVectorColumnProcessorFactory.java | 135 ++
.../frame/write/FrameRowTooLargeExceptionTest.java | 17 +-
.../apache/druid/frame/write/FrameWriterTest.java | 505 +++++
.../druid/frame/write/FrameWriterTestData.java | 254 +++
.../apache/druid/frame/write/FrameWritersTest.java | 202 ++
.../org/apache/druid/query/DoubleStorageTest.java | 152 +-
.../apache/druid/query/NestedDataTestUtils.java | 394 ++++
.../java/org/apache/druid/query/TestQuery.java | 16 +
.../query/aggregation/AggregationTestHelper.java | 48 +
.../expression/NestedDataExpressionsTest.java | 349 ++++
.../druid/query/expression/TestExprMacroTable.java | 12 +-
.../query/groupby/GroupByQueryConfigTest.java | 62 +-
.../query/groupby/GroupByQueryRunnerTest.java | 74 +-
.../query/groupby/NestedDataGroupByQueryTest.java | 292 +++
.../vector/VectorGroupByEngineIteratorTest.java | 2 +
.../druid/query/lookup/LookupSegmentTest.java | 11 +-
.../druid/query/metadata/SegmentAnalysisTest.java | 89 +
.../druid/query/metadata/SegmentAnalyzerTest.java | 42 +-
.../SegmentMetadataQueryQueryToolChestTest.java | 58 +-
.../query/metadata/SegmentMetadataQueryTest.java | 468 +++--
.../metadata/SegmentMetadataUnionQueryTest.java | 29 +-
.../druid/query/scan/NestedDataScanQueryTest.java | 708 +++++++
.../druid/query/topn/NestedDataTopNQueryTest.java | 181 ++
.../org/apache/druid/segment/IndexBuilder.java | 24 +-
.../druid/segment/NestedDataColumnIndexerTest.java | 86 +
.../segment/RowBasedColumnSelectorFactoryTest.java | 2 +-
.../druid/segment/RowBasedStorageAdapterTest.java | 14 +-
.../data/CompressedVariableSizeBlobColumnTest.java | 235 +++
.../druid/segment/data/FixedIndexedTest.java | 164 ++
.../druid/segment/filter/BaseFilterTest.java | 20 +-
.../druid/segment/generator/SegmentGenerator.java | 41 +-
.../segment/join/InlineJoinableFactoryTest.java | 0
.../segment/join/JoinableFactoryWrapperTest.java | 123 +-
.../NestedFieldLiteralColumnIndexSupplierTest.java | 98 +
.../druid/segment/nested/NestedPathFinderTest.java | 441 ++++
.../druid/segment/nested/NestedPathPartTest.java | 66 +
.../druid/segment/nested/StructuredDataTest.java | 103 +
.../virtual/NestedFieldVirtualColumnTest.java | 97 +
.../resources/numeric-nested-test-data-parser.json | 20 +
.../test/resources/numeric-nested-test-data.json | 10 +
.../resources/simple-nested-test-data-aggs.json | 6 +
.../resources/simple-nested-test-data-parser.json | 33 +
.../simple-nested-test-data-tsv-parser.json | 41 +
.../simple-nested-test-data-tsv-transform.json | 24 +
.../test/resources/simple-nested-test-data.json | 8 +
.../src/test/resources/simple-nested-test-data.tsv | 8 +
.../druid/client/CachingClusteredClient.java | 5 +-
.../apache/druid/client/indexing/TaskStatus.java | 101 -
.../org/apache/druid/guice/ExpressionModule.java | 57 +-
.../druid/initialization/Initialization.java | 2 +
.../apache/druid/rpc/indexing/OverlordClient.java | 2 +-
.../druid/rpc/indexing/OverlordClientImpl.java | 2 +-
.../segment/realtime/RealtimeMetricsMonitor.java | 23 +
.../realtime/appenderator/Appenderators.java | 3 +-
.../appenderator/SinkQuerySegmentWalker.java | 5 +-
.../UnifiedIndexerAppenderatorsManager.java | 9 +-
.../segment/realtime/plumber/RealtimePlumber.java | 3 +-
.../druid/server/LocalQuerySegmentWalker.java | 5 +-
.../org/apache/druid/server/SegmentManager.java | 51 +-
.../coordination/SegmentLoadDropHandler.java | 11 +
.../druid/server/coordination/ServerManager.java | 5 +-
.../druid/server/initialization/ServerConfig.java | 1 +
.../metrics/SegmentRowCountDistribution.java | 161 ++
.../druid/server/metrics/SegmentStatsMonitor.java | 105 +
.../metrics/WorkerTaskCountStatsMonitor.java | 2 +-
.../CachingClusteredClientFunctionalityTest.java | 5 +-
.../client/CachingClusteredClientPerfTest.java | 4 +-
.../druid/client/CachingClusteredClientTest.java | 5 +-
.../druid/client/indexing/NoopOverlordClient.java | 1 +
.../druid/initialization/ServerConfigTest.java | 4 +-
.../QueryRunnerBasedOnClusteredClientTestBase.java | 5 +-
.../segment/loading/CacheTestSegmentLoader.java | 102 +-
.../realtime/RealtimeMetricsMonitorTest.java | 75 +
.../UnifiedIndexerAppenderatorsManagerTest.java | 4 +-
.../druid/server/ClientQuerySegmentWalkerTest.java | 6 +-
.../org/apache/druid/server/QueryStackTests.java | 9 +-
.../apache/druid/server/SegmentManagerTest.java | 6 +-
.../server/SegmentManagerThreadSafetyTest.java | 6 +-
.../server/TestClusterQuerySegmentWalker.java | 5 +-
.../server/coordination/ServerManagerTest.java | 4 +-
.../metrics/SegmentRowCountDistributionTest.java | 233 +++
.../server/metrics/SegmentStatsMonitorTest.java | 214 ++
.../metrics/WorkerTaskCountStatsMonitorTest.java | 10 +-
.../apache/calcite/prepare/DruidSqlValidator.java | 41 +-
.../calcite/expression/OperatorConversions.java | 1 -
.../builtin/NestedDataOperatorConversions.java | 606 ++++++
.../builtin/ReductionOperatorConversionHelper.java | 12 +-
.../druid/sql/calcite/planner/CalcitePlanner.java | 437 ++++
.../apache/druid/sql/calcite/planner/Calcites.java | 9 +
.../sql/calcite/planner/DruidOperatorTable.java | 17 +
.../druid/sql/calcite/planner/DruidPlanner.java | 106 +-
.../druid/sql/calcite/schema/DruidSchema.java | 5 +-
.../druid/sql/avatica/DruidAvaticaHandlerTest.java | 40 +-
.../druid/sql/avatica/DruidStatementTest.java | 6 +-
.../druid/sql/calcite/CalciteExplainQueryTest.java | 12 +-
.../druid/sql/calcite/CalciteIngestionDmlTest.java | 2 +-
.../druid/sql/calcite/CalciteInsertDmlTest.java | 15 +
.../sql/calcite/CalciteNestedDataQueryTest.java | 2162 ++++++++++++++++++++
.../apache/druid/sql/calcite/CalciteQueryTest.java | 114 +-
.../druid/sql/calcite/CalciteReplaceDmlTest.java | 13 +
.../druid/sql/calcite/CalciteSelectQueryTest.java | 50 +-
.../druid/sql/calcite/TestQueryMakerFactory.java | 2 +-
.../druid/sql/calcite/schema/DruidSchemaTest.java | 121 +-
.../druid/sql/calcite/util/CalciteTests.java | 28 +-
.../util/SpecificSegmentsQuerySegmentWalker.java | 72 +-
.../org/apache/druid/sql/http/SqlResourceTest.java | 33 +-
web-console/e2e-tests/tutorial-batch.spec.ts | 8 +-
web-console/src/bootstrap/ace.ts | 1 +
.../segment-timeline/segment-timeline.tsx | 5 +-
web-console/src/components/show-json/show-json.tsx | 16 +-
web-console/src/utils/sampler.ts | 39 +-
.../src/views/load-data-view/load-data-view.tsx | 27 +-
website/.spelling | 88 +
website/sidebars.json | 1 +
342 files changed, 36791 insertions(+), 1863 deletions(-)
create mode 100644
benchmarks/src/test/java/org/apache/druid/benchmark/query/SqlNestedDataBenchmark.java
create mode 100644
core/src/test/java/org/apache/druid/java/util/common/parsers/ObjectFlattenersTest.java
create mode 100644 docs/querying/sql-functions.md
create mode 100644
indexing-service/src/test/java/org/apache/druid/indexing/common/stats/TaskRealtimeMetricsMonitorTest.java
create mode 100644 processing/src/main/java/org/apache/druid/frame/Frame.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/FrameType.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/allocation/AppendableMemory.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/allocation/ArenaMemoryAllocator.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/allocation/HeapMemoryAllocator.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/allocation/MemoryAllocator.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/allocation/MemoryRange.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/field/ComplexFieldReader.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/field/ComplexFieldWriter.java
copy
core/src/main/java/org/apache/druid/java/util/common/parsers/ObjectFlattener.java
=>
processing/src/main/java/org/apache/druid/frame/field/ConstantFieldPointer.java
(74%)
create mode 100644
processing/src/main/java/org/apache/druid/frame/field/DoubleFieldReader.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/field/DoubleFieldWriter.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/field/FieldReader.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/field/FieldReaders.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/field/FieldWriter.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/field/FieldWriters.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/field/FloatFieldReader.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/field/FloatFieldWriter.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/field/LongFieldReader.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/field/LongFieldWriter.java
copy
core/src/main/java/org/apache/druid/java/util/common/parsers/ObjectFlattener.java
=>
processing/src/main/java/org/apache/druid/frame/field/ReadableFieldPointer.java
(66%)
create mode 100644
processing/src/main/java/org/apache/druid/frame/field/RowMemoryFieldPointer.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/field/RowReader.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/field/StringArrayFieldWriter.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/field/StringFieldReader.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/field/StringFieldWriter.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/file/FrameFile.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/file/FrameFileWriter.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/key/FrameComparisonWidget.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/key/FrameComparisonWidgetImpl.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/key/RowKey.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/key/RowKeyComparator.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/key/RowKeyReader.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/key/SortColumn.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/read/FrameReader.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/read/FrameReaderUtils.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/read/columnar/ColumnPlus.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/read/columnar/ComplexFrameColumnReader.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/read/columnar/DoubleFrameColumnReader.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/read/columnar/FloatFrameColumnReader.java
copy
cloud/aws-common/src/main/java/org/apache/druid/common/aws/AWSEndpointConfig.java
=>
processing/src/main/java/org/apache/druid/frame/read/columnar/FrameColumnReader.java
(61%)
create mode 100644
processing/src/main/java/org/apache/druid/frame/read/columnar/FrameColumnReaders.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/read/columnar/LongFrameColumnReader.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/read/columnar/StringFrameColumnReader.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/segment/FrameCursor.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/segment/FrameCursorUtils.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/segment/FrameFilteredOffset.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/segment/FrameSegment.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/segment/FrameStorageAdapter.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/segment/columnar/FrameCursorFactory.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/segment/columnar/FrameQueryableIndex.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/segment/columnar/FrameVectorCursor.java
copy
core/src/main/java/org/apache/druid/java/util/common/parsers/ObjectFlattener.java
=> processing/src/main/java/org/apache/druid/frame/segment/package-info.java
(81%)
copy
cloud/aws-common/src/main/java/org/apache/druid/common/aws/AWSEndpointConfig.java
=>
processing/src/main/java/org/apache/druid/frame/segment/row/ConstantFrameRowPointer.java
(67%)
create mode 100644
processing/src/main/java/org/apache/druid/frame/segment/row/CursorFrameRowPointer.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/segment/row/FrameColumnSelectorFactory.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/segment/row/FrameCursorFactory.java
copy
cloud/aws-common/src/main/java/org/apache/druid/common/aws/AWSEndpointConfig.java
=>
processing/src/main/java/org/apache/druid/frame/segment/row/ReadableFrameRowPointer.java
(61%)
create mode 100644
processing/src/main/java/org/apache/druid/frame/util/SettableLongVirtualColumn.java
copy
core/src/main/java/org/apache/druid/java/util/metrics/AbstractMonitor.java =>
processing/src/main/java/org/apache/druid/frame/write/FrameRowTooLargeException.java
(56%)
create mode 100644
processing/src/main/java/org/apache/druid/frame/write/FrameSort.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/write/FrameWriter.java
copy
cloud/aws-common/src/main/java/org/apache/druid/common/aws/AWSEndpointConfig.java
=>
processing/src/main/java/org/apache/druid/frame/write/FrameWriterFactory.java
(66%)
create mode 100644
processing/src/main/java/org/apache/druid/frame/write/FrameWriterUtils.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/write/FrameWriters.java
copy
core/src/main/java/org/apache/druid/java/util/common/parsers/ObjectFlattener.java
=>
processing/src/main/java/org/apache/druid/frame/write/InvalidNullByteException.java
(76%)
create mode 100644
processing/src/main/java/org/apache/druid/frame/write/RowBasedFrameWriter.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/write/RowBasedFrameWriterFactory.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/write/UnsupportedColumnTypeException.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/write/columnar/ColumnarFrameWriter.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/write/columnar/ColumnarFrameWriterFactory.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/write/columnar/ComplexFrameColumnWriter.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/write/columnar/DoubleFrameColumnWriter.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/write/columnar/FloatFrameColumnWriter.java
copy
core/src/main/java/org/apache/druid/java/util/common/parsers/ObjectFlattener.java
=>
processing/src/main/java/org/apache/druid/frame/write/columnar/FrameColumnWriter.java
(71%)
create mode 100644
processing/src/main/java/org/apache/druid/frame/write/columnar/FrameColumnWriters.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/write/columnar/LongFrameColumnWriter.java
create mode 100644
processing/src/main/java/org/apache/druid/frame/write/columnar/StringFrameColumnWriter.java
create mode 100644
processing/src/main/java/org/apache/druid/guice/NestedDataModule.java
create mode 100644
processing/src/main/java/org/apache/druid/query/expression/NestedDataExpressions.java
create mode 100644
processing/src/main/java/org/apache/druid/segment/ComparatorDimensionDictionary.java
create mode 100644
processing/src/main/java/org/apache/druid/segment/ComparatorSortedDimensionDictionary.java
create mode 100644
processing/src/main/java/org/apache/druid/segment/NestedDataColumnIndexer.java
create mode 100644
processing/src/main/java/org/apache/druid/segment/NestedDataColumnMerger.java
create mode 100644
processing/src/main/java/org/apache/druid/segment/NestedDataDimensionHandler.java
copy
cloud/aws-common/src/main/java/org/apache/druid/common/aws/AWSProxyConfig.java
=>
processing/src/main/java/org/apache/druid/segment/NestedDataDimensionSchema.java
(58%)
create mode 100644
processing/src/main/java/org/apache/druid/segment/data/CompressedBlockReader.java
create mode 100644
processing/src/main/java/org/apache/druid/segment/data/CompressedBlockSerializer.java
create mode 100644
processing/src/main/java/org/apache/druid/segment/data/CompressedLongsReader.java
create mode 100644
processing/src/main/java/org/apache/druid/segment/data/CompressedLongsSerializer.java
create mode 100644
processing/src/main/java/org/apache/druid/segment/data/CompressedVariableSizedBlobColumn.java
create mode 100644
processing/src/main/java/org/apache/druid/segment/data/CompressedVariableSizedBlobColumnSerializer.java
create mode 100644
processing/src/main/java/org/apache/druid/segment/data/CompressedVariableSizedBlobColumnSupplier.java
create mode 100644
processing/src/main/java/org/apache/druid/segment/data/FixedIndexed.java
create mode 100644
processing/src/main/java/org/apache/druid/segment/data/FixedIndexedIntWriter.java
create mode 100644
processing/src/main/java/org/apache/druid/segment/data/FixedIndexedWriter.java
rename {server =>
processing}/src/main/java/org/apache/druid/segment/join/InlineJoinableFactory.java
(100%)
create mode 100644
processing/src/main/java/org/apache/druid/segment/nested/CompressedNestedDataComplexColumn.java
create mode 100644
processing/src/main/java/org/apache/druid/segment/nested/GlobalDictionaryIdLookup.java
create mode 100644
processing/src/main/java/org/apache/druid/segment/nested/GlobalDictionarySortedCollector.java
create mode 100644
processing/src/main/java/org/apache/druid/segment/nested/GlobalDimensionDictionary.java
copy
core/src/main/java/org/apache/druid/java/util/metrics/AbstractMonitor.java =>
processing/src/main/java/org/apache/druid/segment/nested/LocalDimensionDictionary.java
(54%)
create mode 100644
processing/src/main/java/org/apache/druid/segment/nested/NestedDataColumnMetadata.java
create mode 100644
processing/src/main/java/org/apache/druid/segment/nested/NestedDataColumnSerializer.java
create mode 100644
processing/src/main/java/org/apache/druid/segment/nested/NestedDataColumnSupplier.java
create mode 100644
processing/src/main/java/org/apache/druid/segment/nested/NestedDataComplexColumn.java
create mode 100644
processing/src/main/java/org/apache/druid/segment/nested/NestedDataComplexTypeSerde.java
create mode 100644
processing/src/main/java/org/apache/druid/segment/nested/NestedFieldLiteralColumnIndexSupplier.java
create mode 100644
processing/src/main/java/org/apache/druid/segment/nested/NestedFieldLiteralDictionaryEncodedColumn.java
create mode 100644
processing/src/main/java/org/apache/druid/segment/nested/NestedLiteralTypeInfo.java
create mode 100644
processing/src/main/java/org/apache/druid/segment/nested/NestedPathArrayElement.java
create mode 100644
processing/src/main/java/org/apache/druid/segment/nested/NestedPathField.java
create mode 100644
processing/src/main/java/org/apache/druid/segment/nested/NestedPathFinder.java
copy
cloud/aws-common/src/main/java/org/apache/druid/common/aws/AWSEndpointConfig.java
=>
processing/src/main/java/org/apache/druid/segment/nested/NestedPathPart.java
(60%)
create mode 100644
processing/src/main/java/org/apache/druid/segment/nested/StructuredData.java
copy
core/src/main/java/org/apache/druid/java/util/metrics/AbstractMonitor.java =>
processing/src/main/java/org/apache/druid/segment/nested/StructuredDataJsonSerializer.java
(56%)
create mode 100644
processing/src/main/java/org/apache/druid/segment/nested/StructuredDataProcessor.java
create mode 100644
processing/src/main/java/org/apache/druid/segment/virtual/NestedFieldVirtualColumn.java
create mode 100644
processing/src/test/java/org/apache/druid/frame/FrameTest.java
create mode 100644
processing/src/test/java/org/apache/druid/frame/TestArrayStorageAdapter.java
create mode 100644
processing/src/test/java/org/apache/druid/frame/field/ComplexFieldReaderTest.java
create mode 100644
processing/src/test/java/org/apache/druid/frame/field/DoubleFieldReaderTest.java
create mode 100644
processing/src/test/java/org/apache/druid/frame/field/FloatFieldReaderTest.java
create mode 100644
processing/src/test/java/org/apache/druid/frame/field/LongFieldReaderTest.java
create mode 100644
processing/src/test/java/org/apache/druid/frame/field/StringFieldReaderTest.java
create mode 100644
processing/src/test/java/org/apache/druid/frame/field/StringFieldWriterTest.java
create mode 100644
processing/src/test/java/org/apache/druid/frame/file/FrameFileTest.java
create mode 100644
processing/src/test/java/org/apache/druid/frame/file/FrameFileWriterTest.java
create mode 100644
processing/src/test/java/org/apache/druid/frame/key/FrameComparisonWidgetImplTest.java
create mode 100644
processing/src/test/java/org/apache/druid/frame/key/KeyTestUtils.java
create mode 100644
processing/src/test/java/org/apache/druid/frame/key/RowKeyComparatorTest.java
create mode 100644
processing/src/test/java/org/apache/druid/frame/key/RowKeyReaderTest.java
create mode 100644
processing/src/test/java/org/apache/druid/frame/key/RowKeyTest.java
copy
core/src/main/java/org/apache/druid/java/util/common/parsers/ObjectFlattener.java
=> processing/src/test/java/org/apache/druid/frame/key/SortColumnTest.java
(76%)
create mode 100644
processing/src/test/java/org/apache/druid/frame/read/FrameReaderTest.java
create mode 100644
processing/src/test/java/org/apache/druid/frame/segment/FrameStorageAdapterTest.java
create mode 100644
processing/src/test/java/org/apache/druid/frame/testutil/FrameSequenceBuilder.java
create mode 100644
processing/src/test/java/org/apache/druid/frame/testutil/FrameTestUtil.java
create mode 100644
processing/src/test/java/org/apache/druid/frame/testutil/RowNumberUpdatingCursor.java
create mode 100644
processing/src/test/java/org/apache/druid/frame/testutil/RowReadingVectorColumnProcessorFactory.java
copy
core/src/main/java/org/apache/druid/java/util/common/parsers/ObjectFlattener.java
=>
processing/src/test/java/org/apache/druid/frame/write/FrameRowTooLargeExceptionTest.java
(69%)
create mode 100644
processing/src/test/java/org/apache/druid/frame/write/FrameWriterTest.java
create mode 100644
processing/src/test/java/org/apache/druid/frame/write/FrameWriterTestData.java
create mode 100644
processing/src/test/java/org/apache/druid/frame/write/FrameWritersTest.java
create mode 100644
processing/src/test/java/org/apache/druid/query/NestedDataTestUtils.java
create mode 100644
processing/src/test/java/org/apache/druid/query/expression/NestedDataExpressionsTest.java
create mode 100644
processing/src/test/java/org/apache/druid/query/groupby/NestedDataGroupByQueryTest.java
create mode 100644
processing/src/test/java/org/apache/druid/query/metadata/SegmentAnalysisTest.java
create mode 100644
processing/src/test/java/org/apache/druid/query/scan/NestedDataScanQueryTest.java
create mode 100644
processing/src/test/java/org/apache/druid/query/topn/NestedDataTopNQueryTest.java
create mode 100644
processing/src/test/java/org/apache/druid/segment/NestedDataColumnIndexerTest.java
create mode 100644
processing/src/test/java/org/apache/druid/segment/data/CompressedVariableSizeBlobColumnTest.java
create mode 100644
processing/src/test/java/org/apache/druid/segment/data/FixedIndexedTest.java
rename {server =>
processing}/src/test/java/org/apache/druid/segment/join/InlineJoinableFactoryTest.java
(100%)
create mode 100644
processing/src/test/java/org/apache/druid/segment/nested/NestedFieldLiteralColumnIndexSupplierTest.java
create mode 100644
processing/src/test/java/org/apache/druid/segment/nested/NestedPathFinderTest.java
create mode 100644
processing/src/test/java/org/apache/druid/segment/nested/NestedPathPartTest.java
create mode 100644
processing/src/test/java/org/apache/druid/segment/nested/StructuredDataTest.java
create mode 100644
processing/src/test/java/org/apache/druid/segment/virtual/NestedFieldVirtualColumnTest.java
create mode 100644
processing/src/test/resources/numeric-nested-test-data-parser.json
create mode 100644 processing/src/test/resources/numeric-nested-test-data.json
create mode 100644
processing/src/test/resources/simple-nested-test-data-aggs.json
create mode 100644
processing/src/test/resources/simple-nested-test-data-parser.json
create mode 100644
processing/src/test/resources/simple-nested-test-data-tsv-parser.json
create mode 100644
processing/src/test/resources/simple-nested-test-data-tsv-transform.json
create mode 100644 processing/src/test/resources/simple-nested-test-data.json
create mode 100644 processing/src/test/resources/simple-nested-test-data.tsv
delete mode 100644
server/src/main/java/org/apache/druid/client/indexing/TaskStatus.java
create mode 100644
server/src/main/java/org/apache/druid/server/metrics/SegmentRowCountDistribution.java
create mode 100644
server/src/main/java/org/apache/druid/server/metrics/SegmentStatsMonitor.java
create mode 100644
server/src/test/java/org/apache/druid/segment/realtime/RealtimeMetricsMonitorTest.java
create mode 100644
server/src/test/java/org/apache/druid/server/metrics/SegmentRowCountDistributionTest.java
create mode 100644
server/src/test/java/org/apache/druid/server/metrics/SegmentStatsMonitorTest.java
copy
core/src/main/java/org/apache/druid/java/util/metrics/AbstractMonitor.java =>
sql/src/main/java/org/apache/calcite/prepare/DruidSqlValidator.java (54%)
create mode 100644
sql/src/main/java/org/apache/druid/sql/calcite/expression/builtin/NestedDataOperatorConversions.java
create mode 100644
sql/src/main/java/org/apache/druid/sql/calcite/planner/CalcitePlanner.java
create mode 100644
sql/src/test/java/org/apache/druid/sql/calcite/CalciteNestedDataQueryTest.java
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
