This is an automated email from the ASF dual-hosted git repository.
xiangfu pushed a change to branch upgrade_jdk_11
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
discard 06ff521 move http requests in ControlerTest to use apache http client
lib
discard 04f2831 upgrade jdk to 11
add a67cf87 Pinot Minion SegmentGenerationAndPush task: PinotFS configs
inside taskSpec is always temporary and has higher priority than default
PinotFS created by the minion server configs (#6744)
add 4aef4c4 Extend the quick-start test setup time from 30 seconds to 1
minute (#6746)
add 913492e Remove legacy docs (#6747)
add 2f89971 Interface changes for Kinesis connector (#6667)
add 737265d In Quickstart, do not start minions by default (#6749)
add 50a4531 fixing license headers and plugin checks (#6748)
add 4b0db5a Fixing minion SegmentGenerationAndPushTask to for task spec
generator using created PinotFS (#6755)
add 25bd754 Add more logging for segment reloading status. (#6754)
add 4fd84be Added guava cache package to common relocated packages (#6758)
add 5815f4c Fix hadoop-mapreduce-client-core dependency. (#6743)
add 409e5da SegmentUploader impl (#6740)
add 3028055 Fix quick-start tests (#6751)
add 26b990e upgrade jdk to 11
add 9fe250e move http requests in ControlerTest to use apache http client
lib
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (06ff521)
\
N -- N -- N refs/heads/upgrade_jdk_11 (9fe250e)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.codecov.yml | 19 +
.github/workflows/scripts/.pinot_quickstart.sh | 34 +-
docs/Makefile | 230 ------------
docs/README.md | 28 --
docs/admin_guide.rst | 39 ---
docs/architecture.rst | 214 ------------
docs/batch_data_ingestion.rst | 223 ------------
docs/client_api.rst | 252 --------------
docs/code_modules.rst | 153 --------
docs/conf.py | 313 -----------------
docs/contribution_guidelines.rst | 263 --------------
docs/customizations.rst | 172 ---------
docs/dev_env.rst | 96 -----
docs/dev_guide.rst | 36 --
docs/docutils.conf | 2 -
docs/extensions.rst | 32 --
docs/getting_started.rst | 317 -----------------
docs/img/CustomizingPinot.png | Bin 421572 -> 0 bytes
docs/img/Pinot - Hybrid flow.png | Bin 15756 -> 0 bytes
docs/img/Pinot-Offline-only-flow.png | Bin 8179 -> 0 bytes
docs/img/PinotBroker.png | Bin 40314 -> 0 bytes
docs/img/PinotController.png | Bin 61419 -> 0 bytes
docs/img/PinotFoundation.png | Bin 29973 -> 0 bytes
docs/img/PinotMinionHadoop.png | Bin 38638 -> 0 bytes
docs/img/PinotServer.png | Bin 73944 -> 0 bytes
docs/img/dictionary.png | Bin 80599 -> 0 bytes
docs/img/eclipse_style.png | Bin 137578 -> 0 bytes
docs/img/hlc-arch.png | Bin 47924 -> 0 bytes
docs/img/image2014-11-12-1-54-56.png | Bin 112436 -> 0 bytes
docs/img/image2014-11-12-19-54-12.png | Bin 54744 -> 0 bytes
docs/img/image2014-11-12-20-59-50.png | Bin 36925 -> 0 bytes
docs/img/image2014-11-13-11-21-7.png | Bin 99075 -> 0 bytes
docs/img/image2014-11-13-11-22-57.png | Bin 27562 -> 0 bytes
docs/img/image2015-4-14-194451.png | Bin 83171 -> 0 bytes
docs/img/image2015-5-12-7-24-58.png | Bin 38969 -> 0 bytes
docs/img/image2015-5-13 15-2-9.png | Bin 41882 -> 0 bytes
docs/img/image2015-5-17 13-32-28.png | Bin 89700 -> 0 bytes
docs/img/image2015-5-17 17-59-10.png | Bin 82542 -> 0 bytes
docs/img/image2015-5-19 0-29-34.png | Bin 39085 -> 0 bytes
docs/img/image2015-5-19 0-58-54.png | Bin 54859 -> 0 bytes
docs/img/image2015-5-19 1-28-35.png | Bin 34374 -> 0 bytes
docs/img/image2015-5-19 1-47-44.png | Bin 34374 -> 0 bytes
docs/img/image2015-5-19 1-59-51.png | Bin 37098 -> 0 bytes
docs/img/import_scheme.png | Bin 164276 -> 0 bytes
docs/img/list-schemas.png | Bin 247946 -> 0 bytes
docs/img/llc-arch.png | Bin 39899 -> 0 bytes
docs/img/no-dictionary.png | Bin 111237 -> 0 bytes
docs/img/partitioning.png | Bin 81303 -> 0 bytes
docs/img/pinot-architecture.png | Bin 58474 -> 0 bytes
docs/img/pinot-console.png | Bin 157310 -> 0 bytes
docs/img/pluggable_streams.png | Bin 136984 -> 0 bytes
docs/img/rebalance-table.png | Bin 164989 -> 0 bytes
docs/img/replica-group.png | Bin 126306 -> 0 bytes
docs/img/sorted-forward.png | Bin 70022 -> 0 bytes
docs/img/sorted-inverted.png | Bin 89473 -> 0 bytes
docs/img/znode_layout.png | Bin 43271 -> 0 bytes
docs/in_production.rst | 210 -----------
docs/index.rst | 65 ----
docs/index_techniques.rst | 178 ----------
docs/intro.rst | 68 ----
docs/introduction.rst | 35 --
docs/make.bat | 300 ----------------
docs/pinot_hadoop.rst | 354 -------------------
docs/pluggable_storage.rst | 128 -------
docs/pluggable_streams.rst | 342 ------------------
docs/pql_examples.rst | 357 -------------------
docs/record_reader.rst | 117 -------
docs/schema.rst | 140 --------
docs/segment_fetcher.rst | 126 -------
docs/star-tree/example.png | Bin 29005 -> 0 bytes
docs/star-tree/space-time.png | Bin 25225 -> 0 bytes
docs/star-tree/star-tree.rst | 351 -------------------
docs/star-tree/structure.png | Bin 25841 -> 0 bytes
docs/tableconfig_schema.rst | 387 ---------------------
docs/tuning_pinot.rst | 43 ---
docs/tuning_realtime_performance.rst | 115 ------
docs/tuning_scatter_and_gather.rst | 184 ----------
docs/user_guide.rst | 35 --
rstheaderdefinition.xml => headerdefinition.xml | 10 +
pinot-common/pom.xml | 4 +
.../segment/LLCRealtimeSegmentZKMetadata.java | 5 -
.../protocols/SegmentCompletionProtocol.java | 66 ++--
.../org/apache/pinot/common/utils/URIUtils.java | 26 ++
pinot-common/src/main/proto/server.proto | 19 +
.../src/main/resources/zone-index.properties | 19 +
.../protocols/SegmentCompletionProtocolTest.java | 135 +++++++
.../apache/pinot/common/utils/URIUtilsTest.java | 28 ++
pinot-controller/pom.xml | 5 +
.../helix/core/PinotTableIdealStateBuilder.java | 51 ++-
.../realtime/PinotLLCRealtimeSegmentManager.java | 291 ++++++++++------
.../core/realtime/SegmentCompletionManager.java | 4 +-
.../SegmentSizeBasedFlushThresholdUpdater.java | 1 +
.../pinot/controller/util/FileIngestionHelper.java | 39 ++-
pinot-controller/src/main/resources/tsconfig.json | 2 +-
.../api/PinotIngestionRestletResourceTest.java | 14 +-
.../pinot/controller/helix/ControllerTest.java | 5 +
.../PinotLLCRealtimeSegmentManagerTest.java | 205 ++++++++---
.../realtime/LLRealtimeSegmentDataManager.java | 54 ++-
.../segment/index/loader/SegmentPreProcessor.java | 3 +
.../org/apache/pinot/core/util/IngestionUtils.java | 165 ++++++---
.../apache/pinot/core/util}/SegmentPushUtils.java | 2 +-
.../realtime/LLRealtimeSegmentDataManagerTest.java | 2 +
.../pinot/core/util}/SegmentPushUtilsTest.java | 2 +-
.../test/resources/conf/pinot-broker.properties | 19 +
.../test/resources/conf/query-executor.properties | 19 +
pinot-core/src/test/resources/data/README | 19 +
.../src/test/resources/generate-test-data.py | 19 +
pinot-distribution/pinot-assembly.xml | 6 +
pinot-distribution/pinot-source-assembly.xml | 11 +-
pinot-distribution/pom.xml | 2 +-
pinot-integration-tests/pom.xml | 5 +
.../tests/BaseClusterIntegrationTestSet.java | 2 +-
.../pinot/integration/tests/QueryGenerator.java | 2 +-
.../SegmentWriterUploaderIntegrationTest.java | 88 ++++-
...formance_2014_100k_subset.test_queries_10K.pql} | 19 +
...rformance_2014_100k_subset.test_queries_10K.sql | 19 +
...formance_2014_100k_subset.test_queries_500.pql} | 19 +
...rformance_2014_100k_subset.test_queries_500.sql | 19 +
.../test/resources/compat-tests/kafka/topic1.cfg | 19 +
.../queries/feature-test-1-sql.queries | 19 +
.../query-results/feature-test-1-rest-sql.results | 19 +
.../src/test/resources/index.html | 20 ++
.../hadoop/HadoopSegmentMetadataPushJobRunner.java | 2 +-
.../hadoop/HadoopSegmentTarPushJobRunner.java | 2 +-
.../hadoop/HadoopSegmentUriPushJobRunner.java | 2 +-
.../spark/SparkSegmentMetadataPushJobRunner.java | 2 +-
.../batch/spark/SparkSegmentTarPushJobRunner.java | 2 +-
.../batch/spark/SparkSegmentUriPushJobRunner.java | 2 +-
.../standalone/SegmentMetadataPushJobRunner.java | 2 +-
.../batch/standalone/SegmentTarPushJobRunner.java | 2 +-
.../batch/standalone/SegmentUriPushJobRunner.java | 2 +-
.../org.mockito.plugins.MockMaker | 19 +
.../pinot-s3/src/test/resources/log4j2.xml | 20 ++
.../pinot-input-format/pinot-parquet/pom.xml | 2 +
.../src/test/resources/complex_types.proto | 19 +
.../pinot-protobuf/src/test/resources/sample.proto | 19 +
.../SegmentGenerationAndPushTaskExecutor.java | 49 +--
.../SegmentGenerationAndPushTaskGenerator.java | 13 +-
.../SegmentGenerationAndPushTaskUtils.java | 75 ++++
.../pinot-segment-uploader-default}/pom.xml | 11 +-
.../segmentuploader/SegmentUploaderDefault.java | 100 ++++++
.../pom.xml | 8 +-
.../filebased/FileBasedSegmentWriter.java | 2 +-
pinot-plugins/pom.xml | 1 +
.../test/resources/conf/pinot-broker.properties | 19 +
.../org/apache/pinot/spi/auth/AuthContext.java | 15 +-
.../pinot/spi/ingestion/batch/BatchConfig.java | 52 ++-
.../spi/ingestion/batch/BatchConfigProperties.java | 3 +
.../segment/uploader/SegmentUploader.java | 11 +-
.../org/apache/pinot/spi/stream/LongMsgOffset.java | 5 +
.../org/apache/pinot/spi/stream/MessageBatch.java | 7 +
...geMetadata.java => PartitionGroupConsumer.java} | 33 +-
.../stream/PartitionGroupConsumptionStatus.java | 86 +++++
...geMetadata.java => PartitionGroupMetadata.java} | 31 +-
...her.java => PartitionGroupMetadataFetcher.java} | 37 +-
.../pinot/spi/stream/PartitionLevelConsumer.java | 2 +-
.../pinot/spi/stream/PartitionOffsetFetcher.java | 87 -----
.../pinot/spi/stream/StreamConsumerFactory.java | 10 +-
.../pinot/spi/stream/StreamMetadataProvider.java | 47 ++-
.../pinot/spi/stream/StreamPartitionMsgOffset.java | 12 +-
.../pinot/spi/utils/IngestionConfigUtils.java | 54 ++-
.../resources/pinot-configuration-1.properties | 19 +
.../resources/pinot-configuration-2.properties | 19 +
.../resources/pinot-configuration-3.properties | 21 +-
pinot-tools/pom.xml | 21 +-
.../pinot/tools/BatchQuickstartWithMinion.java | 5 +
.../org/apache/pinot/tools/JoinQuickStart.java | 2 +-
.../java/org/apache/pinot/tools/Quickstart.java | 10 +-
.../tools/admin/command/QuickstartRunner.java | 65 ++--
.../conf/sample_filesystem_benchmark.conf | 19 +
.../resources/conf/sample_query_comparison.conf | 19 +
pom.xml | 178 +++++-----
172 files changed, 2104 insertions(+), 6601 deletions(-)
delete mode 100644 docs/Makefile
delete mode 100644 docs/README.md
delete mode 100644 docs/admin_guide.rst
delete mode 100644 docs/architecture.rst
delete mode 100644 docs/batch_data_ingestion.rst
delete mode 100644 docs/client_api.rst
delete mode 100644 docs/code_modules.rst
delete mode 100644 docs/conf.py
delete mode 100644 docs/contribution_guidelines.rst
delete mode 100644 docs/customizations.rst
delete mode 100644 docs/dev_env.rst
delete mode 100644 docs/dev_guide.rst
delete mode 100644 docs/docutils.conf
delete mode 100644 docs/extensions.rst
delete mode 100644 docs/getting_started.rst
delete mode 100644 docs/img/CustomizingPinot.png
delete mode 100644 docs/img/Pinot - Hybrid flow.png
delete mode 100644 docs/img/Pinot-Offline-only-flow.png
delete mode 100644 docs/img/PinotBroker.png
delete mode 100644 docs/img/PinotController.png
delete mode 100644 docs/img/PinotFoundation.png
delete mode 100644 docs/img/PinotMinionHadoop.png
delete mode 100644 docs/img/PinotServer.png
delete mode 100644 docs/img/dictionary.png
delete mode 100644 docs/img/eclipse_style.png
delete mode 100644 docs/img/hlc-arch.png
delete mode 100644 docs/img/image2014-11-12-1-54-56.png
delete mode 100644 docs/img/image2014-11-12-19-54-12.png
delete mode 100644 docs/img/image2014-11-12-20-59-50.png
delete mode 100644 docs/img/image2014-11-13-11-21-7.png
delete mode 100644 docs/img/image2014-11-13-11-22-57.png
delete mode 100644 docs/img/image2015-4-14-194451.png
delete mode 100644 docs/img/image2015-5-12-7-24-58.png
delete mode 100644 docs/img/image2015-5-13 15-2-9.png
delete mode 100644 docs/img/image2015-5-17 13-32-28.png
delete mode 100644 docs/img/image2015-5-17 17-59-10.png
delete mode 100644 docs/img/image2015-5-19 0-29-34.png
delete mode 100644 docs/img/image2015-5-19 0-58-54.png
delete mode 100644 docs/img/image2015-5-19 1-28-35.png
delete mode 100644 docs/img/image2015-5-19 1-47-44.png
delete mode 100644 docs/img/image2015-5-19 1-59-51.png
delete mode 100644 docs/img/import_scheme.png
delete mode 100644 docs/img/list-schemas.png
delete mode 100644 docs/img/llc-arch.png
delete mode 100644 docs/img/no-dictionary.png
delete mode 100644 docs/img/partitioning.png
delete mode 100644 docs/img/pinot-architecture.png
delete mode 100644 docs/img/pinot-console.png
delete mode 100644 docs/img/pluggable_streams.png
delete mode 100644 docs/img/rebalance-table.png
delete mode 100644 docs/img/replica-group.png
delete mode 100644 docs/img/sorted-forward.png
delete mode 100644 docs/img/sorted-inverted.png
delete mode 100644 docs/img/znode_layout.png
delete mode 100644 docs/in_production.rst
delete mode 100644 docs/index.rst
delete mode 100644 docs/index_techniques.rst
delete mode 100644 docs/intro.rst
delete mode 100644 docs/introduction.rst
delete mode 100644 docs/make.bat
delete mode 100644 docs/pinot_hadoop.rst
delete mode 100644 docs/pluggable_storage.rst
delete mode 100644 docs/pluggable_streams.rst
delete mode 100644 docs/pql_examples.rst
delete mode 100644 docs/record_reader.rst
delete mode 100644 docs/schema.rst
delete mode 100644 docs/segment_fetcher.rst
delete mode 100755 docs/star-tree/example.png
delete mode 100755 docs/star-tree/space-time.png
delete mode 100644 docs/star-tree/star-tree.rst
delete mode 100755 docs/star-tree/structure.png
delete mode 100644 docs/tableconfig_schema.rst
delete mode 100644 docs/tuning_pinot.rst
delete mode 100644 docs/tuning_realtime_performance.rst
delete mode 100644 docs/tuning_scatter_and_gather.rst
delete mode 100644 docs/user_guide.rst
rename rstheaderdefinition.xml => headerdefinition.xml (76%)
create mode 100644
pinot-common/src/test/java/org/apache/pinot/common/protocols/SegmentCompletionProtocolTest.java
rename
{pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-common/src/main/java/org/apache/pinot/plugin/ingestion/batch/common
=> pinot-core/src/main/java/org/apache/pinot/core/util}/SegmentPushUtils.java
(99%)
rename
{pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-common/src/test/java/org/apache/pinot/plugin/ingestion/batch/common
=>
pinot-core/src/test/java/org/apache/pinot/core/util}/SegmentPushUtilsTest.java
(98%)
rename
pinot-integration-tests/src/test/resources/{On_Time_On_Time_Performance_2014_100k_subset.test_queries_10K
=> On_Time_On_Time_Performance_2014_100k_subset.test_queries_10K.pql} (99%)
rename
pinot-integration-tests/src/test/resources/{On_Time_On_Time_Performance_2014_100k_subset.test_queries_500
=> On_Time_On_Time_Performance_2014_100k_subset.test_queries_500.pql} (99%)
create mode 100644
pinot-plugins/pinot-minion-tasks/pinot-minion-builtin-tasks/src/main/java/org/apache/pinot/plugin/minion/tasks/segment_generation_and_push/SegmentGenerationAndPushTaskUtils.java
copy pinot-plugins/{pinot-segment-writer/pinot-segment-writer-file-based =>
pinot-segment-uploader/pinot-segment-uploader-default}/pom.xml (84%)
create mode 100644
pinot-plugins/pinot-segment-uploader/pinot-segment-uploader-default/src/main/java/org/apache/pinot/plugin/segmentuploader/SegmentUploaderDefault.java
copy pinot-plugins/{pinot-segment-writer => pinot-segment-uploader}/pom.xml
(91%)
copy
pinot-core/src/main/java/org/apache/pinot/core/query/scheduler/OutOfCapacityException.java
=> pinot-spi/src/main/java/org/apache/pinot/spi/auth/AuthContext.java (75%)
copy
pinot-spi/src/main/java/org/apache/pinot/spi/stream/{StreamMessageMetadata.java
=> PartitionGroupConsumer.java} (50%)
create mode 100644
pinot-spi/src/main/java/org/apache/pinot/spi/stream/PartitionGroupConsumptionStatus.java
copy
pinot-spi/src/main/java/org/apache/pinot/spi/stream/{StreamMessageMetadata.java
=> PartitionGroupMetadata.java} (51%)
rename
pinot-spi/src/main/java/org/apache/pinot/spi/stream/{PartitionCountFetcher.java
=> PartitionGroupMetadataFetcher.java} (58%)
delete mode 100644
pinot-spi/src/main/java/org/apache/pinot/spi/stream/PartitionOffsetFetcher.java
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
