[incubator-pinot] branch pinot-jfrog-bintray updated (246eefe -> 2e2ff3c)
This is an automated email from the ASF dual-hosted git repository. jlli pushed a change to branch pinot-jfrog-bintray in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git. discard 246eefe Change versions before deploying to bintray add 2e2ff3c Change versions before deploying to bintray This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (246eefe) \ N -- N -- N refs/heads/pinot-jfrog-bintray (2e2ff3c) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. No new revisions were added by this update. Summary of changes: .travis.yml | 2 ++ .travis_nightly_build.sh | 2 +- 2 files changed, 3 insertions(+), 1 deletion(-) - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[incubator-pinot] branch pinot-jfrog-bintray updated (deb88ae -> 246eefe)
This is an automated email from the ASF dual-hosted git repository. jlli pushed a change to branch pinot-jfrog-bintray in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git. discard deb88ae Change versions before deploying to bintray add 246eefe Change versions before deploying to bintray This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (deb88ae) \ N -- N -- N refs/heads/pinot-jfrog-bintray (246eefe) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. No new revisions were added by this update. Summary of changes: .travis_nightly_build.sh | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[incubator-pinot] branch pinot-jfrog-bintray updated (01450ce -> deb88ae)
This is an automated email from the ASF dual-hosted git repository. jlli pushed a change to branch pinot-jfrog-bintray in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git. discard 01450ce Change versions before deploying to bintray add deb88ae Change versions before deploying to bintray This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (01450ce) \ N -- N -- N refs/heads/pinot-jfrog-bintray (deb88ae) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. No new revisions were added by this update. Summary of changes: .travis_nightly_build.sh | 11 +-- 1 file changed, 5 insertions(+), 6 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[incubator-pinot] branch pinot-jfrog-bintray updated (07eb7c2 -> 01450ce)
This is an automated email from the ASF dual-hosted git repository. jlli pushed a change to branch pinot-jfrog-bintray in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git. discard 07eb7c2 Change versions before deploying to bintray discard 43b6b79 Add relative path discard e6eff7c Testing discard 3c56219 Fix the build discard 6c672ce Deploy pinot to bintray add 4a6b21d Fix docker compose & quick start (#5178) add b274d02 Prepare for pinot release 0.4.0 (#5186) add ed235d2 Add a simple PinotFS benchmark driver (#5160) add 8ff155a Change the name for azure data lake gen2 implementation (#5188) add 02352ce Deploy pinot to bintray add 26beead Fix the build add 8d7d03d Testing add e31571e Add relative path add 01450ce Change versions before deploying to bintray This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (07eb7c2) \ N -- N -- N refs/heads/pinot-jfrog-bintray (01450ce) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. No new revisions were added by this update. Summary of changes: docker/images/pinot/README.md | 4 +- docker/images/pinot/docker-compose.yml | 2 +- pinot-common/pom.xml | 36 +-- ...{AzureGen2PinotFS.java => ADLSGen2PinotFS.java} | 6 +- .../org/apache/pinot/tools/PinotToolLauncher.java | 10 +- .../tools/filesystem/PinotFSBenchmarkDriver.java | 249 + .../tools/filesystem/PinotFSBenchmarkRunner.java | 79 +++ .../conf/sample_filesystem_benchmark.conf | 5 + pom.xml| 10 +- 9 files changed, 370 insertions(+), 31 deletions(-) rename pinot-plugins/pinot-file-system/pinot-adls/src/main/java/org/apache/pinot/plugin/filesystem/{AzureGen2PinotFS.java => ADLSGen2PinotFS.java} (99%) create mode 100644 pinot-tools/src/main/java/org/apache/pinot/tools/filesystem/PinotFSBenchmarkDriver.java create mode 100644 pinot-tools/src/main/java/org/apache/pinot/tools/filesystem/PinotFSBenchmarkRunner.java create mode 100644 pinot-tools/src/main/resources/conf/sample_filesystem_benchmark.conf - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[incubator-pinot] branch pinot-jfrog-bintray updated (e889599 -> 07eb7c2)
This is an automated email from the ASF dual-hosted git repository. jlli pushed a change to branch pinot-jfrog-bintray in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git. discard e889599 Change versions before deploying to bintray add 07eb7c2 Change versions before deploying to bintray This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (e889599) \ N -- N -- N refs/heads/pinot-jfrog-bintray (07eb7c2) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. No new revisions were added by this update. Summary of changes: .travis_nightly_build.sh | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[incubator-pinot] branch master updated: Change the name for azure data lake gen2 implementation (#5188)
This is an automated email from the ASF dual-hosted git repository. snlee pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git The following commit(s) were added to refs/heads/master by this push: new 8ff155a Change the name for azure data lake gen2 implementation (#5188) 8ff155a is described below commit 8ff155a2a0bad5784d125d9e188fdf015acf5ec1 Author: Seunghyun Lee AuthorDate: Wed Mar 25 19:13:54 2020 -0700 Change the name for azure data lake gen2 implementation (#5188) --- .../filesystem/{AzureGen2PinotFS.java => ADLSGen2PinotFS.java} | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/pinot-plugins/pinot-file-system/pinot-adls/src/main/java/org/apache/pinot/plugin/filesystem/AzureGen2PinotFS.java b/pinot-plugins/pinot-file-system/pinot-adls/src/main/java/org/apache/pinot/plugin/filesystem/ADLSGen2PinotFS.java similarity index 99% rename from pinot-plugins/pinot-file-system/pinot-adls/src/main/java/org/apache/pinot/plugin/filesystem/AzureGen2PinotFS.java rename to pinot-plugins/pinot-file-system/pinot-adls/src/main/java/org/apache/pinot/plugin/filesystem/ADLSGen2PinotFS.java index 488aca7..ba45764 100644 --- a/pinot-plugins/pinot-file-system/pinot-adls/src/main/java/org/apache/pinot/plugin/filesystem/AzureGen2PinotFS.java +++ b/pinot-plugins/pinot-file-system/pinot-adls/src/main/java/org/apache/pinot/plugin/filesystem/ADLSGen2PinotFS.java @@ -66,8 +66,8 @@ import org.slf4j.LoggerFactory; * * TODO: add the unit test */ -public class AzureGen2PinotFS extends PinotFS { - private static final Logger LOGGER = LoggerFactory.getLogger(AzureGen2PinotFS.class); +public class ADLSGen2PinotFS extends PinotFS { + private static final Logger LOGGER = LoggerFactory.getLogger(ADLSGen2PinotFS.class); private static final String ACCOUNT_NAME = "accountName"; private static final String ACCESS_KEY = "accessKey"; @@ -117,7 +117,7 @@ public class AzureGen2PinotFS extends PinotFS { _blobServiceClient = new BlobServiceClientBuilder().credential(sharedKeyCredential).endpoint(blobServiceEndpointUrl).buildClient(); _fileSystemClient = serviceClient.getFileSystemClient(fileSystemName); -LOGGER.info("AzureGen2PinotFS is initialized (accountName={}, fileSystemName={}, dfsServiceEndpointUrl={}, " +LOGGER.info("ADLSGen2PinotFS is initialized (accountName={}, fileSystemName={}, dfsServiceEndpointUrl={}, " + "blobServiceEndpointUrl={}, enableChecksum={})", accountName, fileSystemName, dfsServiceEndpointUrl, blobServiceEndpointUrl, _enableChecksum); } - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[GitHub] [incubator-pinot] snleee merged pull request #5188: Change the name for azure data lake gen2 implementation
snleee merged pull request #5188: Change the name for azure data lake gen2 implementation URL: https://github.com/apache/incubator-pinot/pull/5188 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[incubator-pinot] branch pinot-jfrog-bintray updated (8bc52e8 -> e889599)
This is an automated email from the ASF dual-hosted git repository. jlli pushed a change to branch pinot-jfrog-bintray in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git. discard 8bc52e8 Change versions before deploying to bintray add e889599 Change versions before deploying to bintray This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (8bc52e8) \ N -- N -- N refs/heads/pinot-jfrog-bintray (e889599) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. No new revisions were added by this update. Summary of changes: .travis_nightly_build.sh | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[incubator-pinot] branch pinot-jfrog-bintray updated (f6f1abe -> 8bc52e8)
This is an automated email from the ASF dual-hosted git repository. jlli pushed a change to branch pinot-jfrog-bintray in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git. omit f6f1abe Change versions before deploying to bintray add 8bc52e8 Change versions before deploying to bintray This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (f6f1abe) \ N -- N -- N refs/heads/pinot-jfrog-bintray (8bc52e8) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. No new revisions were added by this update. Summary of changes: .travis_nightly_build.sh | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[GitHub] [incubator-pinot] codecov-io commented on issue #5188: Change the name for azure data lake gen2 implementation
codecov-io commented on issue #5188: Change the name for azure data lake gen2 implementation URL: https://github.com/apache/incubator-pinot/pull/5188#issuecomment-604174255 # [Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/5188?src=pr=h1) Report > Merging [#5188](https://codecov.io/gh/apache/incubator-pinot/pull/5188?src=pr=desc) into [master](https://codecov.io/gh/apache/incubator-pinot/commit/4a6b21df1474cb82cdf790e7f1eb02dd4229a986=desc) will **decrease** coverage by `9.64%`. > The diff coverage is `n/a`. [![Impacted file tree graph](https://codecov.io/gh/apache/incubator-pinot/pull/5188/graphs/tree.svg?width=650=150=pr=4ibza2ugkz)](https://codecov.io/gh/apache/incubator-pinot/pull/5188?src=pr=tree) ```diff @@ Coverage Diff @@ ## master#5188 +/- ## - Coverage 66.12% 56.48% -9.65% Complexity 12 12 Files 1052 1052 Lines 5417054170 Branches 8078 8078 - Hits 3582030598-5222 - Misses1570421139+5435 + Partials 2646 2433 -213 ``` | [Impacted Files](https://codecov.io/gh/apache/incubator-pinot/pull/5188?src=pr=tree) | Coverage Δ | Complexity Δ | | |---|---|---|---| | [...a/org/apache/pinot/minion/metrics/MinionMeter.java](https://codecov.io/gh/apache/incubator-pinot/pull/5188/diff?src=pr=tree#diff-cGlub3QtbWluaW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9waW5vdC9taW5pb24vbWV0cmljcy9NaW5pb25NZXRlci5qYXZh) | `0.00% <0.00%> (-100.00%)` | `0.00% <0.00%> (ø%)` | | | [.../apache/pinot/common/metrics/BrokerQueryPhase.java](https://codecov.io/gh/apache/incubator-pinot/pull/5188/diff?src=pr=tree#diff-cGlub3QtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9waW5vdC9jb21tb24vbWV0cmljcy9Ccm9rZXJRdWVyeVBoYXNlLmphdmE=) | `0.00% <0.00%> (-100.00%)` | `0.00% <0.00%> (ø%)` | | | [.../apache/pinot/minion/metrics/MinionQueryPhase.java](https://codecov.io/gh/apache/incubator-pinot/pull/5188/diff?src=pr=tree#diff-cGlub3QtbWluaW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9waW5vdC9taW5pb24vbWV0cmljcy9NaW5pb25RdWVyeVBoYXNlLmphdmE=) | `0.00% <0.00%> (-100.00%)` | `0.00% <0.00%> (ø%)` | | | [...he/pinot/core/query/reduce/ComparisonFunction.java](https://codecov.io/gh/apache/incubator-pinot/pull/5188/diff?src=pr=tree#diff-cGlub3QtY29yZS9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUvcGlub3QvY29yZS9xdWVyeS9yZWR1Y2UvQ29tcGFyaXNvbkZ1bmN0aW9uLmphdmE=) | `0.00% <0.00%> (-100.00%)` | `0.00% <0.00%> (ø%)` | | | [...pinot/minion/exception/TaskCancelledException.java](https://codecov.io/gh/apache/incubator-pinot/pull/5188/diff?src=pr=tree#diff-cGlub3QtbWluaW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9waW5vdC9taW5pb24vZXhjZXB0aW9uL1Rhc2tDYW5jZWxsZWRFeGNlcHRpb24uamF2YQ==) | `0.00% <0.00%> (-100.00%)` | `0.00% <0.00%> (ø%)` | | | [...ot/minion/events/EventObserverFactoryRegistry.java](https://codecov.io/gh/apache/incubator-pinot/pull/5188/diff?src=pr=tree#diff-cGlub3QtbWluaW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9waW5vdC9taW5pb24vZXZlbnRzL0V2ZW50T2JzZXJ2ZXJGYWN0b3J5UmVnaXN0cnkuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | `0.00% <0.00%> (ø%)` | | | [...t/minion/executor/TaskExecutorFactoryRegistry.java](https://codecov.io/gh/apache/incubator-pinot/pull/5188/diff?src=pr=tree#diff-cGlub3QtbWluaW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9waW5vdC9taW5pb24vZXhlY3V0b3IvVGFza0V4ZWN1dG9yRmFjdG9yeVJlZ2lzdHJ5LmphdmE=) | `0.00% <0.00%> (-100.00%)` | `0.00% <0.00%> (ø%)` | | | [...minion/executor/ConvertToRawIndexTaskExecutor.java](https://codecov.io/gh/apache/incubator-pinot/pull/5188/diff?src=pr=tree#diff-cGlub3QtbWluaW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9waW5vdC9taW5pb24vZXhlY3V0b3IvQ29udmVydFRvUmF3SW5kZXhUYXNrRXhlY3V0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | `0.00% <0.00%> (ø%)` | | | [...nion/events/DefaultMinionEventObserverFactory.java](https://codecov.io/gh/apache/incubator-pinot/pull/5188/diff?src=pr=tree#diff-cGlub3QtbWluaW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9waW5vdC9taW5pb24vZXZlbnRzL0RlZmF1bHRNaW5pb25FdmVudE9ic2VydmVyRmFjdG9yeS5qYXZh) | `0.00% <0.00%> (-100.00%)` | `0.00% <0.00%> (ø%)` | | | [...startree/executor/StarTreeAggregationExecutor.java](https://codecov.io/gh/apache/incubator-pinot/pull/5188/diff?src=pr=tree#diff-cGlub3QtY29yZS9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUvcGlub3QvY29yZS9zdGFydHJlZS9leGVjdXRvci9TdGFyVHJlZUFnZ3JlZ2F0aW9uRXhlY3V0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | `0.00% <0.00%> (ø%)` | | | ... and [318 more](https://codecov.io/gh/apache/incubator-pinot/pull/5188/diff?src=pr=tree-more) | | -- [Continue to review full report at Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/5188?src=pr=continue). > **Legend** - [Click here to
[incubator-pinot] branch master updated: Add a simple PinotFS benchmark driver (#5160)
This is an automated email from the ASF dual-hosted git repository. snlee pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git The following commit(s) were added to refs/heads/master by this push: new ed235d2 Add a simple PinotFS benchmark driver (#5160) ed235d2 is described below commit ed235d208d16d1e2a3f03c461f40bbc0df379f6c Author: Seunghyun Lee AuthorDate: Wed Mar 25 18:10:07 2020 -0700 Add a simple PinotFS benchmark driver (#5160) * Add a simple PinotFS benchmark driver This benchmark tests the performance of pinotFS operations. * addressing comments --- .../org/apache/pinot/tools/PinotToolLauncher.java | 10 +- .../tools/filesystem/PinotFSBenchmarkDriver.java | 249 + .../tools/filesystem/PinotFSBenchmarkRunner.java | 79 +++ .../conf/sample_filesystem_benchmark.conf | 5 + 4 files changed, 342 insertions(+), 1 deletion(-) diff --git a/pinot-tools/src/main/java/org/apache/pinot/tools/PinotToolLauncher.java b/pinot-tools/src/main/java/org/apache/pinot/tools/PinotToolLauncher.java index 1cea9d1..ac8de23 100644 --- a/pinot-tools/src/main/java/org/apache/pinot/tools/PinotToolLauncher.java +++ b/pinot-tools/src/main/java/org/apache/pinot/tools/PinotToolLauncher.java @@ -20,6 +20,7 @@ package org.apache.pinot.tools; import java.lang.reflect.Field; import org.apache.pinot.spi.plugin.PluginManager; +import org.apache.pinot.tools.filesystem.PinotFSBenchmarkRunner; import org.apache.pinot.tools.perf.PerfBenchmarkRunner; import org.apache.pinot.tools.perf.QueryRunner; import org.kohsuke.args4j.Argument; @@ -38,7 +39,14 @@ public class PinotToolLauncher { // @formatter:off @Argument(handler = SubCommandHandler.class, metaVar = "") - @SubCommands({@SubCommand(name = "UpdateSegmentState", impl = UpdateSegmentState.class), @SubCommand(name = "AutoAddInvertedIndex", impl = AutoAddInvertedIndexTool.class), @SubCommand(name = "ValidateTableRetention", impl = ValidateTableRetention.class), @SubCommand(name = "PerfBenchmarkRunner", impl = PerfBenchmarkRunner.class), @SubCommand(name = "QueryRunner", impl = QueryRunner.class)}) + @SubCommands({ + @SubCommand(name = "UpdateSegmentState", impl = UpdateSegmentState.class), + @SubCommand(name = "AutoAddInvertedIndex", impl = AutoAddInvertedIndexTool.class), + @SubCommand(name = "ValidateTableRetention", impl = ValidateTableRetention.class), + @SubCommand(name = "PerfBenchmarkRunner", impl = PerfBenchmarkRunner.class), + @SubCommand(name = "QueryRunner", impl = QueryRunner.class), + @SubCommand(name = "PinotFSBenchmarkRunner", impl = PinotFSBenchmarkRunner.class) + }) Command _subCommand; // @formatter:on diff --git a/pinot-tools/src/main/java/org/apache/pinot/tools/filesystem/PinotFSBenchmarkDriver.java b/pinot-tools/src/main/java/org/apache/pinot/tools/filesystem/PinotFSBenchmarkDriver.java new file mode 100644 index 000..1be57bc --- /dev/null +++ b/pinot-tools/src/main/java/org/apache/pinot/tools/filesystem/PinotFSBenchmarkDriver.java @@ -0,0 +1,249 @@ +/** + * Licensed to the Apache Software Foundation (ASF) under one + * or more contributor license agreements. See the NOTICE file + * distributed with this work for additional information + * regarding copyright ownership. The ASF licenses this file + * to you under the Apache License, Version 2.0 (the + * "License"); you may not use this file except in compliance + * with the License. You may obtain a copy of the License at + * + * http://www.apache.org/licenses/LICENSE-2.0 + * + * Unless required by applicable law or agreed to in writing, + * software distributed under the License is distributed on an + * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY + * KIND, either express or implied. See the License for the + * specific language governing permissions and limitations + * under the License. + */ +package org.apache.pinot.tools.filesystem; + +import com.google.common.base.Preconditions; +import java.io.File; +import java.io.FileInputStream; +import java.io.IOException; +import java.io.InputStream; +import java.io.RandomAccessFile; +import java.net.URI; +import java.net.URISyntaxException; +import java.security.MessageDigest; +import org.apache.commons.configuration.Configuration; +import org.apache.commons.configuration.ConfigurationException; +import org.apache.commons.configuration.PropertiesConfiguration; +import org.apache.commons.io.FileUtils; +import org.apache.pinot.spi.filesystem.PinotFS; +import org.apache.pinot.spi.filesystem.PinotFSFactory; +import org.apache.pinot.spi.plugin.PluginManager; +import org.slf4j.Logger; +import org.slf4j.LoggerFactory; + + +public class PinotFSBenchmarkDriver { + private static final Logger LOGGER = LoggerFactory.getLogger(PinotFSBenchmarkDriver.class); + + private static final int DEFAULT_NUM_SEGMENTS_FOR_LIST_TEST = 1000; + private static final int
[GitHub] [incubator-pinot] snleee merged pull request #5160: Add a simple PinotFS benchmark driver
snleee merged pull request #5160: Add a simple PinotFS benchmark driver URL: https://github.com/apache/incubator-pinot/pull/5160 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[incubator-pinot] branch master updated (4a6b21d -> b274d02)
This is an automated email from the ASF dual-hosted git repository. xiangfu pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git. from 4a6b21d Fix docker compose & quick start (#5178) add b274d02 Prepare for pinot release 0.4.0 (#5186) No new revisions were added by this update. Summary of changes: pinot-broker/pom.xml | 5 ++- pinot-clients/pinot-java-client/pom.xml| 5 ++- pinot-clients/pom.xml | 6 ++-- pinot-common/pom.xml | 41 +++--- pinot-controller/pom.xml | 5 ++- pinot-core/pom.xml | 5 ++- pinot-distribution/pom.xml | 7 ++-- pinot-integration-tests/pom.xml| 5 ++- pinot-minion/pom.xml | 5 ++- pinot-perf/pom.xml | 5 ++- .../pinot-batch-ingestion-common/pom.xml | 6 ++-- .../pinot-batch-ingestion-hadoop/pom.xml | 6 ++-- .../pinot-batch-ingestion-spark/pom.xml| 6 ++-- .../pinot-batch-ingestion-standalone/pom.xml | 6 ++-- pinot-plugins/pinot-batch-ingestion/pom.xml| 6 ++-- .../v0_deprecated/pinot-hadoop/pom.xml | 7 ++-- .../v0_deprecated/pinot-ingestion-common/pom.xml | 6 ++-- .../v0_deprecated/pinot-spark/pom.xml | 7 ++-- .../pinot-batch-ingestion/v0_deprecated/pom.xml| 6 ++-- pinot-plugins/pinot-file-system/pinot-adls/pom.xml | 5 ++- pinot-plugins/pinot-file-system/pinot-gcs/pom.xml | 6 ++-- pinot-plugins/pinot-file-system/pinot-hdfs/pom.xml | 5 ++- pinot-plugins/pinot-file-system/pom.xml| 6 ++-- .../pinot-input-format/pinot-avro-base/pom.xml | 5 ++- .../pinot-input-format/pinot-avro/pom.xml | 5 ++- .../pinot-confluent-avro/pom.xml | 5 ++- pinot-plugins/pinot-input-format/pinot-csv/pom.xml | 5 ++- .../pinot-input-format/pinot-json/pom.xml | 5 ++- pinot-plugins/pinot-input-format/pinot-orc/pom.xml | 6 ++-- .../pinot-input-format/pinot-parquet/pom.xml | 5 ++- .../pinot-input-format/pinot-thrift/pom.xml| 5 ++- pinot-plugins/pinot-input-format/pom.xml | 6 ++-- .../pinot-stream-ingestion/pinot-kafka-0.9/pom.xml | 6 ++-- .../pinot-stream-ingestion/pinot-kafka-2.0/pom.xml | 6 ++-- .../pinot-kafka-base/pom.xml | 6 ++-- pinot-plugins/pinot-stream-ingestion/pom.xml | 6 ++-- pinot-plugins/pom.xml | 10 +++--- pinot-server/pom.xml | 5 ++- pinot-spi/pom.xml | 5 ++- pinot-tools/pom.xml| 5 ++- pom.xml| 13 +++ 41 files changed, 108 insertions(+), 168 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[GitHub] [incubator-pinot] fx19880617 merged pull request #5186: Prepare for pinot release 0.4.0
fx19880617 merged pull request #5186: Prepare for pinot release 0.4.0 URL: https://github.com/apache/incubator-pinot/pull/5186 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[incubator-pinot] branch pinot-jfrog-bintray updated (fd6fa2d -> f6f1abe)
This is an automated email from the ASF dual-hosted git repository. jlli pushed a change to branch pinot-jfrog-bintray in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git. discard fd6fa2d Change versions before deploying to bintray add f6f1abe Change versions before deploying to bintray This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (fd6fa2d) \ N -- N -- N refs/heads/pinot-jfrog-bintray (f6f1abe) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. No new revisions were added by this update. Summary of changes: .travis_nightly_build.sh | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[GitHub] [incubator-pinot] codecov-io edited a comment on issue #5160: Add a simple PinotFS benchmark driver
codecov-io edited a comment on issue #5160: Add a simple PinotFS benchmark driver URL: https://github.com/apache/incubator-pinot/pull/5160#issuecomment-599897785 # [Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/5160?src=pr=h1) Report > Merging [#5160](https://codecov.io/gh/apache/incubator-pinot/pull/5160?src=pr=desc) into [master](https://codecov.io/gh/apache/incubator-pinot/commit/c81a656aea57ff5ba1abd856ca0f0026d8b5e0ee=desc) will **decrease** coverage by `21.09%`. > The diff coverage is `n/a`. [![Impacted file tree graph](https://codecov.io/gh/apache/incubator-pinot/pull/5160/graphs/tree.svg?width=650=150=pr=4ibza2ugkz)](https://codecov.io/gh/apache/incubator-pinot/pull/5160?src=pr=tree) ```diff @@ Coverage Diff @@ ## master#5160 +/- ## = - Coverage 66.02% 44.93% -21.10% = Files 1050 1052+2 Lines 5411754170 +53 Branches 8071 8078+7 = - Hits 3572924339-11390 - Misses1573427732+11998 + Partials 2654 2099 -555 ``` | [Impacted Files](https://codecov.io/gh/apache/incubator-pinot/pull/5160?src=pr=tree) | Coverage Δ | Complexity Δ | | |---|---|---|---| | [...ava/org/apache/pinot/spi/data/MetricFieldSpec.java](https://codecov.io/gh/apache/incubator-pinot/pull/5160/diff?src=pr=tree#diff-cGlub3Qtc3BpL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9waW5vdC9zcGkvZGF0YS9NZXRyaWNGaWVsZFNwZWMuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | `0.00% <0.00%> (ø%)` | | | [.../org/apache/pinot/spi/data/DimensionFieldSpec.java](https://codecov.io/gh/apache/incubator-pinot/pull/5160/diff?src=pr=tree#diff-cGlub3Qtc3BpL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9waW5vdC9zcGkvZGF0YS9EaW1lbnNpb25GaWVsZFNwZWMuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | `0.00% <0.00%> (ø%)` | | | [.../org/apache/pinot/spi/data/readers/FileFormat.java](https://codecov.io/gh/apache/incubator-pinot/pull/5160/diff?src=pr=tree#diff-cGlub3Qtc3BpL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9waW5vdC9zcGkvZGF0YS9yZWFkZXJzL0ZpbGVGb3JtYXQuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | `0.00% <0.00%> (ø%)` | | | [...va/org/apache/pinot/common/config/FieldConfig.java](https://codecov.io/gh/apache/incubator-pinot/pull/5160/diff?src=pr=tree#diff-cGlub3QtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9waW5vdC9jb21tb24vY29uZmlnL0ZpZWxkQ29uZmlnLmphdmE=) | `0.00% <0.00%> (-100.00%)` | `0.00% <0.00%> (ø%)` | | | [.../org/apache/pinot/common/http/MultiGetRequest.java](https://codecov.io/gh/apache/incubator-pinot/pull/5160/diff?src=pr=tree#diff-cGlub3QtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9waW5vdC9jb21tb24vaHR0cC9NdWx0aUdldFJlcXVlc3QuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | `0.00% <0.00%> (ø%)` | | | [.../org/apache/pinot/common/lineage/SegmentGroup.java](https://codecov.io/gh/apache/incubator-pinot/pull/5160/diff?src=pr=tree#diff-cGlub3QtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9waW5vdC9jb21tb24vbGluZWFnZS9TZWdtZW50R3JvdXAuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | `0.00% <0.00%> (ø%)` | | | [.../apache/pinot/spi/utils/retry/BaseRetryPolicy.java](https://codecov.io/gh/apache/incubator-pinot/pull/5160/diff?src=pr=tree#diff-cGlub3Qtc3BpL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9waW5vdC9zcGkvdXRpbHMvcmV0cnkvQmFzZVJldHJ5UG9saWN5LmphdmE=) | `0.00% <0.00%> (-100.00%)` | `0.00% <0.00%> (ø%)` | | | [...apache/pinot/spi/stream/StreamConsumerFactory.java](https://codecov.io/gh/apache/incubator-pinot/pull/5160/diff?src=pr=tree#diff-cGlub3Qtc3BpL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9waW5vdC9zcGkvc3RyZWFtL1N0cmVhbUNvbnN1bWVyRmFjdG9yeS5qYXZh) | `0.00% <0.00%> (-100.00%)` | `0.00% <0.00%> (ø%)` | | | [...apache/pinot/spi/stream/StreamMessageMetadata.java](https://codecov.io/gh/apache/incubator-pinot/pull/5160/diff?src=pr=tree#diff-cGlub3Qtc3BpL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9waW5vdC9zcGkvc3RyZWFtL1N0cmVhbU1lc3NhZ2VNZXRhZGF0YS5qYXZh) | `0.00% <0.00%> (-100.00%)` | `0.00% <0.00%> (ø%)` | | | [...g/apache/pinot/server/api/resources/ErrorInfo.java](https://codecov.io/gh/apache/incubator-pinot/pull/5160/diff?src=pr=tree#diff-cGlub3Qtc2VydmVyL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9waW5vdC9zZXJ2ZXIvYXBpL3Jlc291cmNlcy9FcnJvckluZm8uamF2YQ==) | `0.00% <0.00%> (-100.00%)` | `0.00% <0.00%> (ø%)` | | | ... and [574 more](https://codecov.io/gh/apache/incubator-pinot/pull/5160/diff?src=pr=tree-more) | | -- [Continue to review full report at Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/5160?src=pr=continue). > **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta) > `Δ = absolute (impact)`, `ø = not affected`, `? = missing data` > Powered by
[incubator-pinot] branch pinot-jfrog-bintray updated (43b6b79 -> fd6fa2d)
This is an automated email from the ASF dual-hosted git repository. jlli pushed a change to branch pinot-jfrog-bintray in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git. from 43b6b79 Add relative path add fd6fa2d Change versions before deploying to bintray No new revisions were added by this update. Summary of changes: .travis_nightly_build.sh | 8 +++- 1 file changed, 7 insertions(+), 1 deletion(-) - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[GitHub] [incubator-pinot] snleee opened a new pull request #5188: Change the name for azure data lake gen2 implementation
snleee opened a new pull request #5188: Change the name for azure data lake gen2 implementation URL: https://github.com/apache/incubator-pinot/pull/5188 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[incubator-pinot] branch pinot-jfrog-bintray updated (6a88330 -> 43b6b79)
This is an automated email from the ASF dual-hosted git repository. jlli pushed a change to branch pinot-jfrog-bintray in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git. discard 6a88330 Add relative path add 43b6b79 Add relative path This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (6a88330) \ N -- N -- N refs/heads/pinot-jfrog-bintray (43b6b79) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. No new revisions were added by this update. Summary of changes: .travis_nightly_build.sh | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[GitHub] [incubator-pinot] harleyjj opened a new pull request #5187: [TE] frontend - harleyjj/validation - surface errors in dom for creat…
harleyjj opened a new pull request #5187: [TE] frontend - harleyjj/validation - surface errors in dom for creat… URL: https://github.com/apache/incubator-pinot/pull/5187 …e and edit alert 1) Surfaces errors in configuration and preview to the DOM 2) Includes modal for 'more details' if response includes 'more-info' field 3) Styling updates to Create Alert and Edit Alert 4) On successful alert creation, Create Alert transitions to Alert Overview for detection 5) Fixes bug where successful Create Alert shown as error This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[GitHub] [incubator-pinot] jackjlli commented on a change in pull request #5181: Nightly deploy pinot to bintray
jackjlli commented on a change in pull request #5181: Nightly deploy pinot to bintray URL: https://github.com/apache/incubator-pinot/pull/5181#discussion_r398246256 ## File path: .travis.yml ## @@ -1,57 +1,25 @@ language: java sudo: false dist: trusty - before_install: - - mkdir -p ~/bin && curl -sSL -o ~/bin/jq https://github.com/stedolan/jq/releases/download/jq-1.5/jq-linux64 && chmod +x ~/bin/jq - - export PATH=$PATH:~/bin - - jq --version - +- mkdir -p ~/bin && curl -sSL -o ~/bin/jq https://github.com/stedolan/jq/releases/download/jq-1.5/jq-linux64 + && chmod +x ~/bin/jq +- export PATH=$PATH:~/bin +- jq --version +- export DEV_VERSION="-dev-${TRAVIS_BUILD_NUMBER}" jdk: - - oraclejdk8 - +- oraclejdk8 cache: directories: -- $HOME/.m2 + - "$HOME/.m2" yarn: true - addons: firefox: latest - install: - - ./.travis_install.sh - -branches: - only: -- master - -jobs: - include: -- name: "Integration Tests - OracleJDK 8" - jdk: oraclejdk8 - script: -- ./.travis_test.sh - env: -- RUN_INTEGRATION_TESTS=true -- name: "Unit Tests - OracleJDK 8" - jdk: oraclejdk8 - script: -- ./.travis_test.sh - env: -- RUN_INTEGRATION_TESTS=false -- name: "QuickStart - OracleJDK 8" - jdk: oraclejdk8 - script: -- ./.travis_quickstart.sh -- name: "QuickStart - OracleJDK 11" - jdk: oraclejdk11 - script: -- ./.travis_quickstart.sh -- name: "QuickStart - OpenJDK 8" - jdk: openjdk8 - script: -- ./.travis_quickstart.sh -- name: "QuickStart - OpenJDK 11" - jdk: openjdk11 - script: -- ./.travis_quickstart.sh +- "./.travis_install.sh" +script: +- "./.travis_nightly_build.sh" +env: + global: + - secure: R3NdobUAThkk6BBzXapek6PiuWHWa1ldnJBvXpk2TAi7Lua/Ctgg8EHCSve7+MK4SU3XFJSi1th32+VSy0K/ARfdVcxiVh6EJSL/Nw0LRQSvGk7VjO382SsWCFoJuZBBqjy9DfBgRLdoqEPfulIBC0XBxjJ+4xedRptkZo7+TAAvtB8Y32EA5ve+Z4cdJipLF1tviL5q2rVbkNXucYUYO2XIv5HOzF2Xy3Hw6lsNrHpbes2CLEkoMiLOQ30zfbXZT/5Xd6OhQNmoZJ9gKziT1opiN2AJMPv269K8FFJZTrDZX74/thq9wmeF4X4f3wPA7EbTupooj0i9LPzb8Xev1QKAsxBtHyRm9NGYOXM06c2yKiGsDtT4HZYQGk4m8/89moe3oGnEwvw/JLu5RvLIZzFE2cBhHrcxRAJgHLIr80+kebNg/YstNlDL+rmP0b9NRrGIVw5OO2BT27ZBgsMFmjnujQtCUJiJ5zqyMxygaYmgZha6xcbhFUPyf4DJ3T46etyFovg2EJnhM7HL9ECZHloQZFhEKs88sZXqvt6HKsA77xyL7ONMrwcPtdDVbFUkN/B1R7LLOf6Wq5vK/Y2EB18oXhKF0ngdahT8HKSMTXjuYf5MPybxhf4fdY6stFmIVkd9b633iZDMu+Aj8E1c8BApyDikCmYK2BI3grH49E0= Review comment: No, no need to do so. ``` Please note that encrypted environment variables are not available for pull requests from forks. ``` First, someone else cannot create a branch from this repo. Second, this release deployment will be set up to be triggered only when the build is a cron job. Third, this release deployment will be set up to be triggered only when the build isn't from PR. Fourth, they are encrypted. They cannot be used locally. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[GitHub] [incubator-pinot] jackjlli commented on a change in pull request #5181: Nightly deploy pinot to bintray
jackjlli commented on a change in pull request #5181: Nightly deploy pinot to bintray URL: https://github.com/apache/incubator-pinot/pull/5181#discussion_r398246256 ## File path: .travis.yml ## @@ -1,57 +1,25 @@ language: java sudo: false dist: trusty - before_install: - - mkdir -p ~/bin && curl -sSL -o ~/bin/jq https://github.com/stedolan/jq/releases/download/jq-1.5/jq-linux64 && chmod +x ~/bin/jq - - export PATH=$PATH:~/bin - - jq --version - +- mkdir -p ~/bin && curl -sSL -o ~/bin/jq https://github.com/stedolan/jq/releases/download/jq-1.5/jq-linux64 + && chmod +x ~/bin/jq +- export PATH=$PATH:~/bin +- jq --version +- export DEV_VERSION="-dev-${TRAVIS_BUILD_NUMBER}" jdk: - - oraclejdk8 - +- oraclejdk8 cache: directories: -- $HOME/.m2 + - "$HOME/.m2" yarn: true - addons: firefox: latest - install: - - ./.travis_install.sh - -branches: - only: -- master - -jobs: - include: -- name: "Integration Tests - OracleJDK 8" - jdk: oraclejdk8 - script: -- ./.travis_test.sh - env: -- RUN_INTEGRATION_TESTS=true -- name: "Unit Tests - OracleJDK 8" - jdk: oraclejdk8 - script: -- ./.travis_test.sh - env: -- RUN_INTEGRATION_TESTS=false -- name: "QuickStart - OracleJDK 8" - jdk: oraclejdk8 - script: -- ./.travis_quickstart.sh -- name: "QuickStart - OracleJDK 11" - jdk: oraclejdk11 - script: -- ./.travis_quickstart.sh -- name: "QuickStart - OpenJDK 8" - jdk: openjdk8 - script: -- ./.travis_quickstart.sh -- name: "QuickStart - OpenJDK 11" - jdk: openjdk11 - script: -- ./.travis_quickstart.sh +- "./.travis_install.sh" +script: +- "./.travis_nightly_build.sh" +env: + global: + - secure: R3NdobUAThkk6BBzXapek6PiuWHWa1ldnJBvXpk2TAi7Lua/Ctgg8EHCSve7+MK4SU3XFJSi1th32+VSy0K/ARfdVcxiVh6EJSL/Nw0LRQSvGk7VjO382SsWCFoJuZBBqjy9DfBgRLdoqEPfulIBC0XBxjJ+4xedRptkZo7+TAAvtB8Y32EA5ve+Z4cdJipLF1tviL5q2rVbkNXucYUYO2XIv5HOzF2Xy3Hw6lsNrHpbes2CLEkoMiLOQ30zfbXZT/5Xd6OhQNmoZJ9gKziT1opiN2AJMPv269K8FFJZTrDZX74/thq9wmeF4X4f3wPA7EbTupooj0i9LPzb8Xev1QKAsxBtHyRm9NGYOXM06c2yKiGsDtT4HZYQGk4m8/89moe3oGnEwvw/JLu5RvLIZzFE2cBhHrcxRAJgHLIr80+kebNg/YstNlDL+rmP0b9NRrGIVw5OO2BT27ZBgsMFmjnujQtCUJiJ5zqyMxygaYmgZha6xcbhFUPyf4DJ3T46etyFovg2EJnhM7HL9ECZHloQZFhEKs88sZXqvt6HKsA77xyL7ONMrwcPtdDVbFUkN/B1R7LLOf6Wq5vK/Y2EB18oXhKF0ngdahT8HKSMTXjuYf5MPybxhf4fdY6stFmIVkd9b633iZDMu+Aj8E1c8BApyDikCmYK2BI3grH49E0= Review comment: No, no need to do so. ``` Please note that encrypted environment variables are not available for pull requests from forks. ``` First, someone else cannot create a branch from this repo. Second, this release deployment will be set up to be triggered only when the build is a cron job. Third, this release deployment will be set up to be triggered only when the build isn't from PR. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[GitHub] [incubator-pinot] snleee commented on a change in pull request #5181: Nightly deploy pinot to bintray
snleee commented on a change in pull request #5181: Nightly deploy pinot to bintray URL: https://github.com/apache/incubator-pinot/pull/5181#discussion_r398242443 ## File path: .travis.yml ## @@ -1,57 +1,25 @@ language: java sudo: false dist: trusty - before_install: - - mkdir -p ~/bin && curl -sSL -o ~/bin/jq https://github.com/stedolan/jq/releases/download/jq-1.5/jq-linux64 && chmod +x ~/bin/jq - - export PATH=$PATH:~/bin - - jq --version - +- mkdir -p ~/bin && curl -sSL -o ~/bin/jq https://github.com/stedolan/jq/releases/download/jq-1.5/jq-linux64 + && chmod +x ~/bin/jq +- export PATH=$PATH:~/bin +- jq --version +- export DEV_VERSION="-dev-${TRAVIS_BUILD_NUMBER}" jdk: - - oraclejdk8 - +- oraclejdk8 cache: directories: -- $HOME/.m2 + - "$HOME/.m2" yarn: true - addons: firefox: latest - install: - - ./.travis_install.sh - -branches: - only: -- master - -jobs: - include: -- name: "Integration Tests - OracleJDK 8" - jdk: oraclejdk8 - script: -- ./.travis_test.sh - env: -- RUN_INTEGRATION_TESTS=true -- name: "Unit Tests - OracleJDK 8" - jdk: oraclejdk8 - script: -- ./.travis_test.sh - env: -- RUN_INTEGRATION_TESTS=false -- name: "QuickStart - OracleJDK 8" - jdk: oraclejdk8 - script: -- ./.travis_quickstart.sh -- name: "QuickStart - OracleJDK 11" - jdk: oraclejdk11 - script: -- ./.travis_quickstart.sh -- name: "QuickStart - OpenJDK 8" - jdk: openjdk8 - script: -- ./.travis_quickstart.sh -- name: "QuickStart - OpenJDK 11" - jdk: openjdk11 - script: -- ./.travis_quickstart.sh +- "./.travis_install.sh" +script: +- "./.travis_nightly_build.sh" +env: + global: + - secure: R3NdobUAThkk6BBzXapek6PiuWHWa1ldnJBvXpk2TAi7Lua/Ctgg8EHCSve7+MK4SU3XFJSi1th32+VSy0K/ARfdVcxiVh6EJSL/Nw0LRQSvGk7VjO382SsWCFoJuZBBqjy9DfBgRLdoqEPfulIBC0XBxjJ+4xedRptkZo7+TAAvtB8Y32EA5ve+Z4cdJipLF1tviL5q2rVbkNXucYUYO2XIv5HOzF2Xy3Hw6lsNrHpbes2CLEkoMiLOQ30zfbXZT/5Xd6OhQNmoZJ9gKziT1opiN2AJMPv269K8FFJZTrDZX74/thq9wmeF4X4f3wPA7EbTupooj0i9LPzb8Xev1QKAsxBtHyRm9NGYOXM06c2yKiGsDtT4HZYQGk4m8/89moe3oGnEwvw/JLu5RvLIZzFE2cBhHrcxRAJgHLIr80+kebNg/YstNlDL+rmP0b9NRrGIVw5OO2BT27ZBgsMFmjnujQtCUJiJ5zqyMxygaYmgZha6xcbhFUPyf4DJ3T46etyFovg2EJnhM7HL9ECZHloQZFhEKs88sZXqvt6HKsA77xyL7ONMrwcPtdDVbFUkN/B1R7LLOf6Wq5vK/Y2EB18oXhKF0ngdahT8HKSMTXjuYf5MPybxhf4fdY6stFmIVkd9b633iZDMu+Aj8E1c8BApyDikCmYK2BI3grH49E0= Review comment: Is there a way to hide this? What the standard practice on putting key? For instance, can someone copy this key and make some random release to our repo? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[GitHub] [incubator-pinot-site] fx19880617 commented on issue #19: Adding release 0.3.0 reference
fx19880617 commented on issue #19: Adding release 0.3.0 reference URL: https://github.com/apache/incubator-pinot-site/pull/19#issuecomment-604145237 > The link is broken > > ``` > http://apache.mirrors.pair.com/incubator/pinot/apache-pinot-incubating-0.3.0 > ``` it works for me: ![image](https://user-images.githubusercontent.com/1202120/77595618-eac36a80-6eb6-11ea-957b-31149c174ba2.png) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[GitHub] [incubator-pinot] fx19880617 opened a new pull request #5186: Prepare for pinot release 0.4.0
fx19880617 opened a new pull request #5186: Prepare for pinot release 0.4.0 URL: https://github.com/apache/incubator-pinot/pull/5186 Updated pom version to `0.4.0-SNAPSHOT` This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[incubator-pinot] branch update-version-release-0.4.0-SNAPSHOT created (now 535a193)
This is an automated email from the ASF dual-hosted git repository. xiangfu pushed a change to branch update-version-release-0.4.0-SNAPSHOT in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git. at 535a193 Prepare for pinot release 0.4.0 This branch includes the following new commits: new 535a193 Prepare for pinot release 0.4.0 The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[incubator-pinot] 01/01: Prepare for pinot release 0.4.0
This is an automated email from the ASF dual-hosted git repository. xiangfu pushed a commit to branch update-version-release-0.4.0-SNAPSHOT in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git commit 535a193f8982d8f372bdc4e56345094b599425a7 Author: Xiang Fu AuthorDate: Wed Mar 25 16:28:42 2020 -0700 Prepare for pinot release 0.4.0 --- pinot-broker/pom.xml | 5 ++- pinot-clients/pinot-java-client/pom.xml| 5 ++- pinot-clients/pom.xml | 6 ++-- pinot-common/pom.xml | 41 +++--- pinot-controller/pom.xml | 5 ++- pinot-core/pom.xml | 5 ++- pinot-distribution/pom.xml | 7 ++-- pinot-integration-tests/pom.xml| 5 ++- pinot-minion/pom.xml | 5 ++- pinot-perf/pom.xml | 5 ++- .../pinot-batch-ingestion-common/pom.xml | 6 ++-- .../pinot-batch-ingestion-hadoop/pom.xml | 6 ++-- .../pinot-batch-ingestion-spark/pom.xml| 6 ++-- .../pinot-batch-ingestion-standalone/pom.xml | 6 ++-- pinot-plugins/pinot-batch-ingestion/pom.xml| 6 ++-- .../v0_deprecated/pinot-hadoop/pom.xml | 7 ++-- .../v0_deprecated/pinot-ingestion-common/pom.xml | 6 ++-- .../v0_deprecated/pinot-spark/pom.xml | 7 ++-- .../pinot-batch-ingestion/v0_deprecated/pom.xml| 6 ++-- pinot-plugins/pinot-file-system/pinot-adls/pom.xml | 5 ++- pinot-plugins/pinot-file-system/pinot-gcs/pom.xml | 6 ++-- pinot-plugins/pinot-file-system/pinot-hdfs/pom.xml | 5 ++- pinot-plugins/pinot-file-system/pom.xml| 6 ++-- .../pinot-input-format/pinot-avro-base/pom.xml | 5 ++- .../pinot-input-format/pinot-avro/pom.xml | 5 ++- .../pinot-confluent-avro/pom.xml | 5 ++- pinot-plugins/pinot-input-format/pinot-csv/pom.xml | 5 ++- .../pinot-input-format/pinot-json/pom.xml | 5 ++- pinot-plugins/pinot-input-format/pinot-orc/pom.xml | 6 ++-- .../pinot-input-format/pinot-parquet/pom.xml | 5 ++- .../pinot-input-format/pinot-thrift/pom.xml| 5 ++- pinot-plugins/pinot-input-format/pom.xml | 6 ++-- .../pinot-stream-ingestion/pinot-kafka-0.9/pom.xml | 6 ++-- .../pinot-stream-ingestion/pinot-kafka-2.0/pom.xml | 6 ++-- .../pinot-kafka-base/pom.xml | 6 ++-- pinot-plugins/pinot-stream-ingestion/pom.xml | 6 ++-- pinot-plugins/pom.xml | 10 +++--- pinot-server/pom.xml | 5 ++- pinot-spi/pom.xml | 5 ++- pinot-tools/pom.xml| 5 ++- pom.xml| 13 +++ 41 files changed, 108 insertions(+), 168 deletions(-) diff --git a/pinot-broker/pom.xml b/pinot-broker/pom.xml index be1e9dc..76f2aab 100644 --- a/pinot-broker/pom.xml +++ b/pinot-broker/pom.xml @@ -19,13 +19,12 @@ under the License. --> -http://www.w3.org/2001/XMLSchema-instance; xmlns="http://maven.apache.org/POM/4.0.0; - xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd;> +http://maven.apache.org/POM/4.0.0; xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance; xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd;> 4.0.0 pinot org.apache.pinot -0.3.0-SNAPSHOT +0.4.0-SNAPSHOT pinot-broker Pinot Broker diff --git a/pinot-clients/pinot-java-client/pom.xml b/pinot-clients/pinot-java-client/pom.xml index cc0d6cc..ef96fb7 100644 --- a/pinot-clients/pinot-java-client/pom.xml +++ b/pinot-clients/pinot-java-client/pom.xml @@ -19,13 +19,12 @@ under the License. --> -http://maven.apache.org/POM/4.0.0; xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance; - xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd;> +http://maven.apache.org/POM/4.0.0; xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance; xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd;> 4.0.0 pinot-clients org.apache.pinot -0.3.0-SNAPSHOT +0.4.0-SNAPSHOT pinot-java-client Pinot Java Client diff --git a/pinot-clients/pom.xml b/pinot-clients/pom.xml index 52e1cb9..b7069a0 100644 --- a/pinot-clients/pom.xml +++ b/pinot-clients/pom.xml @@ -19,14 +19,12 @@ under the License. --> -http://maven.apache.org/POM/4.0.0; - xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance; - xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd;> +http://maven.apache.org/POM/4.0.0; xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance;
[GitHub] [incubator-pinot-site] snleee edited a comment on issue #19: Adding release 0.3.0 reference
snleee edited a comment on issue #19: Adding release 0.3.0 reference URL: https://github.com/apache/incubator-pinot-site/pull/19#issuecomment-604130596 The link is broken ``` http://apache.mirrors.pair.com/incubator/pinot/apache-pinot-incubating-0.3.0 ``` This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[GitHub] [incubator-pinot-site] snleee commented on issue #19: Adding release 0.3.0 reference
snleee commented on issue #19: Adding release 0.3.0 reference URL: https://github.com/apache/incubator-pinot-site/pull/19#issuecomment-604130596 Actually the link is broken ``` http://apache.mirrors.pair.com/incubator/pinot/apache-pinot-incubating-0.3.0 ``` This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[incubator-pinot-site] 01/01: Merge pull request #19 from apache/update_release-0.3.0
This is an automated email from the ASF dual-hosted git repository. snlee pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/incubator-pinot-site.git commit dc9582c94651d5b592fc6c03e3e1e5f451298218 Merge: b3d3550 2070188 Author: Seunghyun Lee AuthorDate: Wed Mar 25 15:56:56 2020 -0700 Merge pull request #19 from apache/update_release-0.3.0 Adding release 0.3.0 reference download/index.html | 32 +++- index.html | 1 + 2 files changed, 24 insertions(+), 9 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[GitHub] [incubator-pinot-site] snleee merged pull request #19: Adding release 0.3.0 reference
snleee merged pull request #19: Adding release 0.3.0 reference URL: https://github.com/apache/incubator-pinot-site/pull/19 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[incubator-pinot-site] branch asf-site updated (b3d3550 -> dc9582c)
This is an automated email from the ASF dual-hosted git repository. snlee pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/incubator-pinot-site.git. from b3d3550 Updating links to gitbooks add 8a73dae Adding release 0.3.0 reference add 2070188 Update download url from https://www.apache.org/dist/ to https://downloads.apache.org/ new dc9582c Merge pull request #19 from apache/update_release-0.3.0 The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: download/index.html | 32 +++- index.html | 1 + 2 files changed, 24 insertions(+), 9 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[GitHub] [incubator-pinot] snleee commented on issue #5185: Pinot website [WIP]
snleee commented on issue #5185: Pinot website [WIP] URL: https://github.com/apache/incubator-pinot/pull/5185#issuecomment-604122860 @ChethanUK `#722f37` seems to be the wine color. I also like the idea of having source code in `incubator-pinot` code base and push the static files to `incubator-pinot-site` when we have the update. We will need to figure out if we want to migrate back to source code for documentation again. (we migrated out our doc to gitbook recently..) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[incubator-pinot] branch pinot-jfrog-bintray updated (fb0af84 -> 6a88330)
This is an automated email from the ASF dual-hosted git repository. jlli pushed a change to branch pinot-jfrog-bintray in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git. discard fb0af84 Add relative path add 6a88330 Add relative path This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (fb0af84) \ N -- N -- N refs/heads/pinot-jfrog-bintray (6a88330) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. No new revisions were added by this update. Summary of changes: pom.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
svn commit: r38623 - in /dev/incubator/pinot: apache-pinot-incubating-0.3.0-rc0/ apache-pinot-incubating-0.3.0-rc1/
Author: xiangfu Date: Wed Mar 25 22:09:55 2020 New Revision: 38623 Log: remove recalled Pinot rc Removed: dev/incubator/pinot/apache-pinot-incubating-0.3.0-rc0/ dev/incubator/pinot/apache-pinot-incubating-0.3.0-rc1/ - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[GitHub] [incubator-pinot] jamesyfshao commented on issue #5175: add pinot upsert features to pinot common
jamesyfshao commented on issue #5175: add pinot upsert features to pinot common URL: https://github.com/apache/incubator-pinot/pull/5175#issuecomment-604111226 > > also [google doc design doc](https://www.google.com/url?sa=t=j=s=appssearch=8=0=rja=4ypfJoFtqjSdua_7dziWCQ=0ahUKEwjVhpqIybToAhXDHWIKHWFcBVs4ABABKAAwAA=https://drive.google.com/a/uber.com/open?id%3D1SFFir7ByxCff-aVYxQeTHpNhPXeP5q7P4g_6O2iNGgU%26usp%3Dchrome_omnibox=AOvVaw3KEdQYFMPa7tgpOn01R5ol) with comments. > > It's asking uber login. Can you change share settings? > > > remote meeting sync or something else > > @kishoreg At least monthly meeting and sync up on project status will be helpful to all... Yeah our google doc account sharing setting is kind of wanky that it doesn't allow blanket share with everyone outside our organization. I hate it but it is really out of my control. However, just submit a request to view/comment and I can add you as soon as I see it. We originally plan to have a meeting earlier this month but the pandemic kind of mess up with all of our plans. Maybe we can have a work-group specific remote meeting (eg, upsert meeting with kishore/jackie/chethan etc) in the meantime and do the pinot committee meeting later @Jackie-Jiang @kishoreg @ChethanUK let me know if you feel meeting is necessary or you prefer me to update the schema first and see if a remote meeting is necessary This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[incubator-pinot-site] branch update_release-0.3.0 updated (8a73dae -> 2070188)
This is an automated email from the ASF dual-hosted git repository. xiangfu pushed a change to branch update_release-0.3.0 in repository https://gitbox.apache.org/repos/asf/incubator-pinot-site.git. from 8a73dae Adding release 0.3.0 reference add 2070188 Update download url from https://www.apache.org/dist/ to https://downloads.apache.org/ No new revisions were added by this update. Summary of changes: download/index.html | 26 +- 1 file changed, 13 insertions(+), 13 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[incubator-pinot-site] 01/01: Adding release 0.3.0 reference
This is an automated email from the ASF dual-hosted git repository. xiangfu pushed a commit to branch update_release-0.3.0 in repository https://gitbox.apache.org/repos/asf/incubator-pinot-site.git commit 8a73dae7accbbece09cecd4976828bad0f23d035 Author: Xiang Fu AuthorDate: Wed Mar 25 14:33:47 2020 -0700 Adding release 0.3.0 reference --- download/index.html | 14 ++ index.html | 1 + 2 files changed, 15 insertions(+) diff --git a/download/index.html b/download/index.html index f231d27..6f7821b 100644 --- a/download/index.html +++ b/download/index.html @@ -76,6 +76,7 @@ https://www.apache.org/dyn/closer.lua/incubator/pinot/apache-pinot-incubating-0.1.0;>0.1.0 https://www.apache.org/dyn/closer.lua/incubator/pinot/apache-pinot-incubating-0.2.0;>0.2.0 +https://www.apache.org/dyn/closer.lua/incubator/pinot/apache-pinot-incubating-0.3.0;>0.3.0 @@ -194,6 +195,19 @@ [ https://www.apache.org/dist/incubator/pinot/apache-pinot-incubating-0.2.0/apache-pinot-incubating-0.2.0-bin.tar.gz.asc; target="_blank">ASC ] +0.3.0 + + +Official https://www.apache.org/dyn/closer.lua/incubator/pinot/apache-pinot-incubating-0.3.0/apache-pinot-incubating-0.3.0-src.tar.gz; target="_blank">source release +[ https://www.apache.org/dist/incubator/pinot/apache-pinot-incubating-0.3.0/apache-pinot-incubating-0.3.0-src.tar.gz.sha512; target="_blank">SHA512 ] +[ https://www.apache.org/dist/incubator/pinot/apache-pinot-incubating-0.3.0/apache-pinot-incubating-0.3.0-src.tar.gz.asc; target="_blank">ASC ] + + +Official https://www.apache.org/dyn/closer.lua/incubator/pinot/apache-pinot-incubating-0.3.0/apache-pinot-incubating-0.3.0-bin.tar.gz; target="_blank">binary release +[ https://www.apache.org/dist/incubator/pinot/apache-pinot-incubating-0.3.0/apache-pinot-incubating-0.3.0-bin.tar.gz.sha512; target="_blank">SHA512 ] +[ https://www.apache.org/dist/incubator/pinot/apache-pinot-incubating-0.3.0/apache-pinot-incubating-0.3.0-bin.tar.gz.asc; target="_blank">ASC ] + + diff --git a/index.html b/index.html index cbdbca4..2f64a1e 100644 --- a/index.html +++ b/index.html @@ -76,6 +76,7 @@ https://www.apache.org/dyn/closer.lua/incubator/pinot/apache-pinot-incubating-0.1.0;>0.1.0 https://www.apache.org/dyn/closer.lua/incubator/pinot/apache-pinot-incubating-0.2.0;>0.2.0 +https://www.apache.org/dyn/closer.lua/incubator/pinot/apache-pinot-incubating-0.3.0;>0.3.0 - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[incubator-pinot-site] branch update_release-0.3.0 created (now 8a73dae)
This is an automated email from the ASF dual-hosted git repository. xiangfu pushed a change to branch update_release-0.3.0 in repository https://gitbox.apache.org/repos/asf/incubator-pinot-site.git. at 8a73dae Adding release 0.3.0 reference This branch includes the following new commits: new 8a73dae Adding release 0.3.0 reference The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[GitHub] [incubator-pinot-site] fx19880617 opened a new pull request #19: Adding release 0.3.0 reference
fx19880617 opened a new pull request #19: Adding release 0.3.0 reference URL: https://github.com/apache/incubator-pinot-site/pull/19 For release 0.3.0 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[GitHub] [incubator-pinot] ChethanUK commented on issue #5185: Pinot website [WIP]
ChethanUK commented on issue #5185: Pinot website [WIP] URL: https://github.com/apache/incubator-pinot/pull/5185#issuecomment-604092422 > 1. red wine like color Okay, Give me hex code. > trying to replace Not decided yet.. > different approaches. According to me, it will be best to use one repo for both codes and versioned docs instead of many repos like some other projects... It will be just other another folder and then just have to generate and push the content to asf-site This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[incubator-pinot] annotated tag release-0.3.0 updated (9b2dc20 -> ae1815f)
This is an automated email from the ASF dual-hosted git repository. xiangfu pushed a change to annotated tag release-0.3.0 in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git. *** WARNING: tag release-0.3.0 was modified! *** from 9b2dc20 (commit) to ae1815f (tag) tagging 9b2dc20c07dec6cf33df08cd996e8202c3ba (commit) by Xiang Fu on Wed Mar 25 13:46:05 2020 -0700 - Log - Apache Pinot (Incubating) 0.3.0 --- No new revisions were added by this update. Summary of changes: - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[GitHub] [incubator-pinot] jackjlli closed pull request #5166: Nightly deploy Pinot to jfrog bintray
jackjlli closed pull request #5166: Nightly deploy Pinot to jfrog bintray URL: https://github.com/apache/incubator-pinot/pull/5166 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[GitHub] [incubator-pinot] jackjlli commented on issue #5166: Nightly deploy Pinot to jfrog bintray
jackjlli commented on issue #5166: Nightly deploy Pinot to jfrog bintray URL: https://github.com/apache/incubator-pinot/pull/5166#issuecomment-604083997 I'm closing this PR because of the following statement from Travis doc: ``` Please note that encrypted environment variables are not available for pull requests from forks. ``` I've created a new PR from a branch: https://github.com/apache/incubator-pinot/pull/5181 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[incubator-pinot] annotated tag release-0.3.0 updated (9b2dc20 -> ae1815f)
This is an automated email from the ASF dual-hosted git repository. xiangfu pushed a change to annotated tag release-0.3.0 in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git. *** WARNING: tag release-0.3.0 was modified! *** from 9b2dc20 (commit) to ae1815f (tag) tagging 9b2dc20c07dec6cf33df08cd996e8202c3ba (commit) by Xiang Fu on Wed Mar 25 13:46:05 2020 -0700 - Log - Apache Pinot (Incubating) 0.3.0 --- No new revisions were added by this update. Summary of changes: - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[GitHub] [incubator-pinot] snleee edited a comment on issue #5185: Pinot website [WIP]
snleee edited a comment on issue #5185: Pinot website [WIP] URL: https://github.com/apache/incubator-pinot/pull/5185#issuecomment-604080019 Hi, is this trying to replace http://pinot.apache.org? FYI, `http://pinot.apache.org/` is served directly from `https://github.com/apache/incubator-pinot-site`. They will load `index.html` file. In that case, we can have 2 different approaches. 1. keep both source code + generated static website in `incubator-pinot-site`. 2. keep website code in `incubator-pinot`, whenever there's an update put static files to `incubator-pinot-site`. Also, I have 2 comments: 1. can we change the color from sky-blue to red wine like color? (Since pinot is a kind of wine :) ) 2. your static website generator needs a copy of all documentation. This means that we will need to keep 2 separate sources (https://apache-pinot.gitbook.io/apache-pinot-cookbook) we need to find the way to have a single source for documentation. @kishoreg This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[GitHub] [incubator-pinot] snleee commented on issue #5185: Pinot website [WIP]
snleee commented on issue #5185: Pinot website [WIP] URL: https://github.com/apache/incubator-pinot/pull/5185#issuecomment-604080019 Hi, is this trying to replace http://pinot.apache.org? FYI, `http://pinot.apache.org/` is served directly from `https://github.com/apache/incubator-pinot-site`. They will load `index.html` file. In that case, we will have 2 different approaches. 1. keep both source code + generated static website in `incubator-pinot-site`. 2. keep website code in `incubator-pinot`, whenever there's an update put static files to `incubator-pinot-site`. Also, I have 2 comments: 1. can we change the color from sky-blue to red wine like color? (Since pinot is a kind of wine :) ) 2. your static website generator needs a copy of all documentation. This means that we will need to keep 2 separate sources (https://apache-pinot.gitbook.io/apache-pinot-cookbook) we need to find the way to have a single source for documentation. @kishoreg This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[GitHub] [incubator-pinot] ChethanUK edited a comment on issue #5175: add pinot upsert features to pinot common
ChethanUK edited a comment on issue #5175: add pinot upsert features to pinot common URL: https://github.com/apache/incubator-pinot/pull/5175#issuecomment-604074970 > also [google doc design doc](https://www.google.com/url?sa=t=j=s=appssearch=8=0=rja=4ypfJoFtqjSdua_7dziWCQ=0ahUKEwjVhpqIybToAhXDHWIKHWFcBVs4ABABKAAwAA=https://drive.google.com/a/uber.com/open?id%3D1SFFir7ByxCff-aVYxQeTHpNhPXeP5q7P4g_6O2iNGgU%26usp%3Dchrome_omnibox=AOvVaw3KEdQYFMPa7tgpOn01R5ol) with comments. It's asking uber login. Can you change share settings? > remote meeting sync or something else @kishoreg At least monthly meeting and sync up on project status will be helpful to all... This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
svn commit: r38621 - /dev/incubator/pinot/apache-pinot-incubating-0.3.0-rc2/ /release/incubator/pinot/apache-pinot-incubating-0.3.0/
Author: xiangfu Date: Wed Mar 25 20:43:14 2020 New Revision: 38621 Log: Converting 0.3.0-rc2 into 0.3.0 Added: release/incubator/pinot/apache-pinot-incubating-0.3.0/ - copied from r38620, dev/incubator/pinot/apache-pinot-incubating-0.3.0-rc2/ Removed: dev/incubator/pinot/apache-pinot-incubating-0.3.0-rc2/ - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[incubator-pinot] branch pinot-jfrog-bintray updated (e6eff7c -> fb0af84)
This is an automated email from the ASF dual-hosted git repository. jlli pushed a change to branch pinot-jfrog-bintray in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git. from e6eff7c Testing add fb0af84 Add relative path No new revisions were added by this update. Summary of changes: pinot-broker/pom.xml | 1 + pinot-clients/pinot-java-client/pom.xml | 1 + pinot-clients/pom.xml | 1 + pinot-common/pom.xml | 1 + pinot-controller/pom.xml | 1 + pinot-core/pom.xml| 1 + pinot-distribution/pom.xml| 1 + pinot-integration-tests/pom.xml | 1 + pinot-minion/pom.xml | 1 + pinot-perf/pom.xml| 1 + pinot-plugins/pinot-batch-ingestion/pom.xml | 1 + pinot-plugins/pinot-file-system/pinot-adls/pom.xml| 1 + pinot-plugins/pinot-file-system/pinot-gcs/pom.xml | 1 + pinot-plugins/pinot-file-system/pinot-hdfs/pom.xml| 1 + pinot-plugins/pinot-file-system/pom.xml | 1 + pinot-plugins/pinot-input-format/pinot-avro-base/pom.xml | 1 + pinot-plugins/pinot-input-format/pinot-avro/pom.xml | 1 + pinot-plugins/pinot-input-format/pinot-confluent-avro/pom.xml | 1 + pinot-plugins/pinot-input-format/pinot-csv/pom.xml| 1 + pinot-plugins/pinot-input-format/pinot-json/pom.xml | 1 + pinot-plugins/pinot-input-format/pinot-orc/pom.xml| 1 + pinot-plugins/pinot-input-format/pinot-parquet/pom.xml| 1 + pinot-plugins/pinot-input-format/pinot-thrift/pom.xml | 1 + pinot-plugins/pinot-input-format/pom.xml | 1 + pinot-plugins/pinot-stream-ingestion/pinot-kafka-0.9/pom.xml | 1 + pinot-plugins/pinot-stream-ingestion/pinot-kafka-2.0/pom.xml | 1 + pinot-plugins/pinot-stream-ingestion/pinot-kafka-base/pom.xml | 1 + pinot-plugins/pinot-stream-ingestion/pom.xml | 1 + pinot-plugins/pom.xml | 1 + pinot-server/pom.xml | 1 + pinot-spi/pom.xml | 1 + pinot-tools/pom.xml | 1 + 32 files changed, 32 insertions(+) - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[GitHub] [incubator-pinot] ChethanUK commented on issue #5175: add pinot upsert features to pinot common
ChethanUK commented on issue #5175: add pinot upsert features to pinot common URL: https://github.com/apache/incubator-pinot/pull/5175#issuecomment-604074970 > also [google doc design doc](https://www.google.com/url?sa=t=j=s=appssearch=8=0=rja=4ypfJoFtqjSdua_7dziWCQ=0ahUKEwjVhpqIybToAhXDHWIKHWFcBVs4ABABKAAwAA=https://drive.google.com/a/uber.com/open?id%3D1SFFir7ByxCff-aVYxQeTHpNhPXeP5q7P4g_6O2iNGgU%26usp%3Dchrome_omnibox=AOvVaw3KEdQYFMPa7tgpOn01R5ol) with comments. It's asking uber login. Can you change share settings? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[GitHub] [incubator-pinot] ChethanUK commented on a change in pull request #5175: add pinot upsert features to pinot common
ChethanUK commented on a change in pull request #5175: add pinot upsert features to pinot common URL: https://github.com/apache/incubator-pinot/pull/5175#discussion_r398153186 ## File path: pinot-spi/src/main/java/org/apache/pinot/spi/data/Schema.java ## @@ -59,13 +65,28 @@ private static final Logger LOGGER = LoggerFactory.getLogger(Schema.class); private String _schemaName; + + // upsert related config + // primary key refers to the column name that is the primary key of this upsert table + private String _primaryKey; Review comment: > don't have support for multiple primary keys There will be some cases where multiple keys make sense right? Like in clickstream: `userId and timestamp` Will support for multiple keys be added later on? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[GitHub] [incubator-pinot] ChethanUK commented on a change in pull request #5175: add pinot upsert features to pinot common
ChethanUK commented on a change in pull request #5175: add pinot upsert features to pinot common URL: https://github.com/apache/incubator-pinot/pull/5175#discussion_r398153186 ## File path: pinot-spi/src/main/java/org/apache/pinot/spi/data/Schema.java ## @@ -59,13 +65,28 @@ private static final Logger LOGGER = LoggerFactory.getLogger(Schema.class); private String _schemaName; + + // upsert related config + // primary key refers to the column name that is the primary key of this upsert table + private String _primaryKey; Review comment: > don't have support for multiple primary keys There will be some cases where multiple keys make sense right? Like in clickstream: `userId and timestamp` This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[GitHub] [incubator-pinot] ChethanUK opened a new pull request #5185: Pinot website [WIP]
ChethanUK opened a new pull request #5185: Pinot website [WIP] URL: https://github.com/apache/incubator-pinot/pull/5185 WIP.. Check https://pinot-website-i424u28w7.now.sh or https://pinot-website-i424u28w7.now.sh/docs/administration/installation/cloud/on-premises to see more about the website.. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[GitHub] [incubator-pinot] Jackie-Jiang commented on a change in pull request #5182: Update travis scripts and readme links for kafka plugins
Jackie-Jiang commented on a change in pull request #5182: Update travis scripts and readme links for kafka plugins URL: https://github.com/apache/incubator-pinot/pull/5182#discussion_r398111239 ## File path: .travis_quickstart.sh ## @@ -50,9 +50,9 @@ bin/quick-start-streaming.sh & PID=$! sleep 60 COUNT_STAR_RES_1=`curl -X POST --header 'Accept: application/json' -d '{"sql":"select count(*) from meetupRsvp limit 1","trace":false}' http://localhost:8000/query/sql | jq '.resultTable.rows[0][0]'` -sleep 15 +sleep 30 COUNT_STAR_RES_2=`curl -X POST --header 'Accept: application/json' -d '{"sql":"select count(*) from meetupRsvp limit 1","trace":false}' http://localhost:8000/query/sql | jq '.resultTable.rows[0][0]'` -sleep 15 +sleep 30 COUNT_STAR_RES_3=`curl -X POST --header 'Accept: application/json' -d '{"sql":"select count(*) from meetupRsvp limit 1","trace":false}' http://localhost:8000/query/sql | jq '.resultTable.rows[0][0]'` if [ "${COUNT_STAR_RES_3}" -le "${COUNT_STAR_RES_2}" ] || [ "${COUNT_STAR_RES_2}" -le "${COUNT_STAR_RES_1}" ]; then echo 'Streaming Quickstart: Not getting incremental counts for 3 consecutive count star queries with 15 seconds interval.' Review comment: Update this line to 30 seconds This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[GitHub] [incubator-pinot] Jackie-Jiang commented on a change in pull request #5182: Update travis scripts and readme links for kafka plugins
Jackie-Jiang commented on a change in pull request #5182: Update travis scripts and readme links for kafka plugins URL: https://github.com/apache/incubator-pinot/pull/5182#discussion_r398111299 ## File path: .travis_quickstart.sh ## @@ -95,9 +95,9 @@ sleep 30 PID=$! sleep 60 COUNT_STAR_RES_1=`curl -X POST --header 'Accept: application/json' -d '{"sql":"select count(*) from meetupRsvp limit 1","trace":false}' http://localhost:8000/query/sql | jq '.resultTable.rows[0][0]'` -sleep 15 +sleep 30 COUNT_STAR_RES_2=`curl -X POST --header 'Accept: application/json' -d '{"sql":"select count(*) from meetupRsvp limit 1","trace":false}' http://localhost:8000/query/sql | jq '.resultTable.rows[0][0]'` -sleep 15 +sleep 30 COUNT_STAR_RES_3=`curl -X POST --header 'Accept: application/json' -d '{"sql":"select count(*) from meetupRsvp limit 1","trace":false}' http://localhost:8000/query/sql | jq '.resultTable.rows[0][0]'` if [ "${COUNT_STAR_RES_3}" -le "${COUNT_STAR_RES_2}" ] || [ "${COUNT_STAR_RES_2}" -le "${COUNT_STAR_RES_1}" ]; then echo 'Streaming Quickstart: Not getting incremental counts for 3 consecutive count star queries with 15 seconds interval.' Review comment: Same here This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[GitHub] [incubator-pinot] fx19880617 commented on issue #5182: Update readme link to gitbook for kafka plugins
fx19880617 commented on issue #5182: Update readme link to gitbook for kafka plugins URL: https://github.com/apache/incubator-pinot/pull/5182#issuecomment-604018354 > Can you please describe the change for the testing? Or should that be separate into another pr? Updated. It's pretty minor, I feel it's ok to merge them into one PR This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[GitHub] [incubator-pinot] Jackie-Jiang commented on issue #5182: Update readme link to gitbook for kafka plugins
Jackie-Jiang commented on issue #5182: Update readme link to gitbook for kafka plugins URL: https://github.com/apache/incubator-pinot/pull/5182#issuecomment-604014911 Can you please describe the change for the testing? Or should that be separate into another pr? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[GitHub] [incubator-pinot] akshayrai opened a new pull request #5184: [TE] Validate the number of data points to retrieve while fetching timeseries
akshayrai opened a new pull request #5184: [TE] Validate the number of data points to retrieve while fetching timeseries URL: https://github.com/apache/incubator-pinot/pull/5184 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[GitHub] [incubator-pinot] Jackie-Jiang edited a comment on issue #5166: Nightly deploy Pinot to jfrog bintray
Jackie-Jiang edited a comment on issue #5166: Nightly deploy Pinot to jfrog bintray URL: https://github.com/apache/incubator-pinot/pull/5166#issuecomment-604004032 > @Jackie-Jiang oh yeah, it needs some set up to run that cmd. Anyway, I think that it's fine as long as it's backward compatible. Pls ping me when this is ready for review. @snleee Wrong `at` lol This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[GitHub] [incubator-pinot] Jackie-Jiang commented on issue #5166: Nightly deploy Pinot to jfrog bintray
Jackie-Jiang commented on issue #5166: Nightly deploy Pinot to jfrog bintray URL: https://github.com/apache/incubator-pinot/pull/5166#issuecomment-604004032 > @Jackie-Jiang oh yeah, it needs some set up to run that cmd. Anyway, I think that it's fine as long as it's backward compatible. Pls ping me when this is ready for review. Wrong `at` lol This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[GitHub] [incubator-pinot] codecov-io commented on issue #5182: Update readme link to gitbook for kafka plugins
codecov-io commented on issue #5182: Update readme link to gitbook for kafka plugins URL: https://github.com/apache/incubator-pinot/pull/5182#issuecomment-603681209 # [Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/5182?src=pr=h1) Report > Merging [#5182](https://codecov.io/gh/apache/incubator-pinot/pull/5182?src=pr=desc) into [master](https://codecov.io/gh/apache/incubator-pinot/commit/4a6b21df1474cb82cdf790e7f1eb02dd4229a986=desc) will **decrease** coverage by `9.41%`. > The diff coverage is `n/a`. [![Impacted file tree graph](https://codecov.io/gh/apache/incubator-pinot/pull/5182/graphs/tree.svg?width=650=150=pr=4ibza2ugkz)](https://codecov.io/gh/apache/incubator-pinot/pull/5182?src=pr=tree) ```diff @@ Coverage Diff @@ ## master#5182 +/- ## - Coverage 65.95% 56.53% -9.42% Complexity 12 12 Files 1052 1052 Lines 5417054170 Branches 8078 8078 - Hits 3572730625-5102 - Misses1579421112+5318 + Partials 2649 2433 -216 ``` | [Impacted Files](https://codecov.io/gh/apache/incubator-pinot/pull/5182?src=pr=tree) | Coverage Δ | Complexity Δ | | |---|---|---|---| | [...a/org/apache/pinot/minion/metrics/MinionMeter.java](https://codecov.io/gh/apache/incubator-pinot/pull/5182/diff?src=pr=tree#diff-cGlub3QtbWluaW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9waW5vdC9taW5pb24vbWV0cmljcy9NaW5pb25NZXRlci5qYXZh) | `0.00% <0.00%> (-100.00%)` | `0.00% <0.00%> (ø%)` | | | [.../apache/pinot/common/metrics/BrokerQueryPhase.java](https://codecov.io/gh/apache/incubator-pinot/pull/5182/diff?src=pr=tree#diff-cGlub3QtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9waW5vdC9jb21tb24vbWV0cmljcy9Ccm9rZXJRdWVyeVBoYXNlLmphdmE=) | `0.00% <0.00%> (-100.00%)` | `0.00% <0.00%> (ø%)` | | | [.../apache/pinot/minion/metrics/MinionQueryPhase.java](https://codecov.io/gh/apache/incubator-pinot/pull/5182/diff?src=pr=tree#diff-cGlub3QtbWluaW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9waW5vdC9taW5pb24vbWV0cmljcy9NaW5pb25RdWVyeVBoYXNlLmphdmE=) | `0.00% <0.00%> (-100.00%)` | `0.00% <0.00%> (ø%)` | | | [...he/pinot/core/query/reduce/ComparisonFunction.java](https://codecov.io/gh/apache/incubator-pinot/pull/5182/diff?src=pr=tree#diff-cGlub3QtY29yZS9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUvcGlub3QvY29yZS9xdWVyeS9yZWR1Y2UvQ29tcGFyaXNvbkZ1bmN0aW9uLmphdmE=) | `0.00% <0.00%> (-100.00%)` | `0.00% <0.00%> (ø%)` | | | [...pinot/minion/exception/TaskCancelledException.java](https://codecov.io/gh/apache/incubator-pinot/pull/5182/diff?src=pr=tree#diff-cGlub3QtbWluaW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9waW5vdC9taW5pb24vZXhjZXB0aW9uL1Rhc2tDYW5jZWxsZWRFeGNlcHRpb24uamF2YQ==) | `0.00% <0.00%> (-100.00%)` | `0.00% <0.00%> (ø%)` | | | [...ot/minion/events/EventObserverFactoryRegistry.java](https://codecov.io/gh/apache/incubator-pinot/pull/5182/diff?src=pr=tree#diff-cGlub3QtbWluaW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9waW5vdC9taW5pb24vZXZlbnRzL0V2ZW50T2JzZXJ2ZXJGYWN0b3J5UmVnaXN0cnkuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | `0.00% <0.00%> (ø%)` | | | [...t/minion/executor/TaskExecutorFactoryRegistry.java](https://codecov.io/gh/apache/incubator-pinot/pull/5182/diff?src=pr=tree#diff-cGlub3QtbWluaW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9waW5vdC9taW5pb24vZXhlY3V0b3IvVGFza0V4ZWN1dG9yRmFjdG9yeVJlZ2lzdHJ5LmphdmE=) | `0.00% <0.00%> (-100.00%)` | `0.00% <0.00%> (ø%)` | | | [...minion/executor/ConvertToRawIndexTaskExecutor.java](https://codecov.io/gh/apache/incubator-pinot/pull/5182/diff?src=pr=tree#diff-cGlub3QtbWluaW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9waW5vdC9taW5pb24vZXhlY3V0b3IvQ29udmVydFRvUmF3SW5kZXhUYXNrRXhlY3V0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | `0.00% <0.00%> (ø%)` | | | [...nion/events/DefaultMinionEventObserverFactory.java](https://codecov.io/gh/apache/incubator-pinot/pull/5182/diff?src=pr=tree#diff-cGlub3QtbWluaW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9waW5vdC9taW5pb24vZXZlbnRzL0RlZmF1bHRNaW5pb25FdmVudE9ic2VydmVyRmFjdG9yeS5qYXZh) | `0.00% <0.00%> (-100.00%)` | `0.00% <0.00%> (ø%)` | | | [...startree/executor/StarTreeAggregationExecutor.java](https://codecov.io/gh/apache/incubator-pinot/pull/5182/diff?src=pr=tree#diff-cGlub3QtY29yZS9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUvcGlub3QvY29yZS9zdGFydHJlZS9leGVjdXRvci9TdGFyVHJlZUFnZ3JlZ2F0aW9uRXhlY3V0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | `0.00% <0.00%> (ø%)` | | | ... and [315 more](https://codecov.io/gh/apache/incubator-pinot/pull/5182/diff?src=pr=tree-more) | | -- [Continue to review full report at Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/5182?src=pr=continue). > **Legend** - [Click here to learn
[GitHub] [incubator-pinot] kishoreg commented on issue #5175: add pinot upsert features to pinot common
kishoreg commented on issue #5175: add pinot upsert features to pinot common URL: https://github.com/apache/incubator-pinot/pull/5175#issuecomment-603667466 One concern here would be that the update related configuration appears in multiple places. One thing that can simplify this PR is to add a UpdateConfig under TableConfig and move everything under that. That allows you to mark that config as beta/unstable and iterate quickly - updatesemantic (or the new name) - primarykey - offsetkey - This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[GitHub] [incubator-pinot] kishoreg commented on a change in pull request #5175: add pinot upsert features to pinot common
kishoreg commented on a change in pull request #5175: add pinot upsert features to pinot common URL: https://github.com/apache/incubator-pinot/pull/5175#discussion_r397633097 ## File path: pinot-spi/src/main/java/org/apache/pinot/spi/data/Schema.java ## @@ -59,13 +65,28 @@ private static final Logger LOGGER = LoggerFactory.getLogger(Schema.class); private String _schemaName; + + // upsert related config + // primary key refers to the column name that is the primary key of this upsert table + private String _primaryKey; Review comment: Better to design it for multiple, even if the implementation can handle only one primary key This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
[GitHub] [incubator-pinot] kishoreg opened a new issue #5183: Fix license
kishoreg opened a new issue #5183: Fix license URL: https://github.com/apache/incubator-pinot/issues/5183 via Justin on the Pinot release thread > license need a little work. Please fix before the next release. > I checked: > - incubating in name > - signatures and hashes are fine > - DISCLAIMER exists > - LICENSE is missing a license > - NOTICE is fine > - No unexpected binary files > - all source files have ASF headers > > LICENSE file is missing license for: > - jquery.requestAnimationFrame Copyright (c) 2012 Corey Frang in [1] This is also missing in licenses. > - Sizzle.js in [2] This is also missing in licenses. This is one danger with including minified files. > > Thanks, > Justin This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org