fx19880617 commented on issue #6003:
URL:
https://github.com/apache/incubator-pinot/issues/6003#issuecomment-690927594
@elonazoulay could you help check if GcsPinotFs is good when the bucket has
many objects?
This is an
fx19880617 opened a new pull request #6002:
URL: https://github.com/apache/incubator-pinot/pull/6002
## Description
S3 API has a bounded limit(1000) for the objects returned in ListObject API,
which means each call may at most returned 1000 S3 objects.
This PR will check
This is an automated email from the ASF dual-hosted git repository.
xiangfu pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git
The following commit(s) were added to refs/heads/master by this push:
new 11fd62b Fix S3PinotFS List API may
fx19880617 merged pull request #6002:
URL: https://github.com/apache/incubator-pinot/pull/6002
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
This is an automated email from the ASF dual-hosted git repository.
xiangfu pushed a change to branch fixing_s3_list_api
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
at 8665918 Fix S3PinotFS List API may not return full results
This branch includes the
This is an automated email from the ASF dual-hosted git repository.
xiangfu pushed a commit to branch fixing_s3_list_api
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git
commit 86659186e8e2196b199a5c2bb011dd560a5a524f
Author: Xiang Fu
AuthorDate: Thu Sep 10 23:38:37 2020
This is an automated email from the ASF dual-hosted git repository.
xiangfu pushed a change to branch fixing_s3_list_api
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
discard 8665918 Fix S3PinotFS List API may not return full results
add 0226925 Fix S3PinotFS
fx19880617 commented on issue #6003:
URL:
https://github.com/apache/incubator-pinot/issues/6003#issuecomment-690920467
@snleee
@elonazoulay
This is an automated message from the Apache Git Service.
To respond to the
fx19880617 removed a comment on issue #6003:
URL:
https://github.com/apache/incubator-pinot/issues/6003#issuecomment-690920467
@snleee
@elonazoulay
This is an automated message from the Apache Git Service.
To respond
fx19880617 commented on issue #6003:
URL:
https://github.com/apache/incubator-pinot/issues/6003#issuecomment-690926043
@snleee seems that ADLSGen2 also has the problem of truncation:
https://docs.microsoft.com/en-us/rest/api/storageservices/datalakestoragegen2/filesystem/list
fx19880617 commented on issue #6003:
URL:
https://github.com/apache/incubator-pinot/issues/6003#issuecomment-690914135
S3PinotFs is fixed in #6002
This is an automated message from the Apache Git Service.
To respond to
fx19880617 opened a new issue #6003:
URL: https://github.com/apache/incubator-pinot/issues/6003
Per https://github.com/apache/incubator-pinot/pull/6002, S3 has a limit on
each ListObject call response. I think this policy may also be true for other
blob store.
This issue is created
kishoreg commented on a change in pull request #6002:
URL: https://github.com/apache/incubator-pinot/pull/6002#discussion_r486810483
##
File path:
pinot-plugins/pinot-file-system/pinot-s3/src/main/java/org/apache/pinot/plugin/filesystem/S3PinotFS.java
##
@@ -374,33 +375,39 @@
fx19880617 commented on pull request #6002:
URL: https://github.com/apache/incubator-pinot/pull/6002#issuecomment-690912063
We should also review other PinotFs implementations to ensure the similar
issues are not presenting there.
fx19880617 commented on a change in pull request #6002:
URL: https://github.com/apache/incubator-pinot/pull/6002#discussion_r486817834
##
File path:
pinot-plugins/pinot-file-system/pinot-s3/src/main/java/org/apache/pinot/plugin/filesystem/S3PinotFS.java
##
@@ -374,33 +375,39
Jackie-Jiang opened a new pull request #6004:
URL: https://github.com/apache/incubator-pinot/pull/6004
## Description
Introduce `ThetaSketchAggregationFunction` as an enhanced version of
`DistinctCountThetaSketchAggregationFunction`, and add the following supports:
- Support
This is an automated email from the ASF dual-hosted git repository.
xiangfu pushed a change to branch fixing_s3_list_api
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
discard 8665918 Fix S3PinotFS List API may not return full results
add 0226925 Fix S3PinotFS
This is an automated email from the ASF dual-hosted git repository.
xiangfu pushed a change to branch fixing_s3_list_api
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
discard 8665918 Fix S3PinotFS List API may not return full results
add 0226925 Fix S3PinotFS
ChethanUK opened a new pull request #6006:
URL: https://github.com/apache/incubator-pinot/pull/6006
Fixing a few data view and other errors which were failing the build
Updating the packages and adding dev serve test mode
```bash
yarn run serve --build --port 3001 --host
vincentchenjl opened a new pull request #6007:
URL: https://github.com/apache/incubator-pinot/pull/6007
This PR is second PR for severity-based alert feature, including the logic
of parsing labeler configuration and constructing the detection pipelines based
on the YAML.
jihaozh commented on a change in pull request #6001:
URL: https://github.com/apache/incubator-pinot/pull/6001#discussion_r487263049
##
File path:
thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/tools/RunAdhocDatabaseQueriesTool.java
##
@@ -723,9 +741,65 @@
Jackie-Jiang opened a new pull request #6008:
URL: https://github.com/apache/incubator-pinot/pull/6008
## Description
Prevent storing very long values into the segment metadata. This could
happen when Pinot is used as a blob store (not recommended but supported).
fx19880617 merged pull request #6006:
URL: https://github.com/apache/incubator-pinot/pull/6006
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
This is an automated email from the ASF dual-hosted git repository.
xiangfu pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
from 11fd62b Fix S3PinotFS List API may not return full results (#6002)
add 13a281c Fix/data view dev
ChethanUK commented on pull request #6006:
URL: https://github.com/apache/incubator-pinot/pull/6006#issuecomment-691278842
✅ Preview available at
https://incubator-pinot-git-fix-web-data-error.chethanuk.vercel.app
This is
codecov-commenter commented on pull request #6008:
URL: https://github.com/apache/incubator-pinot/pull/6008#issuecomment-691309424
#
[Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/6008?src=pr=h1)
Report
> Merging
yupeng9 commented on a change in pull request #6008:
URL: https://github.com/apache/incubator-pinot/pull/6008#discussion_r487290286
##
File path:
pinot-core/src/main/java/org/apache/pinot/core/segment/creator/impl/SegmentColumnarIndexCreator.java
##
@@ -78,6 +78,9 @@
public
jackjlli commented on pull request #6005:
URL: https://github.com/apache/incubator-pinot/pull/6005#issuecomment-691313748
> Could you add a test such that it fails with the original code, and passes
with the old code?
Test added.
Jackie-Jiang commented on a change in pull request #6005:
URL: https://github.com/apache/incubator-pinot/pull/6005#discussion_r487213705
##
File path:
pinot-plugins/pinot-input-format/pinot-avro-base/src/main/java/org/apache/pinot/plugin/inputformat/avro/AvroRecordExtractor.java
This is an automated email from the ASF dual-hosted git repository.
jlli pushed a commit to branch fix-AvroRecordExtractor
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git
commit fd1cb00a4f8d0f475e114add27b81d11ef651372
Author: Jack Li(Analytics Engineering)
AuthorDate: Fri
This is an automated email from the ASF dual-hosted git repository.
jlli pushed a change to branch fix-AvroRecordExtractor
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
at fd1cb00 Fix extract method in AvroRecordExtractor
This branch includes the following new
jackjlli commented on a change in pull request #6005:
URL: https://github.com/apache/incubator-pinot/pull/6005#discussion_r487224829
##
File path:
pinot-plugins/pinot-input-format/pinot-avro-base/src/main/java/org/apache/pinot/plugin/inputformat/avro/AvroRecordExtractor.java
This is an automated email from the ASF dual-hosted git repository.
jlli pushed a commit to branch fix-AvroRecordExtractor
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git
commit bfb59545cdd13e94f34c882be579afd917fbdd80
Author: Jack Li(Analytics Engineering)
AuthorDate: Fri
This is an automated email from the ASF dual-hosted git repository.
jlli pushed a change to branch fix-AvroRecordExtractor
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
discard f4add59 Fix extract method in AvroRecordExtractor
new bfb5954 Fix extract method in
This is an automated email from the ASF dual-hosted git repository.
jlli pushed a change to branch fix-AvroRecordExtractor
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
discard fd1cb00 Fix extract method in AvroRecordExtractor
new f4add59 Fix extract method in
This is an automated email from the ASF dual-hosted git repository.
jlli pushed a commit to branch fix-AvroRecordExtractor
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git
commit f4add59f9518b37c638d90457a92e18f81108545
Author: Jack Li(Analytics Engineering)
AuthorDate: Fri
jackjlli opened a new pull request #6005:
URL: https://github.com/apache/incubator-pinot/pull/6005
## Description
This PR fixes the extract method in AvroRecordExtractor class.
When `_extractAll` is true, the generic record will be first converted to a
json String and then parse
This is an automated email from the ASF dual-hosted git repository.
jlli pushed a change to branch fix-AvroRecordExtractor
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
from bfb5954 Fix extract method in AvroRecordExtractor
add c19fb22 Address PR comments
No
jackjlli commented on pull request #6009:
URL: https://github.com/apache/incubator-pinot/pull/6009#issuecomment-691397062
> Can you reduce the size of the testing files (both
`test_sample_data_multi_value.avro` and `test_sample_data.avro` previously
checked in)? All we need from the file
This is an automated email from the ASF dual-hosted git repository.
jlli pushed a change to branch fix-schema-validator
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
from 6d22faa Adjust schema validation logic in AvroIngestionSchemaValidator
add f09ca9a
This is an automated email from the ASF dual-hosted git repository.
xiangfu pushed a commit to branch update_pinot_helm_for_custom_config_file
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git
commit c3d3d20b59f5af7e190afdbaa32a8ff121bd4c26
Author: Xiang Fu
AuthorDate: Fri
This is an automated email from the ASF dual-hosted git repository.
xiangfu pushed a change to branch update_pinot_helm_for_custom_config_file
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
at c3d3d20 Update pinot helm to adding custom configs and update the jvm
fx19880617 opened a new pull request #6011:
URL: https://github.com/apache/incubator-pinot/pull/6011
## Description
This change:
1. Allows users to add more configs into pinot config files just through
`values.yaml` file.
2. Add GC related settings into default JVM configs for
Jackie-Jiang opened a new pull request #6010:
URL: https://github.com/apache/incubator-pinot/pull/6010
## Description
Introduce `TextIndexCreator` and `TextIndexReader` for text index
This is an automated message from the
yupeng9 commented on a change in pull request #6008:
URL: https://github.com/apache/incubator-pinot/pull/6008#discussion_r487354466
##
File path:
pinot-core/src/main/java/org/apache/pinot/core/segment/creator/impl/SegmentColumnarIndexCreator.java
##
@@ -78,6 +78,9 @@
public
jackjlli opened a new pull request #6009:
URL: https://github.com/apache/incubator-pinot/pull/6009
## Description
This PR adjusts schema validation logic in AvroIngestionSchemaValidator.
The current logic doesn't check the actual data type for multi-value column,
which could have
This is an automated email from the ASF dual-hosted git repository.
jlli pushed a commit to branch fix-schema-validator
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git
commit 6d22faa9fd916217b764ddebd8cacac54ea4a6db
Author: Jack Li(Analytics Engineering)
AuthorDate: Fri
This is an automated email from the ASF dual-hosted git repository.
jlli pushed a change to branch fix-schema-validator
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
at 6d22faa Adjust schema validation logic in AvroIngestionSchemaValidator
This branch includes
Jackie-Jiang commented on a change in pull request #6008:
URL: https://github.com/apache/incubator-pinot/pull/6008#discussion_r487331483
##
File path:
pinot-core/src/main/java/org/apache/pinot/core/segment/creator/impl/SegmentColumnarIndexCreator.java
##
@@ -78,6 +78,9 @@
49 matches
Mail list logo
