This is an automated email from the ASF dual-hosted git repository.
nehapawar pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
from dfd9bb1 Re-enable S3PinotFSTest. (#5604)
add 60ebe71 Filtering during ingestion (#5597)
No new revisions were added by this update.
Summary of changes:
.../common/utils/config/TableConfigUtils.java | 13 ++-
.../common/utils/config/TableConfigSerDeTest.java | 24 +++++
.../data/function/FunctionEvaluatorFactory.java | 2 +-
.../realtime/HLRealtimeSegmentDataManager.java | 13 +--
.../realtime/LLRealtimeSegmentDataManager.java | 12 +--
.../recordtransformer/CompositeTransformer.java | 12 ++-
.../data/recordtransformer/FilterTransformer.java | 53 ++++++++++
.../generator/SegmentGeneratorConfig.java | 11 +-
.../RecordReaderSegmentCreationDataSource.java | 13 +--
.../core/segment/creator/StatsCollectorConfig.java | 11 +-
.../impl/SegmentIndexCreationDriverImpl.java | 18 ++--
.../org/apache/pinot/core/util/IngestionUtils.java | 87 ++++++++++++++++
.../org/apache/pinot/core/util/SchemaUtils.java | 24 -----
.../data/readers/RecordReaderSampleDataTest.java | 6 +-
.../recordtransformer/RecordTransformerTest.java | 52 +++++++++-
.../MutableSegmentImplNullValueVectorTest.java | 7 +-
.../impl/fakestream/FakeStreamConfigUtils.java | 12 +++
.../impl/fakestream/FakeStreamConsumerFactory.java | 8 +-
.../SegmentGenerationWithBytesTypeTest.java | 1 -
...=> SegmentGenerationWithFilterRecordsTest.java} | 68 ++++++------
... SegmentGenerationWithMultipleRecordsTest.java} | 6 +-
...chemaUtilsTest.java => IngestionUtilsTest.java} | 114 ++++++---------------
.../apache/pinot/core/util/SchemaUtilsTest.java | 89 ----------------
.../segments/v1/creator/DictionariesTest.java | 8 +-
.../apache/pinot/hadoop/io/PinotOutputFormat.java | 8 +-
.../{TenantConfig.java => IngestionConfig.java} | 42 +++-----
.../apache/pinot/spi/config/table/TableConfig.java | 18 +++-
.../FilterConfig.java} | 24 +++--
.../apache/pinot/spi/data/readers/GenericRow.java | 10 ++
.../spi/utils/builder/TableConfigBuilder.java | 9 +-
.../org/apache/pinot/tools/RealtimeQuickStart.java | 2 +-
.../pinot/tools/streams/MeetupRsvpStream.java | 12 +--
32 files changed, 460 insertions(+), 329 deletions(-)
create mode 100644
pinot-core/src/main/java/org/apache/pinot/core/data/recordtransformer/FilterTransformer.java
create mode 100644
pinot-core/src/main/java/org/apache/pinot/core/util/IngestionUtils.java
copy
pinot-core/src/test/java/org/apache/pinot/core/segment/index/creator/{SegmentGenerationWithMultipleRecordsKey.java
=> SegmentGenerationWithFilterRecordsTest.java} (60%)
rename
pinot-core/src/test/java/org/apache/pinot/core/segment/index/creator/{SegmentGenerationWithMultipleRecordsKey.java
=> SegmentGenerationWithMultipleRecordsTest.java} (96%)
copy pinot-core/src/test/java/org/apache/pinot/core/util/{SchemaUtilsTest.java
=> IngestionUtilsTest.java} (50%)
copy
pinot-spi/src/main/java/org/apache/pinot/spi/config/table/{TenantConfig.java =>
IngestionConfig.java} (57%)
copy
pinot-spi/src/main/java/org/apache/pinot/spi/config/table/{TableCustomConfig.java
=> ingestion/FilterConfig.java} (64%)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
