This is an automated email from the ASF dual-hosted git repository.
lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.
from fe6c2c7 [BEAM-7463] Fix BQ IT flake with streaming inserts (#12951)
new be0bd98 [BEAM-10124] Add ContextualTextIO as a copy of TextIO
new 07b4d17 [BEAM-10124] Change access modifiers. * Change access
modifiers of the following function for visibility outside the package * modify
access modifier for getEmptyMatchTreatment() and getWatchInterval() from FileIO
* modify access modifier for getSingleFileMetadata() from FileBasedSource
new f61aad0 [BEAM-10124] Add ContextualTextIO Implementation * Modify and
add additional tests for ContextualTextIO * Add implementation for
ContextualTextIO
new 90617ce [BEAM-10124] Refactor Code and Add option for recordOffset *
Refactored requested changes * Add recordOffset feild that gives the offset of
a record in the file
new 85d576e [BEAM-10124] Refactor requested changes
new e60c4fa [BEAM-10124] Refactor requested changes
new 4bbd2ca [BEAM-10124] Change from RecordWithMetadata To Row
new 0f7ebc5 Fixup Co-authored-by: Lukasz Cwik <[email protected]>
new 1aaa1e9 Update sdks/java/io/contextual-text-io/build.gradle
new 8404af2 Update
sdks/java/io/contextual-text-io/src/main/java/org/apache/beam/sdk/io/contextualtextio/ContextualTextIO.java
new 35d8567 [BEAM-10124] Change default for RecordNum to be false. Add
Check for trigger Change module location Change to MultiMapView
new 29787b3 Merge pull request #12924 from rezarokni/contextualio_rebase
The 29114 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../org/apache/beam/sdk/io/FileBasedSource.java | 2 +-
.../main/java/org/apache/beam/sdk/io/FileIO.java | 4 +-
.../io/{splunk => contextualtextio}/build.gradle | 28 +-
.../sdk/io/contextualtextio/ContextualTextIO.java | 707 +++++++++++++++++++
.../contextualtextio/ContextualTextIOSource.java} | 143 +++-
.../io/contextualtextio/RecordWithMetadata.java | 112 +++
.../sdk/io/contextualtextio}/package-info.java | 7 +-
.../io/contextualtextio/ContextualTextIOTest.java} | 753 +++++++++++++++++----
settings.gradle | 1 +
9 files changed, 1557 insertions(+), 200 deletions(-)
copy sdks/java/io/{splunk => contextualtextio}/build.gradle (55%)
create mode 100644
sdks/java/io/contextualtextio/src/main/java/org/apache/beam/sdk/io/contextualtextio/ContextualTextIO.java
copy sdks/java/{core/src/main/java/org/apache/beam/sdk/io/TextSource.java =>
io/contextualtextio/src/main/java/org/apache/beam/sdk/io/contextualtextio/ContextualTextIOSource.java}
(67%)
create mode 100644
sdks/java/io/contextualtextio/src/main/java/org/apache/beam/sdk/io/contextualtextio/RecordWithMetadata.java
copy
sdks/java/{extensions/sql/datacatalog/src/main/java/org/apache/beam/sdk/extensions/sql/meta/provider/datacatalog
=>
io/contextualtextio/src/main/java/org/apache/beam/sdk/io/contextualtextio}/package-info.java
(83%)
copy sdks/java/{core/src/test/java/org/apache/beam/sdk/io/TextIOReadTest.java
=>
io/contextualtextio/src/test/java/org/apache/beam/sdk/io/contextualtextio/ContextualTextIOTest.java}
(50%)
