This is an automated email from the ASF dual-hosted git repository.
lostluck pushed a change to branch swift-sdk
in repository https://gitbox.apache.org/repos/asf/beam.git
at bcf017ccb32 add swift to git ignore
This branch includes the following new commits:
new cf29f48a462 Moving experimental Swift SDK code into Beam repo
structure. Cleaning up and adding tests and Apache License labels where needed.
new d22e84f5bd2 Adding more of the Swift SDK implementation
new 5be3750fd8f Refactor Unary and Tuple SerializableFn into a single
ClosureFn since one is just a special case of the other. Add the wordcount
integration test to verify the refactoring does indeed work and start moving
the pipeline code into the branch.
new 534b3e4c2c9 Moving some stuff around to make the proto construction
code easier to read
new 9ebd42c7948 Add missing file
new f3f519d11d9 Add the rest of the code. Basic word count integration
test now completes successfully with the Python Portable Runner.
new 24d960835ad Add licenses everywhere
new c3d71877323 Add the generated proto files so other people don't have
to do it along with the typealias data
new 28268f78874 Use a single advance in varint implementation
new 33ad4d8a97a Small change to try to stop crashing on Linux
new 02b0ae54ca7 Trying to stop advanced(by:) crashes on non-macOS platforms
new e155dc3e87d safeAdvance to try to address issues with zero-length data
elements on non-mac platforms.
new 844cd182f16 Move typealiases for model protos to make it easier to
find and less likely to be ignored by .gitignore
new adfd8948ae3 Turns out String interpolation breaks the #file and #line
macros. Try a new approach with optional "real" names to get more stable
transform names. Start adding "ObjectFn" for more complicated DoFn
implementations.
new 16e1ca311d1 Second attempt and fixing the line values.
new 59328968ac5 Remove random output file
new c5edeac1289 Start stubbing out more of the composite transform
implementation. Start stubbing out External Transforms and Schema support.
Improve automatic naming of pardos and make explicit name implementation
cleaner. Add S3 and GCS dependencies to implement basic internal IOs.
new 9471e336310 Added backwards links in PCollections to support Composite
transforms. Added a very basic composite version of WordCount to the test
suite. Still need to hook up the graph generation, which requires searching for
the roots from the leaves to give it more of that "SwiftUI" style.
new 0bfcf41f455 Added the primitives for a FileIO implementation with
Google Storage support to start. Doesn't do anything fancy, but does implement
a true version of wordcount with the classic Shakespeare input.
new 739ea5a644e Rename previous stream-based pardo implementation to
pstream and start to introduce an element-wise pardo. This better matches other
SDK conventions (i.e. processElement) and allows us to implicitly transfer the
timestamp and window from the input to an output. Repurposes the PInput and
POutput protocols to handle this functionality. Also update the map and flatmap
implementations to use pardo rather than pstream to get a sense of how well it
works (well).
new c13e652d2a4 Changes to allow Swift SDK to operate successfully with
the Flink Portable Runner as well as the Python Portable Runner. Modified the
PInput/POutput functionality to just be structs, this allows us to use them for
both closures as well as the eventual DoFn interface and cleans up the function
signatures.
new bcf017ccb32 add swift to git ignore
The 22 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
