[2/2] incubator-beam git commit: This closes #1632
This closes #1632 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/203b7b17 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/203b7b17 Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/203b7b17 Branch: refs/heads/master Commit: 203b7b174ad6e4194baae6965a1e714c4acadf8c Parents: 1e148cd 9bd4288 Author: Aljoscha Krettek <aljoscha.kret...@gmail.com> Authored: Mon Dec 19 12:09:03 2016 +0100 Committer: Aljoscha Krettek <aljoscha.kret...@gmail.com> Committed: Mon Dec 19 12:09:03 2016 +0100 -- runners/flink/examples/pom.xml | 12 ++-- 1 file changed, 6 insertions(+), 6 deletions(-) --
[1/2] incubator-beam git commit: [BEAM-1165] Fix unexpected file creation when checking dependencies
Repository: incubator-beam
Updated Branches:
refs/heads/master 1e148cd7d -> 203b7b174
[BEAM-1165] Fix unexpected file creation when checking dependencies
This error happens because maven-dependency-plugin asumes the property output
used by the flink tests as the export file for the depedency:tree
command.
Ref.
https://maven.apache.org/plugins/maven-dependency-plugin/tree-mojo.html#output
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/9bd4288f
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/9bd4288f
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/9bd4288f
Branch: refs/heads/master
Commit: 9bd4288f13ac3f279b795e93adcfa3f897ef266c
Parents: 1e148cd
Author: Ismaël MejÃa <ieme...@gmail.com>
Authored: Thu Dec 15 22:06:18 2016 +0100
Committer: Aljoscha Krettek <aljoscha.kret...@gmail.com>
Committed: Mon Dec 19 10:09:10 2016 +0100
--
runners/flink/examples/pom.xml | 12 ++--
1 file changed, 6 insertions(+), 6 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/9bd4288f/runners/flink/examples/pom.xml
--
diff --git a/runners/flink/examples/pom.xml b/runners/flink/examples/pom.xml
index 3145848..c50a293 100644
--- a/runners/flink/examples/pom.xml
+++ b/runners/flink/examples/pom.xml
@@ -34,9 +34,9 @@
-kinglear.txt
-wordcounts.txt
--1
+kinglear.txt
+wordcounts.txt
+-1
@@ -112,9 +112,9 @@
java
--runner=org.apache.beam.runners.flink.FlinkRunner
---parallelism=${parallelism}
---input=${input}
---output=${output}
+--parallelism=${flink.examples.parallelism}
+--input=${flink.examples.input}
+--output=${flink.examples.output}
[jira] [Commented] (BEAM-1148) Port PAssert away from Aggregators
[ https://issues.apache.org/jira/browse/BEAM-1148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15748240#comment-15748240 ] Aljoscha Krettek commented on BEAM-1148: Just out of curiosity, what are they going to be replaced with? > Port PAssert away from Aggregators > -- > > Key: BEAM-1148 > URL: https://issues.apache.org/jira/browse/BEAM-1148 > Project: Beam > Issue Type: New Feature > Components: sdk-java-core >Reporter: Kenneth Knowles > > One step in the removal of Aggregators (in favor of Metrics) is to remove our > reliance on them for PAssert checking. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (BEAM-1096) flink streaming side output optimization using SplitStream
[ https://issues.apache.org/jira/browse/BEAM-1096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated BEAM-1096: --- Assignee: Alexey Diomin > flink streaming side output optimization using SplitStream > -- > > Key: BEAM-1096 > URL: https://issues.apache.org/jira/browse/BEAM-1096 > Project: Beam > Issue Type: Improvement > Components: runner-flink >Affects Versions: 0.4.0-incubating >Reporter: Alexey Diomin >Assignee: Alexey Diomin >Priority: Minor > Fix For: 0.4.0-incubating > > > Current implementation: > 1) send all events in all output streams > 2) filtering streams for necessary tags > Cons: increased cpu usage for serialization all events > Proposed implementation: > 1) route event in correct streams based on tag -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[2/2] incubator-beam git commit: This closes #1520
This closes #1520 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/6807480a Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/6807480a Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/6807480a Branch: refs/heads/master Commit: 6807480a97f2315b3f48ad8dd5accb4e30475fa4 Parents: c53e0b1 f1a5704 Author: Aljoscha Krettek <aljoscha.kret...@gmail.com> Authored: Thu Dec 8 09:55:32 2016 +0800 Committer: Aljoscha Krettek <aljoscha.kret...@gmail.com> Committed: Thu Dec 8 09:55:32 2016 +0800 -- .../FlinkStreamingTransformTranslators.java | 28 +--- 1 file changed, 18 insertions(+), 10 deletions(-) --
[1/2] incubator-beam git commit: [BEAM-1096] Flink streaming side output optimization using SplitStream
Repository: incubator-beam
Updated Branches:
refs/heads/master c53e0b162 -> 6807480a9
[BEAM-1096] Flink streaming side output optimization using SplitStream
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/f1a5704a
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/f1a5704a
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/f1a5704a
Branch: refs/heads/master
Commit: f1a5704a505b01d7d4649b61d1f6697859367964
Parents: c53e0b1
Author: Alexey Diomin <diomi...@gmail.com>
Authored: Wed Dec 7 09:48:35 2016 +0400
Committer: Aljoscha Krettek <aljoscha.kret...@gmail.com>
Committed: Thu Dec 8 09:55:22 2016 +0800
--
.../FlinkStreamingTransformTranslators.java | 28 +---
1 file changed, 18 insertions(+), 10 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/f1a5704a/runners/flink/runner/src/main/java/org/apache/beam/runners/flink/translation/FlinkStreamingTransformTranslators.java
--
diff --git
a/runners/flink/runner/src/main/java/org/apache/beam/runners/flink/translation/FlinkStreamingTransformTranslators.java
b/runners/flink/runner/src/main/java/org/apache/beam/runners/flink/translation/FlinkStreamingTransformTranslators.java
index 47935eb..7b32c76 100644
---
a/runners/flink/runner/src/main/java/org/apache/beam/runners/flink/translation/FlinkStreamingTransformTranslators.java
+++
b/runners/flink/runner/src/main/java/org/apache/beam/runners/flink/translation/FlinkStreamingTransformTranslators.java
@@ -78,11 +78,13 @@ import
org.apache.flink.api.common.functions.RichFlatMapFunction;
import org.apache.flink.api.common.typeinfo.TypeInformation;
import org.apache.flink.api.java.tuple.Tuple2;
import org.apache.flink.core.fs.FileSystem;
+import org.apache.flink.streaming.api.collector.selector.OutputSelector;
import org.apache.flink.streaming.api.datastream.DataStream;
import org.apache.flink.streaming.api.datastream.DataStreamSink;
import org.apache.flink.streaming.api.datastream.DataStreamSource;
import org.apache.flink.streaming.api.datastream.KeyedStream;
import org.apache.flink.streaming.api.datastream.SingleOutputStreamOperator;
+import org.apache.flink.streaming.api.datastream.SplitStream;
import org.apache.flink.streaming.api.functions.AssignerWithPeriodicWatermarks;
import org.apache.flink.streaming.api.operators.OneInputStreamOperator;
import org.apache.flink.streaming.api.operators.TwoInputStreamOperator;
@@ -554,6 +556,14 @@ public class FlinkStreamingTransformTranslators {
.transform(transform.getName(), outputUnionTypeInformation,
doFnOperator);
}
+ SplitStream splitStream = unionOutputStream
+ .split(new OutputSelector() {
+@Override
+public Iterable select(RawUnionValue value) {
+ return
Collections.singletonList(Integer.toString(value.getUnionTag()));
+}
+ });
+
for (Map.Entry<TupleTag, PCollection> output : outputs.entrySet())
{
final int outputTag = tagsToLabels.get(output.getKey());
@@ -561,17 +571,15 @@ public class FlinkStreamingTransformTranslators {
context.getTypeInfo(output.getValue());
@SuppressWarnings("unchecked")
-DataStream filtered =
-unionOutputStream.flatMap(new FlatMapFunction<RawUnionValue,
Object>() {
- @Override
- public void flatMap(RawUnionValue value, Collector out)
throws Exception {
-if (value.getUnionTag() == outputTag) {
- out.collect(value.getValue());
-}
- }
-}).returns(outputTypeInfo);
+DataStream unwrapped = splitStream.select(String.valueOf(outputTag))
+ .flatMap(new FlatMapFunction<RawUnionValue, Object>() {
+@Override
+public void flatMap(RawUnionValue value, Collector out)
throws Exception {
+ out.collect(value.getValue());
+}
+ }).returns(outputTypeInfo);
-context.setOutputDataStream(output.getValue(), filtered);
+context.setOutputDataStream(output.getValue(), unwrapped);
}
}
[jira] [Updated] (BEAM-1095) Add support set config for reuse-object on flink
[ https://issues.apache.org/jira/browse/BEAM-1095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated BEAM-1095: --- Assignee: Alexey Diomin > Add support set config for reuse-object on flink > > > Key: BEAM-1095 > URL: https://issues.apache.org/jira/browse/BEAM-1095 > Project: Beam > Issue Type: Improvement > Components: runner-flink >Affects Versions: 0.4.0-incubating >Reporter: Alexey Diomin >Assignee: Alexey Diomin >Priority: Trivial > Fix For: 0.4.0-incubating > > > Object-reuse is dangerous setting and disabled by default, > but sometime we need use this option to omit performance overhead for > serialization-deserialization objects on every transformations -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (BEAM-1095) Add support set config for reuse-object on flink
[ https://issues.apache.org/jira/browse/BEAM-1095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed BEAM-1095. -- Resolution: Fixed Fix Version/s: 0.4.0-incubating > Add support set config for reuse-object on flink > > > Key: BEAM-1095 > URL: https://issues.apache.org/jira/browse/BEAM-1095 > Project: Beam > Issue Type: Improvement > Components: runner-flink >Affects Versions: 0.4.0-incubating >Reporter: Alexey Diomin >Assignee: Alexey Diomin >Priority: Trivial > Fix For: 0.4.0-incubating > > > Object-reuse is dangerous setting and disabled by default, > but sometime we need use this option to omit performance overhead for > serialization-deserialization objects on every transformations -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[2/2] incubator-beam git commit: This closes #1518
This closes #1518 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/c53e0b16 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/c53e0b16 Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/c53e0b16 Branch: refs/heads/master Commit: c53e0b1623e3ee3c08c329e2716440f031681591 Parents: 3b2e029 1b12520 Author: Aljoscha Krettek <aljoscha.kret...@gmail.com> Authored: Thu Dec 8 09:44:07 2016 +0800 Committer: Aljoscha Krettek <aljoscha.kret...@gmail.com> Committed: Thu Dec 8 09:44:07 2016 +0800 -- .../flink/FlinkPipelineExecutionEnvironment.java| 12 .../apache/beam/runners/flink/FlinkPipelineOptions.java | 5 + 2 files changed, 17 insertions(+) --
[1/2] incubator-beam git commit: [BEAM-1095] Add support set config for reuse-object on flink
Repository: incubator-beam
Updated Branches:
refs/heads/master 3b2e0290d -> c53e0b162
[BEAM-1095] Add support set config for reuse-object on flink
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/1b125207
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/1b125207
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/1b125207
Branch: refs/heads/master
Commit: 1b1252074dd6b57f4fb88ceb82c704d3d3d8147f
Parents: 3b2e029
Author: Alexey Diomin <diomi...@gmail.com>
Authored: Wed Dec 7 09:39:27 2016 +0400
Committer: Aljoscha Krettek <aljoscha.kret...@gmail.com>
Committed: Thu Dec 8 09:44:00 2016 +0800
--
.../flink/FlinkPipelineExecutionEnvironment.java| 12
.../apache/beam/runners/flink/FlinkPipelineOptions.java | 5 +
2 files changed, 17 insertions(+)
--
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/1b125207/runners/flink/runner/src/main/java/org/apache/beam/runners/flink/FlinkPipelineExecutionEnvironment.java
--
diff --git
a/runners/flink/runner/src/main/java/org/apache/beam/runners/flink/FlinkPipelineExecutionEnvironment.java
b/runners/flink/runner/src/main/java/org/apache/beam/runners/flink/FlinkPipelineExecutionEnvironment.java
index 391c3f2..69dcd5e 100644
---
a/runners/flink/runner/src/main/java/org/apache/beam/runners/flink/FlinkPipelineExecutionEnvironment.java
+++
b/runners/flink/runner/src/main/java/org/apache/beam/runners/flink/FlinkPipelineExecutionEnvironment.java
@@ -159,6 +159,12 @@ public class FlinkPipelineExecutionEnvironment {
// set parallelism in the options (required by some execution code)
options.setParallelism(flinkBatchEnv.getParallelism());
+if (options.getObjectReuse()) {
+ flinkBatchEnv.getConfig().enableObjectReuse();
+} else {
+ flinkBatchEnv.getConfig().disableObjectReuse();
+}
+
return flinkBatchEnv;
}
@@ -197,6 +203,12 @@ public class FlinkPipelineExecutionEnvironment {
// set parallelism in the options (required by some execution code)
options.setParallelism(flinkStreamEnv.getParallelism());
+if (options.getObjectReuse()) {
+ flinkStreamEnv.getConfig().enableObjectReuse();
+} else {
+ flinkStreamEnv.getConfig().disableObjectReuse();
+}
+
// default to event time
flinkStreamEnv.setStreamTimeCharacteristic(TimeCharacteristic.EventTime);
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/1b125207/runners/flink/runner/src/main/java/org/apache/beam/runners/flink/FlinkPipelineOptions.java
--
diff --git
a/runners/flink/runner/src/main/java/org/apache/beam/runners/flink/FlinkPipelineOptions.java
b/runners/flink/runner/src/main/java/org/apache/beam/runners/flink/FlinkPipelineOptions.java
index be99f29..3bb358e 100644
---
a/runners/flink/runner/src/main/java/org/apache/beam/runners/flink/FlinkPipelineOptions.java
+++
b/runners/flink/runner/src/main/java/org/apache/beam/runners/flink/FlinkPipelineOptions.java
@@ -83,6 +83,11 @@ public interface FlinkPipelineOptions
Long getExecutionRetryDelay();
void setExecutionRetryDelay(Long delay);
+ @Description("Sets the behavior of reusing objects.")
+ @Default.Boolean(false)
+ Boolean getObjectReuse();
+ void setObjectReuse(Boolean reuse);
+
/**
* Sets a state backend to store Beam's state during computation.
* Note: Only applicable when executing in streaming mode.
[jira] [Commented] (BEAM-1107) Display user names for steps in the Flink Web UI
[ https://issues.apache.org/jira/browse/BEAM-1107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15730375#comment-15730375 ] Aljoscha Krettek commented on BEAM-1107: Yep, you're right but even in the black text the operation names (MapPartition, GroupCombine and so on) are hardcoded in Flink right now so we cannot change that coming from Beam-on-Flink. Changing that would require changes to Flink (which I'm not opposed to). > Display user names for steps in the Flink Web UI > > > Key: BEAM-1107 > URL: https://issues.apache.org/jira/browse/BEAM-1107 > Project: Beam > Issue Type: Improvement > Components: runner-flink >Reporter: Daniel Halperin >Assignee: Aljoscha Krettek > Attachments: screenshot-1.png > > > [copying in-person / email discussion at Strata Singapore to JIRA] > The FlinkBatchTransformTranslators use transform.getName() [1] -- this is the > "SDK name" for the transform. > The "user name" for the transform is not available here, it is in fact on the > TransformHierarchy.Node as node.getFullName() [2]. > getFullName() is used some in Flink, but not when setting step names. > I drafted a quick commit that sort of propagates the user names to the web UI > (but only for DataSource, and still too verbose: > https://github.com/dhalperi/incubator-beam/commit/a2f1fb06b22a85ec738e4f2a604c9a129891916c) > Before this change, the "ReadLines" step showed up as: "DataSource (at > Read(CompressedSource) > (org.apache.beam.runners.flink.translation.wrappers.SourceInputFormat))" > With this change, it shows up as "DataSource (at ReadLines/Read > (org.apache.beam.runners.flink.translation.wrappers.SourceInputFormat))" > which I think is closer. [I'd still like it to JUST be "ReadLines/Read" e.g.]. > Thoughts? > [1] > https://github.com/apache/incubator-beam/blob/master/runners/flink/runner/src/main/java/org/apache/beam/runners/flink/translation/FlinkBatchTransformTranslators.java#L129 > [2] > https://github.com/apache/incubator-beam/blob/master/sdks/java/core/src/main/java/org/apache/beam/sdk/runners/TransformHierarchy.java#L252 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (BEAM-1102) Flink Batch Runner does not populate aggregator values
[
https://issues.apache.org/jira/browse/BEAM-1102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aljoscha Krettek closed BEAM-1102.
--
Resolution: Fixed
Fix Version/s: 0.4.0-incubating
> Flink Batch Runner does not populate aggregator values
> --
>
> Key: BEAM-1102
> URL: https://issues.apache.org/jira/browse/BEAM-1102
> Project: Beam
> Issue Type: Bug
> Components: runner-flink
>Affects Versions: 0.3.0-incubating
>Reporter: Daniel Halperin
>Assignee: Aljoscha Krettek
>Priority: Minor
> Fix For: 0.4.0-incubating
>
>
> Running the quickstart gives 0 for emptyLines.
> Running with {{--streaming=true}} gives the correct value (for my input file,
> the default examples archetype {{pom.xml}}, the true value is 27 at the time
> of writing).
> Streaming output:
> {code}
> Dec 07, 2016 1:00:53 PM org.apache.beam.runners.flink.FlinkRunner run
> INFO: Final aggregator values:
> Dec 07, 2016 1:00:53 PM org.apache.beam.runners.flink.FlinkRunner run
> INFO: DroppedDueToLateness : 0
> Dec 07, 2016 1:00:53 PM org.apache.beam.runners.flink.FlinkRunner run
> INFO: emptyLines : 27
> Dec 07, 2016 1:00:53 PM org.apache.beam.runners.flink.FlinkRunner run
> INFO: DroppedDueToClosedWindow : 0
> {code}
> Non-streaming output:
> {code}
> Dec 07, 2016 12:58:07 PM org.apache.beam.runners.flink.FlinkRunner run
> INFO: Final aggregator values:
> Dec 07, 2016 12:58:07 PM org.apache.beam.runners.flink.FlinkRunner run
> INFO: emptyLines : 0
> {code}
> (Note also that the lateness etc. aggregators are missing entirely, may be
> expected).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[1/2] incubator-beam git commit: [FLINK-1102] Fix Aggregator Registration in Flink Batch Runner
Repository: incubator-beam
Updated Branches:
refs/heads/master 0a2ed832c -> b41a46e86
[FLINK-1102] Fix Aggregator Registration in Flink Batch Runner
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/869b2710
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/869b2710
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/869b2710
Branch: refs/heads/master
Commit: 869b2710efdb90bc3ce5b6e9d4f3b49a3a804a63
Parents: 0a2ed83
Author: Aljoscha Krettek <aljoscha.kret...@gmail.com>
Authored: Wed Dec 7 13:28:13 2016 +0800
Committer: Aljoscha Krettek <aljoscha.kret...@gmail.com>
Committed: Wed Dec 7 15:25:44 2016 +0800
--
.../functions/FlinkProcessContextBase.java | 21 +---
1 file changed, 9 insertions(+), 12 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/869b2710/runners/flink/runner/src/main/java/org/apache/beam/runners/flink/translation/functions/FlinkProcessContextBase.java
--
diff --git
a/runners/flink/runner/src/main/java/org/apache/beam/runners/flink/translation/functions/FlinkProcessContextBase.java
b/runners/flink/runner/src/main/java/org/apache/beam/runners/flink/translation/functions/FlinkProcessContextBase.java
index 42607dd..6afca38 100644
---
a/runners/flink/runner/src/main/java/org/apache/beam/runners/flink/translation/functions/FlinkProcessContextBase.java
+++
b/runners/flink/runner/src/main/java/org/apache/beam/runners/flink/translation/functions/FlinkProcessContextBase.java
@@ -20,7 +20,6 @@ package org.apache.beam.runners.flink.translation.functions;
import static com.google.common.base.Preconditions.checkNotNull;
import com.google.common.collect.Iterables;
-import java.io.Serializable;
import java.util.Collection;
import java.util.Collections;
import java.util.Iterator;
@@ -39,7 +38,6 @@ import org.apache.beam.sdk.util.WindowingStrategy;
import org.apache.beam.sdk.util.state.StateInternals;
import org.apache.beam.sdk.values.PCollectionView;
import org.apache.beam.sdk.values.TupleTag;
-import org.apache.flink.api.common.accumulators.Accumulator;
import org.apache.flink.api.common.functions.RuntimeContext;
import org.joda.time.Instant;
@@ -256,15 +254,14 @@ abstract class FlinkProcessContextBase<InputT, OutputT>
@Override
protected <AggInputT, AggOutputT> Aggregator<AggInputT, AggOutputT>
createAggregatorInternal(String name, Combine.CombineFn<AggInputT, ?,
AggOutputT> combiner) {
-SerializableFnAggregatorWrapper<AggInputT, AggOutputT> wrapper =
-new SerializableFnAggregatorWrapper<>(combiner);
-Accumulator existingAccum =
-(Accumulator<AggInputT, Serializable>)
runtimeContext.getAccumulator(name);
-if (existingAccum != null) {
- return wrapper;
-} else {
- runtimeContext.addAccumulator(name, wrapper);
+@SuppressWarnings("unchecked")
+SerializableFnAggregatorWrapper<AggInputT, AggOutputT> result =
+(SerializableFnAggregatorWrapper<AggInputT, AggOutputT>)
+runtimeContext.getAccumulator(name);
+
+if (result == null) {
+ result = new SerializableFnAggregatorWrapper<>(combiner);
+ runtimeContext.addAccumulator(name, result);
}
-return wrapper;
- }
+return result; }
}
[2/2] incubator-beam git commit: This closes #1530
This closes #1530 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/b41a46e8 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/b41a46e8 Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/b41a46e8 Branch: refs/heads/master Commit: b41a46e86fd38c4a887f31bdf6cb75969f4750d3 Parents: 0a2ed83 869b271 Author: Aljoscha Krettek <aljoscha.kret...@gmail.com> Authored: Wed Dec 7 15:26:02 2016 +0800 Committer: Aljoscha Krettek <aljoscha.kret...@gmail.com> Committed: Wed Dec 7 15:26:02 2016 +0800 -- .../functions/FlinkProcessContextBase.java | 21 +--- 1 file changed, 9 insertions(+), 12 deletions(-) --
[jira] [Created] (BEAM-1103) Add Tests For Aggregators in Flink Runner
Aljoscha Krettek created BEAM-1103: -- Summary: Add Tests For Aggregators in Flink Runner Key: BEAM-1103 URL: https://issues.apache.org/jira/browse/BEAM-1103 Project: Beam Issue Type: Improvement Components: runner-flink Reporter: Aljoscha Krettek We currently don't have tests that verify that aggregator values are correctly forwarded to Flink. They didn't work correctly in the Batch Flink runner, as seen in BEAM-1102. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[GitHub] incubator-beam pull request #1530: [FLINK-1102] Fix Aggregator Registration ...
GitHub user aljoscha opened a pull request: https://github.com/apache/incubator-beam/pull/1530 [FLINK-1102] Fix Aggregator Registration in Flink Batch Runner R: @dhalperi This is a quick fix now but we definitely need tests for aggregators, both in streaming and batch mode. Should we merge this now and create a new Issue for adding tests or block this until we have the tests? You can merge this pull request into a Git repository by running: $ git pull https://github.com/aljoscha/incubator-beam flink-fix-batch-aggregators Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/1530.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1530 commit 3792bf1140512f58f61527712b21c74a96cfdc7a Author: Aljoscha Krettek <aljoscha.kret...@gmail.com> Date: 2016-12-07T05:28:13Z [FLINK-1102] Fix Aggregator Registration in Flink Batch Runner --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Commented] (BEAM-1102) Flink Batch Runner does not populate aggregator values
[
https://issues.apache.org/jira/browse/BEAM-1102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15727742#comment-15727742
]
Aljoscha Krettek commented on BEAM-1102:
The problem is this part in {{FlinkProcessContextBase}}:
{code}
@Override
protected <AggInputT, AggOutputT> Aggregator<AggInputT, AggOutputT>
createAggregatorInternal(String name, Combine.CombineFn<AggInputT, ?,
AggOutputT> combiner) {
SerializableFnAggregatorWrapper<AggInputT, AggOutputT> wrapper =
new SerializableFnAggregatorWrapper<>(combiner);
Accumulator existingAccum =
(Accumulator<AggInputT, Serializable>)
runtimeContext.getAccumulator(name);
if (existingAccum != null) {
return wrapper;
} else {
runtimeContext.addAccumulator(name, wrapper);
}
return wrapper;
}
{code}
Notice how the newly created wrapper is returned if the accumulator already
exists.
> Flink Batch Runner does not populate aggregator values
> --
>
> Key: BEAM-1102
> URL: https://issues.apache.org/jira/browse/BEAM-1102
> Project: Beam
> Issue Type: Bug
> Components: runner-flink
>Affects Versions: 0.3.0-incubating
> Reporter: Daniel Halperin
>Assignee: Aljoscha Krettek
>Priority: Minor
>
> Running the quickstart gives 0 for emptyLines.
> Running with {{--streaming=true}} gives the correct value (for my input file,
> the default examples archetype {{pom.xml}}, the true value is 27 at the time
> of writing).
> Streaming output:
> {code}
> Dec 07, 2016 1:00:53 PM org.apache.beam.runners.flink.FlinkRunner run
> INFO: Final aggregator values:
> Dec 07, 2016 1:00:53 PM org.apache.beam.runners.flink.FlinkRunner run
> INFO: DroppedDueToLateness : 0
> Dec 07, 2016 1:00:53 PM org.apache.beam.runners.flink.FlinkRunner run
> INFO: emptyLines : 27
> Dec 07, 2016 1:00:53 PM org.apache.beam.runners.flink.FlinkRunner run
> INFO: DroppedDueToClosedWindow : 0
> {code}
> Non-streaming output:
> {code}
> Dec 07, 2016 12:58:07 PM org.apache.beam.runners.flink.FlinkRunner run
> INFO: Final aggregator values:
> Dec 07, 2016 12:58:07 PM org.apache.beam.runners.flink.FlinkRunner run
> INFO: emptyLines : 0
> {code}
> (Note also that the lateness etc. aggregators are missing entirely, may be
> expected).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Issue Comment Deleted] (BEAM-1092) Shade commonly used libraries (e.g. Guava) to avoid class conflicts
[ https://issues.apache.org/jira/browse/BEAM-1092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated BEAM-1092: --- Comment: was deleted (was: Is 1) necessary if we do 2). I think shading is very necessary (unfortunately) so I like this issue but I would also like to keep the example/archetype POMs as simple as possible.) > Shade commonly used libraries (e.g. Guava) to avoid class conflicts > --- > > Key: BEAM-1092 > URL: https://issues.apache.org/jira/browse/BEAM-1092 > Project: Beam > Issue Type: Bug > Components: examples-java, sdk-java-extensions >Affects Versions: 0.3.0-incubating >Reporter: Maximilian Michels >Assignee: Frances Perry > Fix For: 0.4.0-incubating > > > Beam shades away some of its dependencies like Guava to avoid user classes > from clashing with these dependencies. Some of the artifacts, e.g. KafkaIO, > do not shade any classes and directly depend on potentially conflicting > libraries (e.g. Guava). Also, users might manually add such libraries as > dependencies. > Runners who add classes to the classpath (e.g. Hadoop) can run into conflict > with multiple versions of the same class. To prevent that, we should adjust > the Maven archetypes pom files used for the Quickstart to perform shading of > commonly used libraries (again, Guava is often the culprit). > To prevent the problem in the first place, we should expand the shading of > Guava and other libraries to all modules which make use of these. > To solve both dimensions of the issue, we need to address: > 1. Adding shading of commonly used libraries to the archetypes poms > 2. Properly shade all commonly used libraries in the SDK modules > 2) seems to be of highest priority since it affects users who simply use the > provided IO modules. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (BEAM-1092) Shade commonly used libraries (e.g. Guava) to avoid class conflicts
[ https://issues.apache.org/jira/browse/BEAM-1092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15727530#comment-15727530 ] Aljoscha Krettek commented on BEAM-1092: Is 1) necessary if we do 2)? I think shading is very necessary (unfortunately) so I like this issue but I would also like to keep the example/archetype POMs as simple as possible. > Shade commonly used libraries (e.g. Guava) to avoid class conflicts > --- > > Key: BEAM-1092 > URL: https://issues.apache.org/jira/browse/BEAM-1092 > Project: Beam > Issue Type: Bug > Components: examples-java, sdk-java-extensions >Affects Versions: 0.3.0-incubating >Reporter: Maximilian Michels >Assignee: Frances Perry > Fix For: 0.4.0-incubating > > > Beam shades away some of its dependencies like Guava to avoid user classes > from clashing with these dependencies. Some of the artifacts, e.g. KafkaIO, > do not shade any classes and directly depend on potentially conflicting > libraries (e.g. Guava). Also, users might manually add such libraries as > dependencies. > Runners who add classes to the classpath (e.g. Hadoop) can run into conflict > with multiple versions of the same class. To prevent that, we should adjust > the Maven archetypes pom files used for the Quickstart to perform shading of > commonly used libraries (again, Guava is often the culprit). > To prevent the problem in the first place, we should expand the shading of > Guava and other libraries to all modules which make use of these. > To solve both dimensions of the issue, we need to address: > 1. Adding shading of commonly used libraries to the archetypes poms > 2. Properly shade all commonly used libraries in the SDK modules > 2) seems to be of highest priority since it affects users who simply use the > provided IO modules. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (BEAM-1092) Shade commonly used libraries (e.g. Guava) to avoid class conflicts
[ https://issues.apache.org/jira/browse/BEAM-1092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15727529#comment-15727529 ] Aljoscha Krettek commented on BEAM-1092: Is 1) necessary if we do 2). I think shading is very necessary (unfortunately) so I like this issue but I would also like to keep the example/archetype POMs as simple as possible. > Shade commonly used libraries (e.g. Guava) to avoid class conflicts > --- > > Key: BEAM-1092 > URL: https://issues.apache.org/jira/browse/BEAM-1092 > Project: Beam > Issue Type: Bug > Components: examples-java, sdk-java-extensions >Affects Versions: 0.3.0-incubating >Reporter: Maximilian Michels >Assignee: Frances Perry > Fix For: 0.4.0-incubating > > > Beam shades away some of its dependencies like Guava to avoid user classes > from clashing with these dependencies. Some of the artifacts, e.g. KafkaIO, > do not shade any classes and directly depend on potentially conflicting > libraries (e.g. Guava). Also, users might manually add such libraries as > dependencies. > Runners who add classes to the classpath (e.g. Hadoop) can run into conflict > with multiple versions of the same class. To prevent that, we should adjust > the Maven archetypes pom files used for the Quickstart to perform shading of > commonly used libraries (again, Guava is often the culprit). > To prevent the problem in the first place, we should expand the shading of > Guava and other libraries to all modules which make use of these. > To solve both dimensions of the issue, we need to address: > 1. Adding shading of commonly used libraries to the archetypes poms > 2. Properly shade all commonly used libraries in the SDK modules > 2) seems to be of highest priority since it affects users who simply use the > provided IO modules. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (BEAM-506) Fill in the documentation/runners/flink portion of the website
[ https://issues.apache.org/jira/browse/BEAM-506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed BEAM-506. - Resolution: Fixed Fix Version/s: Not applicable > Fill in the documentation/runners/flink portion of the website > -- > > Key: BEAM-506 > URL: https://issues.apache.org/jira/browse/BEAM-506 > Project: Beam > Issue Type: Bug > Components: website >Reporter: Frances Perry >Assignee: Aljoscha Krettek > Fix For: Not applicable > > > As per > https://docs.google.com/document/d/1-0jMv7NnYp0Ttt4voulUMwVe_qjBYeNMLm2LusYF3gQ/edit. > Should be a landing page for Flink-specific details -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[GitHub] incubator-beam-site pull request #99: Simplify Flink Runner instructions for...
GitHub user aljoscha opened a pull request: https://github.com/apache/incubator-beam-site/pull/99 Simplify Flink Runner instructions for running on cluster R: @davorbonaci I think this should be simple/straighforward enough now ð You can merge this pull request into a Git repository by running: $ git pull https://github.com/aljoscha/incubator-beam-site simplify-flink-quickstart Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam-site/pull/99.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #99 commit 997e045b7e0feee0f3623a8e6c2cc690347a77ef Author: Aljoscha Krettek <aljoscha.kret...@gmail.com> Date: 2016-12-01T20:51:54Z Simplify Flink Runner instructions for running on cluster --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam-site pull request #97: [BEAM-506] Fill in the documentation/r...
GitHub user aljoscha opened a pull request: https://github.com/apache/incubator-beam-site/pull/97 [BEAM-506] Fill in the documentation/runners/flink portion of the website The outline of this is based on the doc for the Cloud Dataflow runner. R: @davorbonaci and @mxm You can merge this pull request into a Git repository by running: $ git pull https://github.com/aljoscha/incubator-beam-site flink-runner-doc Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam-site/pull/97.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #97 commit 438c976ad0208bb60e4a29fb6c07659902cc3823 Author: Aljoscha Krettek <aljoscha.kret...@gmail.com> Date: 2016-11-29T15:23:03Z [BEAM-506] Fill in the documentation/runners/flink portion of the website --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Assigned] (BEAM-506) Fill in the documentation/runners/flink portion of the website
[ https://issues.apache.org/jira/browse/BEAM-506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reassigned BEAM-506: - Assignee: Aljoscha Krettek (was: James Malone) > Fill in the documentation/runners/flink portion of the website > -- > > Key: BEAM-506 > URL: https://issues.apache.org/jira/browse/BEAM-506 > Project: Beam > Issue Type: Bug > Components: website >Reporter: Frances Perry >Assignee: Aljoscha Krettek > > As per > https://docs.google.com/document/d/1-0jMv7NnYp0Ttt4voulUMwVe_qjBYeNMLm2LusYF3gQ/edit. > Should be a landing page for Flink-specific details -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[GitHub] incubator-beam pull request #1446: Ignore UsesStatefulParDo Tests in Flink S...
GitHub user aljoscha opened a pull request: https://github.com/apache/incubator-beam/pull/1446 Ignore UsesStatefulParDo Tests in Flink Streaming Runner Until we fix BEAM-1036 we need to ignore those tests. Before, only the tests for the batch runner ignored them. You can merge this pull request into a Git repository by running: $ git pull https://github.com/aljoscha/incubator-beam flink-ignore-state-tests Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/1446.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1446 commit fff577610d929e713d42bfb2a4e8428727ee7206 Author: Aljoscha Krettek <aljoscha.kret...@gmail.com> Date: 2016-11-28T22:33:17Z Ignore UsesStatefulParDo Tests in Flink Streaming Runner --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[1/2] incubator-beam git commit: Replace WindowAssignment OldDoFn by FlatMap in Flink Runner
Repository: incubator-beam
Updated Branches:
refs/heads/master 3e4b2fd0d -> 8d1214a3b
Replace WindowAssignment OldDoFn by FlatMap in Flink Runner
The streaming runner had an OldDoFn that was used for assigning windows
using a WindowFn. This is now done with a FlatMap.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/4a097729
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/4a097729
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/4a097729
Branch: refs/heads/master
Commit: 4a097729ac9fc65283f4f11f85812188589c8df3
Parents: 3e4b2fd
Author: Aljoscha Krettek <aljoscha.kret...@gmail.com>
Authored: Tue Nov 8 11:03:21 2016 +0100
Committer: Aljoscha Krettek <aljoscha.kret...@gmail.com>
Committed: Thu Nov 24 11:39:30 2016 +0100
--
.../FlinkStreamingTransformTranslators.java | 63 +++-
1 file changed, 9 insertions(+), 54 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/4a097729/runners/flink/runner/src/main/java/org/apache/beam/runners/flink/translation/FlinkStreamingTransformTranslators.java
--
diff --git
a/runners/flink/runner/src/main/java/org/apache/beam/runners/flink/translation/FlinkStreamingTransformTranslators.java
b/runners/flink/runner/src/main/java/org/apache/beam/runners/flink/translation/FlinkStreamingTransformTranslators.java
index 40dfbb9..47935eb 100644
---
a/runners/flink/runner/src/main/java/org/apache/beam/runners/flink/translation/FlinkStreamingTransformTranslators.java
+++
b/runners/flink/runner/src/main/java/org/apache/beam/runners/flink/translation/FlinkStreamingTransformTranslators.java
@@ -18,7 +18,6 @@
package org.apache.beam.runners.flink.translation;
-import com.google.common.collect.Iterables;
import com.google.common.collect.Lists;
import com.google.common.collect.Maps;
import java.nio.ByteBuffer;
@@ -31,6 +30,7 @@ import java.util.Map;
import java.util.Set;
import org.apache.beam.runners.core.SystemReduceFn;
import org.apache.beam.runners.flink.FlinkRunner;
+import org.apache.beam.runners.flink.translation.functions.FlinkAssignWindows;
import org.apache.beam.runners.flink.translation.types.CoderTypeInformation;
import org.apache.beam.runners.flink.translation.types.FlinkCoder;
import
org.apache.beam.runners.flink.translation.wrappers.streaming.DoFnOperator;
@@ -53,7 +53,6 @@ import org.apache.beam.sdk.transforms.Combine;
import org.apache.beam.sdk.transforms.DoFn;
import org.apache.beam.sdk.transforms.Flatten;
import org.apache.beam.sdk.transforms.GroupByKey;
-import org.apache.beam.sdk.transforms.OldDoFn;
import org.apache.beam.sdk.transforms.PTransform;
import org.apache.beam.sdk.transforms.ParDo;
import org.apache.beam.sdk.transforms.join.RawUnionValue;
@@ -637,64 +636,20 @@ public class FlinkStreamingTransformTranslators {
TypeInformation<WindowedValue> typeInfo =
context.getTypeInfo(context.getOutput(transform));
- OldDoFn<T, T> windowAssignerDoFn =
- createWindowAssigner(windowingStrategy.getWindowFn());
-
- @SuppressWarnings("unchecked")
- PCollection inputPCollection = context.getInput(transform);
-
- TypeInformation<WindowedValue> inputTypeInfo =
- context.getTypeInfo(inputPCollection);
-
- DoFnOperator<T, T, WindowedValue> doFnOperator = new DoFnOperator<>(
- windowAssignerDoFn,
- inputTypeInfo,
- new TupleTag("main output"),
- Collections.<TupleTag>emptyList(),
- new DoFnOperator.DefaultOutputManagerFactory<WindowedValue>(),
- windowingStrategy,
- new HashMap<Integer, PCollectionView>(), /* side-input mapping */
- Collections.<PCollectionView>emptyList(), /* side inputs */
- context.getPipelineOptions());
-
DataStream<WindowedValue> inputDataStream =
context.getInputDataStream(context.getInput(transform));
- SingleOutputStreamOperator<WindowedValue> outDataStream =
inputDataStream
- .transform(transform.getName(), typeInfo, doFnOperator);
-
- context.setOutputDataStream(context.getOutput(transform), outDataStream);
-}
+ WindowFn<T, ? extends BoundedWindow> windowFn =
windowingStrategy.getWindowFn();
-private static <T, W extends BoundedWindow> OldDoFn<T, T>
createWindowAssigner(
-final WindowFn<T, W> windowFn) {
+ FlinkAssignWindows<T, ? extends BoundedWindow> assignWindowsFunction =
+ new FlinkAssignWindows<>(windowFn);
- return new OldDoFn<T, T>() {
+ SingleOutputStreamOperator<W
[2/2] incubator-beam git commit: This closes #1435
This closes #1435 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/8d1214a3 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/8d1214a3 Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/8d1214a3 Branch: refs/heads/master Commit: 8d1214a3ba94b21102b74d346e73f24ecd9056f2 Parents: 3e4b2fd 4a09772 Author: Aljoscha Krettek <aljoscha.kret...@gmail.com> Authored: Thu Nov 24 15:20:49 2016 +0100 Committer: Aljoscha Krettek <aljoscha.kret...@gmail.com> Committed: Thu Nov 24 15:20:49 2016 +0100 -- .../FlinkStreamingTransformTranslators.java | 63 +++- 1 file changed, 9 insertions(+), 54 deletions(-) --
[GitHub] incubator-beam pull request #1435: Replace WindowAssignment OldDoFn by FlatM...
GitHub user aljoscha opened a pull request: https://github.com/apache/incubator-beam/pull/1435 Replace WindowAssignment OldDoFn by FlatMap in FLink Runner The streaming runner had an OldDoFn that was used for assigning windows using a WindowFn. This is now done with a FlatMap. R: @mxm for review please CC: @kennknowles I thought you might enjoy seeing `OldDoFns` removed. ð This is the first step towards getting rid of `OldDoFn` in the Flink runner. The next steps are: - https://issues.apache.org/jira/browse/BEAM-956: Execute ReduceFnRunner Directly in Flink Runner - https://issues.apache.org/jira/browse/BEAM-843: Use New DoFn Directly in Flink Runner You can merge this pull request into a Git repository by running: $ git pull https://github.com/aljoscha/incubator-beam flink-remove-olddofn Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/1435.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1435 commit da32dcd06dddc8f4e288e8778fd8ac4a572d72ab Author: Aljoscha Krettek <aljoscha.kret...@gmail.com> Date: 2016-11-08T10:03:21Z Replace WindowAssignment OldDoFn by FlatMap in FLink Runner The streaming runner had an OldDoFn that was used for assigning windows using a WindowFn. This is now done with a FlatMap. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Closed] (BEAM-1007) Runner Toggles in Quickstart.md Don't Work in Safari
[ https://issues.apache.org/jira/browse/BEAM-1007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed BEAM-1007. -- Resolution: Fixed Fix Version/s: Not applicable > Runner Toggles in Quickstart.md Don't Work in Safari > - > > Key: BEAM-1007 > URL: https://issues.apache.org/jira/browse/BEAM-1007 > Project: Beam > Issue Type: Bug > Components: website > Reporter: Aljoscha Krettek >Assignee: Abdullah Bashir >Priority: Minor > Fix For: Not applicable > > Attachments: Screen Shot 2016-11-19 at 00.00.45.png > > > I'm observing this with macOS Sierra 10.12.1 and Safari 10.0.1 > (12602.2.14.0.7). -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[1/3] incubator-beam-site git commit: [BEAM-1007] Fixed toggles code, to work in safari
Repository: incubator-beam-site
Updated Branches:
refs/heads/asf-site f5a084799 -> 0c4bff77b
[BEAM-1007] Fixed toggles code, to work in safari
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/repo
Commit:
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/commit/b3cc5a23
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/tree/b3cc5a23
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/diff/b3cc5a23
Branch: refs/heads/asf-site
Commit: b3cc5a2373b1471ab44efe1a06fcc8a08e3e
Parents: f5a0847
Author: Abdullah Bashir <mabdullah...@gmail.com>
Authored: Wed Nov 2 09:04:41 2016 +0500
Committer: Aljoscha Krettek <aljoscha.kret...@gmail.com>
Committed: Mon Nov 21 10:32:01 2016 +0100
--
src/js/language-switch.js | 5 ++---
1 file changed, 2 insertions(+), 3 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/b3cc5a23/src/js/language-switch.js
--
diff --git a/src/js/language-switch.js b/src/js/language-switch.js
index 2c634fe..653cbcb 100644
--- a/src/js/language-switch.js
+++ b/src/js/language-switch.js
@@ -79,7 +79,6 @@ $(document).ready(function() {
},
"toggle": function() {
var pref=localStorage.getItem(this.dbKey) || this.default;
-
// Adjusting active elements in navigation header.
$("." + this.wrapper + "
li").removeClass("active").each(function() {
if ($(this).data("type") === pref) {
@@ -88,7 +87,7 @@ $(document).ready(function() {
});
// Swapping visibility of code blocks.
-$("[class^=" + prefix).hide();
+$(this.selector).hide();
$("." + pref).show();
},
"render": function(wrapper) {
@@ -101,4 +100,4 @@ $(document).ready(function() {
Switcher({"class-prefix":"language","default":"java"}).render();
Switcher({"class-prefix":"runner","default":"direct"}).render();
-});
\ No newline at end of file
+});
[3/3] incubator-beam-site git commit: This closes #90
This closes #90 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/commit/0c4bff77 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/tree/0c4bff77 Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/diff/0c4bff77 Branch: refs/heads/asf-site Commit: 0c4bff77b31b4fc2809a4dbaf3ac8193f08187fd Parents: f5a0847 3f72e67 Author: Aljoscha Krettek <aljoscha.kret...@gmail.com> Authored: Mon Nov 21 10:35:27 2016 +0100 Committer: Aljoscha Krettek <aljoscha.kret...@gmail.com> Committed: Mon Nov 21 10:35:27 2016 +0100 -- content/js/language-switch.js | 5 ++--- src/js/language-switch.js | 5 ++--- 2 files changed, 4 insertions(+), 6 deletions(-) --
[2/3] incubator-beam-site git commit: Regenerate Website
Regenerate Website
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/repo
Commit:
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/commit/3f72e67a
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/tree/3f72e67a
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/diff/3f72e67a
Branch: refs/heads/asf-site
Commit: 3f72e67ac42e1fd094472c42bebe03520c8c98e4
Parents: b3cc5a2
Author: Aljoscha Krettek <aljoscha.kret...@gmail.com>
Authored: Mon Nov 21 10:35:15 2016 +0100
Committer: Aljoscha Krettek <aljoscha.kret...@gmail.com>
Committed: Mon Nov 21 10:35:15 2016 +0100
--
content/js/language-switch.js | 5 ++---
1 file changed, 2 insertions(+), 3 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/3f72e67a/content/js/language-switch.js
--
diff --git a/content/js/language-switch.js b/content/js/language-switch.js
index 2c634fe..653cbcb 100644
--- a/content/js/language-switch.js
+++ b/content/js/language-switch.js
@@ -79,7 +79,6 @@ $(document).ready(function() {
},
"toggle": function() {
var pref=localStorage.getItem(this.dbKey) || this.default;
-
// Adjusting active elements in navigation header.
$("." + this.wrapper + "
li").removeClass("active").each(function() {
if ($(this).data("type") === pref) {
@@ -88,7 +87,7 @@ $(document).ready(function() {
});
// Swapping visibility of code blocks.
-$("[class^=" + prefix).hide();
+$(this.selector).hide();
$("." + pref).show();
},
"render": function(wrapper) {
@@ -101,4 +100,4 @@ $(document).ready(function() {
Switcher({"class-prefix":"language","default":"java"}).render();
Switcher({"class-prefix":"runner","default":"direct"}).render();
-});
\ No newline at end of file
+});
[jira] [Updated] (BEAM-1007) Runner Toggles in Quickstart.md Don't Work in Safari
[ https://issues.apache.org/jira/browse/BEAM-1007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated BEAM-1007: --- Attachment: Screen Shot 2016-11-19 at 00.00.45.png > Runner Toggles in Quickstart.md Don't Work in Safari > - > > Key: BEAM-1007 > URL: https://issues.apache.org/jira/browse/BEAM-1007 > Project: Beam > Issue Type: Bug > Components: website > Reporter: Aljoscha Krettek >Assignee: Abdullah Bashir >Priority: Minor > Attachments: Screen Shot 2016-11-19 at 00.00.45.png > > > I'm observing this with macOS Sierra 10.12.1 and Safari 10.0.1 > (12602.2.14.0.7). -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (BEAM-1007) Runner Toggles in Quickstart.md Don't Work in Safari
[ https://issues.apache.org/jira/browse/BEAM-1007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15678046#comment-15678046 ] Aljoscha Krettek commented on BEAM-1007: [~mabdullah353], I assigned to you because you initially implemented this and I have no idea of what might be going on there. Hope that's alright. > Runner Toggles in Quickstart.md Don't Work in Safari > - > > Key: BEAM-1007 > URL: https://issues.apache.org/jira/browse/BEAM-1007 > Project: Beam > Issue Type: Bug > Components: website > Reporter: Aljoscha Krettek >Assignee: Abdullah Bashir >Priority: Minor > Attachments: Screen Shot 2016-11-19 at 00.00.45.png > > > I'm observing this with macOS Sierra 10.12.1 and Safari 10.0.1 > (12602.2.14.0.7). -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (BEAM-1007) Runner Toggles in Quickstart.md Don't Work in Safari
Aljoscha Krettek created BEAM-1007: -- Summary: Runner Toggles in Quickstart.md Don't Work in Safari Key: BEAM-1007 URL: https://issues.apache.org/jira/browse/BEAM-1007 Project: Beam Issue Type: Bug Components: website Reporter: Aljoscha Krettek Assignee: Abdullah Bashir Priority: Minor I'm observing this with macOS Sierra 10.12.1 and Safari 10.0.1 (12602.2.14.0.7). -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (BEAM-899) Flink quickstart instructions
[ https://issues.apache.org/jira/browse/BEAM-899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed BEAM-899. - Resolution: Fixed Fix Version/s: 0.4.0-incubating > Flink quickstart instructions > - > > Key: BEAM-899 > URL: https://issues.apache.org/jira/browse/BEAM-899 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Frances Perry >Assignee: Aljoscha Krettek > Fix For: 0.4.0-incubating > > > After initial quickstart structure is pushed, add commandlines for Flink > execution to quickstart.md and detailed Flink setup instructions to > learn/runners/flink.md -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (BEAM-965) Source Transformations Don't Set Correct Output Type in Flink Streaming Runner
[ https://issues.apache.org/jira/browse/BEAM-965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed BEAM-965. - Resolution: Fixed > Source Transformations Don't Set Correct Output Type in Flink Streaming Runner > -- > > Key: BEAM-965 > URL: https://issues.apache.org/jira/browse/BEAM-965 > Project: Beam > Issue Type: Bug > Components: runner-flink > Reporter: Aljoscha Krettek >Assignee: Aljoscha Krettek > Fix For: 0.4.0-incubating > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[1/2] incubator-beam git commit: [BEAM-965] Set Correct Output Type on Sources in Flink Stream Runner
Repository: incubator-beam
Updated Branches:
refs/heads/master 8bfa08519 -> ee55f6e39
[BEAM-965] Set Correct Output Type on Sources in Flink Stream Runner
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/a61832a8
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/a61832a8
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/a61832a8
Branch: refs/heads/master
Commit: a61832a83c15e0aa5e3cc1985fc32aa1afb348e6
Parents: 8bfa085
Author: Aljoscha Krettek <aljoscha.kret...@gmail.com>
Authored: Fri Nov 11 23:58:16 2016 +0100
Committer: Aljoscha Krettek <aljoscha.kret...@gmail.com>
Committed: Mon Nov 14 22:07:45 2016 +0100
--
.../FlinkStreamingTransformTranslators.java| 13 ++---
1 file changed, 10 insertions(+), 3 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/a61832a8/runners/flink/runner/src/main/java/org/apache/beam/runners/flink/translation/FlinkStreamingTransformTranslators.java
--
diff --git
a/runners/flink/runner/src/main/java/org/apache/beam/runners/flink/translation/FlinkStreamingTransformTranslators.java
b/runners/flink/runner/src/main/java/org/apache/beam/runners/flink/translation/FlinkStreamingTransformTranslators.java
index a3e8a49..687e9c8 100644
---
a/runners/flink/runner/src/main/java/org/apache/beam/runners/flink/translation/FlinkStreamingTransformTranslators.java
+++
b/runners/flink/runner/src/main/java/org/apache/beam/runners/flink/translation/FlinkStreamingTransformTranslators.java
@@ -219,6 +219,9 @@ public class FlinkStreamingTransformTranslators {
FlinkStreamingTranslationContext context) {
PCollection output = context.getOutput(transform);
+ TypeInformation<WindowedValue> outputTypeInfo =
+ context.getTypeInfo(context.getOutput(transform));
+
DataStream<WindowedValue> source;
if (transform.getSource().getClass().equals(UnboundedFlinkSource.class))
{
@SuppressWarnings("unchecked")
@@ -246,7 +249,7 @@ public class FlinkStreamingTransformTranslators {
new Instant(flinkAssigner.extractTimestamp(s, -1)),
GlobalWindow.INSTANCE,
PaneInfo.NO_FIRING));
- }});
+ }}).returns(outputTypeInfo);
} else {
try {
UnboundedSourceWrapper<T, ?> sourceWrapper =
@@ -256,7 +259,7 @@ public class FlinkStreamingTransformTranslators {
context.getExecutionEnvironment().getParallelism());
source = context
.getExecutionEnvironment()
- .addSource(sourceWrapper).name(transform.getName());
+
.addSource(sourceWrapper).name(transform.getName()).returns(outputTypeInfo);
} catch (Exception e) {
throw new RuntimeException(
"Error while translating UnboundedSource: " +
transform.getSource(), e);
@@ -276,6 +279,10 @@ public class FlinkStreamingTransformTranslators {
FlinkStreamingTranslationContext context) {
PCollection output = context.getOutput(transform);
+ TypeInformation<WindowedValue> outputTypeInfo =
+ context.getTypeInfo(context.getOutput(transform));
+
+
DataStream<WindowedValue> source;
try {
BoundedSourceWrapper sourceWrapper =
@@ -285,7 +292,7 @@ public class FlinkStreamingTransformTranslators {
context.getExecutionEnvironment().getParallelism());
source = context
.getExecutionEnvironment()
-.addSource(sourceWrapper).name(transform.getName());
+
.addSource(sourceWrapper).name(transform.getName()).returns(outputTypeInfo);
} catch (Exception e) {
throw new RuntimeException(
"Error while translating BoundedSource: " + transform.getSource(),
e);
[2/2] incubator-beam git commit: This closes #1352
This closes #1352 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/ee55f6e3 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/ee55f6e3 Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/ee55f6e3 Branch: refs/heads/master Commit: ee55f6e39ff429cd406835c789ce89c4b01fb4c4 Parents: 8bfa085 a61832a Author: Aljoscha Krettek <aljoscha.kret...@gmail.com> Authored: Mon Nov 14 22:07:53 2016 +0100 Committer: Aljoscha Krettek <aljoscha.kret...@gmail.com> Committed: Mon Nov 14 22:07:53 2016 +0100 -- .../FlinkStreamingTransformTranslators.java| 13 ++--- 1 file changed, 10 insertions(+), 3 deletions(-) --
[GitHub] incubator-beam-site pull request #79: [BEAM-899] Add Flink Instructions to q...
GitHub user aljoscha opened a pull request: https://github.com/apache/incubator-beam-site/pull/79 [BEAM-899] Add Flink Instructions to quickstart.md I added a section about runner specific dependencies in the Quickstart. R: @francesperry You can merge this pull request into a Git repository by running: $ git pull https://github.com/aljoscha/incubator-beam-site flink-quickstart Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam-site/pull/79.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #79 commit d2b3e4810a3ba85c96e15bf82cccd907b86a54be Author: Aljoscha Krettek <aljoscha.kret...@gmail.com> Date: 2016-11-12T10:36:49Z [BEAM-899] Add Flink Instructions to quickstart.md commit a31273ca886b1fb4ff3a3728c9ede30dbf1dc16c Author: Aljoscha Krettek <aljoscha.kret...@gmail.com> Date: 2016-11-12T10:40:42Z Rebuild website --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Commented] (BEAM-899) Flink quickstart instructions
[ https://issues.apache.org/jira/browse/BEAM-899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15659390#comment-15659390 ] Aljoscha Krettek commented on BEAM-899: --- Sorry for the delay, I'm working on this myself now. > Flink quickstart instructions > - > > Key: BEAM-899 > URL: https://issues.apache.org/jira/browse/BEAM-899 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Frances Perry >Assignee: Aljoscha Krettek > > After initial quickstart structure is pushed, add commandlines for Flink > execution to quickstart.md and detailed Flink setup instructions to > learn/runners/flink.md -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[GitHub] incubator-beam pull request #1352: [BEAM-965] Set Correct Output Type on Sou...
GitHub user aljoscha opened a pull request: https://github.com/apache/incubator-beam/pull/1352 [BEAM-965] Set Correct Output Type on Sources in Flink Stream Runner R: @mxm You can merge this pull request into a Git repository by running: $ git pull https://github.com/aljoscha/incubator-beam flink-fix-sources Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/1352.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1352 commit 40825e125be15c1c4c77b66b36c62cec24c6ddd8 Author: Aljoscha Krettek <aljoscha.kret...@gmail.com> Date: 2016-11-11T22:58:16Z [BEAM-965] Set Correct Output Type on Sources in Flink Stream Runner --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Created] (BEAM-965) Source Operations Don't Set Correct Output Type in Flink Streaming Runner
Aljoscha Krettek created BEAM-965: - Summary: Source Operations Don't Set Correct Output Type in Flink Streaming Runner Key: BEAM-965 URL: https://issues.apache.org/jira/browse/BEAM-965 Project: Beam Issue Type: Bug Components: runner-flink Reporter: Aljoscha Krettek Assignee: Aljoscha Krettek Fix For: 0.4.0-incubating -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[1/2] incubator-beam git commit: Remove Leftover Sysout Printing in Flink Runner
Repository: incubator-beam
Updated Branches:
refs/heads/master 66faf74d0 -> 8daa8b519
Remove Leftover Sysout Printing in Flink Runner
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/d8f3da6f
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/d8f3da6f
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/d8f3da6f
Branch: refs/heads/master
Commit: d8f3da6f42713ee02e49ee7bbdd7bc79c88dd37b
Parents: 66faf74
Author: Alexey Diomin <diomi...@gmail.com>
Authored: Thu Nov 10 16:57:43 2016 +0400
Committer: Aljoscha Krettek <aljoscha.kret...@gmail.com>
Committed: Thu Nov 10 15:47:15 2016 +0100
--
.../flink/translation/FlinkStreamingTransformTranslators.java | 2 --
1 file changed, 2 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d8f3da6f/runners/flink/runner/src/main/java/org/apache/beam/runners/flink/translation/FlinkStreamingTransformTranslators.java
--
diff --git
a/runners/flink/runner/src/main/java/org/apache/beam/runners/flink/translation/FlinkStreamingTransformTranslators.java
b/runners/flink/runner/src/main/java/org/apache/beam/runners/flink/translation/FlinkStreamingTransformTranslators.java
index 069162f..a3e8a49 100644
---
a/runners/flink/runner/src/main/java/org/apache/beam/runners/flink/translation/FlinkStreamingTransformTranslators.java
+++
b/runners/flink/runner/src/main/java/org/apache/beam/runners/flink/translation/FlinkStreamingTransformTranslators.java
@@ -536,9 +536,7 @@ public class FlinkStreamingTransformTranslators {
unionOutputStream.flatMap(new FlatMapFunction<RawUnionValue,
Object>() {
@Override
public void flatMap(RawUnionValue value, Collector out)
throws Exception {
-System.out.println("FILTERING: " + value);
if (value.getUnionTag() == outputTag) {
- System.out.println("EMITTING VALUE: " + value);
out.collect(value.getValue());
}
}
[2/2] incubator-beam git commit: This closes #1333
This closes #1333 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/8daa8b51 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/8daa8b51 Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/8daa8b51 Branch: refs/heads/master Commit: 8daa8b519fe5b2f3286c3f592a26841a374c057c Parents: 66faf74 d8f3da6 Author: Aljoscha Krettek <aljoscha.kret...@gmail.com> Authored: Thu Nov 10 15:47:59 2016 +0100 Committer: Aljoscha Krettek <aljoscha.kret...@gmail.com> Committed: Thu Nov 10 15:47:59 2016 +0100 -- .../flink/translation/FlinkStreamingTransformTranslators.java | 2 -- 1 file changed, 2 deletions(-) --
[jira] [Created] (BEAM-956) Execute ReduceFnRunner Directly in Flink Runner
Aljoscha Krettek created BEAM-956:
-
Summary: Execute ReduceFnRunner Directly in Flink Runner
Key: BEAM-956
URL: https://issues.apache.org/jira/browse/BEAM-956
Project: Beam
Issue Type: Improvement
Components: runner-flink
Reporter: Aljoscha Krettek
Right now, a {{ReduceFnRunner}} is executed via
{{GroupAlsoByWindowViaWindowSetDoFn}} which in turn is executed via a
{{DoFnRunner}}. We should change that to get rid of the dependence on
{{GroupAlsoByWindowViaWindowSetDoFn}} which is an {{OldDoFn}} and also to get
rid of some unneeded layering.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Closed] (BEAM-931) Findbugs doesn't pass in Flink runner
[
https://issues.apache.org/jira/browse/BEAM-931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aljoscha Krettek closed BEAM-931.
-
Resolution: Fixed
Fix Version/s: 0.4.0-incubating
> Findbugs doesn't pass in Flink runner
> -
>
> Key: BEAM-931
> URL: https://issues.apache.org/jira/browse/BEAM-931
> Project: Beam
> Issue Type: Bug
> Components: runner-flink
>Reporter: Daniel Halperin
>Assignee: Aljoscha Krettek
> Fix For: 0.4.0-incubating
>
>
> {code}
> [INFO] --- findbugs-maven-plugin:3.0.1:check (default) @
> beam-runners-flink_2.10 ---
> [INFO] BugInstance size is 9
> [INFO] Error size is 0
> [INFO] Total bugs: 9
> [INFO] Class org.apache.beam.runners.flink.FlinkRunner$StreamingViewAsMap
> defines non-transient non-serializable instance field runner
> [org.apache.beam.runners.flink.FlinkRunner$StreamingViewAsMap] In
> FlinkRunner.java
> [INFO] Class
> org.apache.beam.runners.flink.FlinkRunner$StreamingViewAsMultimap defines
> non-transient non-serializable instance field runner
> [org.apache.beam.runners.flink.FlinkRunner$StreamingViewAsMultimap] In
> FlinkRunner.java
> [INFO] Return value of org.apache.beam.sdk.io.Read$Bounded.getSource()
> ignored, but method has no side effect
> [org.apache.beam.runners.flink.translation.FlinkStreamingTransformTranslators$BoundedReadSourceTranslator]
> At FlinkStreamingTransformTranslators.java:[line 282]
> [INFO] Return value of org.apache.beam.sdk.io.Read$Unbounded.getSource()
> ignored, but method has no side effect
> [org.apache.beam.runners.flink.translation.FlinkStreamingTransformTranslators$UnboundedReadSourceTranslator]
> At FlinkStreamingTransformTranslators.java:[line 252]
> [INFO]
> org.apache.beam.runners.flink.translation.wrappers.SerializableFnAggregatorWrapper.clone()
> does not call super.clone()
> [org.apache.beam.runners.flink.translation.wrappers.SerializableFnAggregatorWrapper]
> At SerializableFnAggregatorWrapper.java:[lines 84-89]
> [INFO] Class
> org.apache.beam.runners.flink.translation.wrappers.streaming.WindowDoFnOperator
> defines non-transient non-serializable instance field stateInternals
> [org.apache.beam.runners.flink.translation.wrappers.streaming.WindowDoFnOperator]
> In WindowDoFnOperator.java
> [INFO] Class
> org.apache.beam.runners.flink.translation.wrappers.streaming.io.UnboundedSocketSource$UnboundedSocketReader
> defines non-transient non-serializable instance field reader
> [org.apache.beam.runners.flink.translation.wrappers.streaming.io.UnboundedSocketSource$UnboundedSocketReader]
> In UnboundedSocketSource.java
> [INFO] Class
> org.apache.beam.runners.flink.translation.wrappers.streaming.io.UnboundedSocketSource$UnboundedSocketReader
> defines non-transient non-serializable instance field socket
> [org.apache.beam.runners.flink.translation.wrappers.streaming.io.UnboundedSocketSource$UnboundedSocketReader]
> In UnboundedSocketSource.java
> [INFO] Unconditional wait in
> org.apache.beam.runners.flink.translation.wrappers.streaming.io.UnboundedSourceWrapper.run(SourceFunction$SourceContext)
>
> [org.apache.beam.runners.flink.translation.wrappers.streaming.io.UnboundedSourceWrapper]
> At UnboundedSourceWrapper.java:[line 243]
> [INFO]
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[2/2] incubator-beam git commit: This closes #1311
This closes #1311 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/66faf74d Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/66faf74d Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/66faf74d Branch: refs/heads/master Commit: 66faf74d084e4eba982063c9ca81673b0cfece4b Parents: ef750c0 a609a19 Author: Aljoscha Krettek <aljoscha.kret...@gmail.com> Authored: Thu Nov 10 10:37:46 2016 +0100 Committer: Aljoscha Krettek <aljoscha.kret...@gmail.com> Committed: Thu Nov 10 10:37:46 2016 +0100 -- .../org/apache/beam/runners/flink/examples/TFIDF.java| 11 +-- runners/flink/pom.xml| 8 .../java/org/apache/beam/runners/flink/FlinkRunner.java | 4 ++-- .../translation/FlinkStreamingTransformTranslators.java | 2 -- .../wrappers/SerializableFnAggregatorWrapper.java| 7 +++ .../wrappers/streaming/WindowDoFnOperator.java | 2 +- .../wrappers/streaming/io/UnboundedSocketSource.java | 5 + .../wrappers/streaming/io/UnboundedSourceWrapper.java| 3 ++- 8 files changed, 22 insertions(+), 20 deletions(-) --
[1/2] incubator-beam git commit: [BEAM-931] Fix Findbugs Warnings in Flink Runner
Repository: incubator-beam
Updated Branches:
refs/heads/master ef750c0f8 -> 66faf74d0
[BEAM-931] Fix Findbugs Warnings in Flink Runner
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/a609a19e
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/a609a19e
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/a609a19e
Branch: refs/heads/master
Commit: a609a19e6df763c0aa77d83f05e21ec343f6dcdb
Parents: ef750c0
Author: Aljoscha Krettek <aljoscha.kret...@gmail.com>
Authored: Tue Nov 8 11:56:45 2016 +0100
Committer: Aljoscha Krettek <aljoscha.kret...@gmail.com>
Committed: Thu Nov 10 10:29:43 2016 +0100
--
.../org/apache/beam/runners/flink/examples/TFIDF.java| 11 +--
runners/flink/pom.xml| 8
.../java/org/apache/beam/runners/flink/FlinkRunner.java | 4 ++--
.../translation/FlinkStreamingTransformTranslators.java | 2 --
.../wrappers/SerializableFnAggregatorWrapper.java| 7 +++
.../wrappers/streaming/WindowDoFnOperator.java | 2 +-
.../wrappers/streaming/io/UnboundedSocketSource.java | 5 +
.../wrappers/streaming/io/UnboundedSourceWrapper.java| 3 ++-
8 files changed, 22 insertions(+), 20 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/a609a19e/runners/flink/examples/src/main/java/org/apache/beam/runners/flink/examples/TFIDF.java
--
diff --git
a/runners/flink/examples/src/main/java/org/apache/beam/runners/flink/examples/TFIDF.java
b/runners/flink/examples/src/main/java/org/apache/beam/runners/flink/examples/TFIDF.java
index cf5c8f5..b946d98 100644
---
a/runners/flink/examples/src/main/java/org/apache/beam/runners/flink/examples/TFIDF.java
+++
b/runners/flink/examples/src/main/java/org/apache/beam/runners/flink/examples/TFIDF.java
@@ -129,7 +129,12 @@ public class TFIDF {
Set uris = new HashSet<>();
if (absoluteUri.getScheme().equals("file")) {
File directory = new File(absoluteUri);
- for (String entry : directory.list()) {
+ String[] directoryListing = directory.list();
+ if (directoryListing == null) {
+throw new IOException(
+"Directory " + absoluteUri + " is not a valid path or IO Error
occurred.");
+ }
+ for (String entry : directoryListing) {
File path = new File(directory, entry);
uris.add(path.toURI());
}
@@ -157,7 +162,9 @@ public class TFIDF {
extends PTransform<PBegin, PCollection<KV<URI, String>>> {
private static final long serialVersionUID = 0;
-private Iterable uris;
+// transient because PTransform is not really meant to be serialized.
+// see note on PTransform
+private final transient Iterable uris;
public ReadDocuments(Iterable uris) {
this.uris = uris;
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/a609a19e/runners/flink/pom.xml
--
diff --git a/runners/flink/pom.xml b/runners/flink/pom.xml
index 1b73922..f93af85 100644
--- a/runners/flink/pom.xml
+++ b/runners/flink/pom.xml
@@ -96,14 +96,6 @@
-
-
- org.codehaus.mojo
- findbugs-maven-plugin
-
-true
-
-
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/a609a19e/runners/flink/runner/src/main/java/org/apache/beam/runners/flink/FlinkRunner.java
--
diff --git
a/runners/flink/runner/src/main/java/org/apache/beam/runners/flink/FlinkRunner.java
b/runners/flink/runner/src/main/java/org/apache/beam/runners/flink/FlinkRunner.java
index 12e21c7..488c170 100644
---
a/runners/flink/runner/src/main/java/org/apache/beam/runners/flink/FlinkRunner.java
+++
b/runners/flink/runner/src/main/java/org/apache/beam/runners/flink/FlinkRunner.java
@@ -301,7 +301,7 @@ public class FlinkRunner extends
PipelineRunner {
private static class StreamingViewAsMap<K, V>
extends PTransform<PCollection<KV<K, V>>, PCollectionView<Map<K, V>>> {
-private final FlinkRunner runner;
+private final transient FlinkRunner runner;
@SuppressWarnings("unused") // used via reflection in FlinkRunner#apply()
public StreamingViewAsMap(FlinkRunner runner, View.AsMap<K, V> transform) {
@@ -343,7 +343,7 @@ public class FlinkRunner extends
PipelineRunner {
private static class StreamingViewAsMultimap<K, V>
extends PTransform<PCollection<KV<K, V>>, PCollection
[GitHub] incubator-beam pull request #1311: [BEAM-931] Fix Findbugs Warnings in Flink...
Github user aljoscha closed the pull request at: https://github.com/apache/incubator-beam/pull/1311 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1311: [BEAM-931] Fix Findbugs Warnings in Flink...
GitHub user aljoscha opened a pull request: https://github.com/apache/incubator-beam/pull/1311 [BEAM-931] Fix Findbugs Warnings in Flink Runner I manually checked via `mvn findbugs:check`. This is not currently activated in the pre-commit hook, is it? R: @dhalperi You can merge this pull request into a Git repository by running: $ git pull https://github.com/aljoscha/incubator-beam flink-fix-findbugs Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/1311.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1311 commit 3757cbd20beaf7db2849aa4c182f0dd059a8a755 Author: Aljoscha Krettek <aljoscha.kret...@gmail.com> Date: 2016-11-08T10:56:45Z [BEAM-931] Fix Findbugs Warnings in Flink Runner --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[04/51] [abbrv] [partial] incubator-beam-site git commit: Rebuild site
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/dataflow/options/CloudDebuggerOptions.html
--
diff --git
a/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/dataflow/options/CloudDebuggerOptions.html
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/dataflow/options/CloudDebuggerOptions.html
new file mode 100644
index 000..c1424ec
--- /dev/null
+++
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/dataflow/options/CloudDebuggerOptions.html
@@ -0,0 +1,307 @@
+http://www.w3.org/TR/html4/loose.dtd;>
+
+
+
+
+
+CloudDebuggerOptions (Apache Beam SDK for Java, version
0.3.0-incubating)
+
+
+
+
+
+
+var methods = {"i0":6,"i1":6,"i2":6,"i3":6,"i4":6,"i5":6};
+var tabs = {65535:["t0","All Methods"],2:["t2","Instance
Methods"],4:["t3","Abstract Methods"]};
+var altColor = "altColor";
+var rowColor = "rowColor";
+var tableTab = "tableTab";
+var activeTableTab = "activeTableTab";
+
+
+JavaScript is disabled on your browser.
+
+
+
+
+
+Skip navigation links
+
+
+
+
+Overview
+Package
+Class
+Use
+Tree
+Deprecated
+Index
+Help
+
+
+
+
+PrevClass
+NextClass
+
+
+Frames
+NoFrames
+
+
+AllClasses
+
+
+
+
+
+
+
+Summary:
+Nested|
+Field|
+Constr|
+Method
+
+
+Detail:
+Field|
+Constr|
+Method
+
+
+
+
+
+
+
+
+org.apache.beam.runners.dataflow.options
+Interface
CloudDebuggerOptions
+
+
+
+
+
+
+All Known Subinterfaces:
+BlockingDataflowPipelineOptions,
DataflowPipelineOptions, DataflowWorkerHarnessOptions, TestDataflowPipelineOptions
+
+
+
+@Experimental
+ @Hidden
+public interface CloudDebuggerOptions
+Options for controlling Cloud Debugger.
+
+
+
+
+
+
+
+
+
+
+
+Method Summary
+
+All MethodsInstance MethodsAbstract Methods
+
+Modifier and Type
+Method and Description
+
+
+com.google.api.services.clouddebugger.v2.model.Debuggee
+getDebuggee()
+The Cloud Debugger debuggee to associate with.
+
+
+
+boolean
+getEnableCloudDebugger()
+Whether to enable the Cloud Debugger snapshot agent for the
current job.
+
+
+
+double
+getMaxConditionCost()
+The maximum cost (as a ratio of CPU time) allowed for
evaluating conditional snapshots.
+
+
+
+void
+setDebuggee(com.google.api.services.clouddebugger.v2.model.Debuggeedebuggee)
+
+
+void
+setEnableCloudDebugger(booleanenabled)
+
+
+void
+setMaxConditionCost(doublemaxConditionCost)
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+Method Detail
+
+
+
+
+
+getEnableCloudDebugger
+booleangetEnableCloudDebugger()
+Whether to enable the Cloud Debugger snapshot agent for the
current job.
+
+
+
+
+
+
+
+setEnableCloudDebugger
+voidsetEnableCloudDebugger(booleanenabled)
+
+
+
+
+
+
+
+getDebuggee
+@Hidden
+ http://docs.oracle.com/javase/7/docs/api/javax/annotation/Nullable.html?is-external=true;
title="class or interface in javax.annotation">@Nullable
+com.google.api.services.clouddebugger.v2.model.DebuggeegetDebuggee()
+The Cloud Debugger debuggee to associate with. This should
not be set directly.
+
+
+
+
+
+
+
+setDebuggee
+voidsetDebuggee(com.google.api.services.clouddebugger.v2.model.Debuggeedebuggee)
+
+
+
+
+
+
+
+getMaxConditionCost
+@Default.Double(value=0.01)
+doublegetMaxConditionCost()
+The maximum cost (as a ratio of CPU time) allowed for
evaluating conditional snapshots.
+
+
+
+
+
+
+
+setMaxConditionCost
+voidsetMaxConditionCost(doublemaxConditionCost)
+
+
+
+
+
+
+
+
+
+
+
+
+
+Skip navigation links
+
+
+
+
+Overview
+Package
+Class
+Use
+Tree
+Deprecated
+Index
+Help
+
+
+
+
+PrevClass
+NextClass
+
+
+Frames
+NoFrames
+
+
+AllClasses
+
+
+
+
+
+
+
+Summary:
+Nested|
+Field|
+Constr|
+Method
+
+
+Detail:
+Field|
+Constr|
+Method
+
+
+
+
+
+
+Copyright 2016 http://www.apache.org/;>The Apache Software Foundation. All rights
reserved.
+
+
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/dataflow/options/DataflowPipelineDebugOptions.DataflowClientFactory.html
--
diff --git
a/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/dataflow/options/DataflowPipelineDebugOptions.DataflowClientFactory.html
[41/51] [abbrv] [partial] incubator-beam-site git commit: Rebuild site
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/GroupAlsoByWindowViaWindowSetDoFn.html
--
diff --git
a/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/GroupAlsoByWindowViaWindowSetDoFn.html
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/GroupAlsoByWindowViaWindowSetDoFn.html
new file mode 100644
index 000..965d070
--- /dev/null
+++
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/GroupAlsoByWindowViaWindowSetDoFn.html
@@ -0,0 +1,413 @@
+http://www.w3.org/TR/html4/loose.dtd;>
+
+
+
+
+
+GroupAlsoByWindowViaWindowSetDoFn (Apache Beam SDK for Java, version
0.3.0-incubating)
+
+
+
+
+
+
+var methods = {"i0":10,"i1":9,"i2":10,"i3":10};
+var tabs = {65535:["t0","All Methods"],1:["t1","Static
Methods"],2:["t2","Instance Methods"],8:["t4","Concrete Methods"]};
+var altColor = "altColor";
+var rowColor = "rowColor";
+var tableTab = "tableTab";
+var activeTableTab = "activeTableTab";
+
+
+JavaScript is disabled on your browser.
+
+
+
+
+
+Skip navigation links
+
+
+
+
+Overview
+Package
+Class
+Use
+Tree
+Deprecated
+Index
+Help
+
+
+
+
+PrevClass
+NextClass
+
+
+Frames
+NoFrames
+
+
+AllClasses
+
+
+
+
+
+
+
+Summary:
+Nested|
+Field|
+Constr|
+Method
+
+
+Detail:
+Field|
+Constr|
+Method
+
+
+
+
+
+
+
+
+org.apache.beam.runners.core
+Class
GroupAlsoByWindowViaWindowSetDoFnK,InputT,OutputT,W extends BoundedWindow,RinT extends KeyedWorkItemK,InputT
+
+
+
+http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true;
title="class or interface in java.lang">java.lang.Object
+
+
+org.apache.beam.sdk.transforms.OldDoFnRinT,KVK,OutputT
+
+
+org.apache.beam.runners.core.GroupAlsoByWindowViaWindowSetDoFnK,InputT,OutputT,W,RinT
+
+
+
+
+
+
+
+
+
+All Implemented Interfaces:
+http://docs.oracle.com/javase/7/docs/api/java/io/Serializable.html?is-external=true;
title="class or interface in java.io">Serializable, DoFnRunner.ReduceFnExecutorK,InputT,OutputT,W,
HasDisplayData
+
+
+
+@SystemDoFnInternal
+public class GroupAlsoByWindowViaWindowSetDoFnK,InputT,OutputT,W
extends BoundedWindow,RinT extends KeyedWorkItemK,InputT
+extends OldDoFnRinT,KVK,OutputT
+implements DoFnRunner.ReduceFnExecutorK,InputT,OutputT,W
+A general GroupAlsoByWindowsDoFn. This
delegates all of the logic to the
+ ReduceFnRunner.
+
+See Also:
+Serialized
Form
+
+
+
+
+
+
+
+
+
+
+
+
+Nested Class Summary
+
+
+
+
+Nested classes/interfaces inherited from
classorg.apache.beam.sdk.transforms.OldDoFn
+OldDoFn.Context, OldDoFn.ProcessContext, OldDoFn.RequiresWindowAccess
+
+
+
+
+
+
+
+
+Field Summary
+
+Fields
+
+Modifier and Type
+Field and Description
+
+
+protected Aggregatorhttp://docs.oracle.com/javase/7/docs/api/java/lang/Long.html?is-external=true;
title="class or interface in java.lang">Long,http://docs.oracle.com/javase/7/docs/api/java/lang/Long.html?is-external=true;
title="class or interface in java.lang">Long
+droppedDueToClosedWindow
+
+
+protected Aggregatorhttp://docs.oracle.com/javase/7/docs/api/java/lang/Long.html?is-external=true;
title="class or interface in java.lang">Long,http://docs.oracle.com/javase/7/docs/api/java/lang/Long.html?is-external=true;
title="class or interface in java.lang">Long
+droppedDueToLateness
+
+
+
+
+
+
+
+
+
+Method Summary
+
+All MethodsStatic MethodsInstance MethodsConcrete Methods
+
+Modifier and Type
+Method and Description
+
+
+OldDoFnKeyedWorkItemK,InputT,KVK,OutputT
+asDoFn()
+Gets this object as a OldDoFn.
+
+
+
+static K,InputT,OutputT,W extends BoundedWindowOldDoFnKeyedWorkItemK,InputT,KVK,OutputT
+create(WindowingStrategy?,Wstrategy,
+ StateInternalsFactoryKstateInternalsFactory,
+ SystemReduceFnK,InputT,?,OutputT,WreduceFn)
+
+
+Aggregatorhttp://docs.oracle.com/javase/7/docs/api/java/lang/Long.html?is-external=true;
title="class or interface in java.lang">Long,http://docs.oracle.com/javase/7/docs/api/java/lang/Long.html?is-external=true;
title="class or interface in java.lang">Long
+getDroppedDueToLatenessAggregator()
+Returns an aggregator that tracks elements that are dropped
due to being late.
+
+
+
+void
+processElement(OldDoFn.ProcessContextc)
+Processes one input element.
+
+
+
+
+
+
+
+Methods inherited from classorg.apache.beam.sdk.transforms.OldDoFn
+createAggregator,
createAggregator,
finishBundle,
getAllowedTimestampSkew,
[29/51] [abbrv] [partial] incubator-beam-site git commit: Rebuild site
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/AfterAllStateMachine.html
--
diff --git
a/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/AfterAllStateMachine.html
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/AfterAllStateMachine.html
new file mode 100644
index 000..c8e1d35
--- /dev/null
+++
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/AfterAllStateMachine.html
@@ -0,0 +1,449 @@
+http://www.w3.org/TR/html4/loose.dtd;>
+
+
+
+
+
+AfterAllStateMachine (Apache Beam SDK for Java, version
0.3.0-incubating)
+
+
+
+
+
+
+var methods = {"i0":9,"i1":9,"i2":10,"i3":10,"i4":10,"i5":10,"i6":10};
+var tabs = {65535:["t0","All Methods"],1:["t1","Static
Methods"],2:["t2","Instance Methods"],8:["t4","Concrete Methods"]};
+var altColor = "altColor";
+var rowColor = "rowColor";
+var tableTab = "tableTab";
+var activeTableTab = "activeTableTab";
+
+
+JavaScript is disabled on your browser.
+
+
+
+
+
+Skip navigation links
+
+
+
+
+Overview
+Package
+Class
+Use
+Tree
+Deprecated
+Index
+Help
+
+
+
+
+PrevClass
+NextClass
+
+
+Frames
+NoFrames
+
+
+AllClasses
+
+
+
+
+
+
+
+Summary:
+Nested|
+Field|
+Constr|
+Method
+
+
+Detail:
+Field|
+Constr|
+Method
+
+
+
+
+
+
+
+
+org.apache.beam.runners.core.triggers
+Class
AfterAllStateMachine
+
+
+
+http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true;
title="class or interface in java.lang">java.lang.Object
+
+
+org.apache.beam.runners.core.triggers.TriggerStateMachine
+
+
+org.apache.beam.runners.core.triggers.TriggerStateMachine.OnceTriggerStateMachine
+
+
+org.apache.beam.runners.core.triggers.AfterAllStateMachine
+
+
+
+
+
+
+
+
+
+
+
+All Implemented Interfaces:
+http://docs.oracle.com/javase/7/docs/api/java/io/Serializable.html?is-external=true;
title="class or interface in java.io">Serializable
+
+
+
+@Experimental(value=TRIGGER)
+public class AfterAllStateMachine
+extends TriggerStateMachine.OnceTriggerStateMachine
+A TriggerStateMachine
that fires and finishes once after all of its sub-triggers
+ have fired.
+
+See Also:
+Serialized
Form
+
+
+
+
+
+
+
+
+
+
+
+
+Nested Class Summary
+
+
+
+
+Nested classes/interfaces inherited from
classorg.apache.beam.runners.core.triggers.TriggerStateMachine
+TriggerStateMachine.MergingTriggerInfo,
TriggerStateMachine.OnceTriggerStateMachine,
TriggerStateMachine.OnElementContext,
TriggerStateMachine.OnMergeContext,
TriggerStateMachine.TriggerContext, TriggerStateMachine.TriggerInfo
+
+
+
+
+
+
+
+
+Field Summary
+
+
+
+
+Fields inherited from classorg.apache.beam.runners.core.triggers.TriggerStateMachine
+subTriggers
+
+
+
+
+
+
+
+
+Method Summary
+
+All MethodsStatic MethodsInstance MethodsConcrete Methods
+
+Modifier and Type
+Method and Description
+
+
+static TriggerStateMachine.OnceTriggerStateMachine
+of(http://docs.oracle.com/javase/7/docs/api/java/lang/Iterable.html?is-external=true;
title="class or interface in java.lang">Iterable? extends TriggerStateMachinetriggers)
+
+
+static TriggerStateMachine.OnceTriggerStateMachine
+of(TriggerStateMachine.OnceTriggerStateMachine...triggers)
+Returns an AfterAll Trigger with
the given subtriggers.
+
+
+
+void
+onElement(TriggerStateMachine.OnElementContextc)
+Called every time an element is incorporated into a
window.
+
+
+
+void
+onMerge(TriggerStateMachine.OnMergeContextc)
+Called immediately after windows have been merged.
+
+
+
+void
+onOnlyFiring(TriggerStateMachine.TriggerContextcontext)
+Invokes TriggerStateMachine.OnceTriggerStateMachine.onFire(org.apache.beam.runners.core.triggers.TriggerStateMachine.TriggerContext)
for all subtriggers, eliding redundant calls to shouldFire(org.apache.beam.runners.core.triggers.TriggerStateMachine.TriggerContext)
+ because they all must be ready to fire.
+
+
+
+boolean
+shouldFire(TriggerStateMachine.TriggerContextcontext)
+Returns true if the current state of the
trigger indicates that its condition
+ is satisfied and it is ready to fire.
+
+
+
+http://docs.oracle.com/javase/7/docs/api/java/lang/String.html?is-external=true;
title="class or interface in java.lang">String
+toString()
+
+
+
+
+
+
+Methods inherited from classorg.apache.beam.runners.core.triggers.TriggerStateMachine.OnceTriggerStateMachine
+onFire
+
+
+
+
+
+Methods inherited from
[18/51] [abbrv] [partial] incubator-beam-site git commit: Rebuild site
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/TriggerStateMachineRunner.html
--
diff --git
a/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/TriggerStateMachineRunner.html
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/TriggerStateMachineRunner.html
new file mode 100644
index 000..9bcda87
--- /dev/null
+++
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/TriggerStateMachineRunner.html
@@ -0,0 +1,554 @@
+http://www.w3.org/TR/html4/loose.dtd;>
+
+
+
+
+
+TriggerStateMachineRunner (Apache Beam SDK for Java, version
0.3.0-incubating)
+
+
+
+
+
+
+var methods =
{"i0":10,"i1":10,"i2":10,"i3":10,"i4":10,"i5":10,"i6":10,"i7":10,"i8":10,"i9":10,"i10":10};
+var tabs = {65535:["t0","All Methods"],2:["t2","Instance
Methods"],8:["t4","Concrete Methods"]};
+var altColor = "altColor";
+var rowColor = "rowColor";
+var tableTab = "tableTab";
+var activeTableTab = "activeTableTab";
+
+
+JavaScript is disabled on your browser.
+
+
+
+
+
+Skip navigation links
+
+
+
+
+Overview
+Package
+Class
+Use
+Tree
+Deprecated
+Index
+Help
+
+
+
+
+PrevClass
+NextClass
+
+
+Frames
+NoFrames
+
+
+AllClasses
+
+
+
+
+
+
+
+Summary:
+Nested|
+Field|
+Constr|
+Method
+
+
+Detail:
+Field|
+Constr|
+Method
+
+
+
+
+
+
+
+
+org.apache.beam.runners.core.triggers
+Class
TriggerStateMachineRunnerW extends BoundedWindow
+
+
+
+http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true;
title="class or interface in java.lang">java.lang.Object
+
+
+org.apache.beam.runners.core.triggers.TriggerStateMachineRunnerW
+
+
+
+
+
+
+
+Type Parameters:
+W - The kind of windows being processed.
+
+
+
+public class TriggerStateMachineRunnerW
extends BoundedWindow
+extends http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true;
title="class or interface in java.lang">Object
+Executes a trigger while managing persistence of
information about which subtriggers are
+ finished. Subtriggers include all recursive trigger expressions as well as
the entire trigger.
+
+ Specifically, the responsibilities are:
+
+
+ Invoking the trigger's methods via its ExecutableTriggerStateMachine
wrapper by
+ constructing the appropriate trigger contexts.
+ Committing a record of which subtriggers are finished to persistent
state.
+ Restoring the record of which subtriggers are finished from persistent
state.
+ Clearing out the persisted finished set when a caller indicates
+ (via {#link #clearFinished}) that it is no longer needed.
+
+
+ These responsibilities are intertwined: trigger contexts include mutable
information about
+ which subtriggers are finished. This class provides the information when
building the contexts
+ and commits the information when the method of the ExecutableTriggerStateMachine
returns.
+
+
+
+
+
+
+
+
+
+
+
+Field Summary
+
+Fields
+
+Modifier and Type
+Field and Description
+
+
+static StateTaghttp://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true;
title="class or interface in java.lang">Object,ValueStatehttp://docs.oracle.com/javase/7/docs/api/java/util/BitSet.html?is-external=true;
title="class or interface in java.util">BitSet
+FINISHED_BITS_TAG
+
+
+
+
+
+
+
+
+
+Constructor Summary
+
+Constructors
+
+Constructor and Description
+
+
+TriggerStateMachineRunner(ExecutableTriggerStateMachinerootTrigger,
+ TriggerStateMachineContextFactoryWcontextFactory)
+
+
+
+
+
+
+
+
+
+Method Summary
+
+All MethodsInstance MethodsConcrete Methods
+
+Modifier and Type
+Method and Description
+
+
+void
+clearFinished(StateAccessor?state)
+Clear the finished bits.
+
+
+
+void
+clearState(Wwindow,
+ Timerstimers,
+ StateAccessor?state)
+Clear the state used for executing triggers, but leave the
finished set to indicate
+ the window is closed.
+
+
+
+boolean
+isClosed(StateAccessor?state)
+Return true if the trigger is closed in the window
corresponding to the specified state.
+
+
+
+void
+onFire(Wwindow,
+ Timerstimers,
+ StateAccessor?state)
+
+
+void
+onMerge(Wwindow,
+ Timerstimers,
+ MergingStateAccessor?,Wstate)
+Run the trigger merging logic as part of executing the
specified merge.
+
+
+
+void
+prefetchForMerge(Wwindow,
+
[21/51] [abbrv] [partial] incubator-beam-site git commit: Rebuild site
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/TriggerStateMachine.OnElementContext.html
--
diff --git
a/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/TriggerStateMachine.OnElementContext.html
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/TriggerStateMachine.OnElementContext.html
new file mode 100644
index 000..a077a23
--- /dev/null
+++
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/TriggerStateMachine.OnElementContext.html
@@ -0,0 +1,342 @@
+http://www.w3.org/TR/html4/loose.dtd;>
+
+
+
+
+
+TriggerStateMachine.OnElementContext (Apache Beam SDK for Java, version
0.3.0-incubating)
+
+
+
+
+
+
+var methods = {"i0":6,"i1":6,"i2":6};
+var tabs = {65535:["t0","All Methods"],2:["t2","Instance
Methods"],4:["t3","Abstract Methods"]};
+var altColor = "altColor";
+var rowColor = "rowColor";
+var tableTab = "tableTab";
+var activeTableTab = "activeTableTab";
+
+
+JavaScript is disabled on your browser.
+
+
+
+
+
+Skip navigation links
+
+
+
+
+Overview
+Package
+Class
+Use
+Tree
+Deprecated
+Index
+Help
+
+
+
+
+PrevClass
+NextClass
+
+
+Frames
+NoFrames
+
+
+AllClasses
+
+
+
+
+
+
+
+Summary:
+Nested|
+Field|
+Constr|
+Method
+
+
+Detail:
+Field|
+Constr|
+Method
+
+
+
+
+
+
+
+
+org.apache.beam.runners.core.triggers
+Class
TriggerStateMachine.OnElementContext
+
+
+
+http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true;
title="class or interface in java.lang">java.lang.Object
+
+
+org.apache.beam.runners.core.triggers.TriggerStateMachine.TriggerContext
+
+
+org.apache.beam.runners.core.triggers.TriggerStateMachine.OnElementContext
+
+
+
+
+
+
+
+
+
+Enclosing class:
+TriggerStateMachine
+
+
+
+public abstract class TriggerStateMachine.OnElementContext
+extends TriggerStateMachine.TriggerContext
+Extended TriggerStateMachine.TriggerContext
containing information accessible to the TriggerStateMachine.onElement(org.apache.beam.runners.core.triggers.TriggerStateMachine.OnElementContext)
+ operational hook.
+
+
+
+
+
+
+
+
+
+
+
+Constructor Summary
+
+Constructors
+
+Constructor and Description
+
+
+OnElementContext()
+
+
+
+
+
+
+
+
+
+Method Summary
+
+All MethodsInstance MethodsAbstract Methods
+
+Modifier and Type
+Method and Description
+
+
+abstract org.joda.time.Instant
+eventTimestamp()
+The event timestamp of the element currently being
processed.
+
+
+
+abstract TriggerStateMachine.OnElementContext
+forTrigger(ExecutableTriggerStateMachinetrigger)
+Create an OnElementContext for executing the
given trigger.
+
+
+
+abstract void
+setTimer(org.joda.time.Instanttimestamp,
+TimeDomaindomain)
+Sets a timer to fire when the watermark or processing time
is beyond the given timestamp.
+
+
+
+
+
+
+
+Methods inherited from classorg.apache.beam.runners.core.triggers.TriggerStateMachine.TriggerContext
+currentEventTime,
currentProcessingTime,
currentSynchronizedProcessingTime,
deleteTimer,
state,
trigger,
window
+
+
+
+
+
+Methods inherited from classjava.lang.http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true;
title="class or interface in java.lang">Object
+http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#clone--;
title="class or interface in java.lang">clone, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#equals-java.lang.Object-;
title="class or interface in java.lang">equals, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#finalize--;
title="class or interface in java.lang">finalize, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#getClass--;
title="class or interface in java.lang">getClass, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#hashCode--;
title="class or interface in java.lang">hashCode, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#notify--;
title="class or interface in java.lang">notify, http://docs.oracle.com/javase/7/docs/api/java/lang
/Object.html?is-external=true#notifyAll--" title="class or interface in
java.lang">notifyAll, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#toString--;
title="class or interface in java.lang">toString,
[33/51] [abbrv] [partial] incubator-beam-site git commit: Rebuild site
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/class-use/DoFnRunner.html -- diff --git a/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/class-use/DoFnRunner.html b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/class-use/DoFnRunner.html new file mode 100644 index 000..be9d690 --- /dev/null +++ b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/class-use/DoFnRunner.html @@ -0,0 +1,301 @@ +http://www.w3.org/TR/html4/loose.dtd;> + + + + + +Uses of Interface org.apache.beam.runners.core.DoFnRunner (Apache Beam SDK for Java, version 0.3.0-incubating) + + + + + + + + +JavaScript is disabled on your browser. + + + + + +Skip navigation links + + + + +Overview +Package +Class +Use +Tree +Deprecated +Index +Help + + + + +Prev +Next + + +Frames +NoFrames + + +AllClasses + + + + + + + + + + +Uses of Interfaceorg.apache.beam.runners.core.DoFnRunner + + + + + +Packages that use DoFnRunner + +Package +Description + + + +org.apache.beam.runners.core + +Provides utilities for Beam runner authors. + + + + + + + + + + +Uses of DoFnRunner in org.apache.beam.runners.core + +Classes in org.apache.beam.runners.core that implement DoFnRunner + +Modifier and Type +Class and Description + + + +class +LateDataDroppingDoFnRunnerK,InputT,OutputT,W extends BoundedWindow +A customized DoFnRunner that handles late data dropping for + a KeyedWorkItem input OldDoFn. + + + +class +PushbackSideInputDoFnRunnerInputT,OutputT +A DoFnRunner that can refuse to process elements that are not ready, instead returning + them via the PushbackSideInputDoFnRunner.processElementInReadyWindows(WindowedValue). + + + +class +SimpleDoFnRunnerInputT,OutputT +Runs a DoFn by constructing the appropriate contexts and passing them in. + + + + + +Methods in org.apache.beam.runners.core that return DoFnRunner + +Modifier and Type +Method and Description + + + +static InputT,OutputTDoFnRunnerInputT,OutputT +DoFnRunners.createDefault(PipelineOptionsoptions, + DoFnInputT,OutputTdoFn, + SideInputReadersideInputReader, + DoFnRunners.OutputManageroutputManager, + TupleTagOutputTmainOutputTag, + http://docs.oracle.com/javase/7/docs/api/java/util/List.html?is-external=true; title="class or interface in java.util">ListTupleTag?sideOutputTags, + ExecutionContext.StepContextstepContext, + Aggregator.AggregatorFactoryaggregatorFactory, + WindowingStrategy?,?windowingStrategy) +Creates a DoFnRunner for the provided DoFn. + + + +static InputT,OutputTDoFnRunnerInputT,OutputT +DoFnRunners.createDefault(PipelineOptionsoptions, + http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true; title="class or interface in java.lang">ObjectdeserializedFn, + SideInputReadersideInputReader, + DoFnRunners.OutputManageroutputManager, + TupleTagOutputTmainOutputTag, + http://docs.oracle.com/javase/7/docs/api/java/util/List.html?is-external=true; title="class or interface in java.util">ListTupleTag?sideOutputTags, + ExecutionContext.StepContextstepContext, + Aggregator.AggregatorFactoryaggregatorFactory, + WindowingStrategy?,?windowingStrategy) +Deprecated. +for migration purposes only for services where users may still submit either OldDoFn or DoFn. If you know that you have a DoFn then you should use the + variant for that instead. + + + + +static InputT,OutputTDoFnRunnerInputT,OutputT +DoFnRunners.createDefault(PipelineOptionsoptions, + OldDoFnInputT,OutputTdoFn, + SideInputReadersideInputReader, + DoFnRunners.OutputManageroutputManager, + TupleTagOutputTmainOutputTag, + http://docs.oracle.com/javase/7/docs/api/java/util/List.html?is-external=true; title="class or interface in java.util">ListTupleTag?sideOutputTags, + ExecutionContext.StepContextstepContext, + Aggregator.AggregatorFactoryaggregatorFactory, + WindowingStrategy?,?windowingStrategy) +Deprecated. +please port uses of OldDoFn to use DoFn + + + + +static K,InputT,OutputT,W extends BoundedWindowDoFnRunnerKeyedWorkItemK,InputT,KVK,OutputT
[42/51] [abbrv] [partial] incubator-beam-site git commit: Rebuild site
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/ElementAndRestriction.html
--
diff --git
a/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/ElementAndRestriction.html
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/ElementAndRestriction.html
new file mode 100644
index 000..b5b37d6
--- /dev/null
+++
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/ElementAndRestriction.html
@@ -0,0 +1,315 @@
+http://www.w3.org/TR/html4/loose.dtd;>
+
+
+
+
+
+ElementAndRestriction (Apache Beam SDK for Java, version
0.3.0-incubating)
+
+
+
+
+
+
+var methods = {"i0":6,"i1":9,"i2":6};
+var tabs = {65535:["t0","All Methods"],1:["t1","Static
Methods"],2:["t2","Instance Methods"],4:["t3","Abstract
Methods"],8:["t4","Concrete Methods"]};
+var altColor = "altColor";
+var rowColor = "rowColor";
+var tableTab = "tableTab";
+var activeTableTab = "activeTableTab";
+
+
+JavaScript is disabled on your browser.
+
+
+
+
+
+Skip navigation links
+
+
+
+
+Overview
+Package
+Class
+Use
+Tree
+Deprecated
+Index
+Help
+
+
+
+
+PrevClass
+NextClass
+
+
+Frames
+NoFrames
+
+
+AllClasses
+
+
+
+
+
+
+
+Summary:
+Nested|
+Field|
+Constr|
+Method
+
+
+Detail:
+Field|
+Constr|
+Method
+
+
+
+
+
+
+
+
+org.apache.beam.runners.core
+Class
ElementAndRestrictionElementT,RestrictionT
+
+
+
+http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true;
title="class or interface in java.lang">java.lang.Object
+
+
+org.apache.beam.runners.core.ElementAndRestrictionElementT,RestrictionT
+
+
+
+
+
+
+
+
+@Experimental(value=SPLITTABLE_DO_FN)
+public abstract class ElementAndRestrictionElementT,RestrictionT
+extends http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true;
title="class or interface in java.lang">Object
+A tuple of an element and a restriction applied to
processing it with a
+ https://s.apache.org/splittable-do-fn;>splittable DoFn.
+
+
+
+
+
+
+
+
+
+
+
+Constructor Summary
+
+Constructors
+
+Constructor and Description
+
+
+ElementAndRestriction()
+
+
+
+
+
+
+
+
+
+Method Summary
+
+All MethodsStatic MethodsInstance MethodsAbstract MethodsConcrete Methods
+
+Modifier and Type
+Method and Description
+
+
+abstract ElementT
+element()
+The element to process.
+
+
+
+static InputT,RestrictionTElementAndRestrictionInputT,RestrictionT
+of(InputTelement,
+ RestrictionTrestriction)
+Constructs the ElementAndRestriction.
+
+
+
+abstract RestrictionT
+restriction()
+The restriction applied to processing the element.
+
+
+
+
+
+
+
+Methods inherited from classjava.lang.http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true;
title="class or interface in java.lang">Object
+http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#clone--;
title="class or interface in java.lang">clone, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#equals-java.lang.Object-;
title="class or interface in java.lang">equals, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#finalize--;
title="class or interface in java.lang">finalize, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#getClass--;
title="class or interface in java.lang">getClass, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#hashCode--;
title="class or interface in java.lang">hashCode, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#notify--;
title="class or interface in java.lang">notify, http://docs.oracle.com/javase/7/docs/api/java/lang
/Object.html?is-external=true#notifyAll--" title="class or interface in
java.lang">notifyAll, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#toString--;
title="class or interface in java.lang">toString, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#wait--;
title="class or interface in java.lang">wait, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#wait-long-;
title="class or interface in java.lang">wait, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#wait-long-int-;
title="class or interface in java.lang">wait
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+Constructor Detail
+
+
+
+
+
[49/51] [abbrv] [partial] incubator-beam-site git commit: Rebuild site
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/allclasses-frame.html -- diff --git a/content/learn/sdks/javadoc/0.3.0-incubating/allclasses-frame.html b/content/learn/sdks/javadoc/0.3.0-incubating/allclasses-frame.html new file mode 100644 index 000..0328dbb --- /dev/null +++ b/content/learn/sdks/javadoc/0.3.0-incubating/allclasses-frame.html @@ -0,0 +1,923 @@ +http://www.w3.org/TR/html4/loose.dtd;> + + + + + +All Classes (Apache Beam SDK for Java, version 0.3.0-incubating) + + + + + +AllClasses + + +AccumulatorCombiningState +AccumulatorSingleton +ActiveWindowSet +ActiveWindowSet.MergeCallback +AfterAll +AfterAllStateMachine +AfterDelayFromFirstElement +AfterDelayFromFirstElementStateMachine +AfterEach +AfterEachStateMachine +AfterFirst +AfterFirstStateMachine +AfterPane +AfterPaneStateMachine +AfterProcessingTime +AfterProcessingTimeStateMachine +AfterSynchronizedProcessingTime +AfterWatermark +AfterWatermark.AfterWatermarkEarlyAndLate +AfterWatermark.FromEndOfWindow +AfterWatermarkStateMachine +AfterWatermarkStateMachine.AfterWatermarkEarlyAndLate +AfterWatermarkStateMachine.FromEndOfWindow +AggAccumParam +Aggregator +Aggregator.AggregatorFactory +AggregatorContainer +AggregatorContainer.AggregatorKey +AggregatorContainer.Mutator +AggregatorMetric +AggregatorMetricSource +AggregatorRetrievalException +AggregatorRetriever +AggregatorValues +ApiSurface +AppEngineEnvironment +ApplicationNameOptions +AppliedCombineFn +AppliedPTransform +ApproximateQuantiles +ApproximateQuantiles.ApproximateQuantilesCombineFn +ApproximateUnique +ApproximateUnique.ApproximateUniqueCombineFn +ApproximateUnique.ApproximateUniqueCombineFn.LargestUnique +AssignWindows +AssignWindowsDoFn +AtomicCoder +AttemptAndTimeBoundedExponentialBackOff +AttemptAndTimeBoundedExponentialBackOff.ResetPolicy +AttemptBoundedExponentialBackOff +AvroCoder +AvroCoderBenchmark +AvroHDFSFileSource +AvroIO +AvroIO.Read +AvroIO.Read.Bound +AvroIO.Write +AvroIO.Write.Bound +AvroSource +AvroSource.AvroReader +AvroUtils +AvroUtils.AvroMetadata +AvroWrapperCoder +BagState +BaseExecutionContext +BaseExecutionContext.CreateStepContextFunction +BaseExecutionContext.StepContext +BigDecimalCoder +BigEndianIntegerCoder +BigEndianLongCoder +BigIntegerCoder +BigQueryIO +BigQueryIO.Read +BigQueryIO.Read.Bound +BigQueryIO.Write +BigQueryIO.Write.Bound +BigQueryIO.Write.CreateDisposition +BigQueryIO.Write.WriteDisposition +BigqueryMatcher +BigQueryOptions +BigtableIO +BigtableIO.Read +BigtableIO.Write +BigtableTestOptions +BitSetCoder +BlockBasedSource +BlockBasedSource.Block +BlockBasedSource.BlockBasedReader +BlockingDataflowPipelineOptions +BlockingDataflowRunner +BoundedReadFromUnboundedSource +BoundedSource +BoundedSource.BoundedReader +BoundedWindow +BroadcastHelper +BucketingFunction +BufferedElementCountingOutputStream +BundleFactory +ByteArray +ByteArrayCoder +ByteArrayCoderBenchmark +ByteCoder +ByteKey +ByteKeyRange +ByteKeyRangeTracker +ByteStringCoder +CalendarWindows +CalendarWindows.DaysWindows +CalendarWindows.MonthsWindows +CalendarWindows.YearsWindows +CannotProvideCoderException +CannotProvideCoderException.ReasonCode +Clock +CloudDebuggerOptions +CloudObject +CloudResourceManagerOptions +Coder +Coder.Context +Coder.NonDeterministicException +CoderException +CoderFactories +CoderFactory +CoderHelpers +CoderProperties +CoderProperties.TestElementByteSizeObserver +CoderProvider +CoderProviders +CoderRegistry +CoderUtils +CoGbkResult +CoGbkResult.CoGbkResultCoder +CoGbkResultSchema +CoGroupByKey +CollectionCoder +Combine +Combine.AccumulatingCombineFn +Combine.AccumulatingCombineFn.Accumulator +Combine.BinaryCombineDoubleFn +Combine.BinaryCombineFn +Combine.BinaryCombineIntegerFn +Combine.BinaryCombineLongFn +Combine.CombineFn +Combine.Globally +Combine.GloballyAsSingletonView +Combine.GroupedValues +Combine.Holder +Combine.IterableCombineFn +Combine.KeyedCombineFn +Combine.PerKey +Combine.PerKeyWithHotKeyFanout +Combine.SimpleCombineFn +CombineContextFactory +CombineFnBase +CombineFnBase.GlobalCombineFn +CombineFnBase.PerKeyCombineFn +CombineFns +CombineFns.CoCombineResult +CombineFns.ComposeCombineFnBuilder +CombineFns.ComposedCombineFn +CombineFns.ComposedCombineFnWithContext +CombineFns.ComposedKeyedCombineFn +CombineFns.ComposedKeyedCombineFnWithContext +CombineFns.ComposeKeyedCombineFnBuilder +CombineFnUtil +CombineWithContext +CombineWithContext.CombineFnWithContext +CombineWithContext.Context +CombineWithContext.KeyedCombineFnWithContext +CombineWithContext.RequiresContextInternal +CombiningState +CompressedSource +CompressedSource.CompressedReader +CompressedSource.CompressionMode +CompressedSource.DecompressingChannelFactory +ConsoleIO +ConsoleIO.Write +ConsoleIO.Write.Unbound +ConsumerTrackingPipelineVisitor +CopyOnAccessInMemoryStateInternals +Count +Count.PerElement +Counter +CountingInput
[31/51] [abbrv] [partial] incubator-beam-site git commit: Rebuild site
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/class-use/ReduceFn.Context.html -- diff --git a/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/class-use/ReduceFn.Context.html b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/class-use/ReduceFn.Context.html new file mode 100644 index 000..f2080df --- /dev/null +++ b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/class-use/ReduceFn.Context.html @@ -0,0 +1,213 @@ +http://www.w3.org/TR/html4/loose.dtd;> + + + + + +Uses of Class org.apache.beam.runners.core.ReduceFn.Context (Apache Beam SDK for Java, version 0.3.0-incubating) + + + + + + + + +JavaScript is disabled on your browser. + + + + + +Skip navigation links + + + + +Overview +Package +Class +Use +Tree +Deprecated +Index +Help + + + + +Prev +Next + + +Frames +NoFrames + + +AllClasses + + + + + + + + + + +Uses of Classorg.apache.beam.runners.core.ReduceFn.Context + + + + + +Packages that use ReduceFn.Context + +Package +Description + + + +org.apache.beam.runners.core + +Provides utilities for Beam runner authors. + + + + + + + + + + +Uses of ReduceFn.Context in org.apache.beam.runners.core + +Subclasses of ReduceFn.Context in org.apache.beam.runners.core + +Modifier and Type +Class and Description + + + +class +ReduceFn.OnMergeContext +Information accessible within ReduceFn.onMerge(org.apache.beam.runners.core.ReduceFnK, InputT, OutputT, W.OnMergeContext). + + + +class +ReduceFn.OnTriggerContext +Information accessible within ReduceFn.onTrigger(org.apache.beam.runners.core.ReduceFnK, InputT, OutputT, W.OnTriggerContext). + + + +class +ReduceFn.ProcessValueContext +Information accessible within ReduceFn.processValue(org.apache.beam.runners.core.ReduceFnK, InputT, OutputT, W.ProcessValueContext). + + + + + +Methods in org.apache.beam.runners.core with parameters of type ReduceFn.Context + +Modifier and Type +Method and Description + + + +void +SystemReduceFn.clearState(ReduceFn.Contextc) + + +abstract void +ReduceFn.clearState(ReduceFn.Contextcontext) +Called to clear any persisted state that the ReduceFn may be holding. + + + +ReadableStatePaneInfo +PaneInfoTracker.getNextPaneInfo(ReduceFn.Contextcontext, + booleanisFinal) +Return a (ReadableState for) the pane info appropriate for context. + + + +void +PaneInfoTracker.storeCurrentPaneInfo(ReduceFn.Contextcontext, +PaneInfocurrentPane) + + + + + + + + + + + + +Skip navigation links + + + + +Overview +Package +Class +Use +Tree +Deprecated +Index +Help + + + + +Prev +Next + + +Frames +NoFrames + + +AllClasses + + + + + + + + + +Copyright 2016 http://www.apache.org/;>The Apache Software Foundation. All rights reserved. + + http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/class-use/ReduceFn.OnMergeContext.html -- diff --git a/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/class-use/ReduceFn.OnMergeContext.html b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/class-use/ReduceFn.OnMergeContext.html new file mode 100644 index 000..20755ae --- /dev/null +++ b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/class-use/ReduceFn.OnMergeContext.html @@ -0,0 +1,170 @@ +http://www.w3.org/TR/html4/loose.dtd;> + + + + + +Uses of Class org.apache.beam.runners.core.ReduceFn.OnMergeContext (Apache Beam SDK for Java, version 0.3.0-incubating) + + + + + + + + +JavaScript is disabled on your browser. + + + + + +Skip navigation links + + + + +Overview +Package +Class +Use +Tree +Deprecated +Index +Help + + + + +Prev +Next + + +Frames +NoFrames + + +AllClasses + +
[14/51] [abbrv] [partial] incubator-beam-site git commit: Rebuild site
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/class-use/TriggerStateMachine.OnceTriggerStateMachine.html -- diff --git a/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/class-use/TriggerStateMachine.OnceTriggerStateMachine.html b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/class-use/TriggerStateMachine.OnceTriggerStateMachine.html new file mode 100644 index 000..a006507 --- /dev/null +++ b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/class-use/TriggerStateMachine.OnceTriggerStateMachine.html @@ -0,0 +1,297 @@ +http://www.w3.org/TR/html4/loose.dtd;> + + + + + +Uses of Class org.apache.beam.runners.core.triggers.TriggerStateMachine.OnceTriggerStateMachine (Apache Beam SDK for Java, version 0.3.0-incubating) + + + + + + + + +JavaScript is disabled on your browser. + + + + + +Skip navigation links + + + + +Overview +Package +Class +Use +Tree +Deprecated +Index +Help + + + + +Prev +Next + + +Frames +NoFrames + + +AllClasses + + + + + + + + + + +Uses of Classorg.apache.beam.runners.core.triggers.TriggerStateMachine.OnceTriggerStateMachine + + + + + +Packages that use TriggerStateMachine.OnceTriggerStateMachine + +Package +Description + + + +org.apache.beam.runners.core.triggers + +State machine implementations for triggers, called "triggers" because + they react to events. + + + + + + + + + + +Uses of TriggerStateMachine.OnceTriggerStateMachine in org.apache.beam.runners.core.triggers + +Subclasses of TriggerStateMachine.OnceTriggerStateMachine in org.apache.beam.runners.core.triggers + +Modifier and Type +Class and Description + + + +class +AfterAllStateMachine +A TriggerStateMachine that fires and finishes once after all of its sub-triggers + have fired. + + + +class +AfterDelayFromFirstElementStateMachine +A base class for triggers that happen after a processing time delay from the arrival + of the first element in a pane. + + + +class +AfterFirstStateMachine +Create a composite TriggerStateMachine that fires once after at least one of its + sub-triggers have fired. + + + +class +AfterPaneStateMachine +TriggerStateMachines that fire based on properties of the elements in the current pane. + + + +class +AfterProcessingTimeStateMachine +AfterProcessingTime triggers fire based on the current processing time. + + + +static class +AfterWatermarkStateMachine.FromEndOfWindow +A watermark trigger targeted relative to the end of the window. + + + +class +NeverStateMachine +A TriggerStateMachine which never fires. + + + + + +Methods in org.apache.beam.runners.core.triggers that return TriggerStateMachine.OnceTriggerStateMachine + +Modifier and Type +Method and Description + + + +static TriggerStateMachine.OnceTriggerStateMachine +AfterFirstStateMachine.of(http://docs.oracle.com/javase/7/docs/api/java/lang/Iterable.html?is-external=true; title="class or interface in java.lang">Iterable? extends TriggerStateMachinetriggers) + + +static TriggerStateMachine.OnceTriggerStateMachine +AfterAllStateMachine.of(http://docs.oracle.com/javase/7/docs/api/java/lang/Iterable.html?is-external=true; title="class or interface in java.lang">Iterable? extends TriggerStateMachinetriggers) + + +static TriggerStateMachine.OnceTriggerStateMachine +AfterFirstStateMachine.of(TriggerStateMachine.OnceTriggerStateMachine...triggers) +Returns an AfterFirst Trigger with the given subtriggers. + + + +static TriggerStateMachine.OnceTriggerStateMachine +AfterAllStateMachine.of(TriggerStateMachine.OnceTriggerStateMachine...triggers) +Returns an AfterAll Trigger with the given subtriggers. + + + +static TriggerStateMachine.OnceTriggerStateMachine +TriggerStateMachines.stateMachineForOnceTrigger(Trigger.OnceTriggertrigger) + + + + +Methods in org.apache.beam.runners.core.triggers with parameters of type TriggerStateMachine.OnceTriggerStateMachine + +Modifier and Type +Method and Description + + + +static W extends BoundedWindowExecutableTriggerStateMachine +ExecutableTriggerStateMachine.createForOnceTrigger(TriggerStateMachine.OnceTriggerStateMachinetrigger, +intnextUnusedIndex) + + +static TriggerStateMachine.OnceTriggerStateMachine
[03/51] [abbrv] [partial] incubator-beam-site git commit: Rebuild site
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/dataflow/options/DataflowPipelineDebugOptions.html
--
diff --git
a/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/dataflow/options/DataflowPipelineDebugOptions.html
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/dataflow/options/DataflowPipelineDebugOptions.html
new file mode 100644
index 000..d73561f
--- /dev/null
+++
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/dataflow/options/DataflowPipelineDebugOptions.html
@@ -0,0 +1,685 @@
+http://www.w3.org/TR/html4/loose.dtd;>
+
+
+
+
+
+DataflowPipelineDebugOptions (Apache Beam SDK for Java, version
0.3.0-incubating)
+
+
+
+
+
+
+var methods =
{"i0":6,"i1":6,"i2":6,"i3":6,"i4":6,"i5":6,"i6":6,"i7":6,"i8":6,"i9":6,"i10":6,"i11":6,"i12":6,"i13":6,"i14":6,"i15":6,"i16":6,"i17":6,"i18":6,"i19":6,"i20":6,"i21":6,"i22":6,"i23":6,"i24":6,"i25":6};
+var tabs = {65535:["t0","All Methods"],2:["t2","Instance
Methods"],4:["t3","Abstract Methods"]};
+var altColor = "altColor";
+var rowColor = "rowColor";
+var tableTab = "tableTab";
+var activeTableTab = "activeTableTab";
+
+
+JavaScript is disabled on your browser.
+
+
+
+
+
+Skip navigation links
+
+
+
+
+Overview
+Package
+Class
+Use
+Tree
+Deprecated
+Index
+Help
+
+
+
+
+PrevClass
+NextClass
+
+
+Frames
+NoFrames
+
+
+AllClasses
+
+
+
+
+
+
+
+Summary:
+Nested|
+Field|
+Constr|
+Method
+
+
+Detail:
+Field|
+Constr|
+Method
+
+
+
+
+
+
+
+
+org.apache.beam.runners.dataflow.options
+Interface
DataflowPipelineDebugOptions
+
+
+
+
+
+
+All Superinterfaces:
+HasDisplayData, PipelineOptions
+
+
+All Known Subinterfaces:
+BlockingDataflowPipelineOptions,
DataflowPipelineOptions, DataflowWorkerHarnessOptions, TestDataflowPipelineOptions
+
+
+
+@Hidden
+public interface DataflowPipelineDebugOptions
+extends PipelineOptions
+Internal. Options used to control execution of the Dataflow
SDK for
+ debugging and testing purposes.
+
+
+
+
+
+
+
+
+
+
+
+Nested Class Summary
+
+Nested Classes
+
+Modifier and Type
+Interface and Description
+
+
+static class
+DataflowPipelineDebugOptions.DataflowClientFactory
+Returns the default Dataflow client built from the passed
in PipelineOptions.
+
+
+
+static class
+DataflowPipelineDebugOptions.StagerFactory
+Creates a Stager object using the
class specified in
+ getStagerClass().
+
+
+
+
+
+
+
+Nested classes/interfaces inherited from
interfaceorg.apache.beam.sdk.options.PipelineOptions
+PipelineOptions.AtomicLongFactory, PipelineOptions.CheckEnabled,
PipelineOptions.DirectRunner,
PipelineOptions.JobNameFactory
+
+
+
+
+
+
+
+
+Method Summary
+
+All MethodsInstance MethodsAbstract Methods
+
+Modifier and Type
+Method and Description
+
+
+http://docs.oracle.com/javase/7/docs/api/java/lang/String.html?is-external=true;
title="class or interface in java.lang">String
+getApiRootUrl()
+The root URL for the Dataflow API.
+
+
+
+com.google.api.services.dataflow.Dataflow
+getDataflowClient()
+An instance of the Dataflow client.
+
+
+
+http://docs.oracle.com/javase/7/docs/api/java/lang/String.html?is-external=true;
title="class or interface in java.lang">String
+getDataflowEndpoint()
+Dataflow endpoint to use.
+
+
+
+http://docs.oracle.com/javase/7/docs/api/java/lang/String.html?is-external=true;
title="class or interface in java.lang">String
+getDataflowJobFile()
+The path to write the translated Dataflow job specification
out to
+ at job submission time.
+
+
+
+boolean
+getDumpHeapOnOOM()
+If true, save a heap dump before killing a thread or
process which is GC
+ thrashing or out of memory.
+
+
+
+http://docs.oracle.com/javase/7/docs/api/java/util/List.html?is-external=true;
title="class or interface in java.util">Listhttp://docs.oracle.com/javase/7/docs/api/java/lang/String.html?is-external=true;
title="class or interface in java.lang">String
+getExperiments()
+The list of backend experiments to enable.
+
+
+
+int
+getNumberOfWorkerHarnessThreads()
+Number of threads to use on the Dataflow worker
harness.
+
+
+
+http://docs.oracle.com/javase/7/docs/api/java/lang/String.html?is-external=true;
title="class or interface in java.lang">String
+getOverrideWindmillBinary()
+Custom windmill_main binary to use with the streaming
runner.
+
+
+
+Stager
+getStager()
+The resource stager instance that should be used to stage
resources.
+
+
+
[37/51] [abbrv] [partial] incubator-beam-site git commit: Rebuild site
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/ReduceFn.OnMergeContext.html
--
diff --git
a/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/ReduceFn.OnMergeContext.html
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/ReduceFn.OnMergeContext.html
new file mode 100644
index 000..0d5acad
--- /dev/null
+++
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/ReduceFn.OnMergeContext.html
@@ -0,0 +1,297 @@
+http://www.w3.org/TR/html4/loose.dtd;>
+
+
+
+
+
+ReduceFn.OnMergeContext (Apache Beam SDK for Java, version
0.3.0-incubating)
+
+
+
+
+
+
+var methods = {"i0":6};
+var tabs = {65535:["t0","All Methods"],2:["t2","Instance
Methods"],4:["t3","Abstract Methods"]};
+var altColor = "altColor";
+var rowColor = "rowColor";
+var tableTab = "tableTab";
+var activeTableTab = "activeTableTab";
+
+
+JavaScript is disabled on your browser.
+
+
+
+
+
+Skip navigation links
+
+
+
+
+Overview
+Package
+Class
+Use
+Tree
+Deprecated
+Index
+Help
+
+
+
+
+PrevClass
+NextClass
+
+
+Frames
+NoFrames
+
+
+AllClasses
+
+
+
+
+
+
+
+Summary:
+Nested|
+Field|
+Constr|
+Method
+
+
+Detail:
+Field|
+Constr|
+Method
+
+
+
+
+
+
+
+
+org.apache.beam.runners.core
+Class
ReduceFn.OnMergeContext
+
+
+
+http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true;
title="class or interface in java.lang">java.lang.Object
+
+
+org.apache.beam.runners.core.ReduceFn.Context
+
+
+org.apache.beam.runners.core.ReduceFn.OnMergeContext
+
+
+
+
+
+
+
+
+
+Enclosing class:
+ReduceFnK,InputT,OutputT,W extends BoundedWindow
+
+
+
+public abstract class ReduceFn.OnMergeContext
+extends ReduceFn.Context
+Information accessible within ReduceFn.onMerge(org.apache.beam.runners.core.ReduceFnK,
InputT, OutputT, W.OnMergeContext).
+
+
+
+
+
+
+
+
+
+
+
+Constructor Summary
+
+Constructors
+
+Constructor and Description
+
+
+OnMergeContext()
+
+
+
+
+
+
+
+
+
+Method Summary
+
+All MethodsInstance MethodsAbstract Methods
+
+Modifier and Type
+Method and Description
+
+
+abstract MergingStateAccessorK,W
+state()
+Return the interface for accessing state.
+
+
+
+
+
+
+
+Methods inherited from classorg.apache.beam.runners.core.ReduceFn.Context
+key,
timers,
window,
windowingStrategy
+
+
+
+
+
+Methods inherited from classjava.lang.http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true;
title="class or interface in java.lang">Object
+http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#clone--;
title="class or interface in java.lang">clone, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#equals-java.lang.Object-;
title="class or interface in java.lang">equals, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#finalize--;
title="class or interface in java.lang">finalize, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#getClass--;
title="class or interface in java.lang">getClass, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#hashCode--;
title="class or interface in java.lang">hashCode, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#notify--;
title="class or interface in java.lang">notify, http://docs.oracle.com/javase/7/docs/api/java/lang
/Object.html?is-external=true#notifyAll--" title="class or interface in
java.lang">notifyAll, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#toString--;
title="class or interface in java.lang">toString, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#wait--;
title="class or interface in java.lang">wait, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#wait-long-;
title="class or interface in java.lang">wait, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#wait-long-int-;
title="class or interface in java.lang">wait
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+Constructor Detail
+
+
+
+
+
+OnMergeContext
+publicOnMergeContext()
+
+
+
+
+
+
+
+
+
+Method Detail
+
+
+
+
+
+state
+public abstractMergingStateAccessorK,Wstate()
+Return the interface for accessing state.
+
+Specified by:
+statein
classReduceFn.Context
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+Skip navigation links
+
+
+
+
+Overview
[35/51] [abbrv] [partial] incubator-beam-site git commit: Rebuild site
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/SplittableParDo.html
--
diff --git
a/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/SplittableParDo.html
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/SplittableParDo.html
new file mode 100644
index 000..3b7e8db
--- /dev/null
+++
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/SplittableParDo.html
@@ -0,0 +1,345 @@
+http://www.w3.org/TR/html4/loose.dtd;>
+
+
+
+
+
+SplittableParDo (Apache Beam SDK for Java, version
0.3.0-incubating)
+
+
+
+
+
+
+var methods = {"i0":10};
+var tabs = {65535:["t0","All Methods"],2:["t2","Instance
Methods"],8:["t4","Concrete Methods"]};
+var altColor = "altColor";
+var rowColor = "rowColor";
+var tableTab = "tableTab";
+var activeTableTab = "activeTableTab";
+
+
+JavaScript is disabled on your browser.
+
+
+
+
+
+Skip navigation links
+
+
+
+
+Overview
+Package
+Class
+Use
+Tree
+Deprecated
+Index
+Help
+
+
+
+
+PrevClass
+NextClass
+
+
+Frames
+NoFrames
+
+
+AllClasses
+
+
+
+
+
+
+
+Summary:
+Nested|
+Field|
+Constr|
+Method
+
+
+Detail:
+Field|
+Constr|
+Method
+
+
+
+
+
+
+
+
+org.apache.beam.runners.core
+Class
SplittableParDoInputT,OutputT,RestrictionT,TrackerT extends RestrictionTrackerRestrictionT
+
+
+
+http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true;
title="class or interface in java.lang">java.lang.Object
+
+
+org.apache.beam.sdk.transforms.PTransformPCollectionInputT,PCollectionOutputT
+
+
+org.apache.beam.runners.core.SplittableParDoInputT,OutputT,RestrictionT,TrackerT
+
+
+
+
+
+
+
+
+
+All Implemented Interfaces:
+http://docs.oracle.com/javase/7/docs/api/java/io/Serializable.html?is-external=true;
title="class or interface in java.io">Serializable, HasDisplayData
+
+
+
+@Experimental(value=SPLITTABLE_DO_FN)
+public class SplittableParDoInputT,OutputT,RestrictionT,TrackerT
extends RestrictionTrackerRestrictionT
+extends PTransformPCollectionInputT,PCollectionOutputT
+A utility transform that executes a https://s.apache.org/splittable-do-fn;>splittable DoFn by expanding it into a
+ network of simpler transforms:
+
+
+ Pair each element with an initial restriction
+ Split each restriction into sub-restrictions
+ Assign a unique key to each element/restriction pair
+ Group by key (so that work is partitioned by key and we can access
state/timers)
+ Process each keyed element/restriction pair with the splittable DoFn's
DoFn.ProcessElement method, using state and timers API.
+
+
+ This transform is intended as a helper for internal use by runners when
implementing ParDo.of(splittable DoFn), but not for direct use by
pipeline writers.
+
+See Also:
+Serialized
Form
+
+
+
+
+
+
+
+
+
+
+
+
+Field Summary
+
+
+
+
+Fields inherited from classorg.apache.beam.sdk.transforms.PTransform
+name
+
+
+
+
+
+
+
+
+Constructor Summary
+
+Constructors
+
+Constructor and Description
+
+
+SplittableParDo(DoFnInputT,OutputTfn)
+Creates the transform for the given original ParDo and DoFn.
+
+
+
+
+
+
+
+
+
+
+Method Summary
+
+All MethodsInstance MethodsConcrete Methods
+
+Modifier and Type
+Method and Description
+
+
+PCollectionOutputT
+apply(PCollectionInputTinput)
+Applies this PTransform on the given
InputT, and returns its
+ Output.
+
+
+
+
+
+
+
+Methods inherited from classorg.apache.beam.sdk.transforms.PTransform
+getDefaultOutputCoder,
getDefaultOutputCoder,
getDefaultOutputCoder,
getKindString,
getName,
populateDisplayData,
toString,
valida
te
+
+
+
+
+
+Methods inherited from classjava.lang.http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true;
title="class or interface in java.lang">Object
+http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#clone--;
title="class or interface in java.lang">clone, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#equals-java.lang.Object-;
title="class or interface in java.lang">equals, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#finalize--;
title="class or interface in java.lang">finalize, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#getClass--;
title="class or interface in java.lang">getClass, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#hashCode--;
[13/51] [abbrv] [partial] incubator-beam-site git commit: Rebuild site
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/class-use/TriggerStateMachine.html -- diff --git a/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/class-use/TriggerStateMachine.html b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/class-use/TriggerStateMachine.html new file mode 100644 index 000..68c075f --- /dev/null +++ b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/class-use/TriggerStateMachine.html @@ -0,0 +1,386 @@ +http://www.w3.org/TR/html4/loose.dtd;> + + + + + +Uses of Class org.apache.beam.runners.core.triggers.TriggerStateMachine (Apache Beam SDK for Java, version 0.3.0-incubating) + + + + + + + + +JavaScript is disabled on your browser. + + + + + +Skip navigation links + + + + +Overview +Package +Class +Use +Tree +Deprecated +Index +Help + + + + +Prev +Next + + +Frames +NoFrames + + +AllClasses + + + + + + + + + + +Uses of Classorg.apache.beam.runners.core.triggers.TriggerStateMachine + + + + + +Packages that use TriggerStateMachine + +Package +Description + + + +org.apache.beam.runners.core.triggers + +State machine implementations for triggers, called "triggers" because + they react to events. + + + + + + + + + + +Uses of TriggerStateMachine in org.apache.beam.runners.core.triggers + +Subclasses of TriggerStateMachine in org.apache.beam.runners.core.triggers + +Modifier and Type +Class and Description + + + +class +AfterAllStateMachine +A TriggerStateMachine that fires and finishes once after all of its sub-triggers + have fired. + + + +class +AfterDelayFromFirstElementStateMachine +A base class for triggers that happen after a processing time delay from the arrival + of the first element in a pane. + + + +class +AfterEachStateMachine +A composite TriggerStateMachine that executes its sub-triggers in order. + + + +class +AfterFirstStateMachine +Create a composite TriggerStateMachine that fires once after at least one of its + sub-triggers have fired. + + + +class +AfterPaneStateMachine +TriggerStateMachines that fire based on properties of the elements in the current pane. + + + +class +AfterProcessingTimeStateMachine +AfterProcessingTime triggers fire based on the current processing time. + + + +static class +AfterWatermarkStateMachine.AfterWatermarkEarlyAndLate + + +static class +AfterWatermarkStateMachine.FromEndOfWindow +A watermark trigger targeted relative to the end of the window. + + + +class +DefaultTriggerStateMachine +A trigger that is equivalent to Repeatedly.forever(AfterWatermark.pastEndOfWindow()). + + + +class +NeverStateMachine +A TriggerStateMachine which never fires. + + + +class +RepeatedlyStateMachine +Repeat a trigger, either until some condition is met or forever. + + + +class +ReshuffleTriggerStateMachine +The trigger used with Reshuffle which triggers on every element + and never buffers state. + + + +static class +TriggerStateMachine.OnceTriggerStateMachine +TriggerStateMachines that are guaranteed to fire at most once should extend from this, + rather than the general TriggerStateMachine class to indicate that behavior. + + + + + +Fields in org.apache.beam.runners.core.triggers with type parameters of type TriggerStateMachine + +Modifier and Type +Field and Description + + + +protected http://docs.oracle.com/javase/7/docs/api/java/util/List.html?is-external=true; title="class or interface in java.util">ListTriggerStateMachine +TriggerStateMachine.subTriggers + + + + +Methods in org.apache.beam.runners.core.triggers that return TriggerStateMachine + +Modifier and Type +Method and Description + + + +TriggerStateMachine +ExecutableTriggerStateMachine.getSpec() +Return the underlying trigger specification corresponding to this ExecutableTrigger. + + + +static TriggerStateMachine +AfterEachStateMachine.inOrder(http://docs.oracle.com/javase/7/docs/api/java/lang/Iterable.html?is-external=true; title="class or interface in java.lang">Iterable? extends TriggerStateMachinetriggers) + + +static TriggerStateMachine +AfterEachStateMachine.inOrder(TriggerStateMachine...triggers) +Returns an AfterEach Trigger with the given subtriggers. + + + +TriggerStateMachine +TriggerStateMachine.orFinally(TriggerStateMachine.OnceTriggerStateMachineuntil) +Specify an ending condition for
[39/51] [abbrv] [partial] incubator-beam-site git commit: Rebuild site
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/GroupByKeyViaGroupByKeyOnly.html
--
diff --git
a/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/GroupByKeyViaGroupByKeyOnly.html
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/GroupByKeyViaGroupByKeyOnly.html
new file mode 100644
index 000..77382b0
--- /dev/null
+++
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/GroupByKeyViaGroupByKeyOnly.html
@@ -0,0 +1,383 @@
+http://www.w3.org/TR/html4/loose.dtd;>
+
+
+
+
+
+GroupByKeyViaGroupByKeyOnly (Apache Beam SDK for Java, version
0.3.0-incubating)
+
+
+
+
+
+
+var methods = {"i0":10};
+var tabs = {65535:["t0","All Methods"],2:["t2","Instance
Methods"],8:["t4","Concrete Methods"]};
+var altColor = "altColor";
+var rowColor = "rowColor";
+var tableTab = "tableTab";
+var activeTableTab = "activeTableTab";
+
+
+JavaScript is disabled on your browser.
+
+
+
+
+
+Skip navigation links
+
+
+
+
+Overview
+Package
+Class
+Use
+Tree
+Deprecated
+Index
+Help
+
+
+
+
+PrevClass
+NextClass
+
+
+Frames
+NoFrames
+
+
+AllClasses
+
+
+
+
+
+
+
+Summary:
+Nested|
+Field|
+Constr|
+Method
+
+
+Detail:
+Field|
+Constr|
+Method
+
+
+
+
+
+
+
+
+org.apache.beam.runners.core
+Class
GroupByKeyViaGroupByKeyOnlyK,V
+
+
+
+http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true;
title="class or interface in java.lang">java.lang.Object
+
+
+org.apache.beam.sdk.transforms.PTransformPCollectionKVK,V,PCollectionKVK,http://docs.oracle.com/javase/7/docs/api/java/lang/Iterable.html?is-external=true;
title="class or interface in java.lang">IterableV
+
+
+org.apache.beam.runners.core.GroupByKeyViaGroupByKeyOnlyK,V
+
+
+
+
+
+
+
+
+
+All Implemented Interfaces:
+http://docs.oracle.com/javase/7/docs/api/java/io/Serializable.html?is-external=true;
title="class or interface in java.io">Serializable, HasDisplayData
+
+
+
+public class GroupByKeyViaGroupByKeyOnlyK,V
+extends PTransformPCollectionKVK,V,PCollectionKVK,http://docs.oracle.com/javase/7/docs/api/java/lang/Iterable.html?is-external=true;
title="class or interface in java.lang">IterableV
+An implementation of GroupByKey
built on top of a lower-level GroupByKeyViaGroupByKeyOnly.GroupByKeyOnly
+ primitive.
+
+ This implementation of GroupByKey
proceeds via the following steps:
+
+ ReifyTimestampsAndWindowsDoFn
ParDo(ReifyTimestampsAndWindows): This embeds
+ the previously-implicit timestamp and window into the elements
themselves, so a
+ window-and-timestamp-unaware transform can operate on them.
+ GroupByKeyOnly: This lower-level primitive groups by keys,
ignoring windows
+ and timestamps. Many window-unaware runners have such a primitive
already.
+ SortValuesByTimestamp ParDo(SortValuesByTimestamp): The
values in the iterables
+ output by GroupByKeyViaGroupByKeyOnly.GroupByKeyOnly
are sorted by timestamp.
+ GroupAlsoByWindow: This primitive processes the sorted
values. Today it is
+ implemented as a ParDo that calls reserved
internal methods.
+
+
+ This implementation of GroupByKey has
severe limitations unless its component
+ transforms are replaced. As-is, it is only applicable for in-memory runners
using a batch-style
+ execution strategy. Specifically:
+
+
+ Every iterable output by GroupByKeyViaGroupByKeyOnly.GroupByKeyOnly
must contain all elements for that key.
+ A streaming-style partition, with multiple elements for the same key,
will not yield
+ correct results.
+ Sorting of values by timestamp is performed on an in-memory list. It
will not succeed
+ for large iterables.
+ The implementation of GroupAlsoByWindow does not support
timers. This is only
+ appropriate for runners which also do not support timers.
+
+
+See Also:
+Serialized
Form
+
+
+
+
+
+
+
+
+
+
+
+
+Nested Class Summary
+
+Nested Classes
+
+Modifier and Type
+Class and Description
+
+
+static class
+GroupByKeyViaGroupByKeyOnly.GroupAlsoByWindowK,V
+Runner-specific primitive that takes a collection of
timestamp-ordered values associated with
+ each key, groups the values by window, merges windows as needed, and for each
window in each
+ key, outputs a collection of key/value-list pairs implicitly assigned to the
window and with
+ the timestamp derived from that window.
+
+
+
+static class
[47/51] [abbrv] [partial] incubator-beam-site git commit: Rebuild site
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/constant-values.html -- diff --git a/content/learn/sdks/javadoc/0.3.0-incubating/constant-values.html b/content/learn/sdks/javadoc/0.3.0-incubating/constant-values.html new file mode 100644 index 000..24eac64 --- /dev/null +++ b/content/learn/sdks/javadoc/0.3.0-incubating/constant-values.html @@ -0,0 +1,1260 @@ +http://www.w3.org/TR/html4/loose.dtd;> + + + + + +Constant Field Values (Apache Beam SDK for Java, version 0.3.0-incubating) + + + + + + + + +JavaScript is disabled on your browser. + + + + + +Skip navigation links + + + + +Overview +Package +Class +Use +Tree +Deprecated +Index +Help + + + + +Prev +Next + + +Frames +NoFrames + + +AllClasses + + + + + + + + + + +Constant Field Values +Contents + +org.apache.* + + + + + +org.apache.* + + + +org.apache.beam.runners.core.GroupAlsoByWindowsDoFnK,InputT,OutputT,W extends BoundedWindow + +Modifier and Type +Constant Field +Value + + + + + +publicstaticfinalhttp://docs.oracle.com/javase/7/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String +DROPPED_DUE_TO_CLOSED_WINDOW_COUNTER +"DroppedDueToClosedWindow" + + + + +publicstaticfinalhttp://docs.oracle.com/javase/7/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String +DROPPED_DUE_TO_LATENESS_COUNTER +"DroppedDueToLateness" + + + + + + + + +org.apache.beam.runners.dataflow.DataflowRunner + +Modifier and Type +Constant Field +Value + + + + + +publicstaticfinalhttp://docs.oracle.com/javase/7/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String +BATCH_WORKER_HARNESS_CONTAINER_IMAGE +"dataflow.gcr.io/v1beta3/beam-java-batch:beam-master-20161017" + + + + +publicstaticfinalhttp://docs.oracle.com/javase/7/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String +PROJECT_ID_REGEXP +"[a-z][-a-z0-9:.]+[a-z0-9]" + + + + +publicstaticfinalhttp://docs.oracle.com/javase/7/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String +STREAMING_WORKER_HARNESS_CONTAINER_IMAGE +"dataflow.gcr.io/v1beta3/beam-java-streaming:beam-master-20161017" + + + + + + + + +org.apache.beam.runners.dataflow.util.OutputReference + +Modifier and Type +Constant Field +Value + + + + + +publicfinalhttp://docs.oracle.com/javase/7/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String +type +"OutputReference" + + + + + + +org.apache.beam.runners.dataflow.util.PackageUtil + +Modifier and Type +Constant Field +Value + + + + + +publicstaticfinalint +SANE_CLASSPATH_SIZE +1000 + + + + + + + + +org.apache.beam.runners.spark.io.hadoop.ShardNameTemplateHelper + +Modifier and Type +Constant Field +Value + + + + + +publicstaticfinalhttp://docs.oracle.com/javase/7/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String +OUTPUT_FILE_PREFIX +"spark.beam.fileoutputformat.prefix" + + + + +publicstaticfinalhttp://docs.oracle.com/javase/7/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String +OUTPUT_FILE_SUFFIX +"spark.beam.fileoutputformat.suffix" + + + + +publicstaticfinalhttp://docs.oracle.com/javase/7/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String +OUTPUT_FILE_TEMPLATE +"spark.beam.fileoutputformat.template" + + + + + + + + +org.apache.beam.runners.spark.util.BroadcastHelperT + +Modifier and Type +Constant Field +Value + + + + + +publicstaticfinalhttp://docs.oracle.com/javase/7/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String +DIRECT_BROADCAST +"beam.spark.directBroadcast" + + + + + + + + +org.apache.beam.sdk.io.BoundedSource.BoundedReaderT + +Modifier and Type +Constant Field +Value + + + + + +publicstaticfinallong +SPLIT_POINTS_UNKNOWN +-1L + + + + + + +org.apache.beam.sdk.io.FileBasedSink.FileBasedWriteOperationT + +Modifier and Type +Constant Field +Value + + + + + +protectedstaticfinalhttp://docs.oracle.com/javase/7/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String +TEMPORARY_FILENAME_SEPARATOR +"-temp-" + + + + + + +org.apache.beam.sdk.io.ShardNameTemplate + +Modifier and Type +Constant Field +Value + + + + +
[45/51] [abbrv] [partial] incubator-beam-site git commit: Rebuild site
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/index-all.html -- diff --git a/content/learn/sdks/javadoc/0.3.0-incubating/index-all.html b/content/learn/sdks/javadoc/0.3.0-incubating/index-all.html new file mode 100644 index 000..5df51c8 --- /dev/null +++ b/content/learn/sdks/javadoc/0.3.0-incubating/index-all.html @@ -0,0 +1,20643 @@ +http://www.w3.org/TR/html4/loose.dtd;> + + + + + +Index (Apache Beam SDK for Java, version 0.3.0-incubating) + + + + + + + + +JavaScript is disabled on your browser. + + + + + +Skip navigation links + + + + +Overview +Package +Class +Use +Tree +Deprecated +Index +Help + + + + +Prev +Next + + +Frames +NoFrames + + +AllClasses + + + + + + + + + +ABCDEFGHIJKLMNOPQRSTUVWXYZ + + +A + +absolute(String, String...) - Static method in class org.apache.beam.sdk.transforms.display.DisplayData.Path + +Construct a path from an absolute component path hierarchy. + +access(StateTag? super K, StateT) - Method in interface org.apache.beam.sdk.util.state.StateAccessor + +Access the storage for the given address in the current window. + +accessInEachMergingWindow(StateTag? super K, StateT) - Method in interface org.apache.beam.sdk.util.state.MergingStateAccessor + +Analogous to StateAccessor.access(org.apache.beam.sdk.util.state.StateTag? super K, StateT), but returned as a map from each window which is + about to be merged to the corresponding state. + +AccumulatingCombineFn() - Constructor for class org.apache.beam.sdk.transforms.Combine.AccumulatingCombineFn + +accumulatingFiredPanes() - Static method in class org.apache.beam.sdk.transforms.windowing.Window + +Returns a new Window PTransform that uses the registered WindowFn and + Triggering behavior, and that accumulates elements in a pane after they are triggered. + +accumulatingFiredPanes() - Method in class org.apache.beam.sdk.transforms.windowing.Window.Bound + +Returns a new Window PTransform that uses the registered WindowFn and + Triggering behavior, and that accumulates elements in a pane after they are triggered. + +accumulatingFiredPanes() - Method in class org.apache.beam.sdk.transforms.windowing.Window.Unbound + +Returns a new Window PTransform that uses the registered WindowFn and + Triggering behavior, and that accumulates elements in a pane after they are triggered. + +AccumulatorCombiningStateInputT,AccumT,OutputT - Interface in org.apache.beam.sdk.util.state + +State for a single value that is managed by a Combine.CombineFn. + +AccumulatorSingleton - Class in org.apache.beam.runners.spark.aggregators + +For resilience, Accumulators are required to be wrapped in a Singleton. + +AccumulatorSingleton() - Constructor for class org.apache.beam.runners.spark.aggregators.AccumulatorSingleton + +ackDeadlineSeconds(PubsubClient.SubscriptionPath) - Method in class org.apache.beam.sdk.util.PubsubClient + +Return the ack deadline, in seconds, for subscription. + +ackDeadlineSeconds(PubsubClient.SubscriptionPath) - Method in class org.apache.beam.sdk.util.PubsubGrpcClient + +ackDeadlineSeconds(PubsubClient.SubscriptionPath) - Method in class org.apache.beam.sdk.util.PubsubJsonClient + +ackDeadlineSeconds(PubsubClient.SubscriptionPath) - Method in class org.apache.beam.sdk.util.PubsubTestClient + +ackId - Variable in class org.apache.beam.sdk.util.PubsubClient.IncomingMessage + +Id to pass back to Pubsub to acknowledge receipt of this message. + +acknowledge(PubsubClient.SubscriptionPath, ListString) - Method in class org.apache.beam.sdk.util.PubsubClient + +Acknowldege messages from subscription with ackIds. + +acknowledge(PubsubClient.SubscriptionPath, ListString) - Method in class org.apache.beam.sdk.util.PubsubGrpcClient + +acknowledge(PubsubClient.SubscriptionPath, ListString) - Method in class org.apache.beam.sdk.util.PubsubJsonClient + +acknowledge(PubsubClient.SubscriptionPath, ListString) - Method in class org.apache.beam.sdk.util.PubsubTestClient + +ActiveWindowSetW extends BoundedWindow - Interface in org.apache.beam.sdk.util + +Track which windows are active, and the state address window(s) under which their + state is stored. + +ActiveWindowSet.MergeCallbackW extends BoundedWindow - Interface in org.apache.beam.sdk.util + +Callback for ActiveWindowSet.merge(org.apache.beam.sdk.util.ActiveWindowSet.MergeCallbackW). + +adaptContext(OldDoFnInputT, OutputT, DoFnInputT, OutputT.Context) - Static method in class
[32/51] [abbrv] [partial] incubator-beam-site git commit: Rebuild site
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/class-use/GBKIntoKeyedWorkItems.html -- diff --git a/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/class-use/GBKIntoKeyedWorkItems.html b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/class-use/GBKIntoKeyedWorkItems.html new file mode 100644 index 000..0daf469 --- /dev/null +++ b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/class-use/GBKIntoKeyedWorkItems.html @@ -0,0 +1,126 @@ +http://www.w3.org/TR/html4/loose.dtd;> + + + + + +Uses of Class org.apache.beam.runners.core.GBKIntoKeyedWorkItems (Apache Beam SDK for Java, version 0.3.0-incubating) + + + + + + + + +JavaScript is disabled on your browser. + + + + + +Skip navigation links + + + + +Overview +Package +Class +Use +Tree +Deprecated +Index +Help + + + + +Prev +Next + + +Frames +NoFrames + + +AllClasses + + + + + + + + + + +Uses of Classorg.apache.beam.runners.core.GBKIntoKeyedWorkItems + +No usage of org.apache.beam.runners.core.GBKIntoKeyedWorkItems + + + + +Skip navigation links + + + + +Overview +Package +Class +Use +Tree +Deprecated +Index +Help + + + + +Prev +Next + + +Frames +NoFrames + + +AllClasses + + + + + + + + + +Copyright 2016 http://www.apache.org/;>The Apache Software Foundation. All rights reserved. + + http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/class-use/GroupAlsoByWindowViaWindowSetDoFn.html -- diff --git a/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/class-use/GroupAlsoByWindowViaWindowSetDoFn.html b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/class-use/GroupAlsoByWindowViaWindowSetDoFn.html new file mode 100644 index 000..d2fe5fb --- /dev/null +++ b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/class-use/GroupAlsoByWindowViaWindowSetDoFn.html @@ -0,0 +1,126 @@ +http://www.w3.org/TR/html4/loose.dtd;> + + + + + +Uses of Class org.apache.beam.runners.core.GroupAlsoByWindowViaWindowSetDoFn (Apache Beam SDK for Java, version 0.3.0-incubating) + + + + + + + + +JavaScript is disabled on your browser. + + + + + +Skip navigation links + + + + +Overview +Package +Class +Use +Tree +Deprecated +Index +Help + + + + +Prev +Next + + +Frames +NoFrames + + +AllClasses + + + + + + + + + + +Uses of Classorg.apache.beam.runners.core.GroupAlsoByWindowViaWindowSetDoFn + +No usage of org.apache.beam.runners.core.GroupAlsoByWindowViaWindowSetDoFn + + + + +Skip navigation links + + + + +Overview +Package +Class +Use +Tree +Deprecated +Index +Help + + + + +Prev +Next + + +Frames +NoFrames + + +AllClasses + + + + + + + + + +Copyright 2016 http://www.apache.org/;>The Apache Software Foundation. All rights reserved. + + http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/class-use/GroupAlsoByWindowsDoFn.html -- diff --git a/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/class-use/GroupAlsoByWindowsDoFn.html
[48/51] [abbrv] [partial] incubator-beam-site git commit: Rebuild site
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/allclasses-noframe.html -- diff --git a/content/learn/sdks/javadoc/0.3.0-incubating/allclasses-noframe.html b/content/learn/sdks/javadoc/0.3.0-incubating/allclasses-noframe.html new file mode 100644 index 000..44afe79 --- /dev/null +++ b/content/learn/sdks/javadoc/0.3.0-incubating/allclasses-noframe.html @@ -0,0 +1,923 @@ +http://www.w3.org/TR/html4/loose.dtd;> + + + + + +All Classes (Apache Beam SDK for Java, version 0.3.0-incubating) + + + + + +AllClasses + + +AccumulatorCombiningState +AccumulatorSingleton +ActiveWindowSet +ActiveWindowSet.MergeCallback +AfterAll +AfterAllStateMachine +AfterDelayFromFirstElement +AfterDelayFromFirstElementStateMachine +AfterEach +AfterEachStateMachine +AfterFirst +AfterFirstStateMachine +AfterPane +AfterPaneStateMachine +AfterProcessingTime +AfterProcessingTimeStateMachine +AfterSynchronizedProcessingTime +AfterWatermark +AfterWatermark.AfterWatermarkEarlyAndLate +AfterWatermark.FromEndOfWindow +AfterWatermarkStateMachine +AfterWatermarkStateMachine.AfterWatermarkEarlyAndLate +AfterWatermarkStateMachine.FromEndOfWindow +AggAccumParam +Aggregator +Aggregator.AggregatorFactory +AggregatorContainer +AggregatorContainer.AggregatorKey +AggregatorContainer.Mutator +AggregatorMetric +AggregatorMetricSource +AggregatorRetrievalException +AggregatorRetriever +AggregatorValues +ApiSurface +AppEngineEnvironment +ApplicationNameOptions +AppliedCombineFn +AppliedPTransform +ApproximateQuantiles +ApproximateQuantiles.ApproximateQuantilesCombineFn +ApproximateUnique +ApproximateUnique.ApproximateUniqueCombineFn +ApproximateUnique.ApproximateUniqueCombineFn.LargestUnique +AssignWindows +AssignWindowsDoFn +AtomicCoder +AttemptAndTimeBoundedExponentialBackOff +AttemptAndTimeBoundedExponentialBackOff.ResetPolicy +AttemptBoundedExponentialBackOff +AvroCoder +AvroCoderBenchmark +AvroHDFSFileSource +AvroIO +AvroIO.Read +AvroIO.Read.Bound +AvroIO.Write +AvroIO.Write.Bound +AvroSource +AvroSource.AvroReader +AvroUtils +AvroUtils.AvroMetadata +AvroWrapperCoder +BagState +BaseExecutionContext +BaseExecutionContext.CreateStepContextFunction +BaseExecutionContext.StepContext +BigDecimalCoder +BigEndianIntegerCoder +BigEndianLongCoder +BigIntegerCoder +BigQueryIO +BigQueryIO.Read +BigQueryIO.Read.Bound +BigQueryIO.Write +BigQueryIO.Write.Bound +BigQueryIO.Write.CreateDisposition +BigQueryIO.Write.WriteDisposition +BigqueryMatcher +BigQueryOptions +BigtableIO +BigtableIO.Read +BigtableIO.Write +BigtableTestOptions +BitSetCoder +BlockBasedSource +BlockBasedSource.Block +BlockBasedSource.BlockBasedReader +BlockingDataflowPipelineOptions +BlockingDataflowRunner +BoundedReadFromUnboundedSource +BoundedSource +BoundedSource.BoundedReader +BoundedWindow +BroadcastHelper +BucketingFunction +BufferedElementCountingOutputStream +BundleFactory +ByteArray +ByteArrayCoder +ByteArrayCoderBenchmark +ByteCoder +ByteKey +ByteKeyRange +ByteKeyRangeTracker +ByteStringCoder +CalendarWindows +CalendarWindows.DaysWindows +CalendarWindows.MonthsWindows +CalendarWindows.YearsWindows +CannotProvideCoderException +CannotProvideCoderException.ReasonCode +Clock +CloudDebuggerOptions +CloudObject +CloudResourceManagerOptions +Coder +Coder.Context +Coder.NonDeterministicException +CoderException +CoderFactories +CoderFactory +CoderHelpers +CoderProperties +CoderProperties.TestElementByteSizeObserver +CoderProvider +CoderProviders +CoderRegistry +CoderUtils +CoGbkResult +CoGbkResult.CoGbkResultCoder +CoGbkResultSchema +CoGroupByKey +CollectionCoder +Combine +Combine.AccumulatingCombineFn +Combine.AccumulatingCombineFn.Accumulator +Combine.BinaryCombineDoubleFn +Combine.BinaryCombineFn +Combine.BinaryCombineIntegerFn +Combine.BinaryCombineLongFn +Combine.CombineFn +Combine.Globally +Combine.GloballyAsSingletonView +Combine.GroupedValues +Combine.Holder +Combine.IterableCombineFn +Combine.KeyedCombineFn +Combine.PerKey +Combine.PerKeyWithHotKeyFanout +Combine.SimpleCombineFn +CombineContextFactory +CombineFnBase +CombineFnBase.GlobalCombineFn +CombineFnBase.PerKeyCombineFn +CombineFns +CombineFns.CoCombineResult +CombineFns.ComposeCombineFnBuilder +CombineFns.ComposedCombineFn +CombineFns.ComposedCombineFnWithContext +CombineFns.ComposedKeyedCombineFn +CombineFns.ComposedKeyedCombineFnWithContext +CombineFns.ComposeKeyedCombineFnBuilder +CombineFnUtil +CombineWithContext +CombineWithContext.CombineFnWithContext +CombineWithContext.Context +CombineWithContext.KeyedCombineFnWithContext +CombineWithContext.RequiresContextInternal +CombiningState +CompressedSource +CompressedSource.CompressedReader +CompressedSource.CompressionMode +CompressedSource.DecompressingChannelFactory +ConsoleIO +ConsoleIO.Write +ConsoleIO.Write.Unbound +ConsumerTrackingPipelineVisitor +CopyOnAccessInMemoryStateInternals +Count +Count.PerElement +Counter +CountingInput
[51/51] [abbrv] [partial] incubator-beam-site git commit: Rebuild site
Rebuild site Project: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/commit/141627ec Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/tree/141627ec Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/diff/141627ec Branch: refs/heads/asf-site Commit: 141627ec4b6e57589deac52b284dcd4ed542e399 Parents: 1841a9a Author: Aljoscha Krettek <aljoscha.kret...@gmail.com> Authored: Mon Oct 31 17:18:16 2016 +0100 Committer: Aljoscha Krettek <aljoscha.kret...@gmail.com> Committed: Mon Oct 31 17:18:26 2016 +0100 -- .../contribute/contribution-guide/index.html|41 +- .../0.3.0-incubating/allclasses-frame.html | 923 + .../0.3.0-incubating/allclasses-noframe.html| 923 + .../0.3.0-incubating/constant-values.html | 1260 + .../0.3.0-incubating/deprecated-list.html | 552 + .../sdks/javadoc/0.3.0-incubating/help-doc.html | 231 + .../javadoc/0.3.0-incubating/index-all.html | 20643 + .../sdks/javadoc/0.3.0-incubating/index.html|75 + .../sdks/javadoc/0.3.0-incubating/javadoc.sh| 1 + .../learn/sdks/javadoc/0.3.0-incubating/options |24 + .../apache/beam/runners/core/AssignWindows.html | 331 + .../beam/runners/core/AssignWindowsDoFn.html| 341 + .../core/DoFnRunner.ReduceFnExecutor.html | 254 + .../apache/beam/runners/core/DoFnRunner.html| 288 + .../runners/core/DoFnRunners.OutputManager.html | 233 + .../apache/beam/runners/core/DoFnRunners.html | 453 + .../runners/core/ElementAndRestriction.html | 315 + .../core/ElementAndRestrictionCoder.html| 368 + .../runners/core/ElementByteSizeObservable.html | 267 + .../runners/core/GBKIntoKeyedWorkItems.html | 328 + .../core/GroupAlsoByWindowViaWindowSetDoFn.html | 413 + .../runners/core/GroupAlsoByWindowsDoFn.html| 419 + .../GroupAlsoByWindowsViaOutputBufferDoFn.html | 366 + ...yKeyViaGroupByKeyOnly.GroupAlsoByWindow.html | 371 + ...upByKeyViaGroupByKeyOnly.GroupByKeyOnly.html | 356 + .../core/GroupByKeyViaGroupByKeyOnly.html | 383 + .../core/LateDataDroppingDoFnRunner.html| 366 + .../apache/beam/runners/core/NonEmptyPanes.html | 348 + .../beam/runners/core/PaneInfoTracker.html | 316 + .../beam/runners/core/PeekingReiterator.html| 383 + .../core/PushbackSideInputDoFnRunner.html | 354 + .../beam/runners/core/ReduceFn.Context.html | 349 + .../runners/core/ReduceFn.OnMergeContext.html | 297 + .../runners/core/ReduceFn.OnTriggerContext.html | 311 + .../core/ReduceFn.ProcessValueContext.html | 309 + .../org/apache/beam/runners/core/ReduceFn.html | 471 + .../beam/runners/core/ReduceFnRunner.html | 401 + .../beam/runners/core/SideInputHandler.html | 437 + .../beam/runners/core/SimpleDoFnRunner.html | 369 + .../beam/runners/core/SplittableParDo.html | 345 + .../beam/runners/core/SystemReduceFn.html | 463 + ...dSource.BoundedToUnboundedSourceAdapter.html | 450 + .../core/UnboundedReadFromBoundedSource.html| 452 + .../runners/core/class-use/AssignWindows.html | 126 + .../core/class-use/AssignWindowsDoFn.html | 126 + .../class-use/DoFnRunner.ReduceFnExecutor.html | 170 + .../beam/runners/core/class-use/DoFnRunner.html | 301 + .../class-use/DoFnRunners.OutputManager.html| 244 + .../runners/core/class-use/DoFnRunners.html | 126 + .../core/class-use/ElementAndRestriction.html | 191 + .../class-use/ElementAndRestrictionCoder.html | 171 + .../class-use/ElementByteSizeObservable.html| 126 + .../core/class-use/GBKIntoKeyedWorkItems.html | 126 + .../GroupAlsoByWindowViaWindowSetDoFn.html | 126 + .../core/class-use/GroupAlsoByWindowsDoFn.html | 189 + .../GroupAlsoByWindowsViaOutputBufferDoFn.html | 126 + ...yKeyViaGroupByKeyOnly.GroupAlsoByWindow.html | 126 + ...upByKeyViaGroupByKeyOnly.GroupByKeyOnly.html | 126 + .../class-use/GroupByKeyViaGroupByKeyOnly.html | 126 + .../class-use/LateDataDroppingDoFnRunner.html | 126 + .../runners/core/class-use/NonEmptyPanes.html | 126 + .../runners/core/class-use/PaneInfoTracker.html | 126 + .../core/class-use/PeekingReiterator.html | 168 + .../class-use/PushbackSideInputDoFnRunner.html | 170 + .../core/class-use/ReduceFn.Context.html| 213 + .../core/class-use/ReduceFn.OnMergeContext.html | 170 + .../class-use/ReduceFn.OnTriggerContext.html| 174 + .../class-use/ReduceFn.ProcessValueContext.html | 174 + .../beam/runners/core/class-use/ReduceFn.html | 189 + .../runners/core/class-use/ReduceFnRunner.html | 126 + .../core/class-use/SideInputHandler.html| 126 + .../core/class-use/SimpleDoFnRunner.html| 126 + .../runners/co
[22/51] [abbrv] [partial] incubator-beam-site git commit: Rebuild site
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/RepeatedlyStateMachine.html
--
diff --git
a/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/RepeatedlyStateMachine.html
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/RepeatedlyStateMachine.html
new file mode 100644
index 000..8805f20
--- /dev/null
+++
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/RepeatedlyStateMachine.html
@@ -0,0 +1,440 @@
+http://www.w3.org/TR/html4/loose.dtd;>
+
+
+
+
+
+RepeatedlyStateMachine (Apache Beam SDK for Java, version
0.3.0-incubating)
+
+
+
+
+
+
+var methods = {"i0":9,"i1":10,"i2":10,"i3":10,"i4":10,"i5":10};
+var tabs = {65535:["t0","All Methods"],1:["t1","Static
Methods"],2:["t2","Instance Methods"],8:["t4","Concrete Methods"]};
+var altColor = "altColor";
+var rowColor = "rowColor";
+var tableTab = "tableTab";
+var activeTableTab = "activeTableTab";
+
+
+JavaScript is disabled on your browser.
+
+
+
+
+
+Skip navigation links
+
+
+
+
+Overview
+Package
+Class
+Use
+Tree
+Deprecated
+Index
+Help
+
+
+
+
+PrevClass
+NextClass
+
+
+Frames
+NoFrames
+
+
+AllClasses
+
+
+
+
+
+
+
+Summary:
+Nested|
+Field|
+Constr|
+Method
+
+
+Detail:
+Field|
+Constr|
+Method
+
+
+
+
+
+
+
+
+org.apache.beam.runners.core.triggers
+Class
RepeatedlyStateMachine
+
+
+
+http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true;
title="class or interface in java.lang">java.lang.Object
+
+
+org.apache.beam.runners.core.triggers.TriggerStateMachine
+
+
+org.apache.beam.runners.core.triggers.RepeatedlyStateMachine
+
+
+
+
+
+
+
+
+
+All Implemented Interfaces:
+http://docs.oracle.com/javase/7/docs/api/java/io/Serializable.html?is-external=true;
title="class or interface in java.io">Serializable
+
+
+
+public class RepeatedlyStateMachine
+extends TriggerStateMachine
+Repeat a trigger, either until some condition is met or
forever.
+
+ For example, to fire after the end of the window, and every time late data
arrives:
+
+ Repeatedly.forever(AfterWatermark.isPastEndOfWindow());
+
+
+ Repeatedly.forever(someTrigger) behaves like an infinite
+ AfterEach.inOrder(someTrigger, someTrigger, someTrigger,
...).
+
+See Also:
+Serialized
Form
+
+
+
+
+
+
+
+
+
+
+
+
+Nested Class Summary
+
+
+
+
+Nested classes/interfaces inherited from
classorg.apache.beam.runners.core.triggers.TriggerStateMachine
+TriggerStateMachine.MergingTriggerInfo,
TriggerStateMachine.OnceTriggerStateMachine,
TriggerStateMachine.OnElementContext,
TriggerStateMachine.OnMergeContext,
TriggerStateMachine.TriggerContext, TriggerStateMachine.TriggerInfo
+
+
+
+
+
+
+
+
+Field Summary
+
+
+
+
+Fields inherited from classorg.apache.beam.runners.core.triggers.TriggerStateMachine
+subTriggers
+
+
+
+
+
+
+
+
+Method Summary
+
+All MethodsStatic MethodsInstance MethodsConcrete Methods
+
+Modifier and Type
+Method and Description
+
+
+static RepeatedlyStateMachine
+forever(TriggerStateMachinerepeated)
+Create a composite trigger that repeatedly executes the
trigger repeated, firing each
+ time it fires and ignoring any indications to finish.
+
+
+
+void
+onElement(TriggerStateMachine.OnElementContextc)
+Called every time an element is incorporated into a
window.
+
+
+
+void
+onFire(TriggerStateMachine.TriggerContextcontext)
+Adjusts the state of the trigger to be ready for the next
pane.
+
+
+
+void
+onMerge(TriggerStateMachine.OnMergeContextc)
+Called immediately after windows have been merged.
+
+
+
+boolean
+shouldFire(TriggerStateMachine.TriggerContextcontext)
+Returns true if the current state of the
trigger indicates that its condition
+ is satisfied and it is ready to fire.
+
+
+
+http://docs.oracle.com/javase/7/docs/api/java/lang/String.html?is-external=true;
title="class or interface in java.lang">String
+toString()
+
+
+
+
+
+
+Methods inherited from classorg.apache.beam.runners.core.triggers.TriggerStateMachine
+clear,
equals,
hashCode,
isCompatible,
orFinally,
prefetchOnElement,
prefetchOnFire,
prefetchOnMerge,
prefetchShouldFire,
subTriggers
+
+
+
+
+
+Methods inherited from classjava.lang.http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true;
title="class or interface in java.lang">Object
[26/51] [abbrv] [partial] incubator-beam-site git commit: Rebuild site
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/AfterPaneStateMachine.html
--
diff --git
a/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/AfterPaneStateMachine.html
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/AfterPaneStateMachine.html
new file mode 100644
index 000..d790dde
--- /dev/null
+++
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/AfterPaneStateMachine.html
@@ -0,0 +1,578 @@
+http://www.w3.org/TR/html4/loose.dtd;>
+
+
+
+
+
+AfterPaneStateMachine (Apache Beam SDK for Java, version
0.3.0-incubating)
+
+
+
+
+
+
+var methods =
{"i0":10,"i1":9,"i2":10,"i3":10,"i4":10,"i5":10,"i6":10,"i7":10,"i8":10,"i9":10,"i10":10,"i11":10,"i12":10};
+var tabs = {65535:["t0","All Methods"],1:["t1","Static
Methods"],2:["t2","Instance Methods"],8:["t4","Concrete Methods"]};
+var altColor = "altColor";
+var rowColor = "rowColor";
+var tableTab = "tableTab";
+var activeTableTab = "activeTableTab";
+
+
+JavaScript is disabled on your browser.
+
+
+
+
+
+Skip navigation links
+
+
+
+
+Overview
+Package
+Class
+Use
+Tree
+Deprecated
+Index
+Help
+
+
+
+
+PrevClass
+NextClass
+
+
+Frames
+NoFrames
+
+
+AllClasses
+
+
+
+
+
+
+
+Summary:
+Nested|
+Field|
+Constr|
+Method
+
+
+Detail:
+Field|
+Constr|
+Method
+
+
+
+
+
+
+
+
+org.apache.beam.runners.core.triggers
+Class
AfterPaneStateMachine
+
+
+
+http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true;
title="class or interface in java.lang">java.lang.Object
+
+
+org.apache.beam.runners.core.triggers.TriggerStateMachine
+
+
+org.apache.beam.runners.core.triggers.TriggerStateMachine.OnceTriggerStateMachine
+
+
+org.apache.beam.runners.core.triggers.AfterPaneStateMachine
+
+
+
+
+
+
+
+
+
+
+
+All Implemented Interfaces:
+http://docs.oracle.com/javase/7/docs/api/java/io/Serializable.html?is-external=true;
title="class or interface in java.io">Serializable
+
+
+
+@Experimental(value=TRIGGER)
+public class AfterPaneStateMachine
+extends TriggerStateMachine.OnceTriggerStateMachine
+TriggerStateMachines
that fire based on properties of the elements in the current pane.
+
+See Also:
+Serialized
Form
+
+
+
+
+
+
+
+
+
+
+
+
+Nested Class Summary
+
+
+
+
+Nested classes/interfaces inherited from
classorg.apache.beam.runners.core.triggers.TriggerStateMachine
+TriggerStateMachine.MergingTriggerInfo,
TriggerStateMachine.OnceTriggerStateMachine,
TriggerStateMachine.OnElementContext,
TriggerStateMachine.OnMergeContext,
TriggerStateMachine.TriggerContext, TriggerStateMachine.TriggerInfo
+
+
+
+
+
+
+
+
+Field Summary
+
+
+
+
+Fields inherited from classorg.apache.beam.runners.core.triggers.TriggerStateMachine
+subTriggers
+
+
+
+
+
+
+
+
+Method Summary
+
+All MethodsStatic MethodsInstance MethodsConcrete Methods
+
+Modifier and Type
+Method and Description
+
+
+void
+clear(TriggerStateMachine.TriggerContextc)
+Clear any state associated with this trigger in the given
window.
+
+
+
+static AfterPaneStateMachine
+elementCountAtLeast(intcountElems)
+Creates a trigger that fires when the pane contains at
least countElems elements.
+
+
+
+boolean
+equals(http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true;
title="class or interface in java.lang">Objectobj)
+
+
+int
+getElementCount()
+The number of elements after which this trigger may
fire.
+
+
+
+int
+hashCode()
+
+
+boolean
+isCompatible(TriggerStateMachineother)
+Returns whether this performs the same triggering as the
given Trigger.
+
+
+
+void
+onElement(TriggerStateMachine.OnElementContextc)
+Called every time an element is incorporated into a
window.
+
+
+
+void
+onMerge(TriggerStateMachine.OnMergeContextcontext)
+Called immediately after windows have been merged.
+
+
+
+protected void
+onOnlyFiring(TriggerStateMachine.TriggerContextcontext)
+Called exactly once by TriggerStateMachine.OnceTriggerStateMachine.onFire(org.apache.beam.runners.core.triggers.TriggerStateMachine.TriggerContext)
when the trigger is fired.
+
+
+
+void
+prefetchOnMerge(MergingStateAccessor?,?state)
+Called to allow the trigger to prefetch any state it will
likely need to read from during
+ an TriggerStateMachine.onMerge(org.apache.beam.runners.core.triggers.TriggerStateMachine.OnMergeContext)
call.
+
+
+
+void
+prefetchShouldFire(StateAccessor?state)
[36/51] [abbrv] [partial] incubator-beam-site git commit: Rebuild site
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/ReduceFnRunner.html
--
diff --git
a/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/ReduceFnRunner.html
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/ReduceFnRunner.html
new file mode 100644
index 000..a35adc3
--- /dev/null
+++
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/ReduceFnRunner.html
@@ -0,0 +1,401 @@
+http://www.w3.org/TR/html4/loose.dtd;>
+
+
+
+
+
+ReduceFnRunner (Apache Beam SDK for Java, version
0.3.0-incubating)
+
+
+
+
+
+
+var methods = {"i0":10,"i1":10,"i2":10};
+var tabs = {65535:["t0","All Methods"],2:["t2","Instance
Methods"],8:["t4","Concrete Methods"]};
+var altColor = "altColor";
+var rowColor = "rowColor";
+var tableTab = "tableTab";
+var activeTableTab = "activeTableTab";
+
+
+JavaScript is disabled on your browser.
+
+
+
+
+
+Skip navigation links
+
+
+
+
+Overview
+Package
+Class
+Use
+Tree
+Deprecated
+Index
+Help
+
+
+
+
+PrevClass
+NextClass
+
+
+Frames
+NoFrames
+
+
+AllClasses
+
+
+
+
+
+
+
+Summary:
+Nested|
+Field|
+Constr|
+Method
+
+
+Detail:
+Field|
+Constr|
+Method
+
+
+
+
+
+
+
+
+org.apache.beam.runners.core
+Class
ReduceFnRunnerK,InputT,OutputT,W extends BoundedWindow
+
+
+
+http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true;
title="class or interface in java.lang">java.lang.Object
+
+
+org.apache.beam.runners.core.ReduceFnRunnerK,InputT,OutputT,W
+
+
+
+
+
+
+
+Type Parameters:
+K - The type of key being processed.
+InputT - The type of values associated with the key.
+OutputT - The output type that will be produced for each
key.
+W - The type of windows this operates on.
+
+
+All Implemented Interfaces:
+TimerCallback
+
+
+
+public class ReduceFnRunnerK,InputT,OutputT,W extends BoundedWindow
+extends http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true;
title="class or interface in java.lang">Object
+implements TimerCallback
+Manages the execution of a ReduceFn after a GroupByKeyViaGroupByKeyOnly.GroupByKeyOnly
has partitioned the
+ PCollection by key.
+
+ The onTrigger(org.apache.beam.runners.core.ReduceFnK,
InputT, OutputT, W.Context, org.apache.beam.runners.core.ReduceFnK,
InputT, OutputT, W.Context, boolean, boolean) relies on a TriggerStateMachineRunner
to manage the execution
+ of the triggering logic. The ReduceFnRunners responsibilities
are:
+
+
+ Tracking the windows that are active (have buffered data) as elements
arrive and triggers are
+ fired.
+ Holding the watermark based on the timestamps of elements in a pane and
releasing it when the
+ trigger fires.
+ Calling the appropriate callbacks on ReduceFn based on trigger
execution, timer
+ firings, etc, and providing appropriate contexts to the ReduceFn for actions such as
+ output.
+ Scheduling garbage collection of state associated with a specific window,
and making that
+ happen when the appropriate timer fires.
+
+
+
+
+
+
+
+
+
+
+
+
+Field Summary
+
+
+
+
+Fields inherited from interfaceorg.apache.beam.sdk.util.state.TimerCallback
+NO_OP
+
+
+
+
+
+
+
+
+Constructor Summary
+
+Constructors
+
+Constructor and Description
+
+
+ReduceFnRunner(Kkey,
+ WindowingStrategy?,WwindowingStrategy,
+ ExecutableTriggerStateMachinetriggerStateMachine,
+ StateInternalsKstateInternals,
+ TimerInternalstimerInternals,
+ WindowingInternals?,KVK,OutputTwindowingInternals,
+ Aggregatorhttp://docs.oracle.com/javase/7/docs/api/java/lang/Long.html?is-external=true;
title="class or interface in java.lang">Long,http://docs.oracle.com/javase/7/docs/api/java/lang/Long.html?is-external=true;
title="class or interface in
java.lang">LongdroppedDueToClosedWindow,
+ ReduceFnK,InputT,OutputT,WreduceFn,
+ PipelineOptionsoptions)
+
+
+
+
+
+
+
+
+
+Method Summary
+
+All MethodsInstance MethodsConcrete Methods
+
+Modifier and Type
+Method and Description
+
+
+void
+onTimer(TimerInternals.TimerDatatimer)
+Called when an end-of-window, garbage collection, or
trigger-specific timer fires.
+
+
+
+void
+persist()
+
+
+void
+processElements(http://docs.oracle.com/javase/7/docs/api/java/lang/Iterable.html?is-external=true;
title="class or interface in java.lang">IterableWindowedValueInputTvalues)
[16/51] [abbrv] [partial] incubator-beam-site git commit: Rebuild site
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/class-use/ExecutableTriggerStateMachine.html -- diff --git a/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/class-use/ExecutableTriggerStateMachine.html b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/class-use/ExecutableTriggerStateMachine.html new file mode 100644 index 000..64a744a --- /dev/null +++ b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/class-use/ExecutableTriggerStateMachine.html @@ -0,0 +1,386 @@ +http://www.w3.org/TR/html4/loose.dtd;> + + + + + +Uses of Class org.apache.beam.runners.core.triggers.ExecutableTriggerStateMachine (Apache Beam SDK for Java, version 0.3.0-incubating) + + + + + + + + +JavaScript is disabled on your browser. + + + + + +Skip navigation links + + + + +Overview +Package +Class +Use +Tree +Deprecated +Index +Help + + + + +Prev +Next + + +Frames +NoFrames + + +AllClasses + + + + + + + + + + +Uses of Classorg.apache.beam.runners.core.triggers.ExecutableTriggerStateMachine + + + + + +Packages that use ExecutableTriggerStateMachine + +Package +Description + + + +org.apache.beam.runners.core + +Provides utilities for Beam runner authors. + + + +org.apache.beam.runners.core.triggers + +State machine implementations for triggers, called "triggers" because + they react to events. + + + + + + + + + + +Uses of ExecutableTriggerStateMachine in org.apache.beam.runners.core + +Constructors in org.apache.beam.runners.core with parameters of type ExecutableTriggerStateMachine + +Constructor and Description + + + +ReduceFnRunner(Kkey, + WindowingStrategy?,WwindowingStrategy, + ExecutableTriggerStateMachinetriggerStateMachine, + StateInternalsKstateInternals, + TimerInternalstimerInternals, + WindowingInternals?,KVK,OutputTwindowingInternals, + Aggregatorhttp://docs.oracle.com/javase/7/docs/api/java/lang/Long.html?is-external=true; title="class or interface in java.lang">Long,http://docs.oracle.com/javase/7/docs/api/java/lang/Long.html?is-external=true; title="class or interface in java.lang">LongdroppedDueToClosedWindow, + ReduceFnK,InputT,OutputT,WreduceFn, + PipelineOptionsoptions) + + + + + + + +Uses of ExecutableTriggerStateMachine in org.apache.beam.runners.core.triggers + +Methods in org.apache.beam.runners.core.triggers that return ExecutableTriggerStateMachine + +Modifier and Type +Method and Description + + + +static W extends BoundedWindowExecutableTriggerStateMachine +ExecutableTriggerStateMachine.create(TriggerStateMachinetrigger) + + +static W extends BoundedWindowExecutableTriggerStateMachine +ExecutableTriggerStateMachine.createForOnceTrigger(TriggerStateMachine.OnceTriggerStateMachinetrigger, +intnextUnusedIndex) + + +ExecutableTriggerStateMachine +TriggerStateMachine.TriggerInfo.firstUnfinishedSubTrigger() +Returns the first unfinished sub-trigger. + + + +ExecutableTriggerStateMachine +ExecutableTriggerStateMachine.getSubTriggerContaining(intindex) + + +ExecutableTriggerStateMachine +TriggerStateMachine.TriggerInfo.subTrigger(intsubtriggerIndex) +Access the executable version of the specified sub-trigger. + + + + + +Methods in org.apache.beam.runners.core.triggers that return types with arguments of type ExecutableTriggerStateMachine + +Modifier and Type +Method and Description + + + +http://docs.oracle.com/javase/7/docs/api/java/util/Set.html?is-external=true; title="class or interface in java.util">SetExecutableTriggerStateMachine +FinishedTriggersSet.getFinishedTriggers() +Returns a mutable http://docs.oracle.com/javase/7/docs/api/java/util/Set.html?is-external=true; title="class or interface in java.util">Set of the underlying triggers that are finished. + + + +http://docs.oracle.com/javase/7/docs/api/java/lang/Iterable.html?is-external=true; title="class or interface in java.lang">IterableExecutableTriggerStateMachine +TriggerStateMachine.TriggerInfo.subTriggers() +Access the executable versions of the sub-triggers of the current trigger. + + + +http://docs.oracle.com/javase/7/docs/api/java/util/List.html?is-external=true; title="class or interface in
[46/51] [abbrv] [partial] incubator-beam-site git commit: Rebuild site
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/deprecated-list.html -- diff --git a/content/learn/sdks/javadoc/0.3.0-incubating/deprecated-list.html b/content/learn/sdks/javadoc/0.3.0-incubating/deprecated-list.html new file mode 100644 index 000..7e90b5d --- /dev/null +++ b/content/learn/sdks/javadoc/0.3.0-incubating/deprecated-list.html @@ -0,0 +1,552 @@ +http://www.w3.org/TR/html4/loose.dtd;> + + + + + +Deprecated List (Apache Beam SDK for Java, version 0.3.0-incubating) + + + + + + + + +JavaScript is disabled on your browser. + + + + + +Skip navigation links + + + + +Overview +Package +Class +Use +Tree +Deprecated +Index +Help + + + + +Prev +Next + + +Frames +NoFrames + + +AllClasses + + + + + + + + + + +Deprecated API +Contents + +Deprecated Interfaces +Deprecated Classes +Deprecated Enums +Deprecated Fields +Deprecated Methods +Deprecated Constructors +Deprecated Enum Constants + + + + + + + + +Deprecated Interfaces + +Interface and Description + + + +org.apache.beam.sdk.util.state.StateTag.StateBinder +for migration only; runners should reference the top level StateBinder + and move towards StateSpec rather than StateTag. + + + +org.apache.beam.sdk.testing.StreamingIT + + + + + + + + + + + +Deprecated Classes + +Class and Description + + + +org.apache.beam.sdk.util.AttemptAndTimeBoundedExponentialBackOff + + +org.apache.beam.sdk.util.AttemptBoundedExponentialBackOff + + +org.apache.beam.sdk.transforms.Combine.SimpleCombineFn + + +org.apache.beam.runners.dataflow.DataflowRunner.StreamingPCollectionViewWriterFn + + +org.apache.beam.sdk.transforms.DoFnAdapters +This class will go away when we start running DoFn's directly (using DoFnInvoker) rather than via OldDoFn. + + + +org.apache.beam.sdk.util.IntervalBoundedExponentialBackOff + + +org.apache.beam.sdk.transforms.OldDoFn +Uses of OldDoFn should be replaced by the new DoFn. + + + +org.apache.beam.sdk.util.PCollectionViews.IterablePCollectionView +Runners should not inspect the PCollectionView subclass, as it is an + implementation detail. To specialize a side input, a runner should inspect the + language-independent metadata of the ViewFn. + + + +org.apache.beam.sdk.util.PCollectionViews.ListPCollectionView +Runners should not inspect the PCollectionView subclass, as it is an + implementation detail. To specialize a side input, a runner should inspect the + language-independent metadata of the ViewFn. + + + +org.apache.beam.sdk.util.PCollectionViews.MapPCollectionView +Runners should not inspect the PCollectionView subclass, as it is an + implementation detail. To specialize a side input, a runner should inspect the + language-independent metadata of the ViewFn. + + + +org.apache.beam.sdk.util.PCollectionViews.MultimapPCollectionView +Runners should not inspect the PCollectionView subclass, as it is an + implementation detail. To specialize a side input, a runner should inspect the + language-independent metadata of the ViewFn. + + + +org.apache.beam.sdk.util.PCollectionViews.SingletonPCollectionView +Runners should not inspect the PCollectionView subclass, as it is an + implementation detail. To specialize a side input, a runner should inspect the + language-independent metadata of the ViewFn. + + + + + + + + + + + + +Deprecated Enums + +Enum and Description + + + +org.apache.beam.runners.dataflow.options.DataflowPipelineWorkerPoolOptions.TeardownPolicy +Dataflow Service will only support TEARDOWN_ALWAYS policy in the future. + + + + + + + + + + + + +Deprecated Fields + +Field and Description + + + +org.apache.beam.sdk.util.AppEngineEnvironment.IS_APP_ENGINE + + + + + + + + + + + +Deprecated Methods + +Method and Description + + + +org.apache.beam.sdk.util.state.StateSpecs.adaptTagBinder(StateTag.StateBinderK) +for migration purposes only + + + +org.apache.beam.sdk.io.PubsubIO.PubsubSubscription.asV1Beta1Path() +the v1beta1 API for Cloud Pub/Sub is deprecated. + + + +org.apache.beam.sdk.io.PubsubIO.PubsubTopic.asV1Beta1Path() +the v1beta1 API for Cloud Pub/Sub is deprecated. + + + +org.apache.beam.sdk.io.PubsubIO.PubsubSubscription.asV1Beta2Path() +the v1beta2 API for Cloud Pub/Sub is deprecated. + + + +org.apache.beam.sdk.io.PubsubIO.PubsubTopic.asV1Beta2Path() +the v1beta2 API for Cloud Pub/Sub is deprecated. + + + +org.apache.beam.sdk.util.state.StateTag.bind(StateTag.StateBinder? extends K) +Use the StateSpec.bind(java.lang.String,
[28/51] [abbrv] [partial] incubator-beam-site git commit: Rebuild site
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/AfterDelayFromFirstElementStateMachine.html
--
diff --git
a/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/AfterDelayFromFirstElementStateMachine.html
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/AfterDelayFromFirstElementStateMachine.html
new file mode 100644
index 000..9e840ab
--- /dev/null
+++
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/AfterDelayFromFirstElementStateMachine.html
@@ -0,0 +1,779 @@
+http://www.w3.org/TR/html4/loose.dtd;>
+
+
+
+
+
+AfterDelayFromFirstElementStateMachine (Apache Beam SDK for Java,
version 0.3.0-incubating)
+
+
+
+
+
+
+var methods =
{"i0":10,"i1":10,"i2":10,"i3":10,"i4":6,"i5":10,"i6":10,"i7":10,"i8":6,"i9":10,"i10":10,"i11":10,"i12":10,"i13":10,"i14":10,"i15":10,"i16":10};
+var tabs = {65535:["t0","All Methods"],2:["t2","Instance
Methods"],4:["t3","Abstract Methods"],8:["t4","Concrete Methods"]};
+var altColor = "altColor";
+var rowColor = "rowColor";
+var tableTab = "tableTab";
+var activeTableTab = "activeTableTab";
+
+
+JavaScript is disabled on your browser.
+
+
+
+
+
+Skip navigation links
+
+
+
+
+Overview
+Package
+Class
+Use
+Tree
+Deprecated
+Index
+Help
+
+
+
+
+PrevClass
+NextClass
+
+
+Frames
+NoFrames
+
+
+AllClasses
+
+
+
+
+
+
+
+Summary:
+Nested|
+Field|
+Constr|
+Method
+
+
+Detail:
+Field|
+Constr|
+Method
+
+
+
+
+
+
+
+
+org.apache.beam.runners.core.triggers
+Class
AfterDelayFromFirstElementStateMachine
+
+
+
+http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true;
title="class or interface in java.lang">java.lang.Object
+
+
+org.apache.beam.runners.core.triggers.TriggerStateMachine
+
+
+org.apache.beam.runners.core.triggers.TriggerStateMachine.OnceTriggerStateMachine
+
+
+org.apache.beam.runners.core.triggers.AfterDelayFromFirstElementStateMachine
+
+
+
+
+
+
+
+
+
+
+
+All Implemented Interfaces:
+http://docs.oracle.com/javase/7/docs/api/java/io/Serializable.html?is-external=true;
title="class or interface in java.io">Serializable
+
+
+Direct Known Subclasses:
+AfterProcessingTimeStateMachine
+
+
+
+@Experimental(value=TRIGGER)
+public abstract class AfterDelayFromFirstElementStateMachine
+extends TriggerStateMachine.OnceTriggerStateMachine
+A base class for triggers that happen after a processing
time delay from the arrival
+ of the first element in a pane.
+
+ This class is for internal use only and may change at any time.
+
+See Also:
+Serialized
Form
+
+
+
+
+
+
+
+
+
+
+
+
+Nested Class Summary
+
+
+
+
+Nested classes/interfaces inherited from
classorg.apache.beam.runners.core.triggers.TriggerStateMachine
+TriggerStateMachine.MergingTriggerInfo,
TriggerStateMachine.OnceTriggerStateMachine,
TriggerStateMachine.OnElementContext,
TriggerStateMachine.OnMergeContext,
TriggerStateMachine.TriggerContext, TriggerStateMachine.TriggerInfo
+
+
+
+
+
+
+
+
+Field Summary
+
+Fields
+
+Modifier and Type
+Field and Description
+
+
+protected static StateTaghttp://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true;
title="class or interface in java.lang">Object,AccumulatorCombiningStateorg.joda.time.Instant,Combine.Holderorg.joda.time.Instant,org.joda.time.Instant
+DELAYED_UNTIL_TAG
+
+
+protected static http://docs.oracle.com/javase/7/docs/api/java/util/List.html?is-external=true;
title="class or interface in java.util">ListSerializableFunctionorg.joda.time.Instant,org.joda.time.Instant
+IDENTITY
+
+
+protected TimeDomain
+timeDomain
+
+
+protected http://docs.oracle.com/javase/7/docs/api/java/util/List.html?is-external=true;
title="class or interface in java.util">ListSerializableFunctionorg.joda.time.Instant,org.joda.time.Instant
+timestampMappers
+A list of timestampMappers m1, m2, m3, ...
+
+
+
+
+
+
+
+Fields inherited from classorg.apache.beam.runners.core.triggers.TriggerStateMachine
+subTriggers
+
+
+
+
+
+
+
+
+Constructor Summary
+
+Constructors
+
+Constructor and Description
+
+
+AfterDelayFromFirstElementStateMachine(TimeDomaintimeDomain,
+ http://docs.oracle.com/javase/7/docs/api/java/util/List.html?is-external=true;
title="class or interface in java.util">ListSerializableFunctionorg.joda.time.Instant,org.joda.time.InstanttimestampMappers)
+
+
[07/51] [abbrv] [partial] incubator-beam-site git commit: Rebuild site
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/dataflow/DataflowRunner.html
--
diff --git
a/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/dataflow/DataflowRunner.html
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/dataflow/DataflowRunner.html
new file mode 100644
index 000..476a0a4
--- /dev/null
+++
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/dataflow/DataflowRunner.html
@@ -0,0 +1,525 @@
+http://www.w3.org/TR/html4/loose.dtd;>
+
+
+
+
+
+DataflowRunner (Apache Beam SDK for Java, version
0.3.0-incubating)
+
+
+
+
+
+
+var methods = {"i0":10,"i1":9,"i2":9,"i3":10,"i4":10,"i5":10,"i6":10};
+var tabs = {65535:["t0","All Methods"],1:["t1","Static
Methods"],2:["t2","Instance Methods"],8:["t4","Concrete Methods"]};
+var altColor = "altColor";
+var rowColor = "rowColor";
+var tableTab = "tableTab";
+var activeTableTab = "activeTableTab";
+
+
+JavaScript is disabled on your browser.
+
+
+
+
+
+Skip navigation links
+
+
+
+
+Overview
+Package
+Class
+Use
+Tree
+Deprecated
+Index
+Help
+
+
+
+
+PrevClass
+NextClass
+
+
+Frames
+NoFrames
+
+
+AllClasses
+
+
+
+
+
+
+
+Summary:
+Nested|
+Field|
+Constr|
+Method
+
+
+Detail:
+Field|
+Constr|
+Method
+
+
+
+
+
+
+
+
+org.apache.beam.runners.dataflow
+Class DataflowRunner
+
+
+
+http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true;
title="class or interface in java.lang">java.lang.Object
+
+
+org.apache.beam.sdk.runners.PipelineRunnerDataflowPipelineJob
+
+
+org.apache.beam.runners.dataflow.DataflowRunner
+
+
+
+
+
+
+
+
+
+
+public class DataflowRunner
+extends PipelineRunnerDataflowPipelineJob
+A PipelineRunner
that executes the operations in the pipeline by first translating them
+ to the Dataflow representation using the DataflowPipelineTranslator
and then submitting
+ them to a Dataflow service for execution.
+
+ Permissions
+
+ When reading from a Dataflow source or writing to a Dataflow sink using
+ DataflowRunner, the Google cloudservices account and the Google
compute engine service
+ account of the GCP project running the Dataflow Job will need access to the
corresponding
+ source/sink.
+
+ Please see https://cloud.google.com/dataflow/security-and-permissions;>Google Cloud
+ Dataflow Security and Permissions for more details.
+
+
+
+
+
+
+
+
+
+
+
+Nested Class Summary
+
+Nested Classes
+
+Modifier and Type
+Class and Description
+
+
+static class
+DataflowRunner.StreamingPCollectionViewWriterFnT
+Deprecated.
+
+
+
+
+
+
+
+
+
+
+Field Summary
+
+Fields
+
+Modifier and Type
+Field and Description
+
+
+static http://docs.oracle.com/javase/7/docs/api/java/lang/String.html?is-external=true;
title="class or interface in java.lang">String
+BATCH_WORKER_HARNESS_CONTAINER_IMAGE
+
+
+static http://docs.oracle.com/javase/7/docs/api/java/lang/String.html?is-external=true;
title="class or interface in java.lang">String
+PROJECT_ID_REGEXP
+Project IDs must contain lowercase letters, digits, or
dashes.
+
+
+
+static http://docs.oracle.com/javase/7/docs/api/java/lang/String.html?is-external=true;
title="class or interface in java.lang">String
+STREAMING_WORKER_HARNESS_CONTAINER_IMAGE
+
+
+
+
+
+
+
+
+
+Constructor Summary
+
+Constructors
+
+Modifier
+Constructor and Description
+
+
+protected
+DataflowRunner(DataflowPipelineOptionsoptions)
+
+
+
+
+
+
+
+
+
+Method Summary
+
+All MethodsStatic MethodsInstance MethodsConcrete Methods
+
+Modifier and Type
+Method and Description
+
+
+OutputT extends POutput,InputT extends PInputOutputT
+apply(PTransformInputT,OutputTtransform,
+ InputTinput)
+Applies the given transform to the input.
+
+
+
+protected static http://docs.oracle.com/javase/7/docs/api/java/util/List.html?is-external=true;
title="class or interface in java.util">Listhttp://docs.oracle.com/javase/7/docs/api/java/lang/String.html?is-external=true;
title="class or interface in java.lang">String
+detectClassPathResourcesToStage(http://docs.oracle.com/javase/7/docs/api/java/lang/ClassLoader.html?is-external=true;
title="class or interface in
java.lang">ClassLoaderclassLoader)
+Attempts to detect all the resources the class loader has
access to.
+
+
+
+static DataflowRunner
+fromOptions(PipelineOptionsoptions)
+Construct a runner from the provided options.
+
+
+
+DataflowPipelineTranslator
+getTranslator()
+Returns the DataflowPipelineTranslator
[25/51] [abbrv] [partial] incubator-beam-site git commit: Rebuild site
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/AfterWatermarkStateMachine.AfterWatermarkEarlyAndLate.html
--
diff --git
a/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/AfterWatermarkStateMachine.AfterWatermarkEarlyAndLate.html
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/AfterWatermarkStateMachine.AfterWatermarkEarlyAndLate.html
new file mode 100644
index 000..dbaeba3
--- /dev/null
+++
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/AfterWatermarkStateMachine.AfterWatermarkEarlyAndLate.html
@@ -0,0 +1,437 @@
+http://www.w3.org/TR/html4/loose.dtd;>
+
+
+
+
+
+AfterWatermarkStateMachine.AfterWatermarkEarlyAndLate (Apache Beam SDK
for Java, version 0.3.0-incubating)
+
+
+
+
+
+
+var methods = {"i0":10,"i1":10,"i2":10,"i3":10,"i4":10,"i5":10,"i6":10};
+var tabs = {65535:["t0","All Methods"],2:["t2","Instance
Methods"],8:["t4","Concrete Methods"]};
+var altColor = "altColor";
+var rowColor = "rowColor";
+var tableTab = "tableTab";
+var activeTableTab = "activeTableTab";
+
+
+JavaScript is disabled on your browser.
+
+
+
+
+
+Skip navigation links
+
+
+
+
+Overview
+Package
+Class
+Use
+Tree
+Deprecated
+Index
+Help
+
+
+
+
+PrevClass
+NextClass
+
+
+Frames
+NoFrames
+
+
+AllClasses
+
+
+
+
+
+
+
+Summary:
+Nested|
+Field|
+Constr|
+Method
+
+
+Detail:
+Field|
+Constr|
+Method
+
+
+
+
+
+
+
+
+org.apache.beam.runners.core.triggers
+Class AfterWatermarkStateMachine.AfterWatermarkEarlyAndLate
+
+
+
+http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true;
title="class or interface in java.lang">java.lang.Object
+
+
+org.apache.beam.runners.core.triggers.TriggerStateMachine
+
+
+org.apache.beam.runners.core.triggers.AfterWatermarkStateMachine.AfterWatermarkEarlyAndLate
+
+
+
+
+
+
+
+
+
+All Implemented Interfaces:
+http://docs.oracle.com/javase/7/docs/api/java/io/Serializable.html?is-external=true;
title="class or interface in java.io">Serializable
+
+
+Enclosing class:
+AfterWatermarkStateMachine
+
+
+
+public static class AfterWatermarkStateMachine.AfterWatermarkEarlyAndLate
+extends TriggerStateMachine
+
+See Also:
+AfterWatermarkStateMachine,
+Serialized
Form
+
+
+
+
+
+
+
+
+
+
+
+
+Nested Class Summary
+
+
+
+
+Nested classes/interfaces inherited from
classorg.apache.beam.runners.core.triggers.TriggerStateMachine
+TriggerStateMachine.MergingTriggerInfo,
TriggerStateMachine.OnceTriggerStateMachine,
TriggerStateMachine.OnElementContext,
TriggerStateMachine.OnMergeContext,
TriggerStateMachine.TriggerContext, TriggerStateMachine.TriggerInfo
+
+
+
+
+
+
+
+
+Field Summary
+
+
+
+
+Fields inherited from classorg.apache.beam.runners.core.triggers.TriggerStateMachine
+subTriggers
+
+
+
+
+
+
+
+
+Method Summary
+
+All MethodsInstance MethodsConcrete Methods
+
+Modifier and Type
+Method and Description
+
+
+void
+onElement(TriggerStateMachine.OnElementContextc)
+Called every time an element is incorporated into a
window.
+
+
+
+void
+onFire(TriggerStateMachine.TriggerContextcontext)
+Adjusts the state of the trigger to be ready for the next
pane.
+
+
+
+void
+onMerge(TriggerStateMachine.OnMergeContextc)
+Called immediately after windows have been merged.
+
+
+
+boolean
+shouldFire(TriggerStateMachine.TriggerContextcontext)
+Returns true if the current state of the
trigger indicates that its condition
+ is satisfied and it is ready to fire.
+
+
+
+http://docs.oracle.com/javase/7/docs/api/java/lang/String.html?is-external=true;
title="class or interface in java.lang">String
+toString()
+
+
+AfterWatermarkStateMachine.AfterWatermarkEarlyAndLate
+withEarlyFirings(TriggerStateMachine.OnceTriggerStateMachineearlyTrigger)
+
+
+AfterWatermarkStateMachine.AfterWatermarkEarlyAndLate
+withLateFirings(TriggerStateMachine.OnceTriggerStateMachinelateTrigger)
+
+
+
+
+
+
+Methods inherited from classorg.apache.beam.runners.core.triggers.TriggerStateMachine
+clear,
equals,
hashCode,
isCompatible,
orFinally,
prefetchOnElement,
prefetchOnFire,
prefetchOnMerge,
prefetchShouldFire,
subTriggers
+
+
+
+
+
+Methods inherited from classjava.lang.http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true;
title="class or interface in java.lang">Object
[34/51] [abbrv] [partial] incubator-beam-site git commit: Rebuild site
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/UnboundedReadFromBoundedSource.BoundedToUnboundedSourceAdapter.html
--
diff --git
a/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/UnboundedReadFromBoundedSource.BoundedToUnboundedSourceAdapter.html
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/UnboundedReadFromBoundedSource.BoundedToUnboundedSourceAdapter.html
new file mode 100644
index 000..90565be
--- /dev/null
+++
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/UnboundedReadFromBoundedSource.BoundedToUnboundedSourceAdapter.html
@@ -0,0 +1,450 @@
+http://www.w3.org/TR/html4/loose.dtd;>
+
+
+
+
+
+UnboundedReadFromBoundedSource.BoundedToUnboundedSourceAdapter (Apache
Beam SDK for Java, version 0.3.0-incubating)
+
+
+
+
+
+
+var methods = {"i0":10,"i1":10,"i2":10,"i3":10,"i4":10};
+var tabs = {65535:["t0","All Methods"],2:["t2","Instance
Methods"],8:["t4","Concrete Methods"]};
+var altColor = "altColor";
+var rowColor = "rowColor";
+var tableTab = "tableTab";
+var activeTableTab = "activeTableTab";
+
+
+JavaScript is disabled on your browser.
+
+
+
+
+
+Skip navigation links
+
+
+
+
+Overview
+Package
+Class
+Use
+Tree
+Deprecated
+Index
+Help
+
+
+
+
+PrevClass
+NextClass
+
+
+Frames
+NoFrames
+
+
+AllClasses
+
+
+
+
+
+
+
+Summary:
+Nested|
+Field|
+Constr|
+Method
+
+
+Detail:
+Field|
+Constr|
+Method
+
+
+
+
+
+
+
+
+org.apache.beam.runners.core
+Class
UnboundedReadFromBoundedSource.BoundedToUnboundedSourceAdapterT
+
+
+
+http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true;
title="class or interface in java.lang">java.lang.Object
+
+
+org.apache.beam.sdk.io.SourceOutputT
+
+
+org.apache.beam.sdk.io.UnboundedSourceT,org.apache.beam.runners.core.UnboundedReadFromBoundedSource.BoundedToUnboundedSourceAdapter.CheckpointT
+
+
+org.apache.beam.runners.core.UnboundedReadFromBoundedSource.BoundedToUnboundedSourceAdapterT
+
+
+
+
+
+
+
+
+
+
+
+All Implemented Interfaces:
+http://docs.oracle.com/javase/7/docs/api/java/io/Serializable.html?is-external=true;
title="class or interface in java.io">Serializable, HasDisplayData
+
+
+Enclosing class:
+UnboundedReadFromBoundedSourceT
+
+
+
+public static class UnboundedReadFromBoundedSource.BoundedToUnboundedSourceAdapterT
+extends UnboundedSourceT,org.apache.beam.runners.core.UnboundedReadFromBoundedSource.BoundedToUnboundedSourceAdapter.CheckpointT
+A BoundedSource to
UnboundedSource adapter.
+
+See Also:
+Serialized
Form
+
+
+
+
+
+
+
+
+
+
+
+
+Nested Class Summary
+
+
+
+
+Nested classes/interfaces inherited from
classorg.apache.beam.sdk.io.UnboundedSource
+UnboundedSource.CheckpointMark, UnboundedSource.UnboundedReaderOutputT
+
+
+
+
+
+
+
+
+Constructor Summary
+
+Constructors
+
+Constructor and Description
+
+
+BoundedToUnboundedSourceAdapter(BoundedSourceTboundedSource)
+
+
+
+
+
+
+
+
+
+Method Summary
+
+All MethodsInstance MethodsConcrete Methods
+
+Modifier and Type
+Method and Description
+
+
+org.apache.beam.runners.core.UnboundedReadFromBoundedSource.BoundedToUnboundedSourceAdapter.Reader
+createReader(PipelineOptionsoptions,
+
org.apache.beam.runners.core.UnboundedReadFromBoundedSource.BoundedToUnboundedSourceAdapter.CheckpointTcheckpoint)
+Create a new UnboundedSource.UnboundedReader to
read from this source, resuming from the given
+ checkpoint if present.
+
+
+
+http://docs.oracle.com/javase/7/docs/api/java/util/List.html?is-external=true;
title="class or interface in java.util">ListUnboundedReadFromBoundedSource.BoundedToUnboundedSourceAdapterT
+generateInitialSplits(intdesiredNumSplits,
+ PipelineOptionsoptions)
+Returns a list of UnboundedSource objects
representing the instances of this source
+ that should be used when executing the workflow.
+
+
+
+Coderorg.apache.beam.runners.core.UnboundedReadFromBoundedSource.BoundedToUnboundedSourceAdapter.CheckpointT
+getCheckpointMarkCoder()
+Returns a Coder for encoding and decoding
the checkpoints for this source, or
+ null if the checkpoints do not need to be durably committed.
+
+
+
+CoderT
+getDefaultOutputCoder()
+Returns the default Coder to use for the data
read from this source.
+
+
+
+void
+validate()
+Checks that this source is valid, before it can be used in
a pipeline.
+
+
+
+
+
+
[44/51] [abbrv] [partial] incubator-beam-site git commit: Rebuild site
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/index.html
--
diff --git a/content/learn/sdks/javadoc/0.3.0-incubating/index.html
b/content/learn/sdks/javadoc/0.3.0-incubating/index.html
new file mode 100644
index 000..fe9f0cc
--- /dev/null
+++ b/content/learn/sdks/javadoc/0.3.0-incubating/index.html
@@ -0,0 +1,75 @@
+http://www.w3.org/TR/html4/frameset.dtd;>
+
+
+
+
+
+Apache Beam SDK for Java, version 0.3.0-incubating
+
+targetPage = "" + window.location.search;
+if (targetPage != "" && targetPage != "undefined")
+targetPage = targetPage.substring(1);
+if (targetPage.indexOf(":") != -1 || (targetPage != "" &&
!validURL(targetPage)))
+targetPage = "undefined";
+function validURL(url) {
+try {
+url = decodeURIComponent(url);
+}
+catch (error) {
+return false;
+}
+var pos = url.indexOf(".html");
+if (pos == -1 || pos != url.length - 5)
+return false;
+var allowNumber = false;
+var allowSep = false;
+var seenDot = false;
+for (var i = 0; i < url.length - 5; i++) {
+var ch = url.charAt(i);
+if ('a' <= ch && ch <= 'z' ||
+'A' <= ch && ch <= 'Z' ||
+ch == '$' ||
+ch == '_' ||
+ch.charCodeAt(0) > 127) {
+allowNumber = true;
+allowSep = true;
+} else if ('0' <= ch && ch <= '9'
+|| ch == '-') {
+if (!allowNumber)
+ return false;
+} else if (ch == '/' || ch == '.') {
+if (!allowSep)
+return false;
+allowNumber = false;
+allowSep = false;
+if (ch == '.')
+ seenDot = true;
+if (ch == '/' && seenDot)
+ return false;
+} else {
+return false;
+}
+}
+return true;
+}
+function loadFrames() {
+if (targetPage != "" && targetPage != "undefined")
+ top.classFrame.location = top.targetPage;
+}
+
+
+
+
+
+
+
+
+
+
+JavaScript is disabled on your browser.
+
+Frame Alert
+This document is designed to be viewed using the frames feature. If you see
this message, you are using a non-frame-capable web client. Link to Non-frame version.
+
+
+
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/javadoc.sh
--
diff --git a/content/learn/sdks/javadoc/0.3.0-incubating/javadoc.sh
b/content/learn/sdks/javadoc/0.3.0-incubating/javadoc.sh
new file mode 100755
index 000..696965c
--- /dev/null
+++ b/content/learn/sdks/javadoc/0.3.0-incubating/javadoc.sh
@@ -0,0 +1 @@
+/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/../bin/javadoc
@options @packages
\ No newline at end of file
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/options
--
diff --git a/content/learn/sdks/javadoc/0.3.0-incubating/options
b/content/learn/sdks/javadoc/0.3.0-incubating/options
new file mode 100644
index 000..746f61f
--- /dev/null
+++ b/content/learn/sdks/javadoc/0.3.0-incubating/options
@@ -0,0 +1,24 @@
+-classpath
+'/Users/aljoscha/Dev/incubator-beam/sdks/target/classes:/Users/aljoscha/Dev/incubator-beam/sdks/java/target/classes:/Users/aljoscha/Dev/incubator-beam/sdks/java/build-tools/target/classes:/Users/aljoscha/Dev/incubator-beam/sdks/java/core/target/classes:/Users/aljoscha/Dev/incubator-beam/runners/target/classes:/Users/aljoscha/Dev/incubator-beam/runners/core-java/target/classes:/Users/aljoscha/Dev/incubator-beam/runners/direct-java/target/classes:/Users/aljoscha/Dev/incubator-beam/runners/google-cloud-dataflow-java/target/classes:/Users/aljoscha/Dev/incubator-beam/sdks/java/io/target/classes:/Users/aljoscha/Dev/incubator-beam/sdks/java/io/google-cloud-platform/target/classes:/Users/aljoscha/Dev/incubator-beam/sdks/java/io/hdfs/target/classes:/Users/aljoscha/Dev/incubator-beam/sdks/java/io/jms/target/classes:/Users/aljoscha/Dev/incubator-beam/sdks/java/io/kafka/target/classes:/Users/aljoscha/Dev/incubator-beam/sdks/java/io/kinesis/target/classes:/Users/aljoscha/Dev/incubator-beam/sdks/
java/io/mongodb/target/classes:/Users/aljoscha/Dev/incubator-beam/sdks/java/io/jdbc/target/classes:/Users/aljoscha/Dev/incubator-beam/sdks/java/extensions/target/classes:/Users/aljoscha/
[43/51] [abbrv] [partial] incubator-beam-site git commit: Rebuild site
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/DoFnRunner.ReduceFnExecutor.html
--
diff --git
a/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/DoFnRunner.ReduceFnExecutor.html
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/DoFnRunner.ReduceFnExecutor.html
new file mode 100644
index 000..08bda79
--- /dev/null
+++
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/DoFnRunner.ReduceFnExecutor.html
@@ -0,0 +1,254 @@
+http://www.w3.org/TR/html4/loose.dtd;>
+
+
+
+
+
+DoFnRunner.ReduceFnExecutor (Apache Beam SDK for Java, version
0.3.0-incubating)
+
+
+
+
+
+
+var methods = {"i0":6,"i1":6};
+var tabs = {65535:["t0","All Methods"],2:["t2","Instance
Methods"],4:["t3","Abstract Methods"]};
+var altColor = "altColor";
+var rowColor = "rowColor";
+var tableTab = "tableTab";
+var activeTableTab = "activeTableTab";
+
+
+JavaScript is disabled on your browser.
+
+
+
+
+
+Skip navigation links
+
+
+
+
+Overview
+Package
+Class
+Use
+Tree
+Deprecated
+Index
+Help
+
+
+
+
+PrevClass
+NextClass
+
+
+Frames
+NoFrames
+
+
+AllClasses
+
+
+
+
+
+
+
+Summary:
+Nested|
+Field|
+Constr|
+Method
+
+
+Detail:
+Field|
+Constr|
+Method
+
+
+
+
+
+
+
+
+org.apache.beam.runners.core
+Interface
DoFnRunner.ReduceFnExecutorK,InputT,OutputT,W
+
+
+
+
+
+
+All Known Implementing Classes:
+GroupAlsoByWindowViaWindowSetDoFn
+
+
+Enclosing interface:
+DoFnRunnerInputT,OutputT
+
+
+
+public static interface DoFnRunner.ReduceFnExecutorK,InputT,OutputT,W
+An internal interface for signaling that a OldDoFn requires late data
dropping.
+
+
+
+
+
+
+
+
+
+
+
+Method Summary
+
+All MethodsInstance MethodsAbstract Methods
+
+Modifier and Type
+Method and Description
+
+
+OldDoFnKeyedWorkItemK,InputT,KVK,OutputT
+asDoFn()
+Gets this object as a OldDoFn.
+
+
+
+Aggregatorhttp://docs.oracle.com/javase/7/docs/api/java/lang/Long.html?is-external=true;
title="class or interface in java.lang">Long,http://docs.oracle.com/javase/7/docs/api/java/lang/Long.html?is-external=true;
title="class or interface in java.lang">Long
+getDroppedDueToLatenessAggregator()
+Returns an aggregator that tracks elements that are dropped
due to being late.
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+Method Detail
+
+
+
+
+
+asDoFn
+OldDoFnKeyedWorkItemK,InputT,KVK,OutputT
asDoFn()
+Gets this object as a OldDoFn.
+
+ Most implementors of this interface are expected to be OldDoFn instances, and will
+ return themselves.
+
+
+
+
+
+
+
+getDroppedDueToLatenessAggregator
+Aggregatorhttp://docs.oracle.com/javase/7/docs/api/java/lang/Long.html?is-external=true;
title="class or interface in java.lang">Long,http://docs.oracle.com/javase/7/docs/api/java/lang/Long.html?is-external=true;
title="class or interface in
java.lang">LonggetDroppedDueToLatenessAggregator()
+Returns an aggregator that tracks elements that are dropped
due to being late.
+
+
+
+
+
+
+
+
+
+
+
+
+
+Skip navigation links
+
+
+
+
+Overview
+Package
+Class
+Use
+Tree
+Deprecated
+Index
+Help
+
+
+
+
+PrevClass
+NextClass
+
+
+Frames
+NoFrames
+
+
+AllClasses
+
+
+
+
+
+
+
+Summary:
+Nested|
+Field|
+Constr|
+Method
+
+
+Detail:
+Field|
+Constr|
+Method
+
+
+
+
+
+
+Copyright 2016 http://www.apache.org/;>The Apache Software Foundation. All rights
reserved.
+
+
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/DoFnRunner.html
--
diff --git
a/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/DoFnRunner.html
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/DoFnRunner.html
new file mode 100644
index 000..00241e9
--- /dev/null
+++
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/DoFnRunner.html
@@ -0,0 +1,288 @@
+http://www.w3.org/TR/html4/loose.dtd;>
+
+
+
+
+
+DoFnRunner (Apache Beam SDK for Java, version 0.3.0-incubating)
+
+
+
+
+
+
+var methods = {"i0":10};
+var tabs = {65535:["t0","All Methods"],2:["t2","Instance
Methods"],8:["t4","Concrete Methods"]};
+var altColor = "altColor";
+var rowColor = "rowColor";
+var tableTab = "tableTab";
+var activeTableTab = "activeTableTab";
+
+
+JavaScript is disabled on your browser.
+
+
+
+
+
+Skip navigation links
+
+
+
+
+Overview
+Package
+Class
+Use
+Tree
+Deprecated
+Index
+Help
+
+
+
+
+PrevClass
+NextClass
+
+
+Frames
+NoFrames
+
+
+AllClasses
+
+
+
+
+
+
+
+Summary:
+Nested|
+Field|
+Constr|
+Method
+
+
+Detail:
+Field|
+Constr|
+Method
+
+
+
+
+
+
+
+
+org.apache.beam.runners.core
+Class
GroupAlsoByWindowsViaOutputBufferDoFnK,InputT,OutputT,W extends BoundedWindow
+
+
+
+http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true;
title="class or interface in java.lang">java.lang.Object
+
+
+org.apache.beam.sdk.transforms.OldDoFnKVK,http://docs.oracle.com/javase/7/docs/api/java/lang/Iterable.html?is-external=true;
title="class or interface in java.lang">IterableWindowedValueInputT,KVK,OutputT
+
+
+org.apache.beam.runners.core.GroupAlsoByWindowsDoFnK,InputT,OutputT,W
+
+
+org.apache.beam.runners.core.GroupAlsoByWindowsViaOutputBufferDoFnK,InputT,OutputT,W
+
+
+
+
+
+
+
+
+
+
+
+All Implemented Interfaces:
+http://docs.oracle.com/javase/7/docs/api/java/io/Serializable.html?is-external=true;
title="class or interface in java.io">Serializable, HasDisplayData
+
+
+
+@SystemDoFnInternal
+public class GroupAlsoByWindowsViaOutputBufferDoFnK,InputT,OutputT,W
extends BoundedWindow
+extends GroupAlsoByWindowsDoFnK,InputT,OutputT,W
+The default batch GroupAlsoByWindowsDoFn
implementation, if no specialized "fast path"
+ implementation is applicable.
+
+See Also:
+Serialized
Form
+
+
+
+
+
+
+
+
+
+
+
+
+Nested Class Summary
+
+
+
+
+Nested classes/interfaces inherited from
classorg.apache.beam.sdk.transforms.OldDoFn
+OldDoFn.Context, OldDoFn.ProcessContext, OldDoFn.RequiresWindowAccess
+
+
+
+
+
+
+
+
+Field Summary
+
+
+
+
+Fields inherited from classorg.apache.beam.runners.core.GroupAlsoByWindowsDoFn
+DROPPED_DUE_TO_CLOSED_WINDOW_COUNTER,
DROPPED_DUE_TO_LATENESS_COUNTER,
droppedDueToClosedWindow,
droppedDueToLateness
+
+
+
+
+
+
+
+
+Constructor Summary
+
+Constructors
+
+Constructor and Description
+
+
+GroupAlsoByWindowsViaOutputBufferDoFn(WindowingStrategy?,WwindowingStrategy,
+ StateInternalsFactoryKstateInternalsFactory,
+ SystemReduceFnK,InputT,?,OutputT,WreduceFn)
+
+
+
+
+
+
+
+
+
+Method Summary
+
+All MethodsInstance MethodsConcrete Methods
+
+Modifier and Type
+Method and Description
+
+
+void
+processElement(OldDoFn.ProcessContextc)
+Processes one input element.
+
+
+
+
+
+
+
+Methods inherited from classorg.apache.beam.runners.core.GroupAlsoByWindowsDoFn
+createDefault
+
+
+
+
+
+Methods inherited from classorg.apache.beam.sdk.transforms.OldDoFn
+createAggregator,
createAggregator,
finishBundle,
getAllowedTimestampSkew,
getInputTypeDescriptor,
getOutputTypeDescriptor,
populateDisplayData, setup,
startBundle,
teardown,
toDoFn
+
+
+
+
+
+Methods inherited from classjava.lang.http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true;
title="class or interface in java.lang">Object
+http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#clone--;
title="class or interface in java.lang">clone, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#equals-java.lang.Object-;
title="class or interface in java.lang">equals,
[17/51] [abbrv] [partial] incubator-beam-site git commit: Rebuild site
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/class-use/AfterPaneStateMachine.html -- diff --git a/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/class-use/AfterPaneStateMachine.html b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/class-use/AfterPaneStateMachine.html new file mode 100644 index 000..66c34b8 --- /dev/null +++ b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/class-use/AfterPaneStateMachine.html @@ -0,0 +1,171 @@ +http://www.w3.org/TR/html4/loose.dtd;> + + + + + +Uses of Class org.apache.beam.runners.core.triggers.AfterPaneStateMachine (Apache Beam SDK for Java, version 0.3.0-incubating) + + + + + + + + +JavaScript is disabled on your browser. + + + + + +Skip navigation links + + + + +Overview +Package +Class +Use +Tree +Deprecated +Index +Help + + + + +Prev +Next + + +Frames +NoFrames + + +AllClasses + + + + + + + + + + +Uses of Classorg.apache.beam.runners.core.triggers.AfterPaneStateMachine + + + + + +Packages that use AfterPaneStateMachine + +Package +Description + + + +org.apache.beam.runners.core.triggers + +State machine implementations for triggers, called "triggers" because + they react to events. + + + + + + + + + + +Uses of AfterPaneStateMachine in org.apache.beam.runners.core.triggers + +Methods in org.apache.beam.runners.core.triggers that return AfterPaneStateMachine + +Modifier and Type +Method and Description + + + +static AfterPaneStateMachine +AfterPaneStateMachine.elementCountAtLeast(intcountElems) +Creates a trigger that fires when the pane contains at least countElems elements. + + + + + + + + + + + + + +Skip navigation links + + + + +Overview +Package +Class +Use +Tree +Deprecated +Index +Help + + + + +Prev +Next + + +Frames +NoFrames + + +AllClasses + + + + + + + + + +Copyright 2016 http://www.apache.org/;>The Apache Software Foundation. All rights reserved. + + http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/class-use/AfterProcessingTimeStateMachine.html -- diff --git a/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/class-use/AfterProcessingTimeStateMachine.html b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/class-use/AfterProcessingTimeStateMachine.html new file mode 100644 index 000..166f071 --- /dev/null +++ b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/class-use/AfterProcessingTimeStateMachine.html @@ -0,0 +1,176 @@ +http://www.w3.org/TR/html4/loose.dtd;> + + + + + +Uses of Class org.apache.beam.runners.core.triggers.AfterProcessingTimeStateMachine (Apache Beam SDK for Java, version 0.3.0-incubating) + + + + + + + + +JavaScript is disabled on your browser. + + + + + +Skip navigation links + + + + +Overview +Package +Class +Use +Tree +Deprecated +Index +Help + + + + +Prev +Next + + +Frames +NoFrames + + +AllClasses + + + + + + + + + + +Uses of Classorg.apache.beam.runners.core.triggers.AfterProcessingTimeStateMachine + + + + + +Packages that use AfterProcessingTimeStateMachine + +Package +Description + + + +org.apache.beam.runners.core.triggers + +State machine implementations for triggers, called "triggers" because + they react to events. + + + + + + + + + + +Uses of AfterProcessingTimeStateMachine in org.apache.beam.runners.core.triggers + +Methods in
[15/51] [abbrv] [partial] incubator-beam-site git commit: Rebuild site
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/class-use/RepeatedlyStateMachine.html -- diff --git a/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/class-use/RepeatedlyStateMachine.html b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/class-use/RepeatedlyStateMachine.html new file mode 100644 index 000..4505d93 --- /dev/null +++ b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/class-use/RepeatedlyStateMachine.html @@ -0,0 +1,172 @@ +http://www.w3.org/TR/html4/loose.dtd;> + + + + + +Uses of Class org.apache.beam.runners.core.triggers.RepeatedlyStateMachine (Apache Beam SDK for Java, version 0.3.0-incubating) + + + + + + + + +JavaScript is disabled on your browser. + + + + + +Skip navigation links + + + + +Overview +Package +Class +Use +Tree +Deprecated +Index +Help + + + + +Prev +Next + + +Frames +NoFrames + + +AllClasses + + + + + + + + + + +Uses of Classorg.apache.beam.runners.core.triggers.RepeatedlyStateMachine + + + + + +Packages that use RepeatedlyStateMachine + +Package +Description + + + +org.apache.beam.runners.core.triggers + +State machine implementations for triggers, called "triggers" because + they react to events. + + + + + + + + + + +Uses of RepeatedlyStateMachine in org.apache.beam.runners.core.triggers + +Methods in org.apache.beam.runners.core.triggers that return RepeatedlyStateMachine + +Modifier and Type +Method and Description + + + +static RepeatedlyStateMachine +RepeatedlyStateMachine.forever(TriggerStateMachinerepeated) +Create a composite trigger that repeatedly executes the trigger repeated, firing each + time it fires and ignoring any indications to finish. + + + + + + + + + + + + + +Skip navigation links + + + + +Overview +Package +Class +Use +Tree +Deprecated +Index +Help + + + + +Prev +Next + + +Frames +NoFrames + + +AllClasses + + + + + + + + + +Copyright 2016 http://www.apache.org/;>The Apache Software Foundation. All rights reserved. + + http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/class-use/ReshuffleTriggerStateMachine.html -- diff --git a/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/class-use/ReshuffleTriggerStateMachine.html b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/class-use/ReshuffleTriggerStateMachine.html new file mode 100644 index 000..305a609 --- /dev/null +++ b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/class-use/ReshuffleTriggerStateMachine.html @@ -0,0 +1,126 @@ +http://www.w3.org/TR/html4/loose.dtd;> + + + + + +Uses of Class org.apache.beam.runners.core.triggers.ReshuffleTriggerStateMachine (Apache Beam SDK for Java, version 0.3.0-incubating) + + + + + + + + +JavaScript is disabled on your browser. + + + + + +Skip navigation links + + + + +Overview +Package +Class +Use +Tree +Deprecated +Index +Help + + + + +Prev +Next + + +Frames +NoFrames + + +AllClasses + + + + + + + + + + +Uses of Classorg.apache.beam.runners.core.triggers.ReshuffleTriggerStateMachine + +No usage of org.apache.beam.runners.core.triggers.ReshuffleTriggerStateMachine + + + + +Skip navigation links + + + + +Overview +Package +Class +Use +Tree +Deprecated +Index +Help + + + + +Prev +Next + + +Frames +NoFrames + + +AllClasses + + + + + +JavaScript is disabled on your browser. + + + + + +Skip navigation links + + + + +Overview +Package +Class +Use +Tree +Deprecated +Index +Help + + + + +Prev +Next + + +Frames +NoFrames + + +AllClasses + + + + + + + + + + +Uses of Classorg.apache.beam.runners.dataflow.DataflowJobException + + + + + +Packages that use DataflowJobException + +Package +Description + + + +org.apache.beam.runners.dataflow + +Provides a Beam runner that executes pipelines on the Google Cloud Dataflow service. + + + + + + + + + + +Uses of DataflowJobException in org.apache.beam.runners.dataflow + +Subclasses of DataflowJobException in org.apache.beam.runners.dataflow + +Modifier and Type +Class and Description + + + +class +DataflowJobAlreadyExistsException +An exception that is thrown if the unique job name constraint of the Dataflow + service is broken because an existing job with the same job name is currently active. + + + +class +DataflowJobAlreadyUpdatedException +An exception that is thrown if the existing job has already been updated within the Dataflow + service and is no longer able to be updated. + + + +class +DataflowJobCancelledException +Signals that a job run by a BlockingDataflowRunner was updated during execution. + + + +class +DataflowJobExecutionException +Signals that a job run by a BlockingDataflowRunner fails during execution, and + provides access to the failed job. + + + +class +DataflowJobUpdatedException +Signals that a job run by a BlockingDataflowRunner was updated during execution. + + + +class +DataflowServiceException +Signals there was an error retrieving information about a job from the Cloud Dataflow Service. + + + + + + + + + + + + + +Skip navigation links + + + + +Overview +Package +Class +Use +Tree +Deprecated +Index +Help + + + + +Prev +Next + + +Frames +NoFrames + + +AllClasses + + + + + + + + + +Copyright 2016 http://www.apache.org/;>The Apache Software Foundation. All rights reserved. + + http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/dataflow/class-use/DataflowJobExecutionException.html -- diff --git a/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/dataflow/class-use/DataflowJobExecutionException.html b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/dataflow/class-use/DataflowJobExecutionException.html new file mode 100644 index 000..e2a39e3 --- /dev/null +++ b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/dataflow/class-use/DataflowJobExecutionException.html @@ -0,0 +1,126 @@ +http://www.w3.org/TR/html4/loose.dtd;> + + + + + +Uses of Class org.apache.beam.runners.dataflow.DataflowJobExecutionException (Apache Beam SDK for Java, version 0.3.0-incubating) + + + + + + + + +JavaScript is disabled on your browser. + + + + + +Skip navigation links + + + + +Overview +Package +Class +Use +Tree +Deprecated +Index +Help + + + + +Prev +Next + + +Frames +NoFrames + + +AllClasses + +
[38/51] [abbrv] [partial] incubator-beam-site git commit: Rebuild site
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/PaneInfoTracker.html
--
diff --git
a/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/PaneInfoTracker.html
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/PaneInfoTracker.html
new file mode 100644
index 000..9062dd6
--- /dev/null
+++
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/PaneInfoTracker.html
@@ -0,0 +1,316 @@
+http://www.w3.org/TR/html4/loose.dtd;>
+
+
+
+
+
+PaneInfoTracker (Apache Beam SDK for Java, version
0.3.0-incubating)
+
+
+
+
+
+
+var methods = {"i0":10,"i1":10,"i2":10};
+var tabs = {65535:["t0","All Methods"],2:["t2","Instance
Methods"],8:["t4","Concrete Methods"]};
+var altColor = "altColor";
+var rowColor = "rowColor";
+var tableTab = "tableTab";
+var activeTableTab = "activeTableTab";
+
+
+JavaScript is disabled on your browser.
+
+
+
+
+
+Skip navigation links
+
+
+
+
+Overview
+Package
+Class
+Use
+Tree
+Deprecated
+Index
+Help
+
+
+
+
+PrevClass
+NextClass
+
+
+Frames
+NoFrames
+
+
+AllClasses
+
+
+
+
+
+
+
+Summary:
+Nested|
+Field|
+Constr|
+Method
+
+
+Detail:
+Field|
+Constr|
+Method
+
+
+
+
+
+
+
+
+org.apache.beam.runners.core
+Class PaneInfoTracker
+
+
+
+http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true;
title="class or interface in java.lang">java.lang.Object
+
+
+org.apache.beam.runners.core.PaneInfoTracker
+
+
+
+
+
+
+
+
+public class PaneInfoTracker
+extends http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true;
title="class or interface in java.lang">Object
+Determine the timing and other properties of a new pane for
a given computation, key and window.
+ Incorporates any previous pane, whether the pane has been produced because an
+ on-time AfterWatermark
trigger firing, and the relation between the element's timestamp
+ and the current output watermark.
+
+
+
+
+
+
+
+
+
+
+
+Constructor Summary
+
+Constructors
+
+Constructor and Description
+
+
+PaneInfoTracker(TimerInternalstimerInternals)
+
+
+
+
+
+
+
+
+
+Method Summary
+
+All MethodsInstance MethodsConcrete Methods
+
+Modifier and Type
+Method and Description
+
+
+void
+clear(StateAccessor?state)
+
+
+ReadableStatePaneInfo
+getNextPaneInfo(ReduceFn.Contextcontext,
+ booleanisFinal)
+Return a (ReadableState for) the pane
info appropriate for context.
+
+
+
+void
+storeCurrentPaneInfo(ReduceFn.Contextcontext,
+PaneInfocurrentPane)
+
+
+
+
+
+
+Methods inherited from classjava.lang.http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true;
title="class or interface in java.lang">Object
+http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#clone--;
title="class or interface in java.lang">clone, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#equals-java.lang.Object-;
title="class or interface in java.lang">equals, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#finalize--;
title="class or interface in java.lang">finalize, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#getClass--;
title="class or interface in java.lang">getClass, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#hashCode--;
title="class or interface in java.lang">hashCode, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#notify--;
title="class or interface in java.lang">notify, http://docs.oracle.com/javase/7/docs/api/java/lang
/Object.html?is-external=true#notifyAll--" title="class or interface in
java.lang">notifyAll, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#toString--;
title="class or interface in java.lang">toString, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#wait--;
title="class or interface in java.lang">wait, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#wait-long-;
title="class or interface in java.lang">wait, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#wait-long-int-;
title="class or interface in java.lang">wait
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+Constructor Detail
+
+
+
+
+
+PaneInfoTracker
+publicPaneInfoTracker(TimerInternalstimerInternals)
+
+
+
+
+
[10/51] [abbrv] [partial] incubator-beam-site git commit: Rebuild site
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/dataflow/DataflowJobUpdatedException.html
--
diff --git
a/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/dataflow/DataflowJobUpdatedException.html
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/dataflow/DataflowJobUpdatedException.html
new file mode 100644
index 000..885e30a
--- /dev/null
+++
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/dataflow/DataflowJobUpdatedException.html
@@ -0,0 +1,347 @@
+http://www.w3.org/TR/html4/loose.dtd;>
+
+
+
+
+
+DataflowJobUpdatedException (Apache Beam SDK for Java, version
0.3.0-incubating)
+
+
+
+
+
+
+var methods = {"i0":10};
+var tabs = {65535:["t0","All Methods"],2:["t2","Instance
Methods"],8:["t4","Concrete Methods"]};
+var altColor = "altColor";
+var rowColor = "rowColor";
+var tableTab = "tableTab";
+var activeTableTab = "activeTableTab";
+
+
+JavaScript is disabled on your browser.
+
+
+
+
+
+Skip navigation links
+
+
+
+
+Overview
+Package
+Class
+Use
+Tree
+Deprecated
+Index
+Help
+
+
+
+
+PrevClass
+NextClass
+
+
+Frames
+NoFrames
+
+
+AllClasses
+
+
+
+
+
+
+
+Summary:
+Nested|
+Field|
+Constr|
+Method
+
+
+Detail:
+Field|
+Constr|
+Method
+
+
+
+
+
+
+
+
+org.apache.beam.runners.dataflow
+Class
DataflowJobUpdatedException
+
+
+
+http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true;
title="class or interface in java.lang">java.lang.Object
+
+
+http://docs.oracle.com/javase/7/docs/api/java/lang/Throwable.html?is-external=true;
title="class or interface in java.lang">java.lang.Throwable
+
+
+http://docs.oracle.com/javase/7/docs/api/java/lang/Exception.html?is-external=true;
title="class or interface in java.lang">java.lang.Exception
+
+
+http://docs.oracle.com/javase/7/docs/api/java/lang/RuntimeException.html?is-external=true;
title="class or interface in java.lang">java.lang.RuntimeException
+
+
+org.apache.beam.runners.dataflow.DataflowJobException
+
+
+org.apache.beam.runners.dataflow.DataflowJobUpdatedException
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+All Implemented Interfaces:
+http://docs.oracle.com/javase/7/docs/api/java/io/Serializable.html?is-external=true;
title="class or interface in java.io">Serializable
+
+
+
+public class DataflowJobUpdatedException
+extends DataflowJobException
+Signals that a job run by a BlockingDataflowRunner was
updated during execution.
+
+See Also:
+Serialized
Form
+
+
+
+
+
+
+
+
+
+
+
+
+Constructor Summary
+
+Constructors
+
+Constructor and Description
+
+
+DataflowJobUpdatedException(DataflowPipelineJobjob,
+ http://docs.oracle.com/javase/7/docs/api/java/lang/String.html?is-external=true;
title="class or interface in java.lang">Stringmessage,
+ DataflowPipelineJobreplacedByJob)
+Create a new DataflowJobUpdatedException with
the specified original DataflowPipelineJob,
message, and replacement DataflowPipelineJob.
+
+
+
+DataflowJobUpdatedException(DataflowPipelineJobjob,
+ http://docs.oracle.com/javase/7/docs/api/java/lang/String.html?is-external=true;
title="class or interface in java.lang">Stringmessage,
+ DataflowPipelineJobreplacedByJob,
+ http://docs.oracle.com/javase/7/docs/api/java/lang/Throwable.html?is-external=true;
title="class or interface in java.lang">Throwablecause)
+Create a new DataflowJobUpdatedException with
the specified original DataflowPipelineJob,
message, replacement DataflowPipelineJob, and
cause.
+
+
+
+
+
+
+
+
+
+
+Method Summary
+
+All MethodsInstance MethodsConcrete Methods
+
+Modifier and Type
+Method and Description
+
+
+DataflowPipelineJob
+getReplacedByJob()
+The new job that replaces the job terminated with this
exception.
+
+
+
+
+
+
+
+Methods inherited from classorg.apache.beam.runners.dataflow.DataflowJobException
+getJob
+
+
+
+
+
+Methods inherited from classjava.lang.http://docs.oracle.com/javase/7/docs/api/java/lang/Throwable.html?is-external=true;
title="class or interface in java.lang">Throwable
+http://docs.oracle.com/javase/7/docs/api/java/lang/Throwable.html?is-external=true#addSuppressed-java.lang.Throwable-;
title="class or interface in java.lang">addSuppressed, http://docs.oracle.com/javase/7/docs/api/java/lang/Throwable.html?is-external=true#fillInStackTrace--;
[23/51] [abbrv] [partial] incubator-beam-site git commit: Rebuild site
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/FinishedTriggersBitSet.html
--
diff --git
a/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/FinishedTriggersBitSet.html
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/FinishedTriggersBitSet.html
new file mode 100644
index 000..6572995
--- /dev/null
+++
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/FinishedTriggersBitSet.html
@@ -0,0 +1,360 @@
+http://www.w3.org/TR/html4/loose.dtd;>
+
+
+
+
+
+FinishedTriggersBitSet (Apache Beam SDK for Java, version
0.3.0-incubating)
+
+
+
+
+
+
+var methods = {"i0":10,"i1":10,"i2":9,"i3":9,"i4":10,"i5":10,"i6":10};
+var tabs = {65535:["t0","All Methods"],1:["t1","Static
Methods"],2:["t2","Instance Methods"],8:["t4","Concrete Methods"]};
+var altColor = "altColor";
+var rowColor = "rowColor";
+var tableTab = "tableTab";
+var activeTableTab = "activeTableTab";
+
+
+JavaScript is disabled on your browser.
+
+
+
+
+
+Skip navigation links
+
+
+
+
+Overview
+Package
+Class
+Use
+Tree
+Deprecated
+Index
+Help
+
+
+
+
+PrevClass
+NextClass
+
+
+Frames
+NoFrames
+
+
+AllClasses
+
+
+
+
+
+
+
+Summary:
+Nested|
+Field|
+Constr|
+Method
+
+
+Detail:
+Field|
+Constr|
+Method
+
+
+
+
+
+
+
+
+org.apache.beam.runners.core.triggers
+Class
FinishedTriggersBitSet
+
+
+
+http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true;
title="class or interface in java.lang">java.lang.Object
+
+
+org.apache.beam.runners.core.triggers.FinishedTriggersBitSet
+
+
+
+
+
+
+
+All Implemented Interfaces:
+FinishedTriggers
+
+
+
+public class FinishedTriggersBitSet
+extends http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true;
title="class or interface in java.lang">Object
+implements FinishedTriggers
+A FinishedTriggers
implementation based on an underlying http://docs.oracle.com/javase/7/docs/api/java/util/BitSet.html?is-external=true;
title="class or interface in java.util">BitSet.
+
+
+
+
+
+
+
+
+
+
+
+Method Summary
+
+All MethodsStatic MethodsInstance MethodsConcrete Methods
+
+Modifier and Type
+Method and Description
+
+
+void
+clearRecursively(ExecutableTriggerStateMachinetrigger)
+Sets the trigger and all of its subtriggers to
unfinished.
+
+
+
+FinishedTriggersBitSet
+copy()
+Create an independent copy of this mutable FinishedTriggers.
+
+
+
+static FinishedTriggersBitSet
+emptyWithCapacity(intcapacity)
+
+
+static FinishedTriggersBitSet
+fromBitSet(http://docs.oracle.com/javase/7/docs/api/java/util/BitSet.html?is-external=true;
title="class or interface in
java.util">BitSetbitSet)
+
+
+http://docs.oracle.com/javase/7/docs/api/java/util/BitSet.html?is-external=true;
title="class or interface in java.util">BitSet
+getBitSet()
+Returns the underlying http://docs.oracle.com/javase/7/docs/api/java/util/BitSet.html?is-external=true;
title="class or interface in java.util">BitSet for this FinishedTriggersBitSet.
+
+
+
+boolean
+isFinished(ExecutableTriggerStateMachinetrigger)
+Returns true if the trigger is finished.
+
+
+
+void
+setFinished(ExecutableTriggerStateMachinetrigger,
+ booleanvalue)
+Sets the fact that the trigger is finished.
+
+
+
+
+
+
+
+Methods inherited from classjava.lang.http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true;
title="class or interface in java.lang">Object
+http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#clone--;
title="class or interface in java.lang">clone, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#equals-java.lang.Object-;
title="class or interface in java.lang">equals, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#finalize--;
title="class or interface in java.lang">finalize, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#getClass--;
title="class or interface in java.lang">getClass, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#hashCode--;
title="class or interface in java.lang">hashCode, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#notify--;
title="class or interface in java.lang">notify, http://docs.oracle.com/javase/7/docs/api/java/lang
[05/51] [abbrv] [partial] incubator-beam-site git commit: Rebuild site
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/dataflow/class-use/DataflowPipelineTranslator.TranslationContext.html -- diff --git a/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/dataflow/class-use/DataflowPipelineTranslator.TranslationContext.html b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/dataflow/class-use/DataflowPipelineTranslator.TranslationContext.html new file mode 100644 index 000..cd47d49 --- /dev/null +++ b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/dataflow/class-use/DataflowPipelineTranslator.TranslationContext.html @@ -0,0 +1,169 @@ +http://www.w3.org/TR/html4/loose.dtd;> + + + + + +Uses of Interface org.apache.beam.runners.dataflow.DataflowPipelineTranslator.TranslationContext (Apache Beam SDK for Java, version 0.3.0-incubating) + + + + + + + + +JavaScript is disabled on your browser. + + + + + +Skip navigation links + + + + +Overview +Package +Class +Use +Tree +Deprecated +Index +Help + + + + +Prev +Next + + +Frames +NoFrames + + +AllClasses + + + + + + + + + + +Uses of Interfaceorg.apache.beam.runners.dataflow.DataflowPipelineTranslator.TranslationContext + + + + + +Packages that use DataflowPipelineTranslator.TranslationContext + +Package +Description + + + +org.apache.beam.runners.dataflow + +Provides a Beam runner that executes pipelines on the Google Cloud Dataflow service. + + + + + + + + + + +Uses of DataflowPipelineTranslator.TranslationContext in org.apache.beam.runners.dataflow + +Methods in org.apache.beam.runners.dataflow with parameters of type DataflowPipelineTranslator.TranslationContext + +Modifier and Type +Method and Description + + + +void +DataflowPipelineTranslator.TransformTranslator.translate(TransformTtransform, + DataflowPipelineTranslator.TranslationContextcontext) + + + + + + + + + + + + +Skip navigation links + + + + +Overview +Package +Class +Use +Tree +Deprecated +Index +Help + + + + +Prev +Next + + +Frames +NoFrames + + +AllClasses + + + + + + + + + +Copyright 2016 http://www.apache.org/;>The Apache Software Foundation. All rights reserved. + + http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/dataflow/class-use/DataflowPipelineTranslator.html -- diff --git a/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/dataflow/class-use/DataflowPipelineTranslator.html b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/dataflow/class-use/DataflowPipelineTranslator.html new file mode 100644 index 000..32347ce --- /dev/null +++ b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/dataflow/class-use/DataflowPipelineTranslator.html @@ -0,0 +1,176 @@ +http://www.w3.org/TR/html4/loose.dtd;> + + + + + +Uses of Class org.apache.beam.runners.dataflow.DataflowPipelineTranslator (Apache Beam SDK for Java, version 0.3.0-incubating) + + + + + + + + +JavaScript is disabled on your browser. + + + + + +Skip navigation links + + + + +Overview +Package +Class +Use +Tree +Deprecated +Index +Help + + + + +Prev +Next + + +Frames +NoFrames + + +AllClasses + + + + + + + + + + +Uses of Classorg.apache.beam.runners.dataflow.DataflowPipelineTranslator + + + + + +Packages that use DataflowPipelineTranslator + +Package +Description + + + +org.apache.beam.runners.dataflow + +Provides a Beam runner that executes pipelines on the Google Cloud Dataflow service. + + + + + + + + + + +Uses of
[50/51] [abbrv] [partial] incubator-beam-site git commit: Rebuild site
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/contribute/contribution-guide/index.html -- diff --git a/content/contribute/contribution-guide/index.html b/content/contribute/contribution-guide/index.html index a1b1aaa..8a1b810 100644 --- a/content/contribute/contribution-guide/index.html +++ b/content/contribute/contribution-guide/index.html @@ -161,7 +161,10 @@ Fork the repository on GitHub Clone the repository locally [Optional] IDE Setup - Intellij + IntelliJ + Checkstyle + + Eclipse @@ -296,9 +299,41 @@ $ cd incubator-beam Depending on your preferred development environment, you may need to prepare it to develop Beam code. -Intellij +IntelliJ -If you are an Intellij user, please contribute instructions! See https://issues.apache.org/jira/browse/BEAM-835;>BEAM-835. +This documentation is incomplete. If you are an Intellij user, please contribute instructions! +See https://issues.apache.org/jira/browse/BEAM-835;>BEAM-835. + +Checkstyle +IntelliJ supports checkstyle within the IDE using the Checkstyle-IDEA plugin. + + + Install the âCheckstyle-IDEAâ plugin from the IntelliJ plugin repository. + Configure the plugin by going to Settings - Other Settings - Checkstyle. + Set the âScan Scopeâ to âOnly Java sources (including tests)â. + In the âConfiguration Fileâ pane, add a new configuration using the plus icon: + + Set the âDescriptionâ to âBeamâ. + Select âUse a local Checkstyle fileâ, and point it to + âsdks/java/build-tools/src/main/resources/beam/checkstyle.xmlâ within + your repository. + Check the box for âStore relative to project locationâ, and click + âNextâ. + Configure the âcheckstyle.suppressions.fileâ property value to + âsuppressions.xmlâ, and click âNextâ, then âFinishâ. + + + Select âBeamâ as the only active configuration file, and click âApplyâ and +âOKâ. + Checkstyle will now give warnings in the editor for any Checkstyle +violations. + + +You can also scan an entire module by opening the Checkstyle tools window and +clicking the âCheck Moduleâ button. The scan should report no errors. + +Note: Selecting âCheck Projectâ may report some errors from the archetype +modules as they are not configured for Checkstyle validation. Eclipse
[08/51] [abbrv] [partial] incubator-beam-site git commit: Rebuild site
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/dataflow/DataflowPipelineTranslator.TranslationContext.html
--
diff --git
a/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/dataflow/DataflowPipelineTranslator.TranslationContext.html
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/dataflow/DataflowPipelineTranslator.TranslationContext.html
new file mode 100644
index 000..01e98af
--- /dev/null
+++
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/dataflow/DataflowPipelineTranslator.TranslationContext.html
@@ -0,0 +1,540 @@
+http://www.w3.org/TR/html4/loose.dtd;>
+
+
+
+
+
+DataflowPipelineTranslator.TranslationContext (Apache Beam SDK for
Java, version 0.3.0-incubating)
+
+
+
+
+
+
+var methods =
{"i0":6,"i1":6,"i2":6,"i3":6,"i4":6,"i5":6,"i6":6,"i7":6,"i8":6,"i9":6,"i10":6,"i11":6,"i12":6,"i13":6,"i14":6,"i15":6,"i16":6};
+var tabs = {65535:["t0","All Methods"],2:["t2","Instance
Methods"],4:["t3","Abstract Methods"]};
+var altColor = "altColor";
+var rowColor = "rowColor";
+var tableTab = "tableTab";
+var activeTableTab = "activeTableTab";
+
+
+JavaScript is disabled on your browser.
+
+
+
+
+
+Skip navigation links
+
+
+
+
+Overview
+Package
+Class
+Use
+Tree
+Deprecated
+Index
+Help
+
+
+
+
+PrevClass
+NextClass
+
+
+Frames
+NoFrames
+
+
+AllClasses
+
+
+
+
+
+
+
+Summary:
+Nested|
+Field|
+Constr|
+Method
+
+
+Detail:
+Field|
+Constr|
+Method
+
+
+
+
+
+
+
+
+org.apache.beam.runners.dataflow
+Interface DataflowPipelineTranslator.TranslationContext
+
+
+
+
+
+
+Enclosing class:
+DataflowPipelineTranslator
+
+
+
+public static interface DataflowPipelineTranslator.TranslationContext
+The interface provided to registered callbacks for
interacting
+ with the DataflowRunner, including
reading and writing the
+ values of PCollections and side inputs
(PCollectionViews).
+
+
+
+
+
+
+
+
+
+
+
+Method Summary
+
+All MethodsInstance MethodsAbstract Methods
+
+Modifier and Type
+Method and Description
+
+
+long
+addCollectionToSingletonOutput(PValueinputValue,
+ PValueoutputValue)
+Adds an output to the previously added
CollectionToSingleton Dataflow step,
+ consuming the specified input PValue and producing the specified
output
+ PValue.
+
+
+
+void
+addEncodingInput(Coder?value)
+Sets the encoding for the current Dataflow step.
+
+
+
+void
+addInput(http://docs.oracle.com/javase/7/docs/api/java/lang/String.html?is-external=true;
title="class or interface in java.lang">Stringname,
+http://docs.oracle.com/javase/7/docs/api/java/lang/Boolean.html?is-external=true;
title="class or interface in java.lang">Booleanvalue)
+Adds an input with the given name and value to the current
+ Dataflow step.
+
+
+
+void
+addInput(http://docs.oracle.com/javase/7/docs/api/java/lang/String.html?is-external=true;
title="class or interface in java.lang">Stringname,
+http://docs.oracle.com/javase/7/docs/api/java/util/List.html?is-external=true;
title="class or interface in java.util">List? extends http://docs.oracle.com/javase/7/docs/api/java/util/Map.html?is-external=true;
title="class or interface in java.util">Maphttp://docs.oracle.com/javase/7/docs/api/java/lang/String.html?is-external=true;
title="class or interface in java.lang">String,http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true;
title="class or interface in
java.lang">Objectelements)
+Adds an input that is a list of objects.
+
+
+
+void
+addInput(http://docs.oracle.com/javase/7/docs/api/java/lang/String.html?is-external=true;
title="class or interface in java.lang">Stringname,
+http://docs.oracle.com/javase/7/docs/api/java/lang/Long.html?is-external=true;
title="class or interface in java.lang">Longvalue)
+Adds an input with the given name and value to the current
+ Dataflow step.
+
+
+
+void
+addInput(http://docs.oracle.com/javase/7/docs/api/java/lang/String.html?is-external=true;
title="class or interface in java.lang">Stringname,
+http://docs.oracle.com/javase/7/docs/api/java/util/Map.html?is-external=true;
title="class or interface in java.util">Maphttp://docs.oracle.com/javase/7/docs/api/java/lang/String.html?is-external=true;
title="class or interface in java.lang">String,http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true;
[12/51] [abbrv] [partial] incubator-beam-site git commit: Rebuild site
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/package-tree.html -- diff --git a/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/package-tree.html b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/package-tree.html new file mode 100644 index 000..0e8cb3f --- /dev/null +++ b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/package-tree.html @@ -0,0 +1,183 @@ +http://www.w3.org/TR/html4/loose.dtd;> + + + + + +org.apache.beam.runners.core.triggers Class Hierarchy (Apache Beam SDK for Java, version 0.3.0-incubating) + + + + + + + + +JavaScript is disabled on your browser. + + + + + +Skip navigation links + + + + +Overview +Package +Class +Use +Tree +Deprecated +Index +Help + + + + +Prev +Next + + +Frames +NoFrames + + +AllClasses + + + + + + + + + + +Hierarchy For Package org.apache.beam.runners.core.triggers +Package Hierarchies: + +All Packages + + + +Class Hierarchy + +java.lang.http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true; title="class or interface in java.lang">Object + +org.apache.beam.runners.core.triggers.AfterWatermarkStateMachine +org.apache.beam.runners.core.triggers.ExecutableTriggerStateMachine (implements java.io.http://docs.oracle.com/javase/7/docs/api/java/io/Serializable.html?is-external=true; title="class or interface in java.io">Serializable) +org.apache.beam.runners.core.triggers.FinishedTriggersBitSet (implements org.apache.beam.runners.core.triggers.FinishedTriggers) +org.apache.beam.runners.core.triggers.FinishedTriggersSet (implements org.apache.beam.runners.core.triggers.FinishedTriggers) +org.apache.beam.runners.core.triggers.TriggerStateMachine (implements java.io.http://docs.oracle.com/javase/7/docs/api/java/io/Serializable.html?is-external=true; title="class or interface in java.io">Serializable) + +org.apache.beam.runners.core.triggers.AfterEachStateMachine +org.apache.beam.runners.core.triggers.AfterWatermarkStateMachine.AfterWatermarkEarlyAndLate +org.apache.beam.runners.core.triggers.DefaultTriggerStateMachine +org.apache.beam.runners.core.triggers.RepeatedlyStateMachine +org.apache.beam.runners.core.triggers.ReshuffleTriggerStateMachine +org.apache.beam.runners.core.triggers.TriggerStateMachine.OnceTriggerStateMachine + +org.apache.beam.runners.core.triggers.AfterAllStateMachine +org.apache.beam.runners.core.triggers.AfterDelayFromFirstElementStateMachine + +org.apache.beam.runners.core.triggers.AfterProcessingTimeStateMachine + + +org.apache.beam.runners.core.triggers.AfterFirstStateMachine +org.apache.beam.runners.core.triggers.AfterPaneStateMachine +org.apache.beam.runners.core.triggers.AfterWatermarkStateMachine.FromEndOfWindow +org.apache.beam.runners.core.triggers.NeverStateMachine + + + + +org.apache.beam.runners.core.triggers.TriggerStateMachine.TriggerContext + +org.apache.beam.runners.core.triggers.TriggerStateMachine.OnElementContext +org.apache.beam.runners.core.triggers.TriggerStateMachine.OnMergeContext + + +org.apache.beam.runners.core.triggers.TriggerStateMachineContextFactoryW +org.apache.beam.runners.core.triggers.TriggerStateMachineRunnerW +org.apache.beam.runners.core.triggers.TriggerStateMachines + + + +Interface Hierarchy + +org.apache.beam.runners.core.triggers.FinishedTriggers +org.apache.beam.runners.core.triggers.TriggerStateMachine.TriggerInfo + +org.apache.beam.runners.core.triggers.TriggerStateMachine.MergingTriggerInfo + + + + + + + + +Skip navigation links + + + + +Overview +Package +Class +Use +Tree +Deprecated +Index +Help + + + + +Prev +Next + + +Frames +NoFrames + + +AllClasses + + + + + + + + + +Copyright 2016 http://www.apache.org/;>The Apache Software Foundation. All rights reserved. + + http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/package-use.html -- diff --git
[20/51] [abbrv] [partial] incubator-beam-site git commit: Rebuild site
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/TriggerStateMachine.TriggerContext.html
--
diff --git
a/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/TriggerStateMachine.TriggerContext.html
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/TriggerStateMachine.TriggerContext.html
new file mode 100644
index 000..c891853
--- /dev/null
+++
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/TriggerStateMachine.TriggerContext.html
@@ -0,0 +1,405 @@
+http://www.w3.org/TR/html4/loose.dtd;>
+
+
+
+
+
+TriggerStateMachine.TriggerContext (Apache Beam SDK for Java, version
0.3.0-incubating)
+
+
+
+
+
+
+var methods = {"i0":6,"i1":6,"i2":6,"i3":6,"i4":6,"i5":6,"i6":6,"i7":6};
+var tabs = {65535:["t0","All Methods"],2:["t2","Instance
Methods"],4:["t3","Abstract Methods"]};
+var altColor = "altColor";
+var rowColor = "rowColor";
+var tableTab = "tableTab";
+var activeTableTab = "activeTableTab";
+
+
+JavaScript is disabled on your browser.
+
+
+
+
+
+Skip navigation links
+
+
+
+
+Overview
+Package
+Class
+Use
+Tree
+Deprecated
+Index
+Help
+
+
+
+
+PrevClass
+NextClass
+
+
+Frames
+NoFrames
+
+
+AllClasses
+
+
+
+
+
+
+
+Summary:
+Nested|
+Field|
+Constr|
+Method
+
+
+Detail:
+Field|
+Constr|
+Method
+
+
+
+
+
+
+
+
+org.apache.beam.runners.core.triggers
+Class
TriggerStateMachine.TriggerContext
+
+
+
+http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true;
title="class or interface in java.lang">java.lang.Object
+
+
+org.apache.beam.runners.core.triggers.TriggerStateMachine.TriggerContext
+
+
+
+
+
+
+
+Direct Known Subclasses:
+TriggerStateMachine.OnElementContext,
TriggerStateMachine.OnMergeContext
+
+
+Enclosing class:
+TriggerStateMachine
+
+
+
+public abstract class TriggerStateMachine.TriggerContext
+extends http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true;
title="class or interface in java.lang">Object
+Information accessible to all operational hooks in this
Trigger.
+
+ Used directly in TriggerStateMachine.shouldFire(org.apache.beam.runners.core.triggers.TriggerStateMachine.TriggerContext)
and TriggerStateMachine.clear(org.apache.beam.runners.core.triggers.TriggerStateMachine.TriggerContext),
and extended with additional information in other methods.
+
+
+
+
+
+
+
+
+
+
+
+Constructor Summary
+
+Constructors
+
+Constructor and Description
+
+
+TriggerContext()
+
+
+
+
+
+
+
+
+
+Method Summary
+
+All MethodsInstance MethodsAbstract Methods
+
+Modifier and Type
+Method and Description
+
+
+abstract org.joda.time.Instant
+currentEventTime()
+The current event time for the input or null
if unknown.
+
+
+
+abstract org.joda.time.Instant
+currentProcessingTime()
+The current processing time.
+
+
+
+abstract org.joda.time.Instant
+currentSynchronizedProcessingTime()
+The current synchronized upstream processing time or
null if unknown.
+
+
+
+abstract void
+deleteTimer(org.joda.time.Instanttimestamp,
+ TimeDomaindomain)
+Removes the timer set in this trigger context for the given
Instant
+ and TimeDomain.
+
+
+
+abstract TriggerStateMachine.TriggerContext
+forTrigger(ExecutableTriggerStateMachinetrigger)
+Create a sub-context for the given sub-trigger.
+
+
+
+abstract StateAccessor?
+state()
+Returns the interface for accessing persistent state.
+
+
+
+abstract TriggerStateMachine.TriggerInfo
+trigger()
+Returns the interface for accessing trigger info.
+
+
+
+abstract BoundedWindow
+window()
+The window that the current context is executing in.
+
+
+
+
+
+
+
+Methods inherited from classjava.lang.http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true;
title="class or interface in java.lang">Object
+http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#clone--;
title="class or interface in java.lang">clone, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#equals-java.lang.Object-;
title="class or interface in java.lang">equals, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#finalize--;
title="class or interface in java.lang">finalize, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#getClass--;
title="class or interface in java.lang">getClass,
[30/51] [abbrv] [partial] incubator-beam-site git commit: Rebuild site
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/class-use/UnboundedReadFromBoundedSource.BoundedToUnboundedSourceAdapter.html -- diff --git a/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/class-use/UnboundedReadFromBoundedSource.BoundedToUnboundedSourceAdapter.html b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/class-use/UnboundedReadFromBoundedSource.BoundedToUnboundedSourceAdapter.html new file mode 100644 index 000..21cc3ad --- /dev/null +++ b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/class-use/UnboundedReadFromBoundedSource.BoundedToUnboundedSourceAdapter.html @@ -0,0 +1,169 @@ +http://www.w3.org/TR/html4/loose.dtd;> + + + + + +Uses of Class org.apache.beam.runners.core.UnboundedReadFromBoundedSource.BoundedToUnboundedSourceAdapter (Apache Beam SDK for Java, version 0.3.0-incubating) + + + + + + + + +JavaScript is disabled on your browser. + + + + + +Skip navigation links + + + + +Overview +Package +Class +Use +Tree +Deprecated +Index +Help + + + + +Prev +Next + + +Frames +NoFrames + + +AllClasses + + + + + + + + + + +Uses of Classorg.apache.beam.runners.core.UnboundedReadFromBoundedSource.BoundedToUnboundedSourceAdapter + + + + + +Packages that use UnboundedReadFromBoundedSource.BoundedToUnboundedSourceAdapter + +Package +Description + + + +org.apache.beam.runners.core + +Provides utilities for Beam runner authors. + + + + + + + + + + +Uses of UnboundedReadFromBoundedSource.BoundedToUnboundedSourceAdapter in org.apache.beam.runners.core + +Methods in org.apache.beam.runners.core that return types with arguments of type UnboundedReadFromBoundedSource.BoundedToUnboundedSourceAdapter + +Modifier and Type +Method and Description + + + +http://docs.oracle.com/javase/7/docs/api/java/util/List.html?is-external=true; title="class or interface in java.util">ListUnboundedReadFromBoundedSource.BoundedToUnboundedSourceAdapterT +UnboundedReadFromBoundedSource.BoundedToUnboundedSourceAdapter.generateInitialSplits(intdesiredNumSplits, + PipelineOptionsoptions) + + + + + + + + + + + + +Skip navigation links + + + + +Overview +Package +Class +Use +Tree +Deprecated +Index +Help + + + + +Prev +Next + + +Frames +NoFrames + + +AllClasses + + + + + + + + + +Copyright 2016 http://www.apache.org/;>The Apache Software Foundation. All rights reserved. + + http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/class-use/UnboundedReadFromBoundedSource.html -- diff --git a/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/class-use/UnboundedReadFromBoundedSource.html b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/class-use/UnboundedReadFromBoundedSource.html new file mode 100644 index 000..1364258 --- /dev/null +++ b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/class-use/UnboundedReadFromBoundedSource.html @@ -0,0 +1,126 @@ +http://www.w3.org/TR/html4/loose.dtd;> + + + + + +Uses of Class org.apache.beam.runners.core.UnboundedReadFromBoundedSource (Apache Beam SDK for Java, version 0.3.0-incubating) + + + + + + + + +JavaScript is disabled on your browser. + + + + + +Skip navigation links + + + + +Overview +Package +Class +Use +Tree +Deprecated +Index +Help + + + + +Prev +Next + + +Frames +NoFrames + + +AllClasses + + + + + + + + + + +Uses of
[09/51] [abbrv] [partial] incubator-beam-site git commit: Rebuild site
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/dataflow/DataflowPipelineRegistrar.Runner.html
--
diff --git
a/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/dataflow/DataflowPipelineRegistrar.Runner.html
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/dataflow/DataflowPipelineRegistrar.Runner.html
new file mode 100644
index 000..9c9273b
--- /dev/null
+++
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/dataflow/DataflowPipelineRegistrar.Runner.html
@@ -0,0 +1,292 @@
+http://www.w3.org/TR/html4/loose.dtd;>
+
+
+
+
+
+DataflowPipelineRegistrar.Runner (Apache Beam SDK for Java, version
0.3.0-incubating)
+
+
+
+
+
+
+var methods = {"i0":10};
+var tabs = {65535:["t0","All Methods"],2:["t2","Instance
Methods"],8:["t4","Concrete Methods"]};
+var altColor = "altColor";
+var rowColor = "rowColor";
+var tableTab = "tableTab";
+var activeTableTab = "activeTableTab";
+
+
+JavaScript is disabled on your browser.
+
+
+
+
+
+Skip navigation links
+
+
+
+
+Overview
+Package
+Class
+Use
+Tree
+Deprecated
+Index
+Help
+
+
+
+
+PrevClass
+NextClass
+
+
+Frames
+NoFrames
+
+
+AllClasses
+
+
+
+
+
+
+
+Summary:
+Nested|
+Field|
+Constr|
+Method
+
+
+Detail:
+Field|
+Constr|
+Method
+
+
+
+
+
+
+
+
+org.apache.beam.runners.dataflow
+Class
DataflowPipelineRegistrar.Runner
+
+
+
+http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true;
title="class or interface in java.lang">java.lang.Object
+
+
+org.apache.beam.runners.dataflow.DataflowPipelineRegistrar.Runner
+
+
+
+
+
+
+
+All Implemented Interfaces:
+PipelineRunnerRegistrar
+
+
+Enclosing class:
+DataflowPipelineRegistrar
+
+
+
+@AutoService(value=PipelineRunnerRegistrar.class)
+public static class DataflowPipelineRegistrar.Runner
+extends http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true;
title="class or interface in java.lang">Object
+implements PipelineRunnerRegistrar
+Register the DataflowRunner and BlockingDataflowRunner.
+
+
+
+
+
+
+
+
+
+
+
+Constructor Summary
+
+Constructors
+
+Constructor and Description
+
+
+Runner()
+
+
+
+
+
+
+
+
+
+Method Summary
+
+All MethodsInstance MethodsConcrete Methods
+
+Modifier and Type
+Method and Description
+
+
+http://docs.oracle.com/javase/7/docs/api/java/lang/Iterable.html?is-external=true;
title="class or interface in java.lang">Iterablehttp://docs.oracle.com/javase/7/docs/api/java/lang/Class.html?is-external=true;
title="class or interface in java.lang">Class? extends PipelineRunner?
+getPipelineRunners()
+Get the set of PipelineRunners
to register.
+
+
+
+
+
+
+
+Methods inherited from classjava.lang.http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true;
title="class or interface in java.lang">Object
+http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#clone--;
title="class or interface in java.lang">clone, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#equals-java.lang.Object-;
title="class or interface in java.lang">equals, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#finalize--;
title="class or interface in java.lang">finalize, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#getClass--;
title="class or interface in java.lang">getClass, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#hashCode--;
title="class or interface in java.lang">hashCode, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#notify--;
title="class or interface in java.lang">notify, http://docs.oracle.com/javase/7/docs/api/java/lang
/Object.html?is-external=true#notifyAll--" title="class or interface in
java.lang">notifyAll, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#toString--;
title="class or interface in java.lang">toString, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#wait--;
title="class or interface in java.lang">wait, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#wait-long-;
title="class or interface in java.lang">wait, http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#wait-long-int-;
title="class or interface in java.lang">wait
+
+
+
+
+
+
[24/51] [abbrv] [partial] incubator-beam-site git commit: Rebuild site
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/DefaultTriggerStateMachine.html
--
diff --git
a/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/DefaultTriggerStateMachine.html
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/DefaultTriggerStateMachine.html
new file mode 100644
index 000..e13bcf4
--- /dev/null
+++
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/core/triggers/DefaultTriggerStateMachine.html
@@ -0,0 +1,458 @@
+http://www.w3.org/TR/html4/loose.dtd;>
+
+
+
+
+
+DefaultTriggerStateMachine (Apache Beam SDK for Java, version
0.3.0-incubating)
+
+
+
+
+
+
+var methods = {"i0":10,"i1":10,"i2":9,"i3":10,"i4":10,"i5":10,"i6":10};
+var tabs = {65535:["t0","All Methods"],1:["t1","Static
Methods"],2:["t2","Instance Methods"],8:["t4","Concrete Methods"]};
+var altColor = "altColor";
+var rowColor = "rowColor";
+var tableTab = "tableTab";
+var activeTableTab = "activeTableTab";
+
+
+JavaScript is disabled on your browser.
+
+
+
+
+
+Skip navigation links
+
+
+
+
+Overview
+Package
+Class
+Use
+Tree
+Deprecated
+Index
+Help
+
+
+
+
+PrevClass
+NextClass
+
+
+Frames
+NoFrames
+
+
+AllClasses
+
+
+
+
+
+
+
+Summary:
+Nested|
+Field|
+Constr|
+Method
+
+
+Detail:
+Field|
+Constr|
+Method
+
+
+
+
+
+
+
+
+org.apache.beam.runners.core.triggers
+Class
DefaultTriggerStateMachine
+
+
+
+http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true;
title="class or interface in java.lang">java.lang.Object
+
+
+org.apache.beam.runners.core.triggers.TriggerStateMachine
+
+
+org.apache.beam.runners.core.triggers.DefaultTriggerStateMachine
+
+
+
+
+
+
+
+
+
+All Implemented Interfaces:
+http://docs.oracle.com/javase/7/docs/api/java/io/Serializable.html?is-external=true;
title="class or interface in java.io">Serializable
+
+
+
+@Experimental(value=TRIGGER)
+public class DefaultTriggerStateMachine
+extends TriggerStateMachine
+A trigger that is equivalent to
Repeatedly.forever(AfterWatermark.pastEndOfWindow()). See
+ RepeatedlyStateMachine.forever(org.apache.beam.runners.core.triggers.TriggerStateMachine)
and AfterWatermarkStateMachine.pastEndOfWindow()
for
+ more details.
+
+See Also:
+Serialized
Form
+
+
+
+
+
+
+
+
+
+
+
+
+Nested Class Summary
+
+
+
+
+Nested classes/interfaces inherited from
classorg.apache.beam.runners.core.triggers.TriggerStateMachine
+TriggerStateMachine.MergingTriggerInfo,
TriggerStateMachine.OnceTriggerStateMachine,
TriggerStateMachine.OnElementContext,
TriggerStateMachine.OnMergeContext,
TriggerStateMachine.TriggerContext, TriggerStateMachine.TriggerInfo
+
+
+
+
+
+
+
+
+Field Summary
+
+
+
+
+Fields inherited from classorg.apache.beam.runners.core.triggers.TriggerStateMachine
+subTriggers
+
+
+
+
+
+
+
+
+Method Summary
+
+All MethodsStatic MethodsInstance MethodsConcrete Methods
+
+Modifier and Type
+Method and Description
+
+
+void
+clear(TriggerStateMachine.TriggerContextc)
+Clear any state associated with this trigger in the given
window.
+
+
+
+boolean
+isCompatible(TriggerStateMachineother)
+Returns whether this performs the same triggering as the
given Trigger.
+
+
+
+static DefaultTriggerStateMachine
+of()
+Returns the default trigger.
+
+
+
+void
+onElement(TriggerStateMachine.OnElementContextc)
+Called every time an element is incorporated into a
window.
+
+
+
+void
+onFire(TriggerStateMachine.TriggerContextcontext)
+Adjusts the state of the trigger to be ready for the next
pane.
+
+
+
+void
+onMerge(TriggerStateMachine.OnMergeContextc)
+Called immediately after windows have been merged.
+
+
+
+boolean
+shouldFire(TriggerStateMachine.TriggerContextcontext)
+Returns true if the current state of the
trigger indicates that its condition
+ is satisfied and it is ready to fire.
+
+
+
+
+
+
+
+Methods inherited from classorg.apache.beam.runners.core.triggers.TriggerStateMachine
+equals,
hashCode,
orFinally,
prefetchOnElement,
prefetchOnFire,
prefetchOnMerge,
prefetchShouldFire,
subTriggers,
toString
+
+
+
+
+
+Methods inherited from classjava.lang.http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true;
title="class or interface in java.lang">Object
+http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true#clone--;
title="class or interface in java.lang">clone,
[01/51] [abbrv] [partial] incubator-beam-site git commit: Rebuild site
Repository: incubator-beam-site
Updated Branches:
refs/heads/asf-site c60d96902 -> 141627ec4
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/blob/141627ec/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/dataflow/options/DataflowPipelineWorkerPoolOptions.TeardownPolicy.html
--
diff --git
a/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/dataflow/options/DataflowPipelineWorkerPoolOptions.TeardownPolicy.html
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/dataflow/options/DataflowPipelineWorkerPoolOptions.TeardownPolicy.html
new file mode 100644
index 000..13a0fb7
--- /dev/null
+++
b/content/learn/sdks/javadoc/0.3.0-incubating/org/apache/beam/runners/dataflow/options/DataflowPipelineWorkerPoolOptions.TeardownPolicy.html
@@ -0,0 +1,406 @@
+http://www.w3.org/TR/html4/loose.dtd;>
+
+
+
+
+
+DataflowPipelineWorkerPoolOptions.TeardownPolicy (Apache Beam SDK for
Java, version 0.3.0-incubating)
+
+
+
+
+
+
+var methods = {"i0":42,"i1":41,"i2":41};
+var tabs = {65535:["t0","All Methods"],1:["t1","Static
Methods"],2:["t2","Instance Methods"],8:["t4","Concrete
Methods"],32:["t6","Deprecated Methods"]};
+var altColor = "altColor";
+var rowColor = "rowColor";
+var tableTab = "tableTab";
+var activeTableTab = "activeTableTab";
+
+
+JavaScript is disabled on your browser.
+
+
+
+
+
+Skip navigation links
+
+
+
+
+Overview
+Package
+Class
+Use
+Tree
+Deprecated
+Index
+Help
+
+
+
+
+PrevClass
+NextClass
+
+
+Frames
+NoFrames
+
+
+AllClasses
+
+
+
+
+
+
+
+Summary:
+Nested|
+Enum Constants|
+Field|
+Method
+
+
+Detail:
+Enum Constants|
+Field|
+Method
+
+
+
+
+
+
+
+
+org.apache.beam.runners.dataflow.options
+Enum DataflowPipelineWorkerPoolOptions.TeardownPolicy
+
+
+
+http://docs.oracle.com/javase/7/docs/api/java/lang/Object.html?is-external=true;
title="class or interface in java.lang">java.lang.Object
+
+
+http://docs.oracle.com/javase/7/docs/api/java/lang/Enum.html?is-external=true;
title="class or interface in java.lang">java.lang.EnumDataflowPipelineWorkerPoolOptions.TeardownPolicy
+
+
+org.apache.beam.runners.dataflow.options.DataflowPipelineWorkerPoolOptions.TeardownPolicy
+
+
+
+
+
+
+
+
+
+All Implemented Interfaces:
+http://docs.oracle.com/javase/7/docs/api/java/io/Serializable.html?is-external=true;
title="class or interface in java.io">Serializable, http://docs.oracle.com/javase/7/docs/api/java/lang/Comparable.html?is-external=true;
title="class or interface in java.lang">ComparableDataflowPipelineWorkerPoolOptions.TeardownPolicy
+
+
+Enclosing interface:
+DataflowPipelineWorkerPoolOptions
+
+
+Deprecated.
+Dataflow Service will only
support TEARDOWN_ALWAYS policy in the future.
+
+
+http://docs.oracle.com/javase/7/docs/api/java/lang/Deprecated.html?is-external=true;
title="class or interface in java.lang">@Deprecated
+public static enum DataflowPipelineWorkerPoolOptions.TeardownPolicy
+extends http://docs.oracle.com/javase/7/docs/api/java/lang/Enum.html?is-external=true;
title="class or interface in java.lang">EnumDataflowPipelineWorkerPoolOptions.TeardownPolicy
+The policy for tearing down the workers spun up by the
service.
+
+
+
+
+
+
+
+
+
+
+
+Enum Constant Summary
+
+Enum Constants
+
+Enum Constant and Description
+
+
+TEARDOWN_ALWAYS
+Deprecated.
+All VMs created for a Dataflow job are deleted when the job
finishes, regardless of whether
+ it fails or succeeds.
+
+
+
+TEARDOWN_NEVER
+Deprecated.
+All VMs created for a Dataflow job are left running when
the job finishes, regardless of
+ whether it fails or succeeds.
+
+
+
+TEARDOWN_ON_SUCCESS
+Deprecated.
+All VMs created for a Dataflow job are deleted when the job
succeeds, but are left running
+ when it fails.
+
+
+
+
+
+
+
+
+
+
+Method Summary
+
+All MethodsStatic MethodsInstance MethodsConcrete MethodsDeprecated Methods
+
+Modifier and Type
+Method and Description
+
+
+http://docs.oracle.com/javase/7/docs/api/java/lang/String.html?is-external=true;
title="class or interface in java.lang">String
+getTeardownPolicyName()
+Deprecated.
+
+
+
+static DataflowPipelineWorkerPoolOptions.TeardownPolicy
+valueOf(http://docs.oracle.com/javase/7/docs/api/java/lang/String.html?is-external=true;
title="class or interface in java.lang">Stringname)
+Deprecated.
+Returns the enum constant of this type with the specified
name.
+
+
+
+static DataflowPipelineWorkerPoolOptions.TeardownPolicy[]
+values()
+Deprecated.
+Returns an
[jira] [Updated] (BEAM-806) Maven Release Plugin Does Not Set Archetype Versions
[
https://issues.apache.org/jira/browse/BEAM-806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aljoscha Krettek updated BEAM-806:
--
Fix Version/s: (was: 0.3.0-incubating)
0.4.0-incubating
> Maven Release Plugin Does Not Set Archetype Versions
>
>
> Key: BEAM-806
> URL: https://issues.apache.org/jira/browse/BEAM-806
> Project: Beam
> Issue Type: Improvement
> Components: build-system
>Affects Versions: 0.1.0-incubating, 0.2.0-incubating, 0.3.0-incubating
>Reporter: Aljoscha Krettek
>Priority: Blocker
> Fix For: 0.4.0-incubating
>
>
> When running {{mvn release:prepare}} as described in the new release guide
> this does not update the version of the poms in the archetypes. To be clear,
> the version of the archetype pom is updated, the pom in
> {{archetype-resources}} (the pom of the project generated by the archetype)
> is not updated.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[incubator-beam] Git Push Summary
Repository: incubator-beam Updated Tags: refs/tags/v0.3.0-incubating [created] fb7f162ab
