See
<https://builds.apache.org/job/beam_PostCommit_RunnableOnService_GearpumpLocal/150/changes>
Changes:
[gaugupt3] Made byteArrayCoder final static
[dhalperi] CompressedSource: CompressedReader is never splittable
[dhalperi] Do not add DataDisks to windmill service jobs.
[lcwik] Remove timeout in DirectRunnerTest
[bchambers] Remove Counter and associated code
[lcwik] Improve Write Error Message
[lcwik] Remove Streaming Write Overrides in DataflowRunner
[lcwik] [BEAM-495] Create General Verifier for File Checksum
[lcwik] Add output checksum to WordCountITOptions
[lcwik] More unit test and code style fix
[lcwik] Using IOChannelUtils to resolve file path
[dhalperi] Added unit tests and error handling in removeTemporaryTables
[mxm] [flink] add missing maven config to example pom
[dhalperi] Remove DataflowPipelineJob from examples
[mariusz89016] [BEAM-432] Corrected BigQueryIO javadoc
[dhalperi] Add TransformEvaluatorFactory#cleanup
[dhalperi] Replace CloningThreadLocal with DoFnLifecycleManager
[dhalperi] Add DoFn @Setup and @Teardown
[dhalperi] Move ParDo Lifecycle tests to their own file
[github] Exclude ParDoTest from Dataflow @RunnableOnService
[lcwik] Exclude guava-testlib from shading relocation
[github] ByteKeyRangeTracker: synchronize toString
[swegner] Fix repackaging exclude pattern for guava-testlib
[bchambers] Rewrites DoFnReflector to go via DoFnSignature
[bchambers] Replace ParDo with simpler transforms where possible
[lcwik] Set Gcs upload buffer size to 1M in streaming mode in DataflowRunner
[lcwik] addressed feedback
[lcwik] fix unused imports
[dhalperi] DatastoreIO Sink as ParDo
[dhalperi] Change name of result returned by BigQueryIO.Read
[dhalperi] Fix NPE in BigQueryIO.TransformingReader
[lcwik] Add inEarlyPanesInGlobalWindow as a PAssert Extractor
[lcwik] Add TestStream to the Testing package
[lcwik] Implement TestStream in the DirectRunner
[dhalperi] Incorporate private IP option for Dataflow runner
[dhalperi] Datastore Sink support for writing Mutations
[lcwik] Mark JAXBContext as Volatile in JAXBCoder
[lcwik] Modify example dependencies to only add runners as optional
[dhalperi] DatastoreIO v1beta3 to v1
[tgroh] Remove unused constant in ExecutorServiceParallelExecutor
[tgroh] Remove extra timer firings in WatermarkManager
[dhalperi] FileBasedSink: improve parallelism in GCS copy/remove
[dhalperi] [BEAM-574] Remove log when new records have not been read yet
(KafkaIO)
[dhalperi] Write: Remove invalid import
[dhalperi] JUnit tests: add @RunWith annotation
[dhalperi] Remove ParDoTest Suppression in Google Cloud Dataflow
[klk] Fix Emission in startBundle/finishBundle in Flink Wrappers
[klk] [BEAM-253] Unify Flink-Streaming Operator Wrappers
[klk] Fix Checkstyle Errors in FlinkStreamingTransformTranslators
[klk] [BEAM-102] Add Side Inputs in Flink Streaming Runner
[klk] Allow DoFn Reuse in ParDoTest.TestDoFnWithContext
[klk] Don't Suppress Throwable in PAssert in Streaming Mode
[klk] Fix Flink Runner Pom for Batch RunnableOnService tests
[klk] Enable Flink Streaming Runner RunnableOnService tests
[klk] Fix combine tests with Accumulation Mode
[klk] Use AllPanes as the PaneExtractor in IterableAssert
[klk] Make ParDoLifecycleTest Serializable to Fix Test with TupleTag
[klk] Fix Exception Unwrapping in TestFlinkRunner
[bchambers] Update checkstyle.xml to put all imports in one group
[dhalperi] Optimize imports
[dhalperi] BigQueryIO.Write: raise size limit to 11 TiB
[dhalperi] Cleanup some javadoc that referring Dataflow
[peihe] Move the samples data to gs://apache-beam-samples/
[swegner] Update DoFn javadocs to remove references to OldDoFn and Dataflow
[dhalperi] [BEAM-545] Promote JobName to PipelineOptions
[dhalperi] Make WriteTest more resilient to Randomness
[dhalperi] checkstyle: prohibit API client repackaged Guava
[jbonofre] [BEAM-294] Rename dataflow references to beam
[dhalperi] Modified BigtableIO to use DoFn setup/tearDown methods instead of
[ansela] Added support for reporting aggregator values to Spark sinks
[dhalperi] travis.yml: disable updating snapshots
[dhalperi] Query latest timestamp
[lcwik] [BEAM-589] Fixing IO.Read transformation
[dhalperi] kinesis: a connector for Amazon Kinesis
[dhalperi] Organize imports in Kinesis
[dhalperi] Fix javadoc in Kinesis
[ansela] [BEAM-592] Fix SparkRunner Dependency Problem in WordCount
[github] DataflowRunner: get PBegin from PInput
[amarouni] [BEAM-313] Provide a context for SparkRunner
[dhalperi] Update Dataflow Container Version
[dhalperi] [BEAM-572] Remove Spark Reference in WordCount
[dhalperi] Returned KafkaIO getWatermark log line in debug mode
[dhalperi] take advantage of setup/teardown for KafkaWriter
[lcwik] Add LeaderBoardTest
[jbonofre] [BEAM-569] Define maxNumRecords default value to Long.MAX_VALUE in
JmsIO
[aljoscha.krettek] Address comments of Flink Side-Input PR
[aljoscha.krettek] Fix condition in FlinkStreamingPipelineTranslator
[diominay] Fix inconsistent in formatting logs: leaveCompositeTransform always
[bchambers] Correct some accidental renames
[bchambers] Test that multiple instances of TestStream are supported
[tgroh] Remove empty unused method in TestStreamEvaluatorFactory
[bchambers] Add Latest CombineFn and PTransforms
[dhalperi] DatastoreIO SplitQueryFn integration test
[dhalperi] Cloud Datastore naming clean-up
[dhalperi] Fixed Combine display data
[dhalperi] Delegate populateDipslayData to wrapped combineFn's
[dhalperi] Put classes in runners-core package into runners.core namespace
[dhalperi] Remove the DataflowRunner instructions from examples
[dhalperi] FluentBackoff: a replacement for a variety of custom backoff
[jbonofre] [BEAM-456] Add MongoDbIO
[jbonofre] [BEAM-242] Enable checkstyle and fix checkstyle errors in Flink
runner
[dhalperi] BigQuery: limit max job polling time to 1 minute
[dhalperi] Be more accepting in UnboundedReadDeduplicatorTest
[dhalperi] Remove timeout in JAXBCoderTest
[jbonofre] [BEAM-242] Enable and fix checkstyle in Flink runner examples
[mxm] [BEAM-619] keep track of local split sources in UnboundedSourceWrapper
[mxm] [flink] use exploded WindowValue in FlinkDoFnFunction
[mxm] [flink] initialize watermarkTimeQueue with Comparator
[lcwik] Add header/footer support to TextIO.Write
[lcwik] Revised according to comments following a code review.
[lcwik] Reverted header and footer to be of type String.
[lcwik] Added javadoc to TextIO#withHeader and TextIO#withFooter.
[lcwik] Added even more javadoc to TextIO#withHeader and TextIO#withFooter.
[lcwik] Added even more javadoc to TextIO#withHeader and TextIO#withFooter (2).
[lcwik] !fixup Minor javadoc clean-up
[aljoscha.krettek] [BEAM-616] Update Flink Runner to Flink 1.1.2
[aljoscha.krettek] Fix shaded imports in Flink Runner
[lcwik] Address comments during backport Dataflow PR/423 for Apache Beam PR/918
[lcwik] !fixup Fix missed @Nullable annotations
[dhalperi] DataflowPipelineJob: catch an underflow in backoff code
[mxm] [BEAM-617][flink] introduce option to set state backend
[mxm] [BEAM-333][flink] make bounded/unbounded sources stoppable
[mxm] [BEAM-619] extend test case to be parameterized
[markliu] Revert Backoff Classes to Fix Worker Dependency Error
[ansela] Support Verifiers in TestSparkRunner
[ansela] Set master if not already set.
[ansela] Fixed the Graphite metrics sink configuration so it actually works when
[bchambers] Remove EvaluationContext as a forApplication Parameter
[bchambers] More changes to DoFn{Signatures,Invokers}
[peihe] Forward port DataflowJavaSDK-337 to Beam
[lcwik] Forward port DataflowJavaSDK-351 to Beam
[kirpichov] [BEAM-630] Fixes wrong type name in generated code
[lcwik] Modify examples pom to add precommit execution profile.
[lcwik] Update Beam examples archetypes
[lcwik] Additinal examples code cleanups
[lcwik] Remove PubsubFileInjector
[lcwik] Fix the maven-archetypes pom.xml
[lcwik] Addressed comments
[peihe] Remove PubsubFileInjector and IntraBundleParallelization
[dhalperi] Enables BytecodeVerificationLocal on travis
[lcwik] Add Flatten with Duplicate Inputs Test
[lcwik] !fixup Minor whitespace changes
[owenzhang1990] [BEAM-631] upgrade surefire plugin to 2.19.1
[jbonofre] [BEAM-634] Be able to import Beam codebase in Eclipse and support m2e
[jesse] Adding Byte and Character TypeDescriptors.
[mxm] [BEAM-283] finalize CheckpointMarks upon completed checkpoint
[dhalperi] checkstyle.xml: blacklist imports of two shaded dependencies
[dhalperi] [BEAM-639] BigtableIO: add support for users to scan table subranges
[kirpichov] Deprecate TeardownPolicy for Dataflow service
[lcwik] Check Dataflow Job Status Before Terminate
[ansela] [BEAM-610] Enable spark's checkpointing mechanism for driver-failure
[dhalperi] TextIO/CompressedSource: split AUTO mode files into bundles
[dhalperi] TextIOTest: rewrite for code reuse and actually more test coverage
[dhalperi] Support BigQuery BYTES type
[mxm] [BEAM-642] Support Flink Detached Mode for JOB execution
[ansela] [BEAM-613] Revised SimpleStreamingWordCountTest to better test fixed
[dhalperi] Remove DataflowMatchers
[lcwik] Support BigQuery DATE type
[lcwik] Update grpc to 1.0.1 and protobuf to 3.0.0
[lcwik] Update PubsubGrpcClient to not take in mocks as they are not needed
[ansela] [BEAM-657] Support Read.Bounded primitive.
[lcwik] Minor clean-up of RunnableOnService definition
[lcwik] Update BigQueryIO tests who expect failure to be NeedsRunner tests
[dhalperi] Correctly type collections in PipelineOptions.
[lcwik] Support BigQuery DATETIME and TIME types
[lcwik] Update Dataflow worker image for Apache Beam
[dhalperi] BigQueryServicesImpl: fix issues in insertAll and add better tests
[dhalperi] Support for @Setup and @Teardown in DoFnTester
[lcwik] [BEAM-604] Use Watermark to Finish Streaming Job in TestDataflowRunner
[lcwik] Fix checkMaxWatermark causing batch test failed
[lcwik] Add StreamingIT category to integration test
[lcwik] More javadoc and keep retry in case of get metrics exception
[mxm] fix potential NPE in checkpointing of UnboundedSourceWrapper
[jbonofre] [BEAM-674] Add GridFS support to MongoDbIO
[lcwik] Upgrade maven-compiler-plugin to fix incremental build
[mxm] [BEAM-615] Add Support for Processing-Time Timers in FlinkRunner Window
[lcwik] Refactor BundleFactory methods
[tgroh] Suppress Flatten Tests in Dataflow
[dhalperi] BoundedReadFromUnboundedSourceTest: remove unused code
[dhalperi] checkstyle: enforce static import of Preconditions utilities
[bchambers] Dedups TimerInternal implementations
[bchambers] Enable EncodabilityEnforcement by default
[lcwik] Forward port PR-411 and PR-420 from Dataflow
[bchambers] Set transform names in DisplayDataEvaluator
[jbonofre] [BEAM-244] Add JDBC IO
[jbonofre] [BEAM-674] Refactoring and improvements on the MongoDB GridFS IO
[jbonofre] [BEAM-698] Use AutoValue and deal with Document instead of String in
[lcwik] Add initial bucket stuff.
[lcwik] Add default bucket scaffolding.
[lcwik] PipelineOptions display data needs to handle array types
[ansela] Avoid losing the encoded defaultValue.
[tgroh] Place fired timers in the Global Window
[dhalperi] [BEAM-561] Add Streaming IT in Jenkins Pre-commit
[swegner] Static import Assert.assertEquals
[jbonofre] [BEAM-698] Use AutoValue in MongoDB GridFS
[lcwik] De-pluralize error message expectation in LatestFnTests
[lcwik] Move LatestFnTests to LatestFnTest
[lcwik] Forbid files ending in Tests.java as they should end in Test.java
[lcwik] Fix Precommit Integration Test Failure
[lcwik] Add RootTransformEvaluatorFactory
[lcwik] Remove KeyedResourcePool
[lcwik] Forward port Dataflow PR-431 to Beam
[lcwik] Forward port Dataflow PR-454 to Beam
[lcwik] Forward port Dataflow PR-453 to Beam
[klk] Add DoFnInvoker for OldDoFn, for migration ease
[dhalperi] Improve compile-time type checking
[tgroh] Only remove Elements that were pending from Pending Elements
[lcwik] BigQueryIO: port trivial fixes from Dataflow version.
[klk] Move GcsPathValidatorTest to package matching class under test
[lcwik] [BEAM-736] Fix BigQueryTornadoesIT, broken by PR-1039
[jbonofre] Define DataSourceConfiguration as public in JdbcIO
[jbonofre] [BEAM-740] improve runners-flink README.md
[klk] Remove unused ListOutputManager
[klk] Inline DoFnRunnerBase to its sole subclass
[klk] Fix access levels on SimpleDoFnRunner
[dhalperi] checkstyle: improve Javadoc checking
[klk] Refactor StateSpec out of StateTag
[klk] Remove last use of PCollectionView.fromIterableInternal
[klk] Remove the deprecated PCollectionView.fromIterableInternal
[lcwik] Disable trimStackTrace in maven-failsafe-plugin
[dhalperi] Add compression codec for AvroIO.Write
[dhalperi] Remove Debug Message when Delivering Timers
[dhalperi] Minor rewording to drop Dataflow from Beam SDK core
[dhalperi] Converts Datastore to use AutoValue
[bchambers] [BEAM-65] SplittableDoFn prototype.
[klk] Move triggers to runners-core
[klk] Rename runners-core Trigger to TriggerStateMachine
[klk] Restore prior trigger files, for temporary compatibility
[bchambers] Initial Metrics API for Beam Java
[bchambers] Add the ability to query metrics on PipelineResult
[bchambers] Implement Metrics in the DirectRunner
[dhalperi] KafkaIO reader should set consumedOffset even before reading the
first
[klk] Add DoFn.StateId annotation and validation on fields
[dhalperi] Add a basic implementation of StaticValueProvider and
[ansela] [BEAM-734] Add support for Spark Streaming Listeners.
[ansela] [BEAM-735] PAssertStreaming should make sure the assertion happened.
[klk] Remove getOrCreate pattern from DoFnSignatures and DoFnInvokers
[dhalperi] [BEAM-55] TextIO & FileBasedSink: Add support for compressed output
[dhalperi] Do not modify the context in NullableCoder
[dhalperi] Delete DatastoreWordCount
[lcwik] Perform initial splitting in the DirectRunner
[dhalperi] ignore JVM crash logs in Apache RAT
[lcwik] Stop Catching Errors in the DirectRunner
[lcwik] Replace DirectResult#awaitCompletion with waitUntilFinish
[peihe] [BEAM-595] avoid throwing Exception in waitUntilFinish in SparkRunner
[lcwik] Move the step output ids to use a flat namespace. Also add a logical
[dhalperi] Remove Remaining Nested Contexts from NullableCoder
[bchambers] Fix SplittableParDoTest
[dhalperi] AvroIO.Write: minor doc and test fixes
[dhalperi] [BEAM-763] Update
BigQueryIOTest.testBuildSourceWithTableAndSqlDialect
[dhalperi] [BEAM-697] TextIO.Write: Preserve validation in withHeader/withFooter
[klk] Make Trigger#subTriggers public and non-null
[klk] Construct AfterAllStateMachine with a list of subtriggers
[klk] Construct AfterFirstStateMachine with a list of subtriggers
[klk] Make AfterSynchronizedProcessingTime public
[klk] Add direct accessors for the components of OrFinallyTrigger
[klk] Construct AfterEachStateMachine from list of subtriggers
[klk] Add accessors to Repeatedly trigger
[klk] Make OrFinallyTrigger public so it can be examined
[klk] Add accessors to AfterWatermark trigger
[klk] Add access to values from AfterDelay triggers
[klk] Add accessors for AfterPane(StateMachine) parameters
[klk] Make return types of trigger static factory methods precise
[klk] Accessors for AfterDelay
[klk] Make NeverTrigger public for translation
[klk] Make return types more precise for AfterWatermarkTriggerStateMachine
[klk] Touch up javadoc for AfterDelayFromFirstElementStateMachine
[klk] Add TriggerStateMachines with conversion from Trigger
[jbonofre] Build in eclipse/eclipse-jdt
[mxm] [BEAM-593] avoid throwing Exception in waitUntilFinish
[lcwik] Update Dataflow container image for current version of Apache Beam.
[dhalperi] SplittableParDoTest does not require RunnableOnService
[klk] Restore ReshuffleTriggerTest to SDK
[lcwik] BEAM-756 fix JavadocPackage checkstyle suppression
[dhalperi] Dataflow: API is in beta now
[dhalperi] Resolve Registered Runners that don't end with Runner
[lcwik] [BEAM-764] Remove cloneAs from PipelineOptions
[peihe] Keep throws in StreamingEvaluationContext cancel() and waitUntilFinish
[lcwik] Restore trigger-related tests missed in #1083
[lcwik] "Intern" schemas and schema strings to prevent out of memory issues when
[klk] Tighten up tests for StateId validation
[klk] Fix condition on state/splittable ParDo validation
[dhalperi] Add a Residual Shard for Empty Readers
[jbonofre] [BEAM-743] JdbcIO deals right getConnection() to use with DBCP
[ansela] [BEAM-777] KafkaIO Test should handle reader.start() better.
[ansela] [BEAM-744] UnboundedKafkaReader should return as soon as it can.
[ansela] [BEAM-259] Execute selected RunnableOnService tests with Spark runner.
[lcwik] [BEAM-605] Create Bigquery Verifier
[lcwik] Add BigQuery Verifier to WindowedWordCountIT
[klk] Add Timer, TimerId, TimerSpec and TimerSpecs
[klk] Add DoFnSignatures analysis of timer declarations
[klk] Reject all timers in ParDo, for now
[ansela] [BEAM-781] Remove Spark's batch unit tests and rely on ROS tests
[dhalperi] Drop static from interfaces
[dhalperi] BoundedReadFromUnboundedSource: make public
[bchambers] Add Display Data 'path' metadata
[klk] Use the correct State class in DoFnSignatures
[klk] Add analysis and validation of State parameters to DoFn.ProcessElement
[klk] Move named DoFn classes into the tests that use them
[klk] Add analysis of Timer parameters to DoFn.ProcessElement
[klk] Port ReduceFnRunner to TriggerStateMachine
[klk] Delete TriggerRunner
[klk] Translate ReshuffleTrigger to ReshuffleTriggerStateMachine
[lcwik] Remove autovalue.shaded imports
[dhalperi] Fix invalid snapshot repo in Travis CI's maven settings.xml
[dhalperi] Add checkstyle RedundantModifier check and fix offending classes
[klk] Simplify DoFnRunners to be somewhat compositional
[klk] Rename SimpleDoFnRunner to SimpleOldDoFnRunner and remove public access
[klk] Add SimpleDoFnRunner for new DoFn and construction via DoFnRunners
[klk] Add OldDoFn.toDoFn() adapter
[klk] Add access to original DoFn on ParDo
[klk] Switch the DirectRunner to use new DoFnRunner code path
[swegner] Use DisplayData delegate in Dataflow Read transform override
[lcwik] Fix typo and dependencies in beam-runners-direct-java
[lcwik] [BEAM-790] Refactor PipelineOptionsFactory validation into separate
[ansela] [BEAM-794] Differ combining in case of merging windows with sideInputs.
[klk] Add adapter from OldDoFn.RequiresWindowAccess to DoFn
[klk] Port ReifyTimestampAndWindowsDoFn to RequiresWindowAccess
[klk] Fix NPE in SimpleDoFnRunner
[klk] Move shared DelegatingAggregator out of OldDoFn
[klk] Move AggregatorFactory to runners-core and deprecate SDK version
[klk] Add setupDelegatingAggregators for DoFn (for now)
[klk] Port some of ParDoTest to new DoFn
[klk] Fix binding of aggregator creating in OldDoFn
[klk] Fix binding of aggregator delegation in DoFnAdapters
[klk] Make DoFnTester aggregator initialization idempotent
[klk] Fix flipped conditional in SimpleDoFnRunner
[klk] Port direct runner to use new DoFn directly
[klk] Make aggregator registration idempotent in FlinkRunner
[aljoscha.krettek] Fix Javadoc of ReadableState
[aljoscha.krettek] Fix
ReduceFnRunner.cancelEndOfWindowAndGarbageCollectionTimers()
[dhalperi] [BEAM-769] Spark: Make graceful stop the default.
[dhalperi] Choose BigQuery Write implementation based on Input PCollection
[dhalperi] Add property name to RuntimeValueProvider
[aljoscha.krettek] [maven-release-plugin] prepare branch
release-0.3.0-incubating
[aljoscha.krettek] [maven-release-plugin] prepare for next development iteration
[dhalperi] [BEAM-806] update archetype poms in master
[dhalperi] OffsetBasedSource: allow empty sources
[dhalperi] Add timestamps to maven output on Travis CI
[dhalperi] pom.xml: make Dataflow runner like every other runner
[klk] Remove pieces of Trigger now owned by TriggerStateMachine
[klk] Update DataflowRunner worker image
[klk] Improve teardown behavior in DoFnLifecycleManager
[tgroh] Encode bundle elements in the DirectRunner
[klk] Remove unused GroupAlsoByWindowsDoFn.createDefault
[davor] Add experimental ServiceAccount option
[klk] Remove use of OldDoFn in ValueWithRecordId
[klk] Remove use of OldDoFn from some DirectRunner tests
[klk] Remove OldDoFn to DoFn in DirectRunner
[dhalperi] Display data: minor cleanups
[owenzhang1990] post-merge fix
[owenzhang1990] remove "pipeline" in runner name
[owenzhang1990] upgrade gearpump-runner to 0.4.0-incubating-SNAPSHOT
------------------------------------------
[...truncated 14431 lines...]
at org.apache.beam.sdk.Pipeline.traverseTopologically(Pipeline.java:292)
at
org.apache.beam.runners.gearpump.GearpumpPipelineTranslator.translate(GearpumpPipelineTranslator.java:82)
at
org.apache.beam.runners.gearpump.GearpumpRunner.run(GearpumpRunner.java:109)
at
org.apache.beam.runners.gearpump.TestGearpumpRunner.run(TestGearpumpRunner.java:54)
at
org.apache.beam.runners.gearpump.TestGearpumpRunner.run(TestGearpumpRunner.java:34)
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:182)
at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:112)
at
org.apache.beam.sdk.transforms.ApproximateUniqueTest.testApproximateUniqueWithSmallInput(ApproximateUniqueTest.java:80)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at
org.apache.maven.surefire.junitcore.pc.Scheduler$1.run(Scheduler.java:393)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Running org.apache.beam.sdk.transforms.windowing.WindowingTest
Tests run: 4, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 2.304 sec <<<
FAILURE! - in org.apache.beam.sdk.transforms.windowing.WindowingTest
testMergingWindowing(org.apache.beam.sdk.transforms.windowing.WindowingTest)
Time elapsed: 0.764 sec <<< ERROR!
java.lang.UnsupportedOperationException: merging window is not supported in
Gearpump pipeline
at
org.apache.beam.runners.gearpump.GearpumpRunner$AssignWindowsAndSetStrategy.apply(GearpumpRunner.java:165)
at
org.apache.beam.runners.gearpump.GearpumpRunner$AssignWindowsAndSetStrategy.apply(GearpumpRunner.java:147)
at
org.apache.beam.sdk.runners.PipelineRunner.apply(PipelineRunner.java:76)
at
org.apache.beam.runners.gearpump.GearpumpRunner.apply(GearpumpRunner.java:79)
at
org.apache.beam.runners.gearpump.TestGearpumpRunner.apply(TestGearpumpRunner.java:62)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:400)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:323)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:167)
at
org.apache.beam.sdk.transforms.windowing.WindowingTest$WindowedCount.apply(WindowingTest.java:74)
at
org.apache.beam.sdk.transforms.windowing.WindowingTest$WindowedCount.apply(WindowingTest.java:56)
at
org.apache.beam.sdk.runners.PipelineRunner.apply(PipelineRunner.java:76)
at
org.apache.beam.runners.gearpump.GearpumpRunner.apply(GearpumpRunner.java:91)
at
org.apache.beam.runners.gearpump.TestGearpumpRunner.apply(TestGearpumpRunner.java:62)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:400)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:307)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:154)
at
org.apache.beam.sdk.transforms.windowing.WindowingTest.testMergingWindowing(WindowingTest.java:153)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at
org.apache.maven.surefire.junitcore.pc.Scheduler$1.run(Scheduler.java:393)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Results :
Failed tests:
PAssertTest.testContainsInAnyOrderFalse:371->runExpectingAssertionFailure:392
assertion should have failed
Tests in error:
CountingInputTest.testBoundedInput:77 » IllegalState no translator registered
...
CountingInputTest.testUnboundedInput:96 » IllegalState no translator
registere...
CountingInputTest.testUnboundedInputTimestamps:148 » IllegalState no
translato...
CountingSourceTest.testBoundedSource:90 » IllegalState no translator
registere...
CountingSourceTest.testBoundedSourceSplits:117 » IllegalState no translator
re...
CountingSourceTest.testUnboundedSource:157 » IllegalState no translator
regist...
CountingSourceTest.testUnboundedSourceSplits:244 » IllegalState no translator
...
CountingSourceTest.testUnboundedSourceTimestamps:184 » IllegalState no
transla...
PAssertTest.testIsEqualTo:266 » IllegalState no translator registered for
View...
PAssertTest.testNotEqualTo:298 » IllegalState no translator registered for
Vie...
PAssertTest.testWindowedIsEqualTo:286 » IllegalState no translator registered
...
ApproximateUniqueTest.testApproximateUniqueWithSmallInput:80 » IllegalState
no...
CombineFnsTest.testComposedCombine:175 » IllegalState no translator
registered...
CombineFnsTest.testComposedCombineWithContext:237 » IllegalState no
translator...
CombineTest.testAccumulatingCombine:477->runTestAccumulatingCombine:250 »
IllegalState
CombineTest.testAccumulatingCombineEmpty:483->runTestAccumulatingCombine:250
» IllegalState
CombineTest.testBasicCombine:221->runTestBasicCombine:215 » IllegalState no
tr...
CombineTest.testBasicCombineEmpty:229->runTestBasicCombine:215 » IllegalState
...
CombineTest.testCombineGloballyAsSingletonView:650 » IllegalState no
translato...
CombineTest.testFixedWindowsCombineWithContext:313 » IllegalState no
translato...
CombineTest.testGlobalCombineWithDefaultsAndTriggers:389 » IllegalState no
tra...
CombineTest.testSessionsCombine:400 » UnsupportedOperation merging window is
n...
CombineTest.testSessionsCombineWithContext:437 » UnsupportedOperation merging
...
CombineTest.testSimpleCombine:171->runTestSimpleCombine:134 » IllegalState no
...
CombineTest.testSimpleCombineEmpty:193->runTestSimpleCombine:134 »
IllegalState
CombineTest.testSimpleCombineWithContext:178->runTestSimpleCombineWithContext:164
» IllegalState
CombineTest.testSimpleCombineWithContextEmpty:186->runTestSimpleCombineWithContext:164
» IllegalState
CombineTest.testSlidingWindowsCombineWithContext:355 » IllegalState no
transla...
CountTest.testCountGloballyBasic:97 » IllegalState no translator registered
fo...
CountTest.testCountGloballyEmpty:112 » IllegalState no translator registered
f...
FlattenTest.testEmptyFlattenAsSideInput:160 » IllegalState no translator
regis...
ParDoTest.testMultiOutputParDoWithSideInputs:713 » IllegalState no translator
...
ParDoTest.testMultiOutputParDoWithSideInputsIsCumulative:751 » IllegalState
no...
ParDoTest.testParDoWithSideInputs:641 » IllegalState no translator registered
...
ParDoTest.testParDoWithSideInputsIsCumulative:675 » IllegalState no
translator...
SampleTest.testPickAny:238->runPickAnyTest:232 » IllegalState no translator
re...
SampleTest.testPickAnyWhenEmpty:255->runPickAnyTest:232 » IllegalState no
tran...
SampleTest.testSample:117 » IllegalState no translator registered for
View.Cre...
SampleTest.testSampleEmpty:132 » IllegalState no translator registered for
Vie...
SampleTest.testSampleInsufficientElements:162 » IllegalState no translator
reg...
SampleTest.testSampleMultiplicity:187 » IllegalState no translator registered
...
SampleTest.testSampleZero:147 » IllegalState no translator registered for
View...
ViewTest.testCombinedMapSideInput:1169 » IllegalState no translator
registered...
ViewTest.testEmptyIterableSideInput:424 » IllegalState no translator
registere...
ViewTest.testEmptyListSideInput:286 » IllegalState no translator registered
fo...
ViewTest.testEmptyMapSideInput:1030 » IllegalState no translator registered
fo...
ViewTest.testEmptyMapSideInputWithNonDeterministicKeyCoder:1059 » IllegalState
ViewTest.testEmptyMultimapSideInput:717 » IllegalState no translator
registere...
ViewTest.testEmptyMultimapSideInputWithNonDeterministicKeyCoder:747 »
IllegalState
ViewTest.testIterableSideInput:358 » IllegalState no translator registered
for...
ViewTest.testIterableSideInputIsImmutable:456 » IllegalState no translator
reg...
ViewTest.testListSideInput:218 » IllegalState no translator registered for
Vie...
ViewTest.testListSideInputIsImmutable:332 » IllegalState no translator
registe...
ViewTest.testMapAsEntrySetSideInput:852 » IllegalState no translator
registere...
ViewTest.testMapSideInput:822 » IllegalState no translator registered for
View...
ViewTest.testMapSideInputIsImmutable:1142 » IllegalState no translator
registe...
ViewTest.testMapSideInputWithNonDeterministicKeyCoder:881 » IllegalState no
tr...
ViewTest.testMultimapAsEntrySetSideInput:516 » IllegalState no translator
regi...
ViewTest.testMultimapSideInput:484 » IllegalState no translator registered
for...
ViewTest.testMultimapSideInputIsImmutable:795 » IllegalState no translator
reg...
ViewTest.testMultimapSideInputWithNonDeterministicKeyCoder:566 » IllegalState
...
ViewTest.testSideInputWithNestedIterables:1341 » IllegalState no translator
re...
ViewTest.testSideInputWithNullDefault:1296 » IllegalState no translator
regist...
ViewTest.testSingletonSideInput:109 » IllegalState no translator registered
fo...
ViewTest.testWindowedIterableSideInput:398 » IllegalState no translator
regist...
ViewTest.testWindowedListSideInput:259 » IllegalState no translator
registered...
ViewTest.testWindowedMapAsEntrySetSideInput:960 » IllegalState no translator
r...
ViewTest.testWindowedMapSideInput:919 » IllegalState no translator registered
...
ViewTest.testWindowedMapSideInputWithNonDeterministicKeyCoder:1001 »
IllegalState
ViewTest.testWindowedMultimapAsEntrySetSideInput:648 » IllegalState no
transla...
ViewTest.testWindowedMultimapSideInput:605 » IllegalState no translator
regist...
ViewTest.testWindowedMultimapSideInputWithNonDeterministicKeyCoder:688 »
IllegalState
ViewTest.testWindowedSideInputFixedToFixed:1202 » IllegalState no translator
r...
ViewTest.testWindowedSideInputFixedToFixedWithDefault:1266 » IllegalState no
t...
ViewTest.testWindowedSideInputFixedToGlobal:1235 » IllegalState no translator
...
ViewTest.testWindowedSingletonSideInput:140 » IllegalState no translator
regis...
CoGroupByKeyTest.testCoGroupByKey:309 » IllegalState no translator registered
...
CoGroupByKeyTest.testCoGroupByKeyGetOnly:144 » IllegalState no translator
regi...
WindowingTest.testMergingWindowing:153 » UnsupportedOperation merging window
i...
ReshuffleTest.testReshuffleAfterSessionsAndGroupByKey:97 »
UnsupportedOperation
Tests run: 184, Failures: 1, Errors: 80, Skipped: 3
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Beam :: Parent .............................. SUCCESS [ 21.208 s]
[INFO] Apache Beam :: SDKs ................................ SUCCESS [ 1.016 s]
[INFO] Apache Beam :: SDKs :: Java ........................ SUCCESS [ 1.915 s]
[INFO] Apache Beam :: SDKs :: Java :: Build Tools ......... SUCCESS [ 8.834 s]
[INFO] Apache Beam :: SDKs :: Java :: Core ................ SUCCESS [03:39 min]
[INFO] Apache Beam :: Runners ............................. SUCCESS [ 2.400 s]
[INFO] Apache Beam :: Runners :: Core Java ................ SUCCESS [ 43.177 s]
[INFO] Apache Beam :: Runners :: Gearpump ................. FAILURE [01:47 min]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 08:16 min
[INFO] Finished at: 2016-10-26T17:02:41+00:00
[INFO] Final Memory: 279M/1159M
[INFO] ------------------------------------------------------------------------
Waiting for Jenkins to finish collecting data
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-surefire-plugin:2.19.1:test
(runnable-on-service-tests) on project beam-runners-gearpump: There are test
failures.
[ERROR]
[ERROR] Please refer to
<https://builds.apache.org/job/beam_PostCommit_RunnableOnService_GearpumpLocal/ws/runners/gearpump/target/surefire-reports>
for the individual test results.
[ERROR] -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal
org.apache.maven.plugins:maven-surefire-plugin:2.19.1:test
(runnable-on-service-tests) on project beam-runners-gearpump: There are test
failures.
Please refer to
<https://builds.apache.org/job/beam_PostCommit_RunnableOnService_GearpumpLocal/ws/runners/gearpump/target/surefire-reports>
for the individual test results.
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:212)
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
at
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
at
org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
at
org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:128)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:307)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:193)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:106)
at
org.jvnet.hudson.maven3.launcher.Maven32Launcher.main(Maven32Launcher.java:132)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.codehaus.plexus.classworlds.launcher.Launcher.launchStandard(Launcher.java:330)
at
org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:238)
at jenkins.maven3.agent.Maven32Main.launch(Maven32Main.java:186)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at hudson.maven.Maven3Builder.call(Maven3Builder.java:136)
at hudson.maven.Maven3Builder.call(Maven3Builder.java:71)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:332)
at
hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.maven.plugin.MojoFailureException: There are test
failures.
Please refer to
<https://builds.apache.org/job/beam_PostCommit_RunnableOnService_GearpumpLocal/ws/runners/gearpump/target/surefire-reports>
for the individual test results.
at
org.apache.maven.plugin.surefire.SurefireHelper.reportExecution(SurefireHelper.java:91)
at
org.apache.maven.plugin.surefire.SurefirePlugin.handleSummary(SurefirePlugin.java:320)
at
org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:892)
at
org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:755)
at
org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:134)
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
... 31 more
[ERROR]
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :beam-runners-gearpump
[JENKINS] Archiving
<https://builds.apache.org/job/beam_PostCommit_RunnableOnService_GearpumpLocal/ws/sdks/java/build-tools/pom.xml>
to
org.apache.beam/beam-sdks-java-build-tools/0.4.0-incubating-SNAPSHOT/beam-sdks-java-build-tools-0.4.0-incubating-SNAPSHOT.pom
[JENKINS] Archiving
<https://builds.apache.org/job/beam_PostCommit_RunnableOnService_GearpumpLocal/ws/sdks/java/build-tools/target/beam-sdks-java-build-tools-0.4.0-incubating-SNAPSHOT.jar>
to
org.apache.beam/beam-sdks-java-build-tools/0.4.0-incubating-SNAPSHOT/beam-sdks-java-build-tools-0.4.0-incubating-SNAPSHOT.jar
[JENKINS] Archiving
<https://builds.apache.org/job/beam_PostCommit_RunnableOnService_GearpumpLocal/ws/sdks/java/build-tools/target/beam-sdks-java-build-tools-0.4.0-incubating-SNAPSHOT-tests.jar>
to
org.apache.beam/beam-sdks-java-build-tools/0.4.0-incubating-SNAPSHOT/beam-sdks-java-build-tools-0.4.0-incubating-SNAPSHOT-tests.jar
[JENKINS] Archiving
<https://builds.apache.org/job/beam_PostCommit_RunnableOnService_GearpumpLocal/ws/sdks/java/core/dependency-reduced-pom.xml>
to
org.apache.beam/beam-sdks-java-core/0.4.0-incubating-SNAPSHOT/beam-sdks-java-core-0.4.0-incubating-SNAPSHOT.pom
[JENKINS] Archiving
<https://builds.apache.org/job/beam_PostCommit_RunnableOnService_GearpumpLocal/ws/sdks/java/core/target/beam-sdks-java-core-0.4.0-incubating-SNAPSHOT.jar>
to
org.apache.beam/beam-sdks-java-core/0.4.0-incubating-SNAPSHOT/beam-sdks-java-core-0.4.0-incubating-SNAPSHOT.jar
[JENKINS] Archiving
<https://builds.apache.org/job/beam_PostCommit_RunnableOnService_GearpumpLocal/ws/sdks/java/core/target/beam-sdks-java-core-0.4.0-incubating-SNAPSHOT-tests.jar>
to
org.apache.beam/beam-sdks-java-core/0.4.0-incubating-SNAPSHOT/beam-sdks-java-core-0.4.0-incubating-SNAPSHOT-tests.jar
[JENKINS] Archiving
<https://builds.apache.org/job/beam_PostCommit_RunnableOnService_GearpumpLocal/ws/runners/core-java/dependency-reduced-pom.xml>
to
org.apache.beam/beam-runners-core-java/0.4.0-incubating-SNAPSHOT/beam-runners-core-java-0.4.0-incubating-SNAPSHOT.pom
[JENKINS] Archiving
<https://builds.apache.org/job/beam_PostCommit_RunnableOnService_GearpumpLocal/ws/runners/core-java/target/beam-runners-core-java-0.4.0-incubating-SNAPSHOT.jar>
to
org.apache.beam/beam-runners-core-java/0.4.0-incubating-SNAPSHOT/beam-runners-core-java-0.4.0-incubating-SNAPSHOT.jar
[JENKINS] Archiving
<https://builds.apache.org/job/beam_PostCommit_RunnableOnService_GearpumpLocal/ws/runners/core-java/target/beam-runners-core-java-0.4.0-incubating-SNAPSHOT-tests.jar>
to
org.apache.beam/beam-runners-core-java/0.4.0-incubating-SNAPSHOT/beam-runners-core-java-0.4.0-incubating-SNAPSHOT-tests.jar
[JENKINS] Archiving
<https://builds.apache.org/job/beam_PostCommit_RunnableOnService_GearpumpLocal/ws/runners/core-java/target/beam-runners-core-java-0.4.0-incubating-SNAPSHOT-javadoc.jar>
to
org.apache.beam/beam-runners-core-java/0.4.0-incubating-SNAPSHOT/beam-runners-core-java-0.4.0-incubating-SNAPSHOT-javadoc.jar
[JENKINS] Archiving
<https://builds.apache.org/job/beam_PostCommit_RunnableOnService_GearpumpLocal/ws/sdks/java/pom.xml>
to
org.apache.beam/beam-sdks-java-parent/0.4.0-incubating-SNAPSHOT/beam-sdks-java-parent-0.4.0-incubating-SNAPSHOT.pom
[JENKINS] Archiving
<https://builds.apache.org/job/beam_PostCommit_RunnableOnService_GearpumpLocal/ws/pom.xml>
to
org.apache.beam/beam-parent/0.4.0-incubating-SNAPSHOT/beam-parent-0.4.0-incubating-SNAPSHOT.pom
[JENKINS] Archiving
<https://builds.apache.org/job/beam_PostCommit_RunnableOnService_GearpumpLocal/ws/sdks/pom.xml>
to
org.apache.beam/beam-sdks-parent/0.4.0-incubating-SNAPSHOT/beam-sdks-parent-0.4.0-incubating-SNAPSHOT.pom
[JENKINS] Archiving
<https://builds.apache.org/job/beam_PostCommit_RunnableOnService_GearpumpLocal/ws/runners/pom.xml>
to
org.apache.beam/beam-runners-parent/0.4.0-incubating-SNAPSHOT/beam-runners-parent-0.4.0-incubating-SNAPSHOT.pom
channel stopped
