This is your daily summary of Beam's current P1 issues, not including flaky
tests.
See https://beam.apache.org/contribute/issue-priorities/#p1-critical for
the meaning and expectations around P1 issues.
https://github.com/apache/beam/issues/22011: [Bug]:
org.apache.beam.sdk.io.aws2.kinesis.KinesisIOWriteTest.testWriteFailure flaky
https://github.com/apache/beam/issues/22010: [Bug]:
org.apache.beam.runners.flink.FlinkRunnerTest.testEnsureStdoutStdErrIsRestored
flaky
https://github.com/apache/beam/issues/22009: [Bug]:
org.apache.beam.examples.subprocess.ExampleEchoPipelineTest.testExampleEchoPipeline
flaky
https://github.com/apache/beam/issues/22008: [Bug]:
org.apache.beam.sdk.io.gcp.spanner.SpannerIOWriteExceptionHandlingTest.testExceptionHandlingForWriteGrouped
flaky
https://github.com/apache/beam/issues/21999: [Bug]:
org.apache.beam.sdk.io.gcp.spanner.SpannerIOReadTest.runBatchQueryTestWithFailures
flaky
https://github.com/apache/beam/issues/21948: [Bug]: KinesisIO javadoc is no
longer up-to-date
https://github.com/apache/beam/issues/21946: [Bug]: No way to read or write to
file when running Beam in Flink
https://github.com/apache/beam/issues/21935: [Bug]: Reject illformed GBK Coders
https://github.com/apache/beam/issues/21897: [Feature Request]: Flink runner
savepoint backward compatibility
https://github.com/apache/beam/issues/21893: [Bug]: BigQuery Storage Write API
implementation does not support table partitioning
https://github.com/apache/beam/issues/21794: Dataflow runner creates a new
timer whenever the output timestamp is change
https://github.com/apache/beam/issues/21715: Data missing when using
CassandraIO.Read
https://github.com/apache/beam/issues/21713: 404s in BigQueryIO don't get
output to Failed Inserts PCollection
https://github.com/apache/beam/issues/21711: Python Streaming job failing to
drain with BigQueryIO write errors
https://github.com/apache/beam/issues/21703: pubsublite.ReadWriteIT failing in
beam_PostCommit_Java_DataflowV1 and V2
https://github.com/apache/beam/issues/21702: SpannerWriteIT failing in beam
PostCommit Java V1
https://github.com/apache/beam/issues/21700:
--dataflowServiceOptions=use_runner_v2 is broken
https://github.com/apache/beam/issues/21695: DataflowPipelineResult does not
raise exception for unsuccessful states.
https://github.com/apache/beam/issues/21694: BigQuery Storage API insert with
writeResult retry and write to error table
https://github.com/apache/beam/issues/21478: KafkaIO.read.withDynamicRead()
doesn't pick up new TopicPartitions
https://github.com/apache/beam/issues/21477: Add integration testing for BQ
Storage API write modes
https://github.com/apache/beam/issues/21476: WriteToBigQuery Dynamic table
destinations returns wrong tableId
https://github.com/apache/beam/issues/21475: Beam x-lang Dataflow tests failing
due to _InactiveRpcError
https://github.com/apache/beam/issues/21473: PVR_Spark2_Streaming perma-red
https://github.com/apache/beam/issues/21465: Kafka commit offset drop data on
failure for runners that have non-checkpointing shuffle
https://github.com/apache/beam/issues/21268: Race between member variable being
accessed due to leaking uninitialized state via OutboundObserverFactory
https://github.com/apache/beam/issues/21267: WriteToBigQuery submits a
duplicate BQ load job if a 503 error code is returned from googleapi
https://github.com/apache/beam/issues/21265:
apache_beam.runners.portability.fn_api_runner.translations_test.TranslationsTest.test_run_packable_combine_globally
'apache_beam.coders.coder_impl._AbstractIterable' object is not reversible
https://github.com/apache/beam/issues/21263: (Broken Pipe induced) Bricked
Dataflow Pipeline
https://github.com/apache/beam/issues/21262: Python AfterAny, AfterAll do not
follow spec
https://github.com/apache/beam/issues/21260: Python DirectRunner does not emit
data at GC time
https://github.com/apache/beam/issues/21259: Consumer group with random prefix
https://github.com/apache/beam/issues/21257: Either Create or DirectRunner
fails to produce all elements to the following transform
https://github.com/apache/beam/issues/21123: Multiple jobs running on Flink
session cluster reuse the persistent Python environment.
https://github.com/apache/beam/issues/21117: "Java IO IT Tests" - missing data
in grafana
https://github.com/apache/beam/issues/21115: JdbcIO date conversion is
sensitive to OS
https://github.com/apache/beam/issues/21111: Java creates an incorrect pipeline
proto when core-construction-java jar is not in the CLASSPATH
https://github.com/apache/beam/issues/21109: SDF BoundedSource seems to execute
significantly slower than 'normal' BoundedSource
https://github.com/apache/beam/issues/21108: java.io.InvalidClassException With
Flink Kafka
https://github.com/apache/beam/issues/20979: Portable runners should be able to
issue checkpoints to Splittable DoFn
https://github.com/apache/beam/issues/20978: PubsubIO.readAvroGenericRecord
creates SchemaCoder that fails to decode some Avro logical types
https://github.com/apache/beam/issues/20818: XmlIO.Read does not handle XML
encoding per spec
https://github.com/apache/beam/issues/20814: JmsIO is not acknowledging
messages correctly
https://github.com/apache/beam/issues/20813: No trigger early repeatedly for
session windows
https://github.com/apache/beam/issues/20812: Cross-language consistency
(RequiresStableInputs) is quietly broken (at least on portable flink runner)
https://github.com/apache/beam/issues/20692: Timer with dataflow runner can be
set multiple times (dataflow runner)
https://github.com/apache/beam/issues/20689: Kafka commitOffsetsInFinalize OOM
on Flink
https://github.com/apache/beam/issues/20532: Support for coder argument in
WriteToBigQuery
https://github.com/apache/beam/issues/20531: FileBasedSink: allow setting temp
directory provider per dynamic destination
https://github.com/apache/beam/issues/20530: Make non-portable Splittable DoFn
the only option when executing Java "Read" transforms
https://github.com/apache/beam/issues/20528: python
CombineGlobally().with_fanout() cause duplicate combine results for sliding
windows
https://github.com/apache/beam/issues/20333: beam_PerformanceTests_Kafka_IO
failing due to " provided port is already allocated"
https://github.com/apache/beam/issues/20332: FileIO writeDynamic with
AvroIO.sink not writing all data
https://github.com/apache/beam/issues/20330: Remove insecure ssl options from
MongoDBIO
https://github.com/apache/beam/issues/20109: SortValues should fail if
SecondaryKey coder is not deterministic
https://github.com/apache/beam/issues/20108: Python direct runner doesn't emit
empty pane when it should
https://github.com/apache/beam/issues/20009: Environment-sensitive provisioning
for Dataflow
https://github.com/apache/beam/issues/19971: [SQL] Some Hive tests throw
NullPointerException, but get marked as passing (Direct Runner)
https://github.com/apache/beam/issues/19817: datetime and decimal should be
logical types
https://github.com/apache/beam/issues/17950: [Bug]: Java Precommit permared
