Mark Liu created BEAM-546:
-
Summary: Aggregator Verifier and Integrate to E2E Test Framework
Key: BEAM-546
URL: https://issues.apache.org/jira/browse/BEAM-546
Project: Beam
Issue Type: Task
[
https://issues.apache.org/jira/browse/BEAM-561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mark Liu reassigned BEAM-561:
-
Assignee: Mark Liu
> Add WindowedWordCountIT
> ---
>
> Key: BEAM-561
>
Mark Liu created BEAM-583:
-
Summary: Auto Register TestDataflowRunner
Key: BEAM-583
URL: https://issues.apache.org/jira/browse/BEAM-583
Project: Beam
Issue Type: Improvement
Reporter: Ma
[
https://issues.apache.org/jira/browse/BEAM-583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mark Liu updated BEAM-583:
--
Description:
Register TestDataflowRunner automatically.
Simplify option's arguments when using TestDataflowRunner
[
https://issues.apache.org/jira/browse/BEAM-583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15435710#comment-15435710
]
Mark Liu commented on BEAM-583:
---
Not figure out how to use --help, but according to PipelineOp
[
https://issues.apache.org/jira/browse/BEAM-583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15435739#comment-15435739
]
Mark Liu commented on BEAM-583:
---
using {code}--runner=TestDataflowRunner{code}will cause follo
[
https://issues.apache.org/jira/browse/BEAM-583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15435760#comment-15435760
]
Mark Liu commented on BEAM-583:
---
I can't think of a case that the pipeline author use TestData
[
https://issues.apache.org/jira/browse/BEAM-583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15435790#comment-15435790
]
Mark Liu commented on BEAM-583:
---
Make sense for me.
For me, TestPipeline is more used in uni
[
https://issues.apache.org/jira/browse/BEAM-583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mark Liu closed BEAM-583.
-
Resolution: Not A Problem
Fix Version/s: Not applicable
> Auto Register TestDataflowRunner
> ---
Mark Liu created BEAM-592:
-
Summary: StackOverflowError Failed example/java/WordCount When
Using SparkRunner
Key: BEAM-592
URL: https://issues.apache.org/jira/browse/BEAM-592
Project: Beam
Issue Typ
[
https://issues.apache.org/jira/browse/BEAM-592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mark Liu updated BEAM-592:
--
Description:
WordCount(example/java/WordCount) failed running with sparkRunner in following
command:
{code}
mvn c
[
https://issues.apache.org/jira/browse/BEAM-594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15446359#comment-15446359
]
Mark Liu commented on BEAM-594:
---
duplicated with BEAM-593
> Support cancel() and waitUntilFin
Mark Liu created BEAM-604:
-
Summary: Use Watermark Check Streaming Job Finish in
TestDataflowRunner
Key: BEAM-604
URL: https://issues.apache.org/jira/browse/BEAM-604
Project: Beam
Issue Type: Bug
Mark Liu created BEAM-605:
-
Summary: Create BigQuery Verifier
Key: BEAM-605
URL: https://issues.apache.org/jira/browse/BEAM-605
Project: Beam
Issue Type: Task
Reporter: Mark Liu
Create
[
https://issues.apache.org/jira/browse/BEAM-604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15449381#comment-15449381
]
Mark Liu commented on BEAM-604:
---
Right. [~pei...@gmail.com] may have some context on this.
>
[
https://issues.apache.org/jira/browse/BEAM-572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15452754#comment-15452754
]
Mark Liu commented on BEAM-572:
---
PR is closed. This jira can be marked as resolved.
> Remove
[
https://issues.apache.org/jira/browse/BEAM-604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mark Liu updated BEAM-604:
--
Summary: Use Watermark Check Streaming Job Finish in DataflowPipelineJob
(was: Use Watermark Check Streaming Job
[
https://issues.apache.org/jira/browse/BEAM-604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mark Liu updated BEAM-604:
--
Description:
Currently, streaming job with bounded input can't be terminated automatically
and TestDataflowRunner
[
https://issues.apache.org/jira/browse/BEAM-604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mark Liu updated BEAM-604:
--
Description:
Currently, streaming job with bounded input can't be terminated automatically
and TestDataflowRunner
[
https://issues.apache.org/jira/browse/BEAM-604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mark Liu updated BEAM-604:
--
Summary: Use Watermark Check Streaming Job Finish in TestDataflowRunner
(was: Use Watermark Check Streaming Job F
[
https://issues.apache.org/jira/browse/BEAM-604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mark Liu updated BEAM-604:
--
Description:
Currently, streaming job with bounded input can't be terminated automatically
and TestDataflowRunner
[
https://issues.apache.org/jira/browse/BEAM-604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mark Liu updated BEAM-604:
--
Description:
Currently, streaming job with bounded input can't be terminated automatically
and TestDataflowRunner
[
https://issues.apache.org/jira/browse/BEAM-604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mark Liu updated BEAM-604:
--
Description:
Currently, streaming job with bounded input can't be terminated automatically
and TestDataflowRunner
Mark Liu created BEAM-624:
-
Summary: NoClassDefFoundError Failed Dataflow Streaming Job
Key: BEAM-624
URL: https://issues.apache.org/jira/browse/BEAM-624
Project: Beam
Issue Type: Bug
Rep
[
https://issues.apache.org/jira/browse/BEAM-624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mark Liu closed BEAM-624.
-
> NoClassDefFoundError Failed Dataflow Streaming Job
> --
>
>
[
https://issues.apache.org/jira/browse/BEAM-624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mark Liu resolved BEAM-624.
---
Resolution: Fixed
Fix Version/s: Not applicable
> NoClassDefFoundError Failed Dataflow Streaming Job
> --
[
https://issues.apache.org/jira/browse/BEAM-495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mark Liu closed BEAM-495.
-
> Generalize FileChecksumMatcher used for all E2E test
>
>
>
[
https://issues.apache.org/jira/browse/BEAM-495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mark Liu resolved BEAM-495.
---
Resolution: Fixed
Fix Version/s: Not applicable
> Generalize FileChecksumMatcher used for all E2E test
>
[
https://issues.apache.org/jira/browse/BEAM-605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mark Liu reassigned BEAM-605:
-
Assignee: Mark Liu
> Create BigQuery Verifier
>
>
> Key: BEAM-605
Mark Liu created BEAM-445:
-
Summary: Beam-examples-java build failed through local "mvn
install"
Key: BEAM-445
URL: https://issues.apache.org/jira/browse/BEAM-445
Project: Beam
Issue Type: Bug
Mark Liu created BEAM-446:
-
Summary: Improve IOChannelUtils.resolve() to accept multiple paths
at once
Key: BEAM-446
URL: https://issues.apache.org/jira/browse/BEAM-446
Project: Beam
Issue Type: Imp
[
https://issues.apache.org/jira/browse/BEAM-446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15373860#comment-15373860
]
Mark Liu commented on BEAM-446:
---
[~lcwik] assign to me?
> Improve IOChannelUtils.resolve() to
[
https://issues.apache.org/jira/browse/BEAM-446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mark Liu updated BEAM-446:
--
Description:
Currently, IOChannelUtils.resolve() method can only resolve one path against
base path.
It's usefu
[
https://issues.apache.org/jira/browse/BEAM-446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mark Liu closed BEAM-446.
-
> Improve IOChannelUtils.resolve() to accept multiple paths at once
> --
Mark Liu created BEAM-495:
-
Summary: Generalize FileChecksumMatcher used for all E2E test
Key: BEAM-495
URL: https://issues.apache.org/jira/browse/BEAM-495
Project: Beam
Issue Type: Improvement
Mark Liu created BEAM-719:
-
Summary: Running WindowedWordCount Integration Test in Spark
Key: BEAM-719
URL: https://issues.apache.org/jira/browse/BEAM-719
Project: Beam
Issue Type: Improvement
Mark Liu created BEAM-720:
-
Summary: Running WindowedWordCount Integration Test in Flink
Key: BEAM-720
URL: https://issues.apache.org/jira/browse/BEAM-720
Project: Beam
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/BEAM-747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15576630#comment-15576630
]
Mark Liu commented on BEAM-747:
---
Yes, it's worth having retry in file path matching and readin
[
https://issues.apache.org/jira/browse/BEAM-605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mark Liu resolved BEAM-605.
---
Resolution: Done
Fix Version/s: Not applicable
> Create BigQuery Verifier
>
>
>
[
https://issues.apache.org/jira/browse/BEAM-719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mark Liu reassigned BEAM-719:
-
Assignee: Mark Liu (was: Amit Sela)
> Run WindowedWordCount Integration Test in Spark
> --
Mark Liu created BEAM-1077:
--
Summary: @ValidatesRunner test in Python postcommit
Key: BEAM-1077
URL: https://issues.apache.org/jira/browse/BEAM-1077
Project: Beam
Issue Type: Test
Componen
Mark Liu created BEAM-1091:
--
Summary: E2E WordCount test in Precommit
Key: BEAM-1091
URL: https://issues.apache.org/jira/browse/BEAM-1091
Project: Beam
Issue Type: Task
Components: sdk-py,
Mark Liu created BEAM-1109:
--
Summary: Python ValidatesRunner Tests on Dataflow Service Timeout
Key: BEAM-1109
URL: https://issues.apache.org/jira/browse/BEAM-1109
Project: Beam
Issue Type: Bug
[
https://issues.apache.org/jira/browse/BEAM-1109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15731495#comment-15731495
]
Mark Liu commented on BEAM-1109:
Actually the current ValidatesRunner tests are not running
[
https://issues.apache.org/jira/browse/BEAM-1077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mark Liu closed BEAM-1077.
--
Resolution: Done
Fix Version/s: Not applicable
> @ValidatesRunner test in Python postcommit
>
Mark Liu created BEAM-1112:
--
Summary: Python E2E Integration Test Framework - Batch Only
Key: BEAM-1112
URL: https://issues.apache.org/jira/browse/BEAM-1112
Project: Beam
Issue Type: Task
Mark Liu created BEAM-1124:
--
Summary: Python ValidateRunner Test
test_multi_valued_singleton_side_input Break Postcommit
Key: BEAM-1124
URL: https://issues.apache.org/jira/browse/BEAM-1124
Project: Beam
[
https://issues.apache.org/jira/browse/BEAM-1124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mark Liu updated BEAM-1124:
---
Description:
Python test_multi_valued_singleton_side_input test, a ValidatesRunner test that
running on datafl
[
https://issues.apache.org/jira/browse/BEAM-1091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mark Liu updated BEAM-1091:
---
Summary: Python E2E WordCount test in Precommit (was: E2E WordCount test
in Precommit)
> Python E2E WordCount
Mark Liu created BEAM-1152:
--
Summary: Java-Maven Archetypes-Starter Build Failed
Key: BEAM-1152
URL: https://issues.apache.org/jira/browse/BEAM-1152
Project: Beam
Issue Type: Bug
Component
Mark Liu created BEAM-1188:
--
Summary: More Verifiers For Python E2E Tests
Key: BEAM-1188
URL: https://issues.apache.org/jira/browse/BEAM-1188
Project: Beam
Issue Type: Task
Components: sdk
[
https://issues.apache.org/jira/browse/BEAM-1109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mark Liu closed BEAM-1109.
--
Resolution: Fixed
Fix Version/s: Not applicable
> Python ValidatesRunner Tests on Dataflow Service Timeout
[
https://issues.apache.org/jira/browse/BEAM-1188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mark Liu updated BEAM-1188:
---
Description:
Add more basic verifiers in e2e test to verify output data in different
storage/fs:
1. File veri
[
https://issues.apache.org/jira/browse/BEAM-1188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mark Liu updated BEAM-1188:
---
Description:
Add more basic verifiers in e2e test to verify output data in different
storage/fs:
1. File veri
54 matches
Mail list logo
