[jira] [Created] (BEAM-2942) DOCUMENTATION in header becomes too long, and needs redesign

2017-09-11 Thread Pei He (JIRA)
Pei He created BEAM-2942: Summary: DOCUMENTATION in header becomes too long, and needs redesign Key: BEAM-2942 URL: https://issues.apache.org/jira/browse/BEAM-2942 Project: Beam Issue Type: Bug

[jira] [Assigned] (BEAM-2846) Support SplittableParDo in MapReduce runner

2017-09-05 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He reassigned BEAM-2846: Assignee: (was: Pei He) > Support SplittableParDo in MapReduce runner >

[jira] [Created] (BEAM-2846) Support SplittableParDo in MapReduce runner

2017-09-05 Thread Pei He (JIRA)
Pei He created BEAM-2846: Summary: Support SplittableParDo in MapReduce runner Key: BEAM-2846 URL: https://issues.apache.org/jira/browse/BEAM-2846 Project: Beam Issue Type: New Feature

[jira] [Created] (BEAM-2845) Support TimersInParDo in MapReduce runner

2017-09-05 Thread Pei He (JIRA)
Pei He created BEAM-2845: Summary: Support TimersInParDo in MapReduce runner Key: BEAM-2845 URL: https://issues.apache.org/jira/browse/BEAM-2845 Project: Beam Issue Type: New Feature

[jira] [Created] (BEAM-2839) MR runner: add runner users guide under documentation/runners

2017-09-03 Thread Pei He (JIRA)
Pei He created BEAM-2839: Summary: MR runner: add runner users guide under documentation/runners Key: BEAM-2839 URL: https://issues.apache.org/jira/browse/BEAM-2839 Project: Beam Issue Type: Task

[jira] [Created] (BEAM-2838) MR runner: update the capability matrix with the current status.

2017-09-03 Thread Pei He (JIRA)
Pei He created BEAM-2838: Summary: MR runner: update the capability matrix with the current status. Key: BEAM-2838 URL: https://issues.apache.org/jira/browse/BEAM-2838 Project: Beam Issue Type:

[jira] [Created] (BEAM-2835) Support executing MapReduce jobs in parallel.

2017-09-01 Thread Pei He (JIRA)
Pei He created BEAM-2835: Summary: Support executing MapReduce jobs in parallel. Key: BEAM-2835 URL: https://issues.apache.org/jira/browse/BEAM-2835 Project: Beam Issue Type: New Feature

[jira] [Created] (BEAM-2830) Main thread needs to re-throw worker exceptions for ValidatesRunner tests that expects exceptions.

2017-08-30 Thread Pei He (JIRA)
Pei He created BEAM-2830: Summary: Main thread needs to re-throw worker exceptions for ValidatesRunner tests that expects exceptions. Key: BEAM-2830 URL: https://issues.apache.org/jira/browse/BEAM-2830

[jira] [Assigned] (BEAM-2783) Support Counters/Metrics and run ValidatesRunner tests

2017-08-30 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He reassigned BEAM-2783: Assignee: Pei He > Support Counters/Metrics and run ValidatesRunner tests >

[jira] [Created] (BEAM-2824) Support PipelineResult in JStormRunner

2017-08-30 Thread Pei He (JIRA)
Pei He created BEAM-2824: Summary: Support PipelineResult in JStormRunner Key: BEAM-2824 URL: https://issues.apache.org/jira/browse/BEAM-2824 Project: Beam Issue Type: New Feature

[jira] [Commented] (BEAM-1763) TestPipeline should ensure that all assertions succeeded

2017-08-29 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146547#comment-16146547 ] Pei He commented on BEAM-1763: -- Do we require runners to quiesce when bounded data was processed? Otherwise,

[jira] [Closed] (BEAM-2757) Link to Jenkins view is dead

2017-08-29 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He closed BEAM-2757. Resolution: Fixed Assignee: Pei He (was: Jason Kuster) Fix Version/s: Not applicable I think this

[jira] [Closed] (BEAM-2126) Add JStorm runner to "Conbribute > Technical References > Ongoing Projects"

2017-08-28 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He closed BEAM-2126. Resolution: Fixed Fix Version/s: Not applicable > Add JStorm runner to "Conbribute > Technical References >

[jira] [Updated] (BEAM-2783) Support Counters/Metrics and run ValidatesRunner tests

2017-08-21 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He updated BEAM-2783: - Issue Type: New Feature (was: Bug) > Support Counters/Metrics and run ValidatesRunner tests >

[jira] [Created] (BEAM-2783) Support Counters/Metrics and run ValidatesRunner tests

2017-08-21 Thread Pei He (JIRA)
Pei He created BEAM-2783: Summary: Support Counters/Metrics and run ValidatesRunner tests Key: BEAM-2783 URL: https://issues.apache.org/jira/browse/BEAM-2783 Project: Beam Issue Type: Bug

[jira] [Closed] (BEAM-1612) Support real Bundle in Flink runner

2017-08-15 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He closed BEAM-1612. Resolution: Fixed > Support real Bundle in Flink runner > --- > >

[jira] [Updated] (BEAM-2709) Add TezRunner

2017-08-08 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He updated BEAM-2709: - Component/s: runner-tez > Add TezRunner > - > > Key: BEAM-2709 > URL:

[jira] [Assigned] (BEAM-165) Add Hadoop MapReduce runner

2017-08-08 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He reassigned BEAM-165: --- Assignee: Pei He (was: Jean-Baptiste Onofré) Component/s: runner-mapreduce Issue Type: New Feature

[jira] [Commented] (BEAM-2714) ParDo.getAdditionalInputs() return the input of View.CreatePCollectionView instead of output.

2017-08-02 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112072#comment-16112072 ] Pei He commented on BEAM-2714: -- Just to clarify: with runner API, there will be no view transform (neither

[jira] [Comment Edited] (BEAM-2714) ParDo.getAdditionalInputs() return the input of View.CreatePCollectionView instead of output.

2017-08-02 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111016#comment-16111016 ] Pei He edited comment on BEAM-2714 at 8/2/17 2:38 PM: -- I use TransformHierarchy.Node

[jira] [Comment Edited] (BEAM-2714) ParDo.getAdditionalInputs() return the input of View.CreatePCollectionView instead of output.

2017-08-02 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111016#comment-16111016 ] Pei He edited comment on BEAM-2714 at 8/2/17 2:37 PM: -- I use TransformHierarchy.Node

[jira] [Updated] (BEAM-2714) ParDo.getAdditionalInputs() return the input of View.CreatePCollectionView instead of output.

2017-08-02 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He updated BEAM-2714: - Attachment: view-tag.png I use TransformHierarchy.Node getInputs() and getOutputs() to setup this diagram. The

[jira] [Created] (BEAM-2714) ParDo.getAdditionalInputs() return the input of View.CreatePCollectionView instead of output.

2017-08-02 Thread Pei He (JIRA)
Pei He created BEAM-2714: Summary: ParDo.getAdditionalInputs() return the input of View.CreatePCollectionView instead of output. Key: BEAM-2714 URL: https://issues.apache.org/jira/browse/BEAM-2714 Project:

[jira] [Created] (BEAM-2681) TransformHierarchy.Node getInputs() TupleTags doesn't match previous ParDo.MultiOutput's getOutputs().

2017-07-25 Thread Pei He (JIRA)
Pei He created BEAM-2681: Summary: TransformHierarchy.Node getInputs() TupleTags doesn't match previous ParDo.MultiOutput's getOutputs(). Key: BEAM-2681 URL: https://issues.apache.org/jira/browse/BEAM-2681

[jira] [Created] (BEAM-2668) JStormPipelineTranslator: use urnEqualTo instead of classEqualTo to support other languages (Python).

2017-07-23 Thread Pei He (JIRA)
Pei He created BEAM-2668: Summary: JStormPipelineTranslator: use urnEqualTo instead of classEqualTo to support other languages (Python). Key: BEAM-2668 URL: https://issues.apache.org/jira/browse/BEAM-2668

[jira] [Created] (BEAM-2667) JStorm runner: views translation could be simplified after merge with master

2017-07-23 Thread Pei He (JIRA)
Pei He created BEAM-2667: Summary: JStorm runner: views translation could be simplified after merge with master Key: BEAM-2667 URL: https://issues.apache.org/jira/browse/BEAM-2667 Project: Beam

[jira] [Created] (BEAM-2666) JStorm runner: add runner users guide under documentation/runners

2017-07-23 Thread Pei He (JIRA)
Pei He created BEAM-2666: Summary: JStorm runner: add runner users guide under documentation/runners Key: BEAM-2666 URL: https://issues.apache.org/jira/browse/BEAM-2666 Project: Beam Issue Type:

[jira] [Created] (BEAM-2665) JStorm runner: update the capability matrix with the current status.

2017-07-23 Thread Pei He (JIRA)
Pei He created BEAM-2665: Summary: JStorm runner: update the capability matrix with the current status. Key: BEAM-2665 URL: https://issues.apache.org/jira/browse/BEAM-2665 Project: Beam Issue Type:

[jira] [Assigned] (BEAM-1899) JStorm runner

2017-07-23 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He reassigned BEAM-1899: Assignee: Basti Liu (was: Pei He) > JStorm runner > - > > Key: BEAM-1899 >

[jira] [Created] (BEAM-2663) ReshuffleTest: reuse ContainsKVs in GroupByKeyTest

2017-07-23 Thread Pei He (JIRA)
Pei He created BEAM-2663: Summary: ReshuffleTest: reuse ContainsKVs in GroupByKeyTest Key: BEAM-2663 URL: https://issues.apache.org/jira/browse/BEAM-2663 Project: Beam Issue Type: Improvement

[jira] [Closed] (BEAM-2630) TestPipeline.getAppName() doesn't work properly when TestPipeline is used as @Rule

2017-07-18 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He closed BEAM-2630. Resolution: Fixed > TestPipeline.getAppName() doesn't work properly when TestPipeline is used as > @Rule >

[jira] [Created] (BEAM-2631) ParDo processing timer need more tests.

2017-07-17 Thread Pei He (JIRA)
Pei He created BEAM-2631: Summary: ParDo processing timer need more tests. Key: BEAM-2631 URL: https://issues.apache.org/jira/browse/BEAM-2631 Project: Beam Issue Type: Test Components:

[jira] [Created] (BEAM-2630) TestPipeline.getAppName() doesn't work properly when TestPipeline is used as @Rule

2017-07-17 Thread Pei He (JIRA)
Pei He created BEAM-2630: Summary: TestPipeline.getAppName() doesn't work properly when TestPipeline is used as @Rule Key: BEAM-2630 URL: https://issues.apache.org/jira/browse/BEAM-2630 Project: Beam

[jira] [Closed] (BEAM-210) Allow control of empty ON_TIME panes analogous to final panes

2017-06-29 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He closed BEAM-210. --- Resolution: Fixed > Allow control of empty ON_TIME panes analogous to final panes >

[jira] [Updated] (BEAM-210) Allow control of empty ON_TIME panes analogous to final panes

2017-06-29 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He updated BEAM-210: Fix Version/s: 2.1.0 Issue Type: New Feature (was: Bug) > Allow control of empty ON_TIME panes analogous to

[jira] [Commented] (BEAM-9) Storm Runner

2017-06-20 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-9?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056175#comment-16056175 ] Pei He commented on BEAM-9: --- Hi Xiao LI, The jstorm runner is in my github repo, and we are working on merging it to

[jira] [Comment Edited] (BEAM-101) Data-driven triggers

2017-06-01 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034083#comment-16034083 ] Pei He edited comment on BEAM-101 at 6/2/17 3:42 AM: - I opened

[jira] [Commented] (BEAM-101) Data-driven triggers

2017-06-01 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034083#comment-16034083 ] Pei He commented on BEAM-101: - I opened https://issues.apache.org/jira/browse/BEAM-2402 > Data-driven triggers

[jira] [Created] (BEAM-2402) Support AfterPane.elementGapAtMost() trigger and its combination with elementCountAtLeast()

2017-06-01 Thread Pei He (JIRA)
Pei He created BEAM-2402: Summary: Support AfterPane.elementGapAtMost() trigger and its combination with elementCountAtLeast() Key: BEAM-2402 URL: https://issues.apache.org/jira/browse/BEAM-2402 Project:

[jira] [Assigned] (BEAM-2402) Support AfterPane.elementGapAtMost() trigger and its combination with elementCountAtLeast()

2017-06-01 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He reassigned BEAM-2402: Assignee: Pei He (was: Davor Bonaci) > Support AfterPane.elementGapAtMost() trigger and its combination

[jira] [Commented] (BEAM-101) Data-driven triggers

2017-06-01 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16032951#comment-16032951 ] Pei He commented on BEAM-101: - Background: We need a way to define a custom trigger, such as

[jira] [Assigned] (BEAM-2394) Postcommit_Java_JDK_Version_Test is broken since SpannerWriteIT failed

2017-06-01 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He reassigned BEAM-2394: Assignee: Mairbek Khadikov (was: Pei He) > Postcommit_Java_JDK_Version_Test is broken since SpannerWriteIT

[jira] [Assigned] (BEAM-2394) Postcommit_Java_JDK_Version_Test is broken since SpannerWriteIT failed

2017-06-01 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He reassigned BEAM-2394: Assignee: Pei He (was: Mairbek Khadikov) > Postcommit_Java_JDK_Version_Test is broken since SpannerWriteIT

[jira] [Commented] (BEAM-2298) Java WordCount doesn't work in Window OS

2017-05-15 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16010555#comment-16010555 ] Pei He commented on BEAM-2298: -- Tried "file:///C:/input.txt" as the input path, also failed. java -cp

[jira] [Created] (BEAM-2299) Beam repo build failes in Windows OS

2017-05-15 Thread Pei He (JIRA)
Pei He created BEAM-2299: Summary: Beam repo build failes in Windows OS Key: BEAM-2299 URL: https://issues.apache.org/jira/browse/BEAM-2299 Project: Beam Issue Type: Bug Components:

[jira] [Created] (BEAM-2298) Java WordCount doesn't work in Window OS

2017-05-15 Thread Pei He (JIRA)
Pei He created BEAM-2298: Summary: Java WordCount doesn't work in Window OS Key: BEAM-2298 URL: https://issues.apache.org/jira/browse/BEAM-2298 Project: Beam Issue Type: Bug Components:

[jira] [Created] (BEAM-2295) Hadoop IO connectors require additional repositories

2017-05-14 Thread Pei He (JIRA)
Pei He created BEAM-2295: Summary: Hadoop IO connectors require additional repositories Key: BEAM-2295 URL: https://issues.apache.org/jira/browse/BEAM-2295 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-2280) Examples archetypes build fail when upgrading

2017-05-12 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16008075#comment-16008075 ] Pei He commented on BEAM-2280: -- I think this is not a release blocker, given it only affects people who check

[jira] [Updated] (BEAM-2280) Examples archetypes build fail when upgrading

2017-05-12 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He updated BEAM-2280: - Priority: Minor (was: Major) > Examples archetypes build fail when upgrading >

[jira] [Created] (BEAM-2280) Examples archetypes build fail when upgrading

2017-05-12 Thread Pei He (JIRA)
Pei He created BEAM-2280: Summary: Examples archetypes build fail when upgrading Key: BEAM-2280 URL: https://issues.apache.org/jira/browse/BEAM-2280 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-644) Primitive to shift the watermark while assigning timestamps

2017-04-23 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15980645#comment-15980645 ] Pei He commented on BEAM-644: - I think this also applies to a more general issue: data unorderedness/delay in

[jira] [Created] (BEAM-1899) JStorm runner

2017-04-06 Thread Pei He (JIRA)
Pei He created BEAM-1899: Summary: JStorm runner Key: BEAM-1899 URL: https://issues.apache.org/jira/browse/BEAM-1899 Project: Beam Issue Type: New Feature Components: runner-ideas

[jira] [Commented] (BEAM-1854) Replace the magic number 42 in PAssert.

2017-03-31 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951951#comment-15951951 ] Pei He commented on BEAM-1854: -- For example, a string like "PAssert-global-key" would be better. > Replace

[jira] [Created] (BEAM-1854) Replace the magic number 42 in PAssert.

2017-03-31 Thread Pei He (JIRA)
Pei He created BEAM-1854: Summary: Replace the magic number 42 in PAssert. Key: BEAM-1854 URL: https://issues.apache.org/jira/browse/BEAM-1854 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-1838) GlobalWindow equals() and hashCode() doesn't work with other serialization frameworks

2017-03-30 Thread Pei He (JIRA)
Pei He created BEAM-1838: Summary: GlobalWindow equals() and hashCode() doesn't work with other serialization frameworks Key: BEAM-1838 URL: https://issues.apache.org/jira/browse/BEAM-1838 Project: Beam

[jira] [Created] (BEAM-1739) Create failed in UnboundedReadFromBoundedSource

2017-03-17 Thread Pei He (JIRA)
Pei He created BEAM-1739: Summary: Create failed in UnboundedReadFromBoundedSource Key: BEAM-1739 URL: https://issues.apache.org/jira/browse/BEAM-1739 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-1503) GcsFileSystem: parallelize matchGlobs()

2017-02-16 Thread Pei He (JIRA)
Pei He created BEAM-1503: Summary: GcsFileSystem: parallelize matchGlobs() Key: BEAM-1503 URL: https://issues.apache.org/jira/browse/BEAM-1503 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-1494) GcsFileSystem should check content encoding when setting IsReadSeekEfficient

2017-02-15 Thread Pei He (JIRA)
Pei He created BEAM-1494: Summary: GcsFileSystem should check content encoding when setting IsReadSeekEfficient Key: BEAM-1494 URL: https://issues.apache.org/jira/browse/BEAM-1494 Project: Beam

[jira] [Updated] (BEAM-1453) Unicode chars in local file system paths break dataflow runner tests.

2017-02-09 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He updated BEAM-1453: - Component/s: (was: sdk-java-core) runner-dataflow > Unicode chars in local file system paths

[jira] [Updated] (BEAM-1453) Unicode chars in local file system paths break dataflow runner tests.

2017-02-09 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He updated BEAM-1453: - Summary: Unicode chars in local file system paths break dataflow runner tests. (was: Unicode chars in local file

[jira] [Updated] (BEAM-1453) Unicode chars in local file system paths break tests.

2017-02-09 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He updated BEAM-1453: - Summary: Unicode chars in local file system paths break tests. (was: Support unicode chars in local file system

[jira] [Updated] (BEAM-1453) Support unicode chars in local file system paths.

2017-02-09 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He updated BEAM-1453: - Summary: Support unicode chars in local file system paths. (was: Unicode support in local file system paths.) >

[jira] [Created] (BEAM-1453) Unicode support in local file system paths.

2017-02-09 Thread Pei He (JIRA)
Pei He created BEAM-1453: Summary: Unicode support in local file system paths. Key: BEAM-1453 URL: https://issues.apache.org/jira/browse/BEAM-1453 Project: Beam Issue Type: Bug Components:

[jira] (BEAM-1352) io/google-cloud-platform should not depend on runners/dataflow for testing

2017-01-30 Thread Pei He (JIRA)
Title: Message Title Pei He created an issue

[jira] [Commented] (BEAM-1181) Investigate: does BigQueryIO honor write disposition in all cases?

2017-01-27 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15843661#comment-15843661 ] Pei He commented on BEAM-1181: -- Manually verified 5.0.0 release that all write dispositions work. >

[jira] [Commented] (BEAM-1309) FileIOChannelFactory.match() traverses entire parent directory recursively

2017-01-27 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15843658#comment-15843658 ] Pei He commented on BEAM-1309: -- Where is match() is called, and what is the pattern? We can probably use:

[jira] [Commented] (BEAM-1315) FileBasedSink could write tmp files above the output prefix.

2017-01-25 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15839076#comment-15839076 ] Pei He commented on BEAM-1315: -- My main concern is about the directory permission. (Users only have write

[jira] [Created] (BEAM-1321) Re-thinking BigQueryIO export/load/copy jobs retry logic

2017-01-25 Thread Pei He (JIRA)
Pei He created BEAM-1321: Summary: Re-thinking BigQueryIO export/load/copy jobs retry logic Key: BEAM-1321 URL: https://issues.apache.org/jira/browse/BEAM-1321 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-1315) FileBasedSink could write tmp files above the output prefix.

2017-01-25 Thread Pei He (JIRA)
Pei He created BEAM-1315: Summary: FileBasedSink could write tmp files above the output prefix. Key: BEAM-1315 URL: https://issues.apache.org/jira/browse/BEAM-1315 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-1302) Improve warning messages in BigQueryServicesImpl.

2017-01-24 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15836938#comment-15836938 ] Pei He commented on BEAM-1302: -- Fixed in

[jira] [Resolved] (BEAM-1258) BigQueryIO.Write: CREATE_IF_NEEDED and per-window tables is broken

2017-01-24 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He resolved BEAM-1258. -- Resolution: Fixed > BigQueryIO.Write: CREATE_IF_NEEDED and per-window tables is broken >

[jira] [Updated] (BEAM-1306) Support additional configuration in BigQueryServices.insertAll()

2017-01-24 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He updated BEAM-1306: - Description: ignoreUnknownValues is requested in https://issues.apache.org/jira/browse/BEAM-1267 There are

[jira] [Created] (BEAM-1305) Support additional configuration in BigQueryServices.insertAll()

2017-01-24 Thread Pei He (JIRA)
Pei He created BEAM-1305: Summary: Support additional configuration in BigQueryServices.insertAll() Key: BEAM-1305 URL: https://issues.apache.org/jira/browse/BEAM-1305 Project: Beam Issue Type:

[jira] [Created] (BEAM-1252) BigQueryIO.Read: validate exported files with GCS glob.

2017-01-09 Thread Pei He (JIRA)
Pei He created BEAM-1252: Summary: BigQueryIO.Read: validate exported files with GCS glob. Key: BEAM-1252 URL: https://issues.apache.org/jira/browse/BEAM-1252 Project: Beam Issue Type: Bug