[jira] (BEAM-1358) Enforce that transitive dependencies do not require > jdk7

2017-01-30 Thread Daniel Halperin (JIRA)
Title: Message Title Daniel Halperin created an issue

[jira] (BEAM-1358) Enforce that transitive dependencies do not require > jdk7

2017-01-30 Thread Daniel Halperin (JIRA)
Title: Message Title Daniel Halperin resolved as Fixed

[jira] (BEAM-1343) HDFSFileSource size estimate is incorrect

2017-01-30 Thread Daniel Halperin (JIRA)
Title: Message Title Daniel Halperin assigned an issue to Daniel Halperin

[jira] (BEAM-1351) Upgrade AutoValue 1.1->1.3

2017-01-30 Thread Daniel Halperin (JIRA)
Title: Message Title Daniel Halperin resolved as Fixed

[jira] (BEAM-1343) HDFSFileSource size estimate is incorrect

2017-01-30 Thread Daniel Halperin (JIRA)
Title: Message Title Daniel Halperin resolved as Fixed

[jira] (BEAM-1343) HDFSFileSource size estimate is incorrect

2017-01-30 Thread Daniel Halperin (JIRA)
Title: Message Title Daniel Halperin assigned an issue to Igor Bernstein

[jira] (BEAM-1360) Reference to the obsolete python-sdk branch in the documentation.

2017-01-31 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-1360: - Assignee: Prabeesh K (was: Davor Bonaci) > Reference to the obsolete python-sdk branch in

[jira] (BEAM-1360) Reference to the obsolete python-sdk branch in the documentation.

2017-01-31 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-1360. --- Resolution: Fixed Fix Version/s: Not applicable > Reference to the obsolete python-sdk b

[jira] [Resolved] (BEAM-1350) BigQueryIO does not honor SQL dialect or result flattening in DirectRunner

2017-01-31 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-1350. --- Resolution: Fixed Fix Version/s: 0.6.0 > BigQueryIO does not honor SQL dialect or result

[jira] [Commented] (BEAM-1367) Need a way to force a page to be set to a specific language for code blocks

2017-01-31 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15847884#comment-15847884 ] Daniel Halperin commented on BEAM-1367: --- Hey [~mabdullah353], do you have any thought

[jira] [Resolved] (BEAM-1301) Support table description patch in BigQuery IO

2017-02-01 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-1301. --- Resolution: Fixed Fix Version/s: 0.6.0 > Support table description patch in BigQuery IO

[jira] [Commented] (BEAM-1092) Shade commonly used libraries (e.g. Guava) to avoid class conflicts

2017-02-01 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15848754#comment-15848754 ] Daniel Halperin commented on BEAM-1092: --- [~aviemzur] I strongly agree that we should

[jira] [Updated] (BEAM-717) Migrate KafkaIO to use AutoValue to reduce boilerplate

2017-02-01 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-717: - Labels: backward-incompatible io simple starter (was: io simple starter) > Migrate KafkaIO to use A

[jira] [Resolved] (BEAM-717) Change KafkaIO API to be consistent with style guide

2017-02-01 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-717. -- Resolution: Fixed Fix Version/s: 0.6.0 > Change KafkaIO API to be consistent with style gui

[jira] [Updated] (BEAM-717) Change KafkaIO API to be consistent with style guide

2017-02-01 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-717: - Summary: Change KafkaIO API to be consistent with style guide (was: KafkaIO should comply with styl

[jira] [Resolved] (BEAM-1378) Late data dropping was removed from Flink Runner

2017-02-02 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-1378. --- Resolution: Fixed Fix Version/s: (was: 0.5.0) Not applicable > La

[jira] [Closed] (BEAM-1378) Late data dropping was removed from Flink Runner

2017-02-02 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-1378. - > Late data dropping was removed from Flink Runner > >

[jira] [Created] (BEAM-1382) Test that standard coders encode the same across SDKs

2017-02-02 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-1382: - Summary: Test that standard coders encode the same across SDKs Key: BEAM-1382 URL: https://issues.apache.org/jira/browse/BEAM-1382 Project: Beam Issue Type

[jira] [Resolved] (BEAM-1127) JmsIO should create an unique source in case of topic

2017-02-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-1127. --- Resolution: Fixed Fix Version/s: 0.6.0 > JmsIO should create an unique source in case of

[jira] [Closed] (BEAM-278) Add I/O section

2017-02-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-278. > Add I/O section > --- > > Key: BEAM-278 > URL: https://issue

[jira] [Resolved] (BEAM-278) Add I/O section

2017-02-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-278. -- Resolution: Fixed Fix Version/s: Not applicable > Add I/O section > --- > >

[jira] [Created] (BEAM-1387) DatastoreIO: use batch-datastore.googleapis.com as the endpoint

2017-02-03 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-1387: - Summary: DatastoreIO: use batch-datastore.googleapis.com as the endpoint Key: BEAM-1387 URL: https://issues.apache.org/jira/browse/BEAM-1387 Project: Beam

[jira] [Commented] (BEAM-1396) GABWVOBDoFn expects grouped values to be ordered by their timestamp but there is no such guarantee

2017-02-05 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15853298#comment-15853298 ] Daniel Halperin commented on BEAM-1396: --- To add a little more flavor: I'm not sure wh

[jira] [Comment Edited] (BEAM-1396) GABWVOBDoFn expects grouped values to be ordered by their timestamp but there is no such guarantee

2017-02-05 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15853298#comment-15853298 ] Daniel Halperin edited comment on BEAM-1396 at 2/5/17 5:54 PM: --

[jira] [Created] (BEAM-1399) Code coverage numbers are not accurate

2017-02-05 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-1399: - Summary: Code coverage numbers are not accurate Key: BEAM-1399 URL: https://issues.apache.org/jira/browse/BEAM-1399 Project: Beam Issue Type: Bug

[jira] [Resolved] (BEAM-1387) DatastoreIO: use batch-datastore.googleapis.com as the endpoint

2017-02-05 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-1387. --- Resolution: Fixed Fix Version/s: 0.6.0 > DatastoreIO: use batch-datastore.googleapis.com

[jira] [Commented] (BEAM-1396) GABWVOBDoFn expects grouped values to be ordered by their timestamp but there is no such guarantee

2017-02-05 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15853587#comment-15853587 ] Daniel Halperin commented on BEAM-1396: --- :+1: > GABWVOBDoFn expects grouped values t

[jira] [Updated] (BEAM-1223) Add static factory methods for Sum.[*]Fn classes

2017-02-05 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1223: -- Labels: backward-incompatible (was: ) > Add static factory methods for Sum.[*]Fn classes > -

[jira] [Updated] (BEAM-1223) Replace public constructors with static factory methods for Sum.[*]Fn classes

2017-02-05 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1223: -- Summary: Replace public constructors with static factory methods for Sum.[*]Fn classes (was: Add

[jira] [Commented] (BEAM-1223) Replace public constructors with static factory methods for Sum.[*]Fn classes

2017-02-05 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15853621#comment-15853621 ] Daniel Halperin commented on BEAM-1223: --- Hey [~staslev], I just found in testing the

[jira] [Commented] (BEAM-1223) Replace public constructors with static factory methods for Sum.[*]Fn classes

2017-02-06 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15853669#comment-15853669 ] Daniel Halperin commented on BEAM-1223: --- Somewhat old thread: https://lists.apache.o

[jira] [Commented] (BEAM-425) Create Elasticsearch IO

2017-02-06 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15854337#comment-15854337 ] Daniel Halperin commented on BEAM-425: -- Hi Reza, Please open a JIRA for ES 5 support,

[jira] [Updated] (BEAM-298) Make TestPipeline implement the TestRule interface

2017-02-06 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-298: - Issue Type: Improvement (was: Bug) > Make TestPipeline implement the TestRule interface > -

[jira] [Updated] (BEAM-440) Create.values() returns a type-unsafe Coder

2017-02-06 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-440: - Labels: backward-incompatible newbie starter (was: newbie starter) > Create.values() returns a type

[jira] [Commented] (BEAM-1411) Unable to downgrade to lower guava version after upgrade to beam-0.5

2017-02-07 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15856291#comment-15856291 ] Daniel Halperin commented on BEAM-1411: --- Hi [~michel], Thanks for the report, and go

[jira] [Updated] (BEAM-1384) JmsIO postcommit failure: testAuthenticationWithBadPassword

2017-02-07 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1384: -- Priority: Major (was: Minor) > JmsIO postcommit failure: testAuthenticationWithBadPassword > ---

[jira] [Assigned] (BEAM-1384) JmsIO postcommit failure: testAuthenticationWithBadPassword

2017-02-07 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-1384: - Assignee: Daniel Halperin (was: Jean-Baptiste Onofré) > JmsIO postcommit failure: testAut

[jira] [Resolved] (BEAM-1384) JmsIO postcommit failure: testAuthenticationWithBadPassword

2017-02-07 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-1384. --- Resolution: Fixed Fix Version/s: 0.6.0 Rewrote racy code in start() so that close() does

[jira] [Commented] (BEAM-1413) DoFn javadoc has @literal where it shouldn't

2017-02-07 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15856782#comment-15856782 ] Daniel Halperin commented on BEAM-1413: --- Grepping the website: {code} [12:58:23 dhal

[jira] [Issue Comment Deleted] (BEAM-1413) DoFn javadoc has @literal where it shouldn't

2017-02-07 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1413: -- Comment: was deleted (was: Grepping the website: {code} [12:58:23 dhalperi@dhalperi:0.5.0 903fd8

[jira] [Commented] (BEAM-1413) DoFn javadoc has @literal where it shouldn't

2017-02-07 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15856781#comment-15856781 ] Daniel Halperin commented on BEAM-1413: --- Grepping the website: {code} [12:58:23 dhal

[jira] [Resolved] (BEAM-1382) Test that standard coders encode the same across SDKs

2017-02-07 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-1382. --- Resolution: Fixed More work to be done here, but we got the basics in and working across two SD

[jira] [Commented] (BEAM-1434) Apex RunnableOnService failure due to Jackson YAML ClassNotFound exception

2017-02-07 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15857552#comment-15857552 ] Daniel Halperin commented on BEAM-1434: --- Hypothesis: it's actually going to end up be

[jira] [Resolved] (BEAM-1434) RunnableOnServices failure due to Jackson YAML ClassNotFound exception

2017-02-08 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-1434. --- Resolution: Fixed Fix Version/s: Not applicable > RunnableOnServices failure due to Jack

[jira] [Updated] (BEAM-1434) RunnableOnServices failure due to Jackson YAML ClassNotFound exception

2017-02-08 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1434: -- Summary: RunnableOnServices failure due to Jackson YAML ClassNotFound exception (was: Apex Runna

[jira] [Commented] (BEAM-1295) Annotations are not properly rendered in JavaDoc when using {@code}

2017-02-09 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15859804#comment-15859804 ] Daniel Halperin commented on BEAM-1295: --- Yessir, you are correct. [~kenn] discovered

[jira] [Resolved] (BEAM-1285) Apache Rat Plugin should list files with invalid licenses in the console

2017-02-11 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-1285. --- Resolution: Fixed Fix Version/s: Not applicable > Apache Rat Plugin should list files wi

[jira] [Resolved] (BEAM-1231) Use well known coder types in Java for WindowedValue, GlobalWindow, and LengthPrefix

2017-02-11 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-1231. --- Resolution: Fixed Fix Version/s: Not applicable > Use well known coder types in Java for

[jira] [Assigned] (BEAM-718) Migrate KinesisIO to use AutoValue to reduce boilerplate

2017-02-11 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-718: Assignee: (was: James Malone) > Migrate KinesisIO to use AutoValue to reduce boilerplate

[jira] [Created] (BEAM-1467) Use well-known coder types for known window coders

2017-02-11 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-1467: - Summary: Use well-known coder types for known window coders Key: BEAM-1467 URL: https://issues.apache.org/jira/browse/BEAM-1467 Project: Beam Issue Type: I

[jira] [Updated] (BEAM-1467) Use well-known coder types for known window coders

2017-02-11 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1467: -- Description: Known window types include: * GlobalWindow * IntervalWindow Standardizing the name

[jira] [Commented] (BEAM-1751) Singleton ByteKeyRange with BigtableIO and Dataflow runner

2017-03-20 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15933751#comment-15933751 ] Daniel Halperin commented on BEAM-1751: --- You are running with the {{--streaming}} opt

[jira] [Updated] (BEAM-632) Dataflow runner does not correctly flatten duplicate inputs

2017-03-20 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-632: - Fix Version/s: First stable release > Dataflow runner does not correctly flatten duplicate inputs >

[jira] [Commented] (BEAM-632) Dataflow runner does not correctly flatten duplicate inputs

2017-03-20 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15934019#comment-15934019 ] Daniel Halperin commented on BEAM-632: -- Thomas, would you mind taking a pass on this on

[jira] [Assigned] (BEAM-632) Dataflow runner does not correctly flatten duplicate inputs

2017-03-20 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-632: Assignee: Thomas Groh (was: Kenneth Knowles) > Dataflow runner does not correctly flatten du

[jira] [Commented] (BEAM-1735) Retry 403:rateLimitExceeded in GCS

2017-03-20 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15934060#comment-15934060 ] Daniel Halperin commented on BEAM-1735: --- Can you provide more information about this

[jira] [Resolved] (BEAM-1740) Update bigtable version to 0.9.5.1

2017-03-21 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-1740. --- Resolution: Fixed Fix Version/s: First stable release > Update bigtable version to 0.9.5

[jira] [Commented] (BEAM-1775) fix issue of start_from_previous_offset in KafkaIO

2017-03-21 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15935577#comment-15935577 ] Daniel Halperin commented on BEAM-1775: --- Hi [~mingmxu], * Re: the question from Jins

[jira] [Commented] (BEAM-1751) Singleton ByteKeyRange with BigtableIO and Dataflow runner

2017-03-22 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15936525#comment-15936525 ] Daniel Halperin commented on BEAM-1751: --- [~pei...@gmail.com] do you have any ideas he

[jira] [Commented] (BEAM-1751) Singleton ByteKeyRange with BigtableIO and Dataflow runner

2017-03-22 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15936528#comment-15936528 ] Daniel Halperin commented on BEAM-1751: --- And how much data is in the Bigtable read?

[jira] [Created] (BEAM-1780) BigtableReader.splitIntoFraction should more carefully guard input

2017-03-22 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-1780: - Summary: BigtableReader.splitIntoFraction should more carefully guard input Key: BEAM-1780 URL: https://issues.apache.org/jira/browse/BEAM-1780 Project: Beam

[jira] [Updated] (BEAM-1735) Retry 403:rateLimitExceeded in GCS

2017-03-23 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1735: -- Priority: Minor (was: Major) > Retry 403:rateLimitExceeded in GCS >

[jira] [Assigned] (BEAM-1735) Retry 403:rateLimitExceeded in GCS

2017-03-23 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-1735: - Assignee: (was: Daniel Halperin) > Retry 403:rateLimitExceeded in GCS > --

[jira] [Commented] (BEAM-1751) Singleton ByteKeyRange with BigtableIO and Dataflow runner

2017-03-23 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15938606#comment-15938606 ] Daniel Halperin commented on BEAM-1751: --- Can you try patching https://github.com/apac

[jira] [Resolved] (BEAM-1780) BigtableReader.splitIntoFraction should more carefully guard input

2017-03-23 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-1780. --- Resolution: Fixed > BigtableReader.splitIntoFraction should more carefully guard input > --

[jira] [Created] (BEAM-1794) Bigtable: improve user agent

2017-03-23 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-1794: - Summary: Bigtable: improve user agent Key: BEAM-1794 URL: https://issues.apache.org/jira/browse/BEAM-1794 Project: Beam Issue Type: Improvement C

[jira] [Commented] (BEAM-1795) Upgrade google-cloud-bigquery to 0.23.0

2017-03-24 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15940756#comment-15940756 ] Daniel Halperin commented on BEAM-1795: --- It's a question of: - upgrade fast & get pe

[jira] [Commented] (BEAM-1795) Upgrade google-cloud-bigquery to 0.23.0

2017-03-24 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15940757#comment-15940757 ] Daniel Halperin commented on BEAM-1795: --- I'd definitely encourage inspect the transit

[jira] [Closed] (BEAM-1794) Bigtable: improve user agent

2017-03-24 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-1794. - Resolution: Fixed Fix Version/s: First stable release > Bigtable: improve user agent > -

[jira] [Commented] (BEAM-1751) Singleton ByteKeyRange with BigtableIO and Dataflow runner

2017-03-24 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15941026#comment-15941026 ] Daniel Halperin commented on BEAM-1751: --- The line numbers in your stack trace don't l

[jira] [Closed] (BEAM-1047) DataflowRunner: support regionalization.

2017-03-24 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-1047. - Resolution: Fixed Fix Version/s: First stable release > DataflowRunner: support regionalizat

[jira] [Commented] (BEAM-1751) Singleton ByteKeyRange with BigtableIO and Dataflow runner

2017-03-24 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15941167#comment-15941167 ] Daniel Halperin commented on BEAM-1751: --- Oof. Good catch, thanks! > Singleton ByteKe

[jira] [Closed] (BEAM-1751) Singleton ByteKeyRange with BigtableIO and Dataflow runner

2017-03-24 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-1751. - Resolution: Fixed Fix Version/s: First stable release > Singleton ByteKeyRange with Bigtable

[jira] [Commented] (BEAM-1822) Improve handling of eventually-consistent filepatterns

2017-03-28 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15946122#comment-15946122 ] Daniel Halperin commented on BEAM-1822: --- I was hoping that [BEAM-60] is the best way

[jira] [Assigned] (BEAM-1822) Improve handling of eventually-consistent filepatterns

2017-03-28 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-1822: - Assignee: (was: Daniel Halperin) > Improve handling of eventually-consistent filepatte

[jira] [Commented] (BEAM-1822) Improve handling of eventually-consistent filepatterns

2017-03-28 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15946125#comment-15946125 ] Daniel Halperin commented on BEAM-1822: --- Also -- just to clarify -- this would be use

[jira] [Commented] (BEAM-1550) HBaseIO tests timeout precommit

2017-03-28 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15946147#comment-15946147 ] Daniel Halperin commented on BEAM-1550: --- Is this still happening? > HBaseIO tests ti

[jira] [Resolved] (BEAM-1303) Improve ToString Class

2017-03-28 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-1303. --- Resolution: Fixed Fix Version/s: Not applicable > Improve ToString Class > -

[jira] [Commented] (BEAM-1303) Improve ToString Class

2017-03-28 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15946149#comment-15946149 ] Daniel Halperin commented on BEAM-1303: --- There has been a whole bunch of work here, I

[jira] [Resolved] (BEAM-230) Remove WindowedValue#valueInEmptyWindows

2017-03-28 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-230. -- Resolution: Fixed > Remove WindowedValue#valueInEmptyWindows > ---

[jira] [Updated] (BEAM-655) Rename @RunnableOnService to something more descriptive

2017-03-28 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-655: - Component/s: website > Rename @RunnableOnService to something more descriptive > ---

[jira] [Commented] (BEAM-655) Rename @RunnableOnService to something more descriptive

2017-03-28 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15946154#comment-15946154 ] Daniel Halperin commented on BEAM-655: -- Resolved in both Java and Python SDKs. However

[jira] [Resolved] (BEAM-451) When producing bundled jars, service files are not concatenated

2017-03-28 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-451. -- Resolution: Fixed Fix Version/s: Not applicable > When producing bundled jars, service file

[jira] [Assigned] (BEAM-1425) Window should comply with PTransform style guide

2017-03-28 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-1425: - Assignee: (was: Davor Bonaci) > Window should comply with PTransform style guide > ---

[jira] [Assigned] (BEAM-709) Migrate CountingSource/CountingInput to use AutoValue to reduce boilerplate

2017-03-28 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-709: Assignee: (was: Davor Bonaci) > Migrate CountingSource/CountingInput to use AutoValue to

[jira] [Assigned] (BEAM-705) Migrate AvroIO/AvroSource to use AutoValue to reduce boilerplate

2017-03-28 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-705: Assignee: (was: Davor Bonaci) > Migrate AvroIO/AvroSource to use AutoValue to reduce boil

[jira] [Assigned] (BEAM-710) Migrate Read/Write to use AutoValue to reduce boilerplate

2017-03-28 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-710: Assignee: (was: Davor Bonaci) > Migrate Read/Write to use AutoValue to reduce boilerplate

[jira] [Assigned] (BEAM-1418) MapElements and FlatMapElements should comply with PTransform style guide

2017-03-28 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-1418: - Assignee: (was: Davor Bonaci) > MapElements and FlatMapElements should comply with PTr

[jira] [Assigned] (BEAM-707) Migrate PubsubIO/PubsubUnboundedSource/PubsubUnboundedSink to use AutoValue to reduce boilerplate

2017-03-28 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-707: Assignee: (was: Davor Bonaci) > Migrate PubsubIO/PubsubUnboundedSource/PubsubUnboundedSin

[jira] [Assigned] (BEAM-706) Migrate TextIO to use AutoValue to reduce boilerplate

2017-03-28 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-706: Assignee: (was: Davor Bonaci) > Migrate TextIO to use AutoValue to reduce boilerplate > -

[jira] [Commented] (BEAM-1826) Allow BigqueryIO to forward errors

2017-03-29 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15947374#comment-15947374 ] Daniel Halperin commented on BEAM-1826: --- This sounds like [BEAM-190] to me -- is that

[jira] [Assigned] (BEAM-190) Dead-letter drop for bad BigQuery records

2017-03-29 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-190: Assignee: Reuven Lax > Dead-letter drop for bad BigQuery records > --

[jira] [Updated] (BEAM-1831) Checking of containment in createdTables may have race condition in StreamingWriteFn

2017-03-29 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1831: -- Component/s: (was: runner-dataflow) sdk-java-gcp > Checking of containment i

[jira] [Updated] (BEAM-1269) BigtableIO should make more efficient use of connections

2017-03-29 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1269: -- Labels: newbie starter (was: ) > BigtableIO should make more efficient use of connections >

[jira] [Resolved] (BEAM-1530) BigQueryIO should support value-dependent windows

2017-03-29 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-1530. --- Resolution: Fixed Fix Version/s: First stable release > BigQueryIO should support value-

[jira] [Resolved] (BEAM-1750) Refactor BigQueryIO.java into multiple files

2017-03-29 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-1750. --- Resolution: Fixed Fix Version/s: Not applicable > Refactor BigQueryIO.java into multiple

[jira] [Assigned] (BEAM-437) Data-dependent BigQueryIO in batch

2017-03-29 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-437: Assignee: Reuven Lax > Data-dependent BigQueryIO in batch > -

[jira] [Assigned] (BEAM-1834) Bigquery Write validation doesn't work well with ValueInSingleWindow

2017-03-29 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-1834: - Assignee: (was: Daniel Halperin) > Bigquery Write validation doesn't work well with Va

[jira] [Commented] (BEAM-1834) Bigquery Write validation doesn't work well with ValueInSingleWindow

2017-03-29 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15948014#comment-15948014 ] Daniel Halperin commented on BEAM-1834: --- It sounds like this a feature request for Bi

[jira] [Comment Edited] (BEAM-1834) Bigquery Write validation doesn't work well with ValueInSingleWindow

2017-03-29 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15948014#comment-15948014 ] Daniel Halperin edited comment on BEAM-1834 at 3/29/17 10:52 PM:

<    1   2   3   4   5   6   7   >