[jira] [Resolved] (BEAM-717) Change KafkaIO API to be consistent with style guide

2017-02-01 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-717. -- Resolution: Fixed Fix Version/s: 0.6.0 > Change KafkaIO API to be consistent with style

[jira] [Closed] (BEAM-1378) Late data dropping was removed from Flink Runner

2017-02-02 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-1378. - > Late data dropping was removed from Flink Runner >

[jira] [Resolved] (BEAM-1378) Late data dropping was removed from Flink Runner

2017-02-02 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-1378. --- Resolution: Fixed Fix Version/s: (was: 0.5.0) Not applicable >

[jira] [Created] (BEAM-1382) Test that standard coders encode the same across SDKs

2017-02-02 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-1382: - Summary: Test that standard coders encode the same across SDKs Key: BEAM-1382 URL: https://issues.apache.org/jira/browse/BEAM-1382 Project: Beam Issue

[jira] [Resolved] (BEAM-278) Add I/O section

2017-02-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-278. -- Resolution: Fixed Fix Version/s: Not applicable > Add I/O section > --- > >

[jira] [Closed] (BEAM-278) Add I/O section

2017-02-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-278. > Add I/O section > --- > > Key: BEAM-278 > URL:

[jira] [Resolved] (BEAM-1350) BigQueryIO does not honor SQL dialect or result flattening in DirectRunner

2017-01-31 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-1350. --- Resolution: Fixed Fix Version/s: 0.6.0 > BigQueryIO does not honor SQL dialect or

[jira] [Commented] (BEAM-1367) Need a way to force a page to be set to a specific language for code blocks

2017-01-31 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15847884#comment-15847884 ] Daniel Halperin commented on BEAM-1367: --- Hey [~mabdullah353], do you have any thoughts here? > Need

[jira] (BEAM-1360) Reference to the obsolete python-sdk branch in the documentation.

2017-01-31 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-1360. --- Resolution: Fixed Fix Version/s: Not applicable > Reference to the obsolete python-sdk

[jira] (BEAM-1360) Reference to the obsolete python-sdk branch in the documentation.

2017-01-31 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-1360: - Assignee: Prabeesh K (was: Davor Bonaci) > Reference to the obsolete python-sdk branch

[jira] [Assigned] (BEAM-1384) JmsIO postcommit failure: testAuthenticationWithBadPassword

2017-02-07 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-1384: - Assignee: Daniel Halperin (was: Jean-Baptiste Onofré) > JmsIO postcommit failure:

[jira] [Updated] (BEAM-1384) JmsIO postcommit failure: testAuthenticationWithBadPassword

2017-02-07 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1384: -- Priority: Major (was: Minor) > JmsIO postcommit failure: testAuthenticationWithBadPassword >

[jira] [Resolved] (BEAM-1434) RunnableOnServices failure due to Jackson YAML ClassNotFound exception

2017-02-08 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-1434. --- Resolution: Fixed Fix Version/s: Not applicable > RunnableOnServices failure due to

[jira] [Updated] (BEAM-1434) RunnableOnServices failure due to Jackson YAML ClassNotFound exception

2017-02-08 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1434: -- Summary: RunnableOnServices failure due to Jackson YAML ClassNotFound exception (was: Apex

[jira] [Resolved] (BEAM-1384) JmsIO postcommit failure: testAuthenticationWithBadPassword

2017-02-07 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-1384. --- Resolution: Fixed Fix Version/s: 0.6.0 Rewrote racy code in start() so that close()

[jira] [Issue Comment Deleted] (BEAM-1413) DoFn javadoc has @literal where it shouldn't

2017-02-07 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1413: -- Comment: was deleted (was: Grepping the website: {code} [12:58:23 dhalperi@dhalperi:0.5.0

[jira] [Commented] (BEAM-1413) DoFn javadoc has @literal where it shouldn't

2017-02-07 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15856781#comment-15856781 ] Daniel Halperin commented on BEAM-1413: --- Grepping the website: {code} [12:58:23

[jira] [Commented] (BEAM-1396) GABWVOBDoFn expects grouped values to be ordered by their timestamp but there is no such guarantee

2017-02-05 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853298#comment-15853298 ] Daniel Halperin commented on BEAM-1396: --- To add a little more flavor: I'm not sure what right thing

[jira] [Updated] (BEAM-440) Create.values() returns a type-unsafe Coder

2017-02-06 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-440: - Labels: backward-incompatible newbie starter (was: newbie starter) > Create.values() returns a

[jira] [Comment Edited] (BEAM-1396) GABWVOBDoFn expects grouped values to be ordered by their timestamp but there is no such guarantee

2017-02-05 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853298#comment-15853298 ] Daniel Halperin edited comment on BEAM-1396 at 2/5/17 5:54 PM: --- To add a

[jira] [Commented] (BEAM-425) Create Elasticsearch IO

2017-02-06 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15854337#comment-15854337 ] Daniel Halperin commented on BEAM-425: -- Hi Reza, Please open a JIRA for ES 5 support, and also we are

[jira] [Updated] (BEAM-298) Make TestPipeline implement the TestRule interface

2017-02-06 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-298: - Issue Type: Improvement (was: Bug) > Make TestPipeline implement the TestRule interface >

[jira] [Commented] (BEAM-1413) DoFn javadoc has @literal where it shouldn't

2017-02-07 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15856782#comment-15856782 ] Daniel Halperin commented on BEAM-1413: --- Grepping the website: {code} [12:58:23

[jira] [Commented] (BEAM-1434) Apex RunnableOnService failure due to Jackson YAML ClassNotFound exception

2017-02-07 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15857552#comment-15857552 ] Daniel Halperin commented on BEAM-1434: --- Hypothesis: it's actually going to end up being all ROS

[jira] [Resolved] (BEAM-1387) DatastoreIO: use batch-datastore.googleapis.com as the endpoint

2017-02-05 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-1387. --- Resolution: Fixed Fix Version/s: 0.6.0 > DatastoreIO: use

[jira] [Updated] (BEAM-1223) Replace public constructors with static factory methods for Sum.[*]Fn classes

2017-02-05 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1223: -- Summary: Replace public constructors with static factory methods for Sum.[*]Fn classes (was:

[jira] [Commented] (BEAM-1223) Replace public constructors with static factory methods for Sum.[*]Fn classes

2017-02-05 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853621#comment-15853621 ] Daniel Halperin commented on BEAM-1223: --- Hey [~staslev], I just found in testing the 0.5.0 that this

[jira] [Commented] (BEAM-1223) Replace public constructors with static factory methods for Sum.[*]Fn classes

2017-02-06 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853669#comment-15853669 ] Daniel Halperin commented on BEAM-1223: --- Somewhat old thread:

[jira] [Commented] (BEAM-1396) GABWVOBDoFn expects grouped values to be ordered by their timestamp but there is no such guarantee

2017-02-05 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853587#comment-15853587 ] Daniel Halperin commented on BEAM-1396: --- :+1: > GABWVOBDoFn expects grouped values to be ordered by

[jira] [Resolved] (BEAM-1127) JmsIO should create an unique source in case of topic

2017-02-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-1127. --- Resolution: Fixed Fix Version/s: 0.6.0 > JmsIO should create an unique source in case

[jira] [Commented] (BEAM-1092) Shade commonly used libraries (e.g. Guava) to avoid class conflicts

2017-02-01 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15848754#comment-15848754 ] Daniel Halperin commented on BEAM-1092: --- [~aviemzur] I strongly agree that we should move to

[jira] [Commented] (BEAM-1325) DataflowRunner support for Class-Path jars

2017-01-26 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15839827#comment-15839827 ] Daniel Halperin commented on BEAM-1325: --- This SO post:

[jira] [Updated] (BEAM-1325) DataflowRunner support for Class-Path jars

2017-01-26 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1325: -- Description: See https://github.com/GoogleCloudPlatform/DataflowJavaSDK/issues/538 The code

[jira] [Commented] (BEAM-947) WindowedWordCountIT fails due to not setting "--output" pipeline options

2017-01-26 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15839847#comment-15839847 ] Daniel Halperin commented on BEAM-947: -- (ignore the above PR -- I tagged the wrong issue). Should be

[jira] [Created] (BEAM-1325) DataflowRunner support for Class-Path jars

2017-01-26 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-1325: - Summary: DataflowRunner support for Class-Path jars Key: BEAM-1325 URL: https://issues.apache.org/jira/browse/BEAM-1325 Project: Beam Issue Type: New

[jira] [Commented] (BEAM-1316) DoFn#startBundle and #finishBundle should not be able to output

2017-01-26 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15840014#comment-15840014 ] Daniel Halperin commented on BEAM-1316: --- What if my output includes a list of filenames paired with

[jira] [Resolved] (BEAM-974) Adds attributes support to PubsubIO

2017-01-26 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-974. -- Resolution: Fixed Fix Version/s: 0.5.0 > Adds attributes support to PubsubIO >

[jira] [Commented] (BEAM-1315) FileBasedSink could write tmp files above the output prefix.

2017-01-26 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15840885#comment-15840885 ] Daniel Halperin commented on BEAM-1315: --- I don't think this needs to be a blocker for the release, so

[jira] [Resolved] (BEAM-1235) BigQueryIO doesn't show the load job error to the user

2017-01-26 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-1235. --- Resolution: Fixed > BigQueryIO doesn't show the load job error to the user >

[jira] [Updated] (BEAM-1315) FileBasedSink could write tmp files above the output prefix.

2017-01-26 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1315: -- Fix Version/s: (was: 0.5.0) > FileBasedSink could write tmp files above the output prefix. >

[jira] (BEAM-843) Use New DoFn Directly in Flink Runner

2017-01-30 Thread Daniel Halperin (JIRA)
Title: Message Title Daniel Halperin updated an issue

[jira] (BEAM-843) Use New DoFn Directly in Flink Runner

2017-01-30 Thread Daniel Halperin (JIRA)
Title: Message Title Daniel Halperin commented on BEAM-843

[jira] (BEAM-843) Use New DoFn Directly in Flink Runner

2017-01-30 Thread Daniel Halperin (JIRA)
Title: Message Title Daniel Halperin reopened an issue

[jira] (BEAM-1350) BigQueryIO does not honor SQL dialect or result flattening in DirectRunner

2017-01-30 Thread Daniel Halperin (JIRA)
Title: Message Title Daniel Halperin created an issue

[jira] (BEAM-1357) Beam java7 compilation broken

2017-01-30 Thread Daniel Halperin (JIRA)
Title: Message Title Daniel Halperin created an issue

[jira] (BEAM-1357) Beam java7 compilation broken

2017-01-30 Thread Daniel Halperin (JIRA)
Title: Message Title Daniel Halperin resolved as Fixed

[jira] (BEAM-1358) Enforce that transitive dependencies do not require > jdk7

2017-01-30 Thread Daniel Halperin (JIRA)
Title: Message Title Daniel Halperin created an issue

[jira] (BEAM-1358) Enforce that transitive dependencies do not require > jdk7

2017-01-30 Thread Daniel Halperin (JIRA)
Title: Message Title Daniel Halperin resolved as Fixed

[jira] (BEAM-1343) HDFSFileSource size estimate is incorrect

2017-01-30 Thread Daniel Halperin (JIRA)
Title: Message Title Daniel Halperin resolved as Fixed

[jira] (BEAM-1343) HDFSFileSource size estimate is incorrect

2017-01-30 Thread Daniel Halperin (JIRA)
Title: Message Title Daniel Halperin assigned an issue to Igor Bernstein

[jira] (BEAM-1351) Upgrade AutoValue 1.1->1.3

2017-01-30 Thread Daniel Halperin (JIRA)
Title: Message Title Daniel Halperin resolved as Fixed

[jira] (BEAM-1343) HDFSFileSource size estimate is incorrect

2017-01-30 Thread Daniel Halperin (JIRA)
Title: Message Title Daniel Halperin assigned an issue to Daniel Halperin

[jira] [Commented] (BEAM-1309) FileIOChannelFactory.match() traverses entire parent directory recursively

2017-01-27 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15843667#comment-15843667 ] Daniel Halperin commented on BEAM-1309: --- Match seems to do a full traversal regardless of whether the

[jira] [Created] (BEAM-1312) Move DataflowRunner properties to pom.xml

2017-01-25 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-1312: - Summary: Move DataflowRunner properties to pom.xml Key: BEAM-1312 URL: https://issues.apache.org/jira/browse/BEAM-1312 Project: Beam Issue Type:

[jira] [Commented] (BEAM-1316) DoFn#startBundle and #finishBundle should not be able to output

2017-01-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15838870#comment-15838870 ] Daniel Halperin commented on BEAM-1316: --- I think one many need to output in finish bundle using the

[jira] [Updated] (BEAM-1315) FileBasedSink could write tmp files above the output prefix.

2017-01-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1315: -- Priority: Major (was: Blocker) > FileBasedSink could write tmp files above the output prefix. >

[jira] [Commented] (BEAM-1315) FileBasedSink could write tmp files above the output prefix.

2017-01-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15838936#comment-15838936 ] Daniel Halperin commented on BEAM-1315: --- Sounds like I was wrong about the above issues. Downgraded

[jira] [Updated] (BEAM-1315) FileBasedSink could write tmp files above the output prefix.

2017-01-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1315: -- Priority: Critical (was: Minor) > FileBasedSink could write tmp files above the output prefix.

[jira] [Updated] (BEAM-1315) FileBasedSink could write tmp files above the output prefix.

2017-01-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1315: -- Priority: Blocker (was: Critical) > FileBasedSink could write tmp files above the output

[jira] [Commented] (BEAM-1315) FileBasedSink could write tmp files above the output prefix.

2017-01-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15838874#comment-15838874 ] Daniel Halperin commented on BEAM-1315: --- This means that in fact temp file cleanup will cause data

[jira] [Created] (BEAM-1317) Strategy around snippet versioning

2017-01-25 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-1317: - Summary: Strategy around snippet versioning Key: BEAM-1317 URL: https://issues.apache.org/jira/browse/BEAM-1317 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-1292) PubSubIO: throws error when configured with topic

2017-01-20 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-1292: - Summary: PubSubIO: throws error when configured with topic Key: BEAM-1292 URL: https://issues.apache.org/jira/browse/BEAM-1292 Project: Beam Issue Type:

[jira] [Resolved] (BEAM-1312) Move DataflowRunner properties to pom.xml

2017-01-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-1312. --- Resolution: Fixed Fix Version/s: (was: 0.5.0) Not applicable >

[jira] [Resolved] (BEAM-814) Improve performance when staging files

2017-01-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-814. -- Resolution: Fixed Fix Version/s: 0.5.0 > Improve performance when staging files >

[jira] [Closed] (BEAM-1307) DataflowRunner tests failing with a test using an unbounded source

2017-01-24 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-1307. - Resolution: Fixed Fix Version/s: (was: 0.5.0) Not applicable >

[jira] [Commented] (BEAM-325) Add Slack details to website

2017-01-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15838616#comment-15838616 ] Daniel Halperin commented on BEAM-325: -- JB, would you mind adding Slack details to website? > Add

[jira] [Updated] (BEAM-325) Add Slack details to website

2017-01-25 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-325: - Assignee: Jean-Baptiste Onofré (was: James Malone) > Add Slack details to website >

[jira] [Assigned] (BEAM-1522) Add support for PaneInfo in Python SDK

2017-02-21 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-1522: - Assignee: Ahmet Altay (was: Vikas Kedigehalli) > Add support for PaneInfo in Python SDK

[jira] [Assigned] (BEAM-1415) PubsubIO should comply with PTransfrom style guide

2017-02-21 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-1415: - Assignee: (was: Daniel Halperin) > PubsubIO should comply with PTransfrom style guide

[jira] [Assigned] (BEAM-1061) PreCommit test with side inputs

2017-02-21 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-1061: - Assignee: (was: Daniel Halperin) > PreCommit test with side inputs >

[jira] [Assigned] (BEAM-1467) Use well-known coder types for known window coders

2017-02-21 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-1467: - Assignee: Vikas Kedigehalli (was: Daniel Halperin) > Use well-known coder types for

[jira] [Assigned] (BEAM-1521) Pass element (and/or generic context) for choosing a table in BigQueryIO

2017-02-21 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-1521: - Assignee: (was: Daniel Halperin) > Pass element (and/or generic context) for choosing

[jira] [Assigned] (BEAM-1427) BigQueryIO should comply with PTransform style guide

2017-02-21 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-1427: - Assignee: (was: Daniel Halperin) > BigQueryIO should comply with PTransform style

[jira] [Resolved] (BEAM-450) Modules are shaded to the same path

2017-02-21 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-450. -- Resolution: Fixed Fix Version/s: Not applicable > Modules are shaded to the same path >

[jira] [Assigned] (BEAM-812) Shade guava in beam-sdks-java-io-google-cloud-platform

2017-02-21 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-812: Assignee: (was: Daniel Halperin) > Shade guava in

[jira] [Resolved] (BEAM-1211) Improve Coder efficiency in outer context for StandardCoder

2017-02-21 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-1211. --- Resolution: Fixed Fix Version/s: 0.5.0 > Improve Coder efficiency in outer context for

[jira] [Assigned] (BEAM-1391) Provide nonce via Context to Sources

2017-02-21 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-1391: - Assignee: Sam McVeety (was: Daniel Halperin) > Provide nonce via Context to Sources >

[jira] [Assigned] (BEAM-684) De-Dataflow Beam

2017-02-21 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-684: Assignee: (was: Daniel Halperin) > De-Dataflow Beam > > >

[jira] [Updated] (BEAM-1497) Refactor Hadoop/HDFS IO

2017-02-16 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1497: -- Labels: backward-incompatible (was: ) > Refactor Hadoop/HDFS IO > --- > >

[jira] [Commented] (BEAM-1399) Code coverage numbers are not accurate

2017-02-16 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15871282#comment-15871282 ] Daniel Halperin commented on BEAM-1399: --- Wow, you did a whole bunch of good research here,

[jira] [Updated] (BEAM-1205) Auto set "enableAbandonedNodeEnforcement" in TestPipeline

2017-02-22 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1205: -- Labels: backward-incompatible (was: ) > Auto set "enableAbandonedNodeEnforcement" in

[jira] [Resolved] (BEAM-1231) Use well known coder types in Java for WindowedValue, GlobalWindow, and LengthPrefix

2017-02-11 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-1231. --- Resolution: Fixed Fix Version/s: Not applicable > Use well known coder types in Java

[jira] [Assigned] (BEAM-718) Migrate KinesisIO to use AutoValue to reduce boilerplate

2017-02-11 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-718: Assignee: (was: James Malone) > Migrate KinesisIO to use AutoValue to reduce boilerplate

[jira] [Created] (BEAM-1467) Use well-known coder types for known window coders

2017-02-11 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-1467: - Summary: Use well-known coder types for known window coders Key: BEAM-1467 URL: https://issues.apache.org/jira/browse/BEAM-1467 Project: Beam Issue Type:

[jira] [Updated] (BEAM-1507) java DataflowRunner should warn if the stagingLocation has a TTL

2017-02-17 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1507: -- Component/s: (was: sdk-py) runner-dataflow > java DataflowRunner should

[jira] [Created] (BEAM-1507) java DataflowRunner should warn if the stagingLocation has a TTL

2017-02-17 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-1507: - Summary: java DataflowRunner should warn if the stagingLocation has a TTL Key: BEAM-1507 URL: https://issues.apache.org/jira/browse/BEAM-1507 Project: Beam

[jira] [Created] (BEAM-1277) BeamTestOptions created in src/main instead of src/test

2017-01-17 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-1277: - Summary: BeamTestOptions created in src/main instead of src/test Key: BEAM-1277 URL: https://issues.apache.org/jira/browse/BEAM-1277 Project: Beam Issue

[jira] [Closed] (BEAM-1277) BigtableTestOptions created in src/main instead of src/test

2017-01-17 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-1277. - Resolution: Fixed > BigtableTestOptions created in src/main instead of src/test >

[jira] [Updated] (BEAM-1277) BigtableTestOptions created in src/main instead of src/test

2017-01-17 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1277: -- Summary: BigtableTestOptions created in src/main instead of src/test (was: BeamTestOptions

[jira] [Updated] (BEAM-1225) Add a ToString transform in Java SDK

2017-01-18 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1225: -- Fix Version/s: 0.5.0 > Add a ToString transform in Java SDK >

[jira] [Created] (BEAM-1284) Make KvSwapTest catch coder errors

2017-01-19 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-1284: - Summary: Make KvSwapTest catch coder errors Key: BEAM-1284 URL: https://issues.apache.org/jira/browse/BEAM-1284 Project: Beam Issue Type: Test

[jira] [Resolved] (BEAM-1284) Make KvSwapTest catch coder errors

2017-01-19 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-1284. --- Resolution: Fixed Fix Version/s: Not applicable > Make KvSwapTest catch coder errors >

[jira] [Created] (BEAM-1288) `mvn verify` leaves .pyc files throughout source tree

2017-01-20 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-1288: - Summary: `mvn verify` leaves .pyc files throughout source tree Key: BEAM-1288 URL: https://issues.apache.org/jira/browse/BEAM-1288 Project: Beam Issue

[jira] [Commented] (BEAM-1100) Consider removing pylint from mvn verify

2017-01-20 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15831361#comment-15831361 ] Daniel Halperin commented on BEAM-1100: --- Just ran into this issue now. To be included in a Beam

[jira] [Created] (BEAM-1586) DataflowRunner mixes up cached and uploaded staged file counters

2017-03-01 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-1586: - Summary: DataflowRunner mixes up cached and uploaded staged file counters Key: BEAM-1586 URL: https://issues.apache.org/jira/browse/BEAM-1586 Project: Beam

[jira] [Updated] (BEAM-1586) DataflowRunner mixes up cached and uploaded staged file counters

2017-03-01 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1586: -- Affects Version/s: 0.5.0 > DataflowRunner mixes up cached and uploaded staged file counters >

[jira] [Updated] (BEAM-1411) Unable to downgrade to lower guava version after upgrade to beam-0.5

2017-03-01 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1411: -- Fix Version/s: First stable release > Unable to downgrade to lower guava version after upgrade

[jira] [Updated] (BEAM-1590) DataflowRunner support for Fn API

2017-03-02 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1590: -- Component/s: beam-model-fn-api > DataflowRunner support for Fn API >

[jira] [Created] (BEAM-1590) DataflowRunner support for Fn API

2017-03-02 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-1590: - Summary: DataflowRunner support for Fn API Key: BEAM-1590 URL: https://issues.apache.org/jira/browse/BEAM-1590 Project: Beam Issue Type: Improvement

[jira] [Commented] (BEAM-1567) hashStream should be closed in PackageUtil#createPackageAttributes()

2017-02-27 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886456#comment-15886456 ] Daniel Halperin commented on BEAM-1567: --- Thanks [~te...@apache.org], This indeed looks like it could

  1   2   3   4   5   6   7   >