[
https://issues.apache.org/jira/browse/BEAM-7339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16841684#comment-16841684
]
Ahmet Altay commented on BEAM-7339:
-----------------------------------
Related to the quota issue, we need to have a solution to this, otherwise we
cannot build large benchmarks which is needed. Either we can increase the
quota, or agree that apache-beam-testing project is not good for benchmarks and
find an alternative solution.
Output verification problem could be simplified IMO. Perhaps we can use gcloud
tool itself to calculate output hashes.
Thanks for summarizing the issues.
> Enable 1Gb input for Python wordcount benchmark
> -----------------------------------------------
>
> Key: BEAM-7339
> URL: https://issues.apache.org/jira/browse/BEAM-7339
> Project: Beam
> Issue Type: Task
> Components: testing
> Reporter: Mark Liu
> Assignee: Mark Liu
> Priority: Major
> Time Spent: 20m
> Remaining Estimate: 0h
>
> Requirement:
> - Use input from: gs://apache-beam-samples/input_small_files/*
> - Use TestDataflowRunner
> - Limit worker number
> - Disable autoscaling
> - Enable both py2 and py3 benchmarks
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
