[
https://issues.apache.org/jira/browse/BEAM-7339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16842634#comment-16842634
]
Mark Liu commented on BEAM-7339:
--------------------------------
We can manually run 100Gb with limited workers (like 10?) and see how long does
it take. If finished in a reasonable amount of time, I think the resource
concern is not that important for now since we currently only have 2 wordcount
benchmarks for Python.
> Enable 1Gb input for Python wordcount benchmark
> -----------------------------------------------
>
> Key: BEAM-7339
> URL: https://issues.apache.org/jira/browse/BEAM-7339
> Project: Beam
> Issue Type: Task
> Components: testing
> Reporter: Mark Liu
> Assignee: Mark Liu
> Priority: Major
> Time Spent: 3h 10m
> Remaining Estimate: 0h
>
> Requirement:
> - Use input from: gs://apache-beam-samples/input_small_files/*
> - Use TestDataflowRunner
> - Limit worker number
> - Disable autoscaling
> - Enable both py2 and py3 benchmarks
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
