boyuanzz commented on pull request #14538: URL: https://github.com/apache/beam/pull/14538#issuecomment-820607884
> > It might be out of scope of this PR, but do we consider having the input size as a pipeline options? It will be much easier if we decide to test on an even larger dataset. > > I've though about that, but the way external IT are executed internally nowadays makes it complicated for testing a single test function with different sets of pipeline options (we pass one predefined set of options by looking up the test method name). What's the purpose to have BigTableRead run against a larger data set as well? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
