(hi, I'm back from vacation)
@iemejia @toelen after merging this PR:
https://github.com/apache/beam/pull/6327 it should be possible to run any file
based io test using the following command (this runs the TextIOIT test but you
can change that):
```
./gradlew clean integrationTest -p sdks/java/io/file-based-io-tests/
-DintegrationTestPipelineOptions='["--awsRegion=REGION",
"--numberOfRecords=1000", "--filenamePrefix=s3://bucket/path/prefix",
"--awsCredentialsProvider={\"@type\" : \"AWSStaticCredentialsProvider\",
\"awsAccessKeyId\" : \"XXXXXXXXXXXXXXXXXXXX\", \"awsSecretKey\" :
\"XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"}"]' -DintegrationTestRunner=direct
-Dfilesystem=s3 --tests org.apache.beam.sdk.io.text.TextIOIT
```
Of course, you must provide the appropiate aws region, credentials etc
[ Full content available at: https://github.com/apache/beam/pull/6232 ]
This message was relayed via gitbox.apache.org for [email protected]
