[
https://issues.apache.org/jira/browse/HADOOP-17784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17373533#comment-17373533
]
Steve Loughran commented on HADOOP-17784:
-----------------------------------------
thanks for the research. TSV isn't bad, just "Different". It actually renders
nicely in text editors/IDEs, which is why the S3A load tests generate them for
their results.
If we move to TSV the S3 select tests will need to be tweaked. For the seeking
stuff we don't actually care about the contents at all, only that they are
beyond the readahead range.
space separated is "wrong"
The NOAA Integrated Surface Database looks good in terms of content, just need
to see if it works as a decompression format for the s3 select tests
> hadoop-aws landsat-pds test bucket will be deleted after Jul 1, 2021
> --------------------------------------------------------------------
>
> Key: HADOOP-17784
> URL: https://issues.apache.org/jira/browse/HADOOP-17784
> Project: Hadoop Common
> Issue Type: Test
> Components: fs/s3, test
> Reporter: Leona Yoda
> Priority: Major
>
> I found an anouncement that landsat-pds buket will be deleted on July 1, 2021
> (https://registry.opendata.aws/landsat-8/)
> and I think this bucket is used in th test of hadoop-aws module use
> [https://github.com/apache/hadoop/blob/trunk/hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/S3ATestConstants.java#L93]
>
> At this time I can access the bucket but we might have to change the test
> bucket in someday.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
