[jira] [Updated] (HADOOP-16586) ITestS3GuardFsck, others fails when run using a local metastore
[ https://issues.apache.org/jira/browse/HADOOP-16586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-16586: Affects Version/s: 3.4.0 > ITestS3GuardFsck, others fails when run using a local metastore > --- > > Key: HADOOP-16586 > URL: https://issues.apache.org/jira/browse/HADOOP-16586 > Project: Hadoop Common > Issue Type: Bug > Components: fs/s3 >Affects Versions: 3.4.0 >Reporter: Siddharth Seth >Assignee: Masatake Iwasaki >Priority: Major > Fix For: 3.4.0 > > > Most of these tests fail if running against a local metastore with a > ClassCastException. > Not sure if these tests are intended to work with dynamo only. The fix > (either ignore in case of other metastores or fix the test) would depend on > the original intent. > {code} > --- > Test set: org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck > --- > Tests run: 12, Failures: 0, Errors: 11, Skipped: 1, Time elapsed: 34.653 s > <<< FAILURE! - in org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck > testIDetectParentTombstoned(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) > Time elapsed: 3.237 s <<< ERROR! > java.lang.ClassCastException: > org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to > org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore > at > org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIDetectParentTombstoned(ITestS3GuardFsck.java:190) > testIDetectDirInS3FileInMs(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) > Time elapsed: 1.827 s <<< ERROR! > java.lang.ClassCastException: > org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to > org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore > at > org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIDetectDirInS3FileInMs(ITestS3GuardFsck.java:214) > testIDetectLengthMismatch(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) > Time elapsed: 2.819 s <<< ERROR! > java.lang.ClassCastException: > org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to > org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore > at > org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIDetectLengthMismatch(ITestS3GuardFsck.java:311) > testIEtagMismatch(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) Time > elapsed: 2.832 s <<< ERROR! > java.lang.ClassCastException: > org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to > org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore > at > org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIEtagMismatch(ITestS3GuardFsck.java:373) > testIDetectFileInS3DirInMs(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) > Time elapsed: 2.752 s <<< ERROR! > java.lang.ClassCastException: > org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to > org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore > at > org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIDetectFileInS3DirInMs(ITestS3GuardFsck.java:238) > testIDetectModTimeMismatch(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) > Time elapsed: 4.103 s <<< ERROR! > java.lang.ClassCastException: > org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to > org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore > at > org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIDetectModTimeMismatch(ITestS3GuardFsck.java:346) > testIDetectNoMetadataEntry(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) > Time elapsed: 3.017 s <<< ERROR! > java.lang.ClassCastException: > org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to > org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore > at > org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIDetectNoMetadataEntry(ITestS3GuardFsck.java:113) > testIDetectNoParentEntry(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) > Time elapsed: 2.821 s <<< ERROR! > java.lang.ClassCastException: > org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to > org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore > at > org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIDetectNoParentEntry(ITestS3GuardFsck.java:136) > testINoEtag(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) Time elapsed: > 4.493 s <<< ERROR! > java.lang.ClassCastException: > org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to > org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore > at > org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testINoEtag(ITestS3GuardFsck.java:403) > testIDetectParentIsAFile(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) > Time elapsed: 2.782 s <<<
[jira] [Updated] (HADOOP-16586) ITestS3GuardFsck, others fails when run using a local metastore
[ https://issues.apache.org/jira/browse/HADOOP-16586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HADOOP-16586: -- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved (was: Patch Available) > ITestS3GuardFsck, others fails when run using a local metastore > --- > > Key: HADOOP-16586 > URL: https://issues.apache.org/jira/browse/HADOOP-16586 > Project: Hadoop Common > Issue Type: Bug > Components: fs/s3 >Reporter: Siddharth Seth >Assignee: Masatake Iwasaki >Priority: Major > Fix For: 3.4.0 > > > Most of these tests fail if running against a local metastore with a > ClassCastException. > Not sure if these tests are intended to work with dynamo only. The fix > (either ignore in case of other metastores or fix the test) would depend on > the original intent. > {code} > --- > Test set: org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck > --- > Tests run: 12, Failures: 0, Errors: 11, Skipped: 1, Time elapsed: 34.653 s > <<< FAILURE! - in org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck > testIDetectParentTombstoned(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) > Time elapsed: 3.237 s <<< ERROR! > java.lang.ClassCastException: > org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to > org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore > at > org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIDetectParentTombstoned(ITestS3GuardFsck.java:190) > testIDetectDirInS3FileInMs(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) > Time elapsed: 1.827 s <<< ERROR! > java.lang.ClassCastException: > org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to > org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore > at > org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIDetectDirInS3FileInMs(ITestS3GuardFsck.java:214) > testIDetectLengthMismatch(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) > Time elapsed: 2.819 s <<< ERROR! > java.lang.ClassCastException: > org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to > org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore > at > org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIDetectLengthMismatch(ITestS3GuardFsck.java:311) > testIEtagMismatch(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) Time > elapsed: 2.832 s <<< ERROR! > java.lang.ClassCastException: > org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to > org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore > at > org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIEtagMismatch(ITestS3GuardFsck.java:373) > testIDetectFileInS3DirInMs(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) > Time elapsed: 2.752 s <<< ERROR! > java.lang.ClassCastException: > org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to > org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore > at > org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIDetectFileInS3DirInMs(ITestS3GuardFsck.java:238) > testIDetectModTimeMismatch(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) > Time elapsed: 4.103 s <<< ERROR! > java.lang.ClassCastException: > org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to > org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore > at > org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIDetectModTimeMismatch(ITestS3GuardFsck.java:346) > testIDetectNoMetadataEntry(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) > Time elapsed: 3.017 s <<< ERROR! > java.lang.ClassCastException: > org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to > org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore > at > org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIDetectNoMetadataEntry(ITestS3GuardFsck.java:113) > testIDetectNoParentEntry(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) > Time elapsed: 2.821 s <<< ERROR! > java.lang.ClassCastException: > org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to > org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore > at > org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIDetectNoParentEntry(ITestS3GuardFsck.java:136) > testINoEtag(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) Time elapsed: > 4.493 s <<< ERROR! > java.lang.ClassCastException: > org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to > org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore > at > org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testINoEtag(ITestS3GuardFsck.java:403) >
[jira] [Updated] (HADOOP-16586) ITestS3GuardFsck, others fails when run using a local metastore
[ https://issues.apache.org/jira/browse/HADOOP-16586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HADOOP-16586: -- Status: Patch Available (was: Open) > ITestS3GuardFsck, others fails when run using a local metastore > --- > > Key: HADOOP-16586 > URL: https://issues.apache.org/jira/browse/HADOOP-16586 > Project: Hadoop Common > Issue Type: Bug > Components: fs/s3 >Reporter: Siddharth Seth >Assignee: Masatake Iwasaki >Priority: Major > > Most of these tests fail if running against a local metastore with a > ClassCastException. > Not sure if these tests are intended to work with dynamo only. The fix > (either ignore in case of other metastores or fix the test) would depend on > the original intent. > {code} > --- > Test set: org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck > --- > Tests run: 12, Failures: 0, Errors: 11, Skipped: 1, Time elapsed: 34.653 s > <<< FAILURE! - in org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck > testIDetectParentTombstoned(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) > Time elapsed: 3.237 s <<< ERROR! > java.lang.ClassCastException: > org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to > org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore > at > org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIDetectParentTombstoned(ITestS3GuardFsck.java:190) > testIDetectDirInS3FileInMs(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) > Time elapsed: 1.827 s <<< ERROR! > java.lang.ClassCastException: > org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to > org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore > at > org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIDetectDirInS3FileInMs(ITestS3GuardFsck.java:214) > testIDetectLengthMismatch(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) > Time elapsed: 2.819 s <<< ERROR! > java.lang.ClassCastException: > org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to > org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore > at > org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIDetectLengthMismatch(ITestS3GuardFsck.java:311) > testIEtagMismatch(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) Time > elapsed: 2.832 s <<< ERROR! > java.lang.ClassCastException: > org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to > org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore > at > org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIEtagMismatch(ITestS3GuardFsck.java:373) > testIDetectFileInS3DirInMs(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) > Time elapsed: 2.752 s <<< ERROR! > java.lang.ClassCastException: > org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to > org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore > at > org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIDetectFileInS3DirInMs(ITestS3GuardFsck.java:238) > testIDetectModTimeMismatch(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) > Time elapsed: 4.103 s <<< ERROR! > java.lang.ClassCastException: > org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to > org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore > at > org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIDetectModTimeMismatch(ITestS3GuardFsck.java:346) > testIDetectNoMetadataEntry(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) > Time elapsed: 3.017 s <<< ERROR! > java.lang.ClassCastException: > org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to > org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore > at > org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIDetectNoMetadataEntry(ITestS3GuardFsck.java:113) > testIDetectNoParentEntry(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) > Time elapsed: 2.821 s <<< ERROR! > java.lang.ClassCastException: > org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to > org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore > at > org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIDetectNoParentEntry(ITestS3GuardFsck.java:136) > testINoEtag(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) Time elapsed: > 4.493 s <<< ERROR! > java.lang.ClassCastException: > org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to > org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore > at > org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testINoEtag(ITestS3GuardFsck.java:403) > testIDetectParentIsAFile(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) > Time elapsed: 2.782 s <<< ERROR! >
[jira] [Updated] (HADOOP-16586) ITestS3GuardFsck, others fails when run using a local metastore
[ https://issues.apache.org/jira/browse/HADOOP-16586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HADOOP-16586: Description: Most of these tests fail if running against a local metastore with a ClassCastException. Not sure if these tests are intended to work with dynamo only. The fix (either ignore in case of other metastores or fix the test) would depend on the original intent. {code} --- Test set: org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck --- Tests run: 12, Failures: 0, Errors: 11, Skipped: 1, Time elapsed: 34.653 s <<< FAILURE! - in org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck testIDetectParentTombstoned(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) Time elapsed: 3.237 s <<< ERROR! java.lang.ClassCastException: org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore at org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIDetectParentTombstoned(ITestS3GuardFsck.java:190) testIDetectDirInS3FileInMs(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) Time elapsed: 1.827 s <<< ERROR! java.lang.ClassCastException: org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore at org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIDetectDirInS3FileInMs(ITestS3GuardFsck.java:214) testIDetectLengthMismatch(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) Time elapsed: 2.819 s <<< ERROR! java.lang.ClassCastException: org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore at org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIDetectLengthMismatch(ITestS3GuardFsck.java:311) testIEtagMismatch(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) Time elapsed: 2.832 s <<< ERROR! java.lang.ClassCastException: org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore at org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIEtagMismatch(ITestS3GuardFsck.java:373) testIDetectFileInS3DirInMs(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) Time elapsed: 2.752 s <<< ERROR! java.lang.ClassCastException: org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore at org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIDetectFileInS3DirInMs(ITestS3GuardFsck.java:238) testIDetectModTimeMismatch(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) Time elapsed: 4.103 s <<< ERROR! java.lang.ClassCastException: org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore at org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIDetectModTimeMismatch(ITestS3GuardFsck.java:346) testIDetectNoMetadataEntry(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) Time elapsed: 3.017 s <<< ERROR! java.lang.ClassCastException: org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore at org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIDetectNoMetadataEntry(ITestS3GuardFsck.java:113) testIDetectNoParentEntry(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) Time elapsed: 2.821 s <<< ERROR! java.lang.ClassCastException: org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore at org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIDetectNoParentEntry(ITestS3GuardFsck.java:136) testINoEtag(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) Time elapsed: 4.493 s <<< ERROR! java.lang.ClassCastException: org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore at org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testINoEtag(ITestS3GuardFsck.java:403) testIDetectParentIsAFile(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) Time elapsed: 2.782 s <<< ERROR! java.lang.ClassCastException: org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore at org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIDetectParentIsAFile(ITestS3GuardFsck.java:163) testTombstonedInMsNotDeletedInS3(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) Time elapsed: 3.008 s <<< ERROR! java.lang.ClassCastException: org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore at
[jira] [Updated] (HADOOP-16586) ITestS3GuardFsck, others fails when run using a local metastore
[ https://issues.apache.org/jira/browse/HADOOP-16586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HADOOP-16586: Description: Most of these tests fail if running against a local metastore with a ClassCastException. Not sure if these tests are intended to work with dynamo only. The fix (either ignore in case of other metastores or fix the test) would depend on the original intent. {code} --- Test set: org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck --- Tests run: 12, Failures: 0, Errors: 11, Skipped: 1, Time elapsed: 34.653 s <<< FAILURE! - in org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck testIDetectParentTombstoned(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) Time elapsed: 3.237 s <<< ERROR! java.lang.ClassCastException: org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore at org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIDetectParentTombstoned(ITestS3GuardFsck.java:190) testIDetectDirInS3FileInMs(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) Time elapsed: 1.827 s <<< ERROR! java.lang.ClassCastException: org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore at org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIDetectDirInS3FileInMs(ITestS3GuardFsck.java:214) testIDetectLengthMismatch(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) Time elapsed: 2.819 s <<< ERROR! java.lang.ClassCastException: org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore at org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIDetectLengthMismatch(ITestS3GuardFsck.java:311) testIEtagMismatch(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) Time elapsed: 2.832 s <<< ERROR! java.lang.ClassCastException: org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore at org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIEtagMismatch(ITestS3GuardFsck.java:373) testIDetectFileInS3DirInMs(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) Time elapsed: 2.752 s <<< ERROR! java.lang.ClassCastException: org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore at org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIDetectFileInS3DirInMs(ITestS3GuardFsck.java:238) testIDetectModTimeMismatch(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) Time elapsed: 4.103 s <<< ERROR! java.lang.ClassCastException: org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore at org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIDetectModTimeMismatch(ITestS3GuardFsck.java:346) testIDetectNoMetadataEntry(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) Time elapsed: 3.017 s <<< ERROR! java.lang.ClassCastException: org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore at org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIDetectNoMetadataEntry(ITestS3GuardFsck.java:113) testIDetectNoParentEntry(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) Time elapsed: 2.821 s <<< ERROR! java.lang.ClassCastException: org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore at org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIDetectNoParentEntry(ITestS3GuardFsck.java:136) testINoEtag(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) Time elapsed: 4.493 s <<< ERROR! java.lang.ClassCastException: org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore at org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testINoEtag(ITestS3GuardFsck.java:403) testIDetectParentIsAFile(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) Time elapsed: 2.782 s <<< ERROR! java.lang.ClassCastException: org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore at org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIDetectParentIsAFile(ITestS3GuardFsck.java:163) testTombstonedInMsNotDeletedInS3(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) Time elapsed: 3.008 s <<< ERROR! java.lang.ClassCastException: org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore at
[jira] [Updated] (HADOOP-16586) ITestS3GuardFsck, others fails when run using a local metastore
[ https://issues.apache.org/jira/browse/HADOOP-16586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HADOOP-16586: Summary: ITestS3GuardFsck, others fails when run using a local metastore (was: ITestS3GuardFsck, others fails when nun using a local metastore) > ITestS3GuardFsck, others fails when run using a local metastore > --- > > Key: HADOOP-16586 > URL: https://issues.apache.org/jira/browse/HADOOP-16586 > Project: Hadoop Common > Issue Type: Bug > Components: fs/s3 >Reporter: Siddharth Seth >Priority: Major > > Most of these tests fail if running against a local metastore with a > ClassCastException. > Not sure if these tests are intended to work with dynamo only. The fix > (either ignore in case of other metastores or fix the test) would depend on > the original intent. > {code} > --- > Test set: org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck > --- > Tests run: 12, Failures: 0, Errors: 11, Skipped: 1, Time elapsed: 34.653 s > <<< FAILURE! - in org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck > testIDetectParentTombstoned(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) > Time elapsed: 3.237 s <<< ERROR! > java.lang.ClassCastException: > org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to > org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore > at > org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIDetectParentTombstoned(ITestS3GuardFsck.java:190) > testIDetectDirInS3FileInMs(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) > Time elapsed: 1.827 s <<< ERROR! > java.lang.ClassCastException: > org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to > org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore > at > org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIDetectDirInS3FileInMs(ITestS3GuardFsck.java:214) > testIDetectLengthMismatch(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) > Time elapsed: 2.819 s <<< ERROR! > java.lang.ClassCastException: > org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to > org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore > at > org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIDetectLengthMismatch(ITestS3GuardFsck.java:311) > testIEtagMismatch(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) Time > elapsed: 2.832 s <<< ERROR! > java.lang.ClassCastException: > org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to > org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore > at > org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIEtagMismatch(ITestS3GuardFsck.java:373) > testIDetectFileInS3DirInMs(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) > Time elapsed: 2.752 s <<< ERROR! > java.lang.ClassCastException: > org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to > org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore > at > org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIDetectFileInS3DirInMs(ITestS3GuardFsck.java:238) > testIDetectModTimeMismatch(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) > Time elapsed: 4.103 s <<< ERROR! > java.lang.ClassCastException: > org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to > org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore > at > org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIDetectModTimeMismatch(ITestS3GuardFsck.java:346) > testIDetectNoMetadataEntry(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) > Time elapsed: 3.017 s <<< ERROR! > java.lang.ClassCastException: > org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to > org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore > at > org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIDetectNoMetadataEntry(ITestS3GuardFsck.java:113) > testIDetectNoParentEntry(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) > Time elapsed: 2.821 s <<< ERROR! > java.lang.ClassCastException: > org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to > org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore > at > org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testIDetectNoParentEntry(ITestS3GuardFsck.java:136) > testINoEtag(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck) Time elapsed: > 4.493 s <<< ERROR! > java.lang.ClassCastException: > org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore cannot be cast to > org.apache.hadoop.fs.s3a.s3guard.DynamoDBMetadataStore > at > org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck.testINoEtag(ITestS3GuardFsck.java:403) > testIDetectParentIsAFile(org.apache.hadoop.fs.s3a.s3guard.ITestS3GuardFsck)