[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-12-12 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15743497#comment-15743497 ] Aaron Fabbri commented on HADOOP-13449: --- Thanks [~steve_l]. Those tests that make assertions

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-12-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15741936#comment-15741936 ] Steve Loughran commented on HADOOP-13449: - I've commented on HADOOP-13886 ; I'm not sure that

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-12-09 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736924#comment-15736924 ] Lei (Eddy) Xu commented on HADOOP-13449: Thanks a lot for the great work here, [~liuml07] and

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-12-09 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736711#comment-15736711 ] Mingliang Liu commented on HADOOP-13449: Yes just edited the comment above. Lei helped us a lot

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-12-09 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736704#comment-15736704 ] Aaron Fabbri commented on HADOOP-13449: --- You are welcome! Thanks also to [~eddyxu] for his help

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-12-09 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736694#comment-15736694 ] Mingliang Liu commented on HADOOP-13449: Thank you [~fabbri] for your great help, discussion,

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-12-09 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736682#comment-15736682 ] Aaron Fabbri commented on HADOOP-13449: --- I committed this to the HADOOP-13345 feature branch.

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-12-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15734222#comment-15734222 ] Hadoop QA commented on HADOOP-13449: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-12-08 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15734138#comment-15734138 ] Aaron Fabbri commented on HADOOP-13449: --- Sounds good. Thanks for analysis on that failure. I will

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-12-08 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15733756#comment-15733756 ] Aaron Fabbri commented on HADOOP-13449: --- I'm in the process of testing the v12 patch. [~liuml07]

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-12-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15727577#comment-15727577 ] Hadoop QA commented on HADOOP-13449: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-12-06 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15727382#comment-15727382 ] Aaron Fabbri commented on HADOOP-13449: --- If it is MetadataStoreTestBase line 154

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-12-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15727385#comment-15727385 ] Mingliang Liu commented on HADOOP-13449: Sorry I marked it as {{@Ignored}} in the patch...

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-12-06 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15727368#comment-15727368 ] Aaron Fabbri commented on HADOOP-13449: --- What line does testPutNew() fail on for you?

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-12-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15727354#comment-15727354 ] Mingliang Liu commented on HADOOP-13449: Thanks for your insightful comments, [~fabbri]. You

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-12-06 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15727226#comment-15727226 ] Aaron Fabbri commented on HADOOP-13449: --- This looks pretty good [~liuml07], thank you. A couple

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-12-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15724940#comment-15724940 ] Hadoop QA commented on HADOOP-13449: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-12-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15717170#comment-15717170 ] Mingliang Liu commented on HADOOP-13449: Yes I did consider putting all the ancestors to the

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-12-02 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15717021#comment-15717021 ] Aaron Fabbri commented on HADOOP-13449: --- I did a little research on #3. It looks like you cannot

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-12-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15716725#comment-15716725 ] Mingliang Liu commented on HADOOP-13449: Thanks [~fabbri]. Quick reply (I'm working on this as

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-12-02 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15716696#comment-15716696 ] Aaron Fabbri commented on HADOOP-13449: --- I think this is the list of outstanding items to get

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-12-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713241#comment-15713241 ] Mingliang Liu commented on HADOOP-13449: Thanks for the tip of disabling s3n integration tests.

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-12-01 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713155#comment-15713155 ] Aaron Fabbri commented on HADOOP-13449: --- That use case for Mock S3 Client + Real DDB client (for

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-12-01 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15711793#comment-15711793 ] Steve Loughran commented on HADOOP-13449: - Some of these tests are failing because dynamo db is

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-11-30 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15710947#comment-15710947 ] Mingliang Liu commented on HADOOP-13449: Sorry for late reply. Thank you [~fabbri] very much for

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-11-30 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15710879#comment-15710879 ] Aaron Fabbri commented on HADOOP-13449: --- FYI so we don't duplicate effort: I'm looking at

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-11-30 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15709115#comment-15709115 ] Aaron Fabbri commented on HADOOP-13449: --- Finished a run of the S3A integration tests. I see that

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-11-29 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15707310#comment-15707310 ] Aaron Fabbri commented on HADOOP-13449: --- This fixes that failed unit test for me: {code} ---

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-11-29 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15707232#comment-15707232 ] Aaron Fabbri commented on HADOOP-13449: --- Congrats on the clean jenkins run [~liuml07]. I'm

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-11-29 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15707088#comment-15707088 ] Mingliang Liu commented on HADOOP-13449: I merged again from the {{trunk}} locally and resolved

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15688831#comment-15688831 ] Hadoop QA commented on HADOOP-13449: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15688595#comment-15688595 ] Hadoop QA commented on HADOOP-13449: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-11-22 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15688223#comment-15688223 ] Aaron Fabbri commented on HADOOP-13449: --- Yes, I believe that is what Steve L was suggesting. Go

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-11-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15688201#comment-15688201 ] Mingliang Liu commented on HADOOP-13449: I guess a {{git checkout HADOOP-13345}} and {{git merge

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-11-22 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15688188#comment-15688188 ] Aaron Fabbri commented on HADOOP-13449: --- Sounds good [~liuml07]. Last time I did a rebase but

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-11-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15688160#comment-15688160 ] Mingliang Liu commented on HADOOP-13449: The patch that bumps the AWS SDK version is committed

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-11-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685462#comment-15685462 ] Hadoop QA commented on HADOOP-13449: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-11-20 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15681442#comment-15681442 ] Steve Loughran commented on HADOOP-13449: - correction; I can't talk monday, other commitments.

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-11-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15679191#comment-15679191 ] Steve Loughran commented on HADOOP-13449: - I can talk morning Palo Alto time from 09:00 to

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-11-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15678636#comment-15678636 ] Hadoop QA commented on HADOOP-13449: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-11-18 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15677910#comment-15677910 ] Aaron Fabbri commented on HADOOP-13449: --- Hey [~liuml07]. I am available early next week to help

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-11-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15677752#comment-15677752 ] Hadoop QA commented on HADOOP-13449: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-11-18 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15677349#comment-15677349 ] Lei (Eddy) Xu commented on HADOOP-13449: +1 for the current patch. LGTM. Thanks [~liuml07] >

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-11-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15675673#comment-15675673 ] Hadoop QA commented on HADOOP-13449: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-11-15 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15669245#comment-15669245 ] Aaron Fabbri commented on HADOOP-13449: --- {quote} I see the difference that we have now. After

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-11-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15669124#comment-15669124 ] Mingliang Liu commented on HADOOP-13449: Thanks for the ideas. Now we're getting close to the

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-11-15 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15669036#comment-15669036 ] Aaron Fabbri commented on HADOOP-13449: --- One more answer.. Sorry for spamming but I have a hard

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-11-15 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15669011#comment-15669011 ] Aaron Fabbri commented on HADOOP-13449: --- Sorry, I was a little hasty to comment without the

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-11-15 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15668965#comment-15668965 ] Aaron Fabbri commented on HADOOP-13449: --- {quote} But for listStatus(), my understanding is that we

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-11-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15668909#comment-15668909 ] Mingliang Liu commented on HADOOP-13449: When we put {{/a/b/file}}, {{/a/b/}} does not need to

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-11-15 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15668739#comment-15668739 ] Aaron Fabbri commented on HADOOP-13449: --- Thanks [~liuml07], sounds good. Can't wait to try this

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-11-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15668686#comment-15668686 ] Mingliang Liu commented on HADOOP-13449: Thanks for your review [~fabbri]. Quick reply (will

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-11-15 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15668591#comment-15668591 ] Aaron Fabbri commented on HADOOP-13449: --- Thanks for your hard work on this [~liuml07]! {code} -

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-11-15 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15668393#comment-15668393 ] Aaron Fabbri commented on HADOOP-13449: --- Hey I've been travelling but I'm back and will try to get

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-11-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15665550#comment-15665550 ] Mingliang Liu commented on HADOOP-13449: We can provision the capacity of an existing table in

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-11-14 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15665532#comment-15665532 ] Lei (Eddy) Xu commented on HADOOP-13449: bq. If we're using an existing table, should we

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-11-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15665511#comment-15665511 ] Mingliang Liu commented on HADOOP-13449: If the user is gonna destroy a non-existent table, that

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-11-14 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15665501#comment-15665501 ] Lei (Eddy) Xu commented on HADOOP-13449: [~liuml07] If you is going to make a new patch. Would

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-11-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15665489#comment-15665489 ] Mingliang Liu commented on HADOOP-13449: Thanks [~eddyxu] for your review and insightful

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-11-14 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15665346#comment-15665346 ] Lei (Eddy) Xu commented on HADOOP-13449: Hi, [~liuml07] The patch LGTM overall. +1. I am OK

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-11-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15658660#comment-15658660 ] Hadoop QA commented on HADOOP-13449: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-11-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15658303#comment-15658303 ] Hadoop QA commented on HADOOP-13449: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-10-31 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15622752#comment-15622752 ] Steve Loughran commented on HADOOP-13449: - regarding create() on a path. S3A isn't strict enough

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-10-31 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15622747#comment-15622747 ] Steve Loughran commented on HADOOP-13449: - I'm just catching up with this, apologies if I say

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-10-30 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15620639#comment-15620639 ] Chris Nauroth commented on HADOOP-13449: bq. Also: that dynamo DB dependency MUST be at {{}}

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-10-29 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15618096#comment-15618096 ] Steve Loughran commented on HADOOP-13449: - I see this patch bumps up the AWS version. Could that

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-10-27 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15613426#comment-15613426 ] Lei (Eddy) Xu commented on HADOOP-13449: Good discussion, [~liuml07] and [~fabbri] bq. The

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-10-27 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15613313#comment-15613313 ] Aaron Fabbri commented on HADOOP-13449: --- Exciting stuff, thanks for update. {quote} I changed the

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-10-27 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15612642#comment-15612642 ] Lei (Eddy) Xu commented on HADOOP-13449: Ping [~liuml07]. Just wondering is there any update on

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-10-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15603396#comment-15603396 ] Mingliang Liu commented on HADOOP-13449: Thanks! I'll review that patch this week. > S3Guard:

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-10-24 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15603380#comment-15603380 ] Aaron Fabbri commented on HADOOP-13449: --- Heads-up I just posted my latest patch to HADOOP-13651.

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-10-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15603231#comment-15603231 ] Mingliang Liu commented on HADOOP-13449: Thansk for the review, [~eddyxu]. Will post new patches

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-10-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15603229#comment-15603229 ] Mingliang Liu commented on HADOOP-13449: {quote} I feel that we should have a consistent

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-10-24 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15603207#comment-15603207 ] Lei (Eddy) Xu commented on HADOOP-13449: Hi, [~liuml07] The patch looks good to me overall.

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-10-24 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15602746#comment-15602746 ] Lei (Eddy) Xu commented on HADOOP-13449: bq. . I'm wondering whether we should also save access

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-10-24 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15602745#comment-15602745 ] Lei (Eddy) Xu commented on HADOOP-13449: bq. . I'm wondering whether we should also save access

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-10-20 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15593462#comment-15593462 ] Aaron Fabbri commented on HADOOP-13449: --- Thanks for feedback [~eddyxu]. Turns out a user can

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-10-20 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15593298#comment-15593298 ] Lei (Eddy) Xu commented on HADOOP-13449: Hi, [~fabbri] One {{S3AFileSystem}} only works for one

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-10-20 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15593268#comment-15593268 ] Aaron Fabbri commented on HADOOP-13449: --- Chatted with a friend about this some and we both are

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-10-20 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15593227#comment-15593227 ] Aaron Fabbri commented on HADOOP-13449: --- I'm curious what you guys are doing about path

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-10-20 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15592718#comment-15592718 ] Lei (Eddy) Xu commented on HADOOP-13449: Ping, [~liuml07], in case that you did not

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-10-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15592543#comment-15592543 ] Mingliang Liu commented on HADOOP-13449: I noticed the work [HADOOP-13650] is blocked. Sorry

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-10-18 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586969#comment-15586969 ] Lei (Eddy) Xu commented on HADOOP-13449: Ping [~liuml07]. Do you have any updates on this? As

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-10-13 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573616#comment-15573616 ] Lei (Eddy) Xu commented on HADOOP-13449: Thanks! For the MS contract test, I am also playing

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-10-13 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573607#comment-15573607 ] Mingliang Liu commented on HADOOP-13449: Thank you [~eddyxu] for your review! I'll address them

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-10-13 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573579#comment-15573579 ] Lei (Eddy) Xu commented on HADOOP-13449: Thanks for posting the patch,[~liuml07]. The concept

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-10-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552730#comment-15552730 ] Mingliang Liu commented on HADOOP-13449: I just came from a short vacation. Will post the patch

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-09-27 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15527444#comment-15527444 ] Lei (Eddy) Xu commented on HADOOP-13449: Great.Thanks a lot! > S3Guard: Implement

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-09-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15527442#comment-15527442 ] Mingliang Liu commented on HADOOP-13449: Will post a WIP patch in one week. > S3Guard:

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-09-27 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15527383#comment-15527383 ] Lei (Eddy) Xu commented on HADOOP-13449: Hi, [~liuml07] Would you mind give some insights

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-09-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15468105#comment-15468105 ] Mingliang Liu commented on HADOOP-13449: Hi [~eddyxu], I expect progress once [HADOOP-13448] is

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-09-06 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15468051#comment-15468051 ] Lei (Eddy) Xu commented on HADOOP-13449: Hi [~liuml07]. Is there any progress here? We'd love

[jira] [Commented] (HADOOP-13449) S3Guard: Implement DynamoDBMetadataStore.

2016-08-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15403079#comment-15403079 ] Mingliang Liu commented on HADOOP-13449: Feel free to assign it to me if your working queue is