[jira] [Commented] (HADOOP-14457) create() does not notify metadataStore of parent directories or ensure they're not existing files

2017-07-07 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16078884#comment-16078884 ] Aaron Fabbri commented on HADOOP-14457: --- FYI did some perf tests.. patch and results posted to

[jira] [Commented] (HADOOP-14457) create() does not notify metadataStore of parent directories or ensure they're not existing files

2017-07-07 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16078476#comment-16078476 ] Aaron Fabbri commented on HADOOP-14457: --- I see this was already committed, so I filed HADOOP-14633

[jira] [Commented] (HADOOP-14457) create() does not notify metadataStore of parent directories or ensure they're not existing files

2017-07-07 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16078465#comment-16078465 ] Aaron Fabbri commented on HADOOP-14457: --- Thanks for the patch [~mackrorysd]. This looks really

[jira] [Commented] (HADOOP-14457) create() does not notify metadataStore of parent directories or ensure they're not existing files

2017-07-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16078152#comment-16078152 ] Steve Loughran commented on HADOOP-14457: - LGTM, tested locally too. +1 committed It'll have

[jira] [Commented] (HADOOP-14457) create() does not notify metadataStore of parent directories or ensure they're not existing files

2017-07-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16077503#comment-16077503 ] Hadoop QA commented on HADOOP-14457: | (/) *{color:green} 1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-14457) create() does not notify metadataStore of parent directories or ensure they're not existing files

2017-06-21 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16057360#comment-16057360 ] Steve Loughran commented on HADOOP-14457: - This is becoming an intersting little architectural

[jira] [Commented] (HADOOP-14457) create() does not notify metadataStore of parent directories or ensure they're not existing files

2017-06-20 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056703#comment-16056703 ] Aaron Fabbri commented on HADOOP-14457: --- [~mackrorysd] and I just chatted about this and I think

[jira] [Commented] (HADOOP-14457) create() does not notify metadataStore of parent directories or ensure they're not existing files

2017-06-14 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16049856#comment-16049856 ] Aaron Fabbri commented on HADOOP-14457: --- Good summary [~mackrorysd]. One thing I'll add about my

[jira] [Commented] (HADOOP-14457) create() does not notify metadataStore of parent directories or ensure they're not existing files

2017-06-13 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16048710#comment-16048710 ] Mingliang Liu commented on HADOOP-14457: Nice discussion here! This week I'll be at the

[jira] [Commented] (HADOOP-14457) create() does not notify metadataStore of parent directories or ensure they're not existing files

2017-06-13 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16048376#comment-16048376 ] Sean Mackrory commented on HADOOP-14457: Had lot of back-and-forth about this offline with

[jira] [Commented] (HADOOP-14457) create() does not notify metadataStore of parent directories or ensure they're not existing files

2017-06-12 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16047186#comment-16047186 ] Aaron Fabbri commented on HADOOP-14457: --- Thanks for interesting discussion [~mackrorysd]. {quote}

[jira] [Commented] (HADOOP-14457) create() does not notify metadataStore of parent directories or ensure they're not existing files

2017-06-10 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16045537#comment-16045537 ] Sean Mackrory commented on HADOOP-14457: A capabilities-based approach seems to me to be far

[jira] [Commented] (HADOOP-14457) create() does not notify metadataStore of parent directories or ensure they're not existing files

2017-06-09 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16045212#comment-16045212 ] Aaron Fabbri commented on HADOOP-14457: --- Thank you for updating your patch [~mackrorysd]. The v9

[jira] [Commented] (HADOOP-14457) create() does not notify metadataStore of parent directories or ensure they're not existing files

2017-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044522#comment-16044522 ] Hadoop QA commented on HADOOP-14457: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-14457) create() does not notify metadataStore of parent directories or ensure they're not existing files

2017-06-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044486#comment-16044486 ] Hadoop QA commented on HADOOP-14457: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-14457) create() does not notify metadataStore of parent directories or ensure they're not existing files

2017-06-08 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043693#comment-16043693 ] Aaron Fabbri commented on HADOOP-14457: --- Thank you for being flexible and splitting this up

[jira] [Commented] (HADOOP-14457) create() does not notify metadataStore of parent directories or ensure they're not existing files

2017-06-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043600#comment-16043600 ] Hadoop QA commented on HADOOP-14457: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-14457) create() does not notify metadataStore of parent directories or ensure they're not existing files

2017-06-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042897#comment-16042897 ] Hadoop QA commented on HADOOP-14457: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-14457) create() does not notify metadataStore of parent directories or ensure they're not existing files

2017-06-08 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042845#comment-16042845 ] Sean Mackrory commented on HADOOP-14457: There's a bit of overlap between this and HADOOP-14505,

[jira] [Commented] (HADOOP-14457) create() does not notify metadataStore of parent directories or ensure they're not existing files

2017-06-07 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16041907#comment-16041907 ] Aaron Fabbri commented on HADOOP-14457: --- Ok.. I created the following JIRAs for the items I list

[jira] [Commented] (HADOOP-14457) create() does not notify metadataStore of parent directories or ensure they're not existing files

2017-06-07 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16041728#comment-16041728 ] Sean Mackrory commented on HADOOP-14457: +1 - works for me. I'm stepping out shortly, but can

[jira] [Commented] (HADOOP-14457) create() does not notify metadataStore of parent directories or ensure they're not existing files

2017-06-07 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16041678#comment-16041678 ] Aaron Fabbri commented on HADOOP-14457: --- [~mackrorysd] how do you feel about splitting this patch

[jira] [Commented] (HADOOP-14457) create() does not notify metadataStore of parent directories or ensure they're not existing files

2017-06-07 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16041001#comment-16041001 ] Sean Mackrory commented on HADOOP-14457: So none of these are related to this patch. I wonder if

[jira] [Commented] (HADOOP-14457) create() does not notify metadataStore of parent directories or ensure they're not existing files

2017-06-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16039906#comment-16039906 ] Hadoop QA commented on HADOOP-14457: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-14457) create() does not notify metadataStore of parent directories or ensure they're not existing files

2017-06-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16039478#comment-16039478 ] Hadoop QA commented on HADOOP-14457: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-14457) create() does not notify metadataStore of parent directories or ensure they're not existing files

2017-06-06 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16039332#comment-16039332 ] Sean Mackrory commented on HADOOP-14457: Also, I looked a bit deeper into the failure that is

[jira] [Commented] (HADOOP-14457) create() does not notify metadataStore of parent directories or ensure they're not existing files

2017-06-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16037533#comment-16037533 ] Steve Loughran commented on HADOOP-14457: - Having a check up the tree during a create is going

[jira] [Commented] (HADOOP-14457) create() does not notify metadataStore of parent directories or ensure they're not existing files

2017-06-02 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035396#comment-16035396 ] Aaron Fabbri commented on HADOOP-14457: --- If we end up adding an "ancestor is a directory" check to

[jira] [Commented] (HADOOP-14457) create() does not notify metadataStore of parent directories or ensure they're not existing files

2017-06-02 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035327#comment-16035327 ] Sean Mackrory commented on HADOOP-14457: I filed HADOOP-14484 for the missing test case (and

[jira] [Commented] (HADOOP-14457) create() does not notify metadataStore of parent directories or ensure they're not existing files

2017-06-02 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035313#comment-16035313 ] Aaron Fabbri commented on HADOOP-14457: --- Thanks for the detail here [~ste...@apache.org]. {quote}

[jira] [Commented] (HADOOP-14457) create() does not notify metadataStore of parent directories or ensure they're not existing files

2017-06-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035283#comment-16035283 ] Steve Loughran commented on HADOOP-14457: - Update: looked at {{finishedWrite}} in more detail.

[jira] [Commented] (HADOOP-14457) create() does not notify metadataStore of parent directories or ensure they're not existing files

2017-06-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035262#comment-16035262 ] Steve Loughran commented on HADOOP-14457: - OK, I am effectively seeing this in my committer

[jira] [Commented] (HADOOP-14457) create() does not notify metadataStore of parent directories or ensure they're not existing files

2017-06-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035059#comment-16035059 ] Steve Loughran commented on HADOOP-14457: - you know we do something in BlockOutputStream when

[jira] [Commented] (HADOOP-14457) create() does not notify metadataStore of parent directories or ensure they're not existing files

2017-06-01 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033381#comment-16033381 ] Sean Mackrory commented on HADOOP-14457: Do also not the bounds-checking I added to

[jira] [Commented] (HADOOP-14457) create() does not notify metadataStore of parent directories or ensure they're not existing files

2017-05-31 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16031152#comment-16031152 ] Steve Loughran commented on HADOOP-14457: - -1 as is Reviewing the patch, it does fix

[jira] [Commented] (HADOOP-14457) create() does not notify metadataStore of parent directories or ensure they're not existing files

2017-05-31 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16031127#comment-16031127 ] Steve Loughran commented on HADOOP-14457: - the fact you can create {{/a/b.txt/c/d.txt}} in a

[jira] [Commented] (HADOOP-14457) create() does not notify metadataStore of parent directories or ensure they're not existing files

2017-05-26 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16026915#comment-16026915 ] Aaron Fabbri commented on HADOOP-14457: --- {quote} My first concern there is handling for cases

[jira] [Commented] (HADOOP-14457) create() does not notify metadataStore of parent directories or ensure they're not existing files

2017-05-26 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16026754#comment-16026754 ] Sean Mackrory commented on HADOOP-14457: Renamed the JIRA, since the actual oversight was very