[
https://issues.apache.org/jira/browse/HDFS-10419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16424559#comment-16424559
]
Sanjay Radia commented on HDFS-10419:
-
While I prefer HDSS, I would gladly let Anu who has done the
[
https://issues.apache.org/jira/browse/HDFS-10419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16420318#comment-16420318
]
Sanjay Radia commented on HDFS-10419:
-
I prefer HDSS : Hadoop Distributed Storage System
sanjay
[
https://issues.apache.org/jira/browse/HDFS-10419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16403116#comment-16403116
]
Sanjay Radia commented on HDFS-10419:
-
In the " [VOTE] Merging branch HDFS-7240 to trunk" thread
[
https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sanjay Radia updated HDFS-7240:
---
Summary: Scaling HDFS (was: Object store in HDFS)
> Scaling HDFS
>
>
>
[
https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sanjay Radia updated HDFS-7240:
---
Description:
[^HDFS Scalability-v2.pdf] describes areas where HDFS does well and its scaling
[
https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sanjay Radia updated HDFS-7240:
---
Description:
[Scaling HDFS| x] describes areas where HDFS does well and its scaling
challenges and
[
https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sanjay Radia updated HDFS-7240:
---
Description:
[^HDFS Scalability-v2.pdf] describes areas where HDFS does well and its scaling
[
https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sanjay Radia updated HDFS-7240:
---
Attachment: HDFS Scalability-v2.pdf
> Object store in HDFS
>
>
>
[
https://issues.apache.org/jira/browse/HDFS-10419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336903#comment-16336903
]
Sanjay Radia commented on HDFS-10419:
-
{quote}As a side note, I didn't understand why you used 50MB
[
https://issues.apache.org/jira/browse/HDFS-12990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16334743#comment-16334743
]
Sanjay Radia commented on HDFS-12990:
-
For this Jira, I can go either way.
In this specific case
[
https://issues.apache.org/jira/browse/HDFS-10419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16302631#comment-16302631
]
Sanjay Radia commented on HDFS-10419:
-
Correct, NN is not part of the consensus with the new
Sanjay Radia created HDFS-12952:
---
Summary: Change OzoneFS's semtics to allow readers to see file
content while being written
Key: HDFS-12952
URL: https://issues.apache.org/jira/browse/HDFS-12952
[
https://issues.apache.org/jira/browse/HDFS-10419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16298728#comment-16298728
]
Sanjay Radia commented on HDFS-10419:
-
The new block-container layer allows partial visibility of a
[
https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297454#comment-16297454
]
Sanjay Radia commented on HDFS-7240:
One of issues raised is that connecting the NN to the new
[
https://issues.apache.org/jira/browse/HDFS-10419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sanjay Radia updated HDFS-10419:
Attachment: Evolving NN using new block-container layer.pdf
I have attached a doc that describes
[
https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sanjay Radia updated HDFS-7240:
---
Attachment: (was: Evolving NN using new block-container layer.pdf)
> Object store in HDFS
>
[
https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sanjay Radia updated HDFS-7240:
---
Comment: was deleted
(was: I have attached a doc that describes how the existing NN can
[
https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sanjay Radia updated HDFS-7240:
---
Attachment: Evolving NN using new block-container layer.pdf
I have attached a doc that describes
[
https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261791#comment-16261791
]
Sanjay Radia commented on HDFS-7240:
Ozone Cloudera Meeting Date: Thursday, November 16th 2017
[
https://issues.apache.org/jira/browse/HDFS-10419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238379#comment-16238379
]
Sanjay Radia commented on HDFS-10419:
-
HDFS-5389 describes one approach of building a NN that scales
[
https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sanjay Radia updated HDFS-7240:
---
Attachment: HDFS Scalability and Ozone.pdf
I have added a document that explains a design for scaling
[
https://issues.apache.org/jira/browse/HDFS-9244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15107238#comment-15107238
]
Sanjay Radia commented on HDFS-9244:
The main motivation for nested EZ is root + subdirs as per
[
https://issues.apache.org/jira/browse/HDFS-8747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15106889#comment-15106889
]
Sanjay Radia edited comment on HDFS-8747 at 1/19/16 7:23 PM:
-
Posted on wrong
[
https://issues.apache.org/jira/browse/HDFS-8747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15106889#comment-15106889
]
Sanjay Radia commented on HDFS-8747:
The main motivation for nested EZ is root + subdirs as per
[
https://issues.apache.org/jira/browse/HDFS-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14702393#comment-14702393
]
Sanjay Radia commented on HDFS-:
There are several motivations for introducing
[
https://issues.apache.org/jira/browse/HDFS-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14702393#comment-14702393
]
Sanjay Radia edited comment on HDFS- at 8/19/15 3:58 AM:
-
[
https://issues.apache.org/jira/browse/HDFS-7923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588681#comment-14588681
]
Sanjay Radia commented on HDFS-7923:
bq. This change is really helpful during startup
[
https://issues.apache.org/jira/browse/HDFS-7923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588931#comment-14588931
]
Sanjay Radia commented on HDFS-7923:
Starvation I didn't literally mean starvation
[
https://issues.apache.org/jira/browse/HDFS-7923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587054#comment-14587054
]
Sanjay Radia commented on HDFS-7923:
How will you ensure that a particular DN does not
[
https://issues.apache.org/jira/browse/HDFS-7923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587163#comment-14587163
]
Sanjay Radia commented on HDFS-7923:
Have you considered a pull model (NN pulls) which
[
https://issues.apache.org/jira/browse/HDFS-8401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564043#comment-14564043
]
Sanjay Radia commented on HDFS-8401:
Consider the following use case: one wants to
[
https://issues.apache.org/jira/browse/HDFS-8241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514487#comment-14514487
]
Sanjay Radia commented on HDFS-8241:
Yes it was unfortunate that this incompatibility
Sanjay Radia created HDFS-8075:
--
Summary: Revist layout version
Key: HDFS-8075
URL: https://issues.apache.org/jira/browse/HDFS-8075
Project: Hadoop HDFS
Issue Type: Bug
Components:
[
https://issues.apache.org/jira/browse/HDFS-8075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sanjay Radia resolved HDFS-8075.
Resolution: Duplicate
Closed: duplicate of HDFS-5223
Revist layout version
-
[
https://issues.apache.org/jira/browse/HDFS-5223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483654#comment-14483654
]
Sanjay Radia commented on HDFS-5223:
For the edits one could require that in order to
[
https://issues.apache.org/jira/browse/HDFS-8075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483602#comment-14483602
]
Sanjay Radia commented on HDFS-8075:
Here is proposal:
* Add a *second* layout version
[
https://issues.apache.org/jira/browse/HDFS-5223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483654#comment-14483654
]
Sanjay Radia edited comment on HDFS-5223 at 4/7/15 6:29 PM:
For
[
https://issues.apache.org/jira/browse/HDFS-5223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sanjay Radia updated HDFS-5223:
---
Description:
Currently all HDFS on-disk formats are version by the single layout version.
This means
[
https://issues.apache.org/jira/browse/HDFS-8075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483606#comment-14483606
]
Sanjay Radia commented on HDFS-8075:
Oops. I will close this as duplicate. I will copy
[
https://issues.apache.org/jira/browse/HDFS-5223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483704#comment-14483704
]
Sanjay Radia commented on HDFS-5223:
The above solution was inspired by Hive's ORC.
[
https://issues.apache.org/jira/browse/HDFS-6200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345657#comment-14345657
]
Sanjay Radia commented on HDFS-6200:
+++1 for this proposal.
Create a separate jar
Sanjay Radia created HDFS-7745:
--
Summary: HDFS should have its own daemon command and not rely on
the one in common
Key: HDFS-7745
URL: https://issues.apache.org/jira/browse/HDFS-7745
Project: Hadoop
[
https://issues.apache.org/jira/browse/HDFS-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14111655#comment-14111655
]
Sanjay Radia commented on HDFS-6469:
My thoughts:
* I do believe that Paxos based NN
[
https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099243#comment-14099243
]
Sanjay Radia commented on HDFS-6134:
We have made very good progress over the last few
[
https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099311#comment-14099311
]
Sanjay Radia commented on HDFS-6134:
Alejandro. Wrt to the subtle difference between
[
https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096614#comment-14096614
]
Sanjay Radia commented on HDFS-6134:
I get your point about client-side code for
[
https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096617#comment-14096617
]
Sanjay Radia commented on HDFS-6134:
Alejandro, can you please summarize your
[
https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097330#comment-14097330
]
Sanjay Radia commented on HDFS-6134:
Had a chat with Owen over the wehbhdfs issue and
[
https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097610#comment-14097610
]
Sanjay Radia commented on HDFS-6134:
Context: making things work for cp, distcp, har,
[
https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097687#comment-14097687
]
Sanjay Radia commented on HDFS-6134:
Soem thoughts on the Har use cases and possible
[
https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097687#comment-14097687
]
Sanjay Radia edited comment on HDFS-6134 at 8/14/14 9:23 PM:
-
[
https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097875#comment-14097875
]
Sanjay Radia commented on HDFS-6134:
bq. Had a chat with Owen over the wehbhdfs issue
[
https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14095204#comment-14095204
]
Sanjay Radia commented on HDFS-6134:
Larry I don't completely get the difference
[
https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096027#comment-14096027
]
Sanjay Radia commented on HDFS-6134:
Alejandro, if we treat user hdfs as a special user
[
https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096027#comment-14096027
]
Sanjay Radia edited comment on HDFS-6134 at 8/13/14 8:19 PM:
-
[
https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096570#comment-14096570
]
Sanjay Radia commented on HDFS-6134:
bq. If you set up httpfs, it runs using the
[
https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094485#comment-14094485
]
Sanjay Radia commented on HDFS-6134:
bq. Regarding webhdfs, it's not a recommended
[
https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094527#comment-14094527
]
Sanjay Radia commented on HDFS-6134:
bq. Regarding HAR, could you lay out the usecase
[
https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094613#comment-14094613
]
Sanjay Radia commented on HDFS-6134:
Alejandro - for both webhdfs and httpfs to work
[
https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094613#comment-14094613
]
Sanjay Radia edited comment on HDFS-6134 at 8/13/14 4:58 AM:
-
[
https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14093538#comment-14093538
]
Sanjay Radia edited comment on HDFS-6134 at 8/12/14 12:19 AM:
--
[
https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14093538#comment-14093538
]
Sanjay Radia commented on HDFS-6134:
.bq. Charles posted a design doc for how distcp
[
https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14093579#comment-14093579
]
Sanjay Radia commented on HDFS-6134:
Wrt to webhdfs, the document says that the
[
https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14093583#comment-14093583
]
Sanjay Radia commented on HDFS-6134:
One of the items raised at the meeting and
[
https://issues.apache.org/jira/browse/HDFS-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14062502#comment-14062502
]
Sanjay Radia commented on HDFS-6469:
bq. I meant that if you use QJM then every update
[
https://issues.apache.org/jira/browse/HDFS-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14062559#comment-14062559
]
Sanjay Radia commented on HDFS-6469:
Todd said:
bq. a fully usable solution would be
[
https://issues.apache.org/jira/browse/HDFS-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14049227#comment-14049227
]
Sanjay Radia commented on HDFS-6469:
Wrt to double journaling
bq. If I follow your
[
https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14045415#comment-14045415
]
Sanjay Radia commented on HDFS-6134:
Noticed the rename restriction for encryption
[
https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042527#comment-14042527
]
Sanjay Radia commented on HDFS-6134:
bq. Can you be a bit more specific on HAR
[
https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042636#comment-14042636
]
Sanjay Radia commented on HDFS-6134:
Alejandro - sorry I should have explained the HAR
[
https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042789#comment-14042789
]
Sanjay Radia commented on HDFS-6134:
bq. The NN gives the HDFS client the encrypted DEK
[
https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14040873#comment-14040873
]
Sanjay Radia commented on HDFS-6134:
Aaron said:
bq. distcp... I disagree - this is
[
https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041429#comment-14041429
]
Sanjay Radia commented on HDFS-6134:
I believe the transparent encryption will break
[
https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041449#comment-14041449
]
Sanjay Radia commented on HDFS-6134:
bq. Vanilla distcp will just work with transparent
[
https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14037737#comment-14037737
]
Sanjay Radia commented on HDFS-6134:
bq. On the distcp not accessing the keys (not
[
https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14038099#comment-14038099
]
Sanjay Radia commented on HDFS-6134:
* distcp and such tools and applications
bq.
[
https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14038106#comment-14038106
]
Sanjay Radia commented on HDFS-6134:
There are a complex set of issues to be addressed.
[
https://issues.apache.org/jira/browse/HDFS-5851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sanjay Radia updated HDFS-5851:
---
Attachment: SupportingMemoryStorageinHDFSPersistentandDiscardableMemory.pdf
Slightly updated doc on
[
https://issues.apache.org/jira/browse/HDFS-5851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14034632#comment-14034632
]
Sanjay Radia commented on HDFS-5851:
Colin wrote:
bq. why a separate namespace under
[
https://issues.apache.org/jira/browse/HDFS-5851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13984544#comment-13984544
]
Sanjay Radia commented on HDFS-5851:
BTW we will host the meeting at Hortonworks for
[
https://issues.apache.org/jira/browse/HDFS-5851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13981608#comment-13981608
]
Sanjay Radia edited comment on HDFS-5851 at 4/28/14 10:23 PM:
--
[
https://issues.apache.org/jira/browse/HDFS-5851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sanjay Radia updated HDFS-5851:
---
Attachment: SupportingMemoryStorageinHDFSPersistentandDiscardableMemory.pdf
Added comparison to
[
https://issues.apache.org/jira/browse/HDFS-5851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13981608#comment-13981608
]
Sanjay Radia edited comment on HDFS-5851 at 4/25/14 9:10 PM:
-
[
https://issues.apache.org/jira/browse/HDFS-5851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sanjay Radia updated HDFS-5851:
---
Attachment: SupportingMemoryStorageinHDFSPersistentandDiscardableMemory.pdf
Please see attached
[
https://issues.apache.org/jira/browse/HDFS-6160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13964250#comment-13964250
]
Sanjay Radia commented on HDFS-6160:
+1
TestSafeMode occasionally fails
[
https://issues.apache.org/jira/browse/HDFS-5477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13920076#comment-13920076
]
Sanjay Radia commented on HDFS-5477:
I read both documents; some key details are
[
https://issues.apache.org/jira/browse/HDFS-4685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880440#comment-13880440
]
Sanjay Radia commented on HDFS-4685:
Comment on the the two alternatives for the
[
https://issues.apache.org/jira/browse/HDFS-5389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sanjay Radia updated HDFS-5389:
---
Issue Type: Sub-task (was: Improvement)
Parent: HDFS-2362
A Namenode that keeps only a part
[
https://issues.apache.org/jira/browse/HDFS-5389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13861940#comment-13861940
]
Sanjay Radia commented on HDFS-5389:
Lin will shortly post a link to her prototype code
[
https://issues.apache.org/jira/browse/HDFS-5711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13860846#comment-13860846
]
Sanjay Radia commented on HDFS-5711:
bq. We also intend to use LevelDB to persist
[
https://issues.apache.org/jira/browse/HDFS-5389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sanjay Radia updated HDFS-5389:
---
Summary: A Namenode that keeps only a part of the namespace in memory
(was: Remove INode limitations
[
https://issues.apache.org/jira/browse/HDFS-5389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sanjay Radia updated HDFS-5389:
---
Description:
*Background:*
Currently, the NN Keeps all its namespace in memory. This has had the
[
https://issues.apache.org/jira/browse/HDFS-5389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13800015#comment-13800015
]
Sanjay Radia commented on HDFS-5389:
Lin built a prototype as an intern at Hortonworks
[
https://issues.apache.org/jira/browse/HDFS-5324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13800022#comment-13800022
]
Sanjay Radia commented on HDFS-5324:
Lin, a summer intern at Hortonworks, prototyped a
[
https://issues.apache.org/jira/browse/HDFS-5324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13790652#comment-13790652
]
Sanjay Radia commented on HDFS-5324:
I am copying my comment from hdfs-dev:
HDFS
[
https://issues.apache.org/jira/browse/HDFS-4685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13747891#comment-13747891
]
Sanjay Radia commented on HDFS-4685:
When we added permissions to HDFS in Hadoop 0.16
[
https://issues.apache.org/jira/browse/HDFS-4949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13712529#comment-13712529
]
Sanjay Radia commented on HDFS-4949:
Caching partial blocks: There is no problem with a
[
https://issues.apache.org/jira/browse/HDFS-4949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13712856#comment-13712856
]
Sanjay Radia commented on HDFS-4949:
bq. we have to use mmap of a file on disk.
Please
[
https://issues.apache.org/jira/browse/HDFS-4949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13713117#comment-13713117
]
Sanjay Radia commented on HDFS-4949:
To converge on this could we do a meetup?
[
https://issues.apache.org/jira/browse/HDFS-5005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13711729#comment-13711729
]
Sanjay Radia commented on HDFS-5005:
+1
Move SnapshotException and
1 - 100 of 449 matches
Mail list logo
