t for FileSystem implementations
Depending on feedback im certainly willing to submit and put in a first
pass at a more modular version of this file.
Its in many ways a very generalizable component of the hdfs trunk.
Thanks!
--
Jay Vyas
http://jayunit100.blogspot.com
IRC, hence should be
> usable
> across the Hadoop versions. May be it something you would benefit from.
>
> Cos
>
> On Wed, Apr 10, 2013 at 10:43AM, Colin McCabe wrote:
> > On Wed, Apr 10, 2013 at 10:16 AM, Jay Vyas wrote:
> >
> > > Hello HDFS brethre
, that run as part of the HDFS build or is
there an HDFS-Mapreduce integration repository ?)
--
Jay Vyas
http://jayunit100.blogspot.com
me code
reviews for our hadoop dependent configuration code. We'd like to follow
hadoopy idioms if possible..
--
Jay Vyas
http://jayunit100.blogspot.com
tting your answer as "No"...?
Thats fine.. but just clarifying :) ?
On Fri, Apr 19, 2013 at 2:23 PM, Aaron T. Myers wrote:
> Hi Jay,
>
> On Sat, Apr 20, 2013 at 1:10 AM, Jay Vyas wrote:
>
> > I recently looked into the HDFS source tree to determine idioms with
&g
be happening during a block transfer which makes the
pipeline a 2 node, rather than 1 node one?
Maybe I'm misunderstanding something about the way the pipeline works so
thanks for helping and apologies if this question is a little silly.
--
Jay Vyas
http://jayunit100.blogspot.com
will eventually be entirely
phased out.
This is in reference to some issues with HBASE and the createNonRecursive
implementation which varies across different hadoop versions.
--
Jay Vyas
http://jayunit100.blogspot.com
ontext, here is a closely related JIRA
https://issues.apache.org/jira/browse/HADOOP-6886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
On Fri, May 31, 2013 at 6:09 AM, Steve Loughran wrote:
> Jay, this is is more a common-dev question, as it goes beyond hdfs
>
> On 31 M
n information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>
--
Jay Vyas
http://jayunit100.blogspot.com
Where is the jira for this?
Sent from my iPhone
> On Nov 18, 2013, at 1:25 PM, Andrew Wang wrote:
>
> Thanks for asking, here's a link:
>
> http://www.umbrant.com/papers/socc12-cake.pdf
>
> I don't think there's a recording of my talk unfortunately.
>
> I'll also copy my comments over to the
nd it will
benefit us all immensly in the long run as well.
--
Jay Vyas
http://jayunit100.blogspot.com
steve you mentioned:
>> but to test YARN it has to be visible across processes.
What do you mean by "test yarn"? I think for the FileSystem APIs unit
testing, we dont care about YARN, do we?
On Thu, Mar 6, 2014 at 6:02 AM, Steve Loughran wrote:
> On 5 March 2014 19:
t close to, and modify their particular file system to declare
semantics using the matching FS as a template.
--
Jay Vyas
http://jayunit100.blogspot.com
models, and
> YARN -even MiniYARNCluster -forks things off.
>
> If the MR commit logic is isolated, that could be tested in the JUnit JVM.
> But for other applications -example: Tez, its probably too complex to mock
>
>
>
>
> On 6 March 2014 16:17, Jay Vyas
do you consider that native S3 FS a real "reference implementation" for
blob stores? or just something that , by mere chance, we are able to use as
a ref. impl.
l
>
> It would be nice to see this or something like it integrated with
> Hadoop. I fear that a lot of applications are not ready for eventual
> consistency, and may never be, leading to the feeling that Hadoop on
> S3 is buggy.
>
> Colin
>
>> On Thu, Mar 6, 2014
, 2014 at 4:01 PM, Steve Loughran wrote:
> Lets get the HADOOP-9361 stuff in (it lives alongside
> FileSystemContractBaseTest) and you can work off that.
>
>
> On 6 March 2014 18:57, Jay Vyas wrote:
>
> > Thanks Colin: that's a good example of why we want To unify t
jay vyas created HDFS-5909:
--
Summary: NameNode : Can some features be implemented in a pure
YARN app, to synergize broader uniformity for HCFS distributed FS metadata
operations?
Key: HDFS-5909
URL: https
jay vyas created HDFS-6027:
--
Summary: hadoop-fuse-dfs is not strictly consistent for "cp"
actions file contents.
Key: HDFS-6027
URL: https://issues.apache.org/jira/browse/HDFS-6027
Project: H
19 matches
Mail list logo
