tants.java#L139
> >
> >
> https://github.com/apache/accumulo/blob/rel/1.7.1/server/base/src/main/java/org/apache/accumulo/server/ServerConstants.java#L151
> > (we are using 1.7.1)
> >
> > is that means, we can simply modify the return value of getWalDirs() to
>
e of getWalDirs() to
> change the location of WAL logs?
>
> Thanks
>
>
>
> --
> View this message in context:
> http://apache-accumulo.1065345.n5.nabble.com/Accumulo-on-s3-tp16737p16872.html
> Sent from the Developers mailing list archive at Nabble.com.
>
.n5.nabble.com/Accumulo-on-s3-tp16737p16872.html
Sent from the Developers mailing list archive at Nabble.com.
> jobs (your use of Spark) can read data from S3 and ingest it into the
> > database (Accumulo here, but commonly Hive or HBase for others).
> >
> > One thought would be that you could use Spark to create Accumulo RFiles,
> > store those in s3 and then get load them into
r others).
>
> One thought would be that you could use Spark to create Accumulo RFiles,
> store those in s3 and then get load them into Accumulo running not on s3.
> You could use ec2 to run Accumulo instead and bulk load your pre-created
> Accumulo RFiles from s3 (this should be fine
(Accumulo here, but commonly Hive or HBase for others).
One thought would be that you could use Spark to create Accumulo RFiles,
store those in s3 and then get load them into Accumulo running not on
s3. You could use ec2 to run Accumulo instead and bulk load your
pre-created Accumulo RFiles from s3
t; put
> > and delete requests.
>
> so may be accumulo will get problem with consistency only by major
> compactions right? it seems no other operation is overwriting or deleting
> files on HDFS.
>
> let me describe our usage of accumulo on s3, basically, we want to combine
entual consistency for overwrite put
> and delete requests.
so may be accumulo will get problem with consistency only by major
compactions right? it seems no other operation is overwriting or deleting
files on HDFS.
let me describe our usage of accumulo on s3, basically, we want to combine
the
ow.com/questions/36602719/accumulo-cluster-in-aws-with-s3-not-really-stable/36772874#36772874
):
Yes, I would expect that running Accumulo with S3 would result in
problems. Even though S3 has a FileSystem implementation, it does not
behave like a normal file system. Some examples of the diffe
stem implementations, and then run your own tests to
> make
> > sure that data is not lost.
> >
> >
> > vdelmeglio wrote:
> >
> >> Hi everyone,
> >>
> >> I recently got this answer on stackoverflow (link:
> >>
>
then run your own tests to make
> sure that data is not lost.
>
>
> vdelmeglio wrote:
>
>> Hi everyone,
>>
>> I recently got this answer on stackoverflow (link:
>>
>> http://stackoverflow.com/questions/36602719/accumulo-cluster-in-aws-with-s3-not-really-stab
://stackoverflow.com/questions/36602719/accumulo-cluster-in-aws-with-s3-not-really-stable/36772874#36772874):
Yes, I would expect that running Accumulo with S3 would result in
problems. Even though S3 has a FileSystem implementation, it does not
behave like a normal file system. Some examples
Hi everyone,
I recently got this answer on stackoverflow (link:
http://stackoverflow.com/questions/36602719/accumulo-cluster-in-aws-with-s3-not-really-stable/36772874#36772874):
> Yes, I would expect that running Accumulo with S3 would result in
> problems. Even though S3 has a File
13 matches
Mail list logo
