Maxim, Interesting that you were able to run A on GCS. I never thought of that--good to know.
Since I am now an AWS guy (at least or the time being), in light of the fact that Amazon purchased Sqrrl, I am interested to see what develops. On Wed, Jun 20, 2018 at 5:15 AM, Maxim Kolchin <kolchin...@gmail.com> wrote: > Hi Geoffry, > > Thank you for the feedback! > > Thanks to [1, 2], I was able to run Accumulo cluster on Google VMs and > with GCS instead of HDFS. And I used Google Dataproc to run Hadoop jobs on > Accumulo. Almost everything was good until I've not faced some connection > issues with GCS. Quite often, the connection to GCS breaks on writing or > closing WALs. > > To all, > > Does Accumulo have a specific write pattern, so that file system may not > support it? Are there Accumulo properties which I can play with to adjust > the write pattern? > > [1]: https://github.com/cybermaggedon/accumulo-gs > [2]: https://github.com/cybermaggedon/accumulo-docker > > Thank you! > Maxim > > On Tue, Jun 19, 2018 at 10:31 PM Geoffry Roberts <threadedb...@gmail.com> > wrote: > >> I tried running Accumulo on Google. I first tried running it on Google's >> pre-made Hadoop. I found the various file paths one must contend with are >> different on Google than on a straight download from Apache. It seems they >> moved things around. To counter this, I installed my own Hadoop along with >> Zookeeper and Accumulo on a Google node. All went well until one fine day >> when I could no longer log in. It seems Google had pushed out some changes >> over night that broke my client side Google Cloud installation. >> Google referred the affected to a lengthy, easy-to-make-a-mistake procedure >> for resolving the issue. >> >> I decided life was too short for this kind of thing and switched to >> Amazon. >> >> On Tue, Jun 19, 2018 at 7:34 AM, Maxim Kolchin <kolchin...@gmail.com> >> wrote: >> >>> Hi all, >>> >>> Does anyone have experience running Accumulo on top of Google Cloud >>> Storage instead of HDFS? In [1] you can see some details if you never heard >>> about this feature. >>> >>> I see some discussion (see [2], [3]) around this topic, but it looks to >>> me that this isn't as popular as, I believe, should be. >>> >>> [1]: https://cloud.google.com/dataproc/docs/concepts/ >>> connectors/cloud-storage >>> [2]: https://github.com/apache/accumulo/issues/428 >>> [3]: https://github.com/GoogleCloudPlatform/bigdata-interop/issues/103 >>> >>> Best regards, >>> Maxim >>> >> >> >> >> -- >> There are ways and there are ways, >> >> Geoffry Roberts >> > -- There are ways and there are ways, Geoffry Roberts
