Super cool story! Thank you very much for being a champion of the change
and for sharing it with the community!
With regards,
Cos
On 12.02.2021 11:52, Luca Toscano wrote:
Hi everybody,
We have finally migrated our CDH cluster to Bigtop 1.5, so I can say
that we are now happy Bigtop users :)
The upgrade of the production cluster (60 worker nodes, ~50M files on
HDFS) was harder than I expected, since we bumped into a strange
performance issue that slowed down the HDFS upgrade. I wrote a summary
in https://phabricator.wikimedia.org/T273711#6818136 for whoever is
interested, it is surely something to highlight in the CDH->Bigtop
guide. Speaking of which, the last thing that we did was starting
https://docs.google.com/document/d/1fI1mvbR1mFLV6ohU5cIEnU5hFvEE7EWnKYWOkF55jtE/edit
some time ago, so I am wondering if we could find a more permanent
location. Would it make sense to start a wiki page somewhere? Or even
a .md file in the github repo, as you prefer (the latter would be more
convenient for reviewers etc..).
Anyway, thanks a lot to all for the support! It was a looong project
but we eventually did it!
Luca
