Oops, that'll teach me to edit elisp without aggressive-indent-mode. :) This should work:
(advice-add 'tabbar-buffer-tab-label :before-until (lambda (tab) (with-current-buffer (buffer-name (tabbar-tab-value tab)) (when (equal major-mode 'org-agenda-mode) "Agenda"))))