I discovered something similar about a month ago. I dug around the directory structure using heroku console, and noticed that the "deleted" gems still existed in the slug's .bundle folder.
-- You received this message because you are subscribed to the Google Groups "Heroku" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/heroku?hl=en.
