Why can't I power off my Sansa Clip Plus when charging?

[Ishi Kahon via rockbox-dev]

My  Sansa Clip Plus doesn't power off when plugged to power source. I've held 
the power button on for a long time, but it just won't turn off.  Why not? And 
how can I power off my Sansa Clip+ when charging?