Although antix is not 100%-free, it is based on Debian Wheezy and *probably* (I have not checked) is "freer" than Puppy in its default setting. Besides, I believe Debian Wheezy's repositories offer far more free software than Puppy.
Have you taken a look at antiX? Its goals are similar to those of Puppy:
fast, lightweight but fully-functional (JVM is one of the proposed desktop
environment), etc.
- [Trisquel-users] Re : Make a Puppy-Libre magicbanana
