Jruby 1.7.x comes with openssl bundled. I think from version 1.7.1 onwards bouncy castle gets a java package rewrite and is used only internally for openssl. So you are free to add any version of bouncy castle as needed by your application - just do not add the jruby-openssl since this will pull in the old version.
Kristian