While I'm not 100% sure there is _no way_ to do this, it's been the only reliable way to make it work.
There are some instructions here
that describe how to install a JCE and provider.
So, you might be lucky and be able to package the whole thing into a WAR.
However, I'm not a lawyer, nor do I play one on an Internet soap, but you might wish to seek legal advice about distributing your product with cryptography installed. This is a difficult area, and one that has been muddied considerably over the last couple of years.