Some programs need Java I think, so that might be a larger action than you intended. If you are doing this over security concerns for Java remote exploits, then you could instead remove IcedTea. That is the Java client for your web browser. With that removed, your web browser won't open Java plugins on websites any longer and hence negative this security threat. See here how to do this:
viewtopic.php?f=47&t=119955#p660774