Ben,
When we first rolled out the IVE we went through your same issue. The fact is to run cache cleaner you need higher then normal permissions on whatever machine you are connecting from. If you enforce cache cleaner, or host checker for that matter, there will be a large amount of machines that simply will not work. Most Kiosk machines are locked down and will not let active kind of program be installed.
I'd recommend running some tests and seeing exactly what is being left behind by the application. When we actually looked at our cache, we realized that we were not leaving anything of interest behind, maybe a couple of images files but no real data. Most applications are configurable to not cache. It will be slower but more secure.
Just my 2cents. Good Luck..