Yes, as well as all the things you're currently downloading (plus stuff from diffused dl/ul) so I would advise against manually deleting any cache. Just do a search on whatever you have downloaded successfully before, they should have an orange status bar (complete), right click on any you want to remove and choose "Delete from cache".