I have never made it a habit to delete temp files. However when getting short on space that's a nice way to gain some space back.  I have done it on several computers and never had a problem with the missing temp files.  So yes it's safe to do especially when done through disc cleanup.