I noticed this when I was playing some music I have archived on a couple old USB flash drives. After inserting a couple (one at a time) with power on, and later removing them with power off, the results were messy. So far I have not stumbled across the correct way to do it.
I may need a remedial lesson in USB magic, but in the meantime, a link or an explanation would help...

Thanks in advance.