Ever delete a desktop drive icon, by right clicking on icon?
All you wanted to do was access the right click menu.
It is very easy to have the right click menu open and accidentally hit "remove item".
Why?
Because that is what the mouse pointer usually is over, "remove item".
Try to put the mouse pointer at a different location on the icon.
So the right click menu opens and "remove item" is not selected.