Odd but my 80's Bulova crown also has an invisible ding of some sort that I occasionally feel catching almost scratching my thumb print ridges when setting or winding.
It must be a manufacturing error of some sort. I think any blow hard enough to upset the metal would have left a visible mark.