It's a super common trope in fantasy video games like Skyrim to have bandits holed up in a broken-down abandoned castle. How common was this practice in real history?