Warning - Even if you don't start the fight you can't re-enter the black knight arena after you leave. Accidentally clicked the crater during a blight so immediately left without thinking about it. Lesson learned!