A common trope is that a healthy body is better for your magic. Similarly that Harry is unhealthy/malnourished and looks smaller/younger than his age. And Canon has school only able to start after age 11.