As we observe look in all directions away from Earth, the volume of space we observe gets larger and larger. But shouldn't it be getting smaller, due to the early universe being much smaller?