I have two sets of speks (tiny magnet balls fidgets). you can use them to build. with one set, I can make flawless cubes, with the other set the magnets always seem to retract making the cube bulge around the edges. why does this happen with one set? is there a fix?