# In order to add more turns I'm going to have to make the inside of the coil smaller (smaller than the area of the magnet). Will this hurt the voltage output? "
No you will still gain extra volts but you may have to add an extra turn or two over what you calculate from the voltage ratios as some turns will not link all the magnet flux.
"Will it hurt the coil output if the magnet passes the top and bottom of the coil instead of just the legs?"
Again it will not hurt but you are linking even less flux with some turns. I am not sure why you need to restrict the radial dimension, it doesn't matter so much at the coil centre, but I can't see why there is any need to do this on the outside.
If you are almost there then just squeeze the coil in the circumferential direction and make the hole a bit triangular to gain a bit more space at the centre.
From your results with the second rotor I suspect your stator is a bit on the thin side and the other option would be to widen the air gap and wind the coils thicker to gain extra winding space. You would again need more turns that calculated from the voltage ratio as you will lower the gap flux. Probably a bit of both may prove to be the best way. Squeeze the hole a bit triangular to gain space at the centre and wind the coils a bit thicker.
Are you sure about your 1.7v?
If this is 16 pole you have 4 coils. At 1.7v per coil this gives 4 x 1.7v phase = 6.8v
If star connected the line voltage will be 6.8 x 1.73 = 11.76 v
Dc volts will be 11.76 x 1.4 = 16.4
This might be ok for a fully charged battery, allowing for diode drop, but you don't really want to get best performance into a fully charged battery. The chance of stalling is much less at 12v with high line and rectifier losses but generally people go for too low a cut in anyway so I think aiming for 1.3 v per coil would be nearer the mark.
If you go for the 1.7v then aim to get it with the minimum safe air gap, then you have the option to increase the gap and you are safer mechanically.
Flux