Most of the time, the woodruff key will stick to the back face of the magnet when removing the magnet from the crankshaft.
To install the pull-start, you 'do not' need to remove the magnet, but you are well advised to make sure the air gap is correct when tightening up the nut; which will now hold the pawl disk to the magnet.