No, you don't need to. The other half stays with the movement and all you have to do is to replace the crown with the outer half.
Here is the pic of the inner half (you don't need to remove the crystal or to take the movement out to change the crown)
Click to expand...