Hi,
This should be fixed in 1.75 final. The reason its doing that is in the editor, the collider is recreated every time it is modified to avoid some issues. In game however, the collider will only be resized.
The patch in 1.75 basically makes it run the "game" path when the editor is in Play mode.