Changing ports in Server Editor does not work

1. Create server in servers view 2. Start server with default parameters - show in browser, server is correctly listening on port 8080 3. Stop server 4. Open server editor and change server ports, e.g. Port Offset 5. Start server Result: Server starts in console, but it is still listening on default ports , server status in server view is Starting Expected: Server is* listening on different ports*, Server status is Started