As said on Discord this happens due to ZM never officially having any dedicated server support and a full reconnect is recommended even when a map restarts.