At least as recently as Developer Edition 77.0b5. Neither the keyboard shortcut nor the UI "x" button closes the mode. This is developer edition 77.0b5 on MacOS 10.14.6. For a handful of beta versions it seems inconsistent (sometimes worked sometimes didn't work) but now it seems like this happens every time. I'm not sure when I first noticed the issue.