Oh, I see, @sakusaku. That is interesting. And I am able to replicate at that point.
@_tanoshi and @ShoeSandwich can you give that a test then. Go to Settings → System and make sure the toggle for Close window when closing last tab is enabled? It should then go away.