Yay, I was able to solve the problem myself. 
You have to go to the settings, and there to the advanced settings. With the language you can not only set your preferred language here, but also move it to the top (via the small menus).
Then everything is displayed in the desired language =)
Maybe you should automate this for new users in some way?