Set correct system language and remove language switcher menu and shortcut

• Go to the Region & language settings window
• Add/remove languages to end up with only the single one that you want
• Then Administrative language settings > Copy settings
• Select both checkboxes
• Click ok
• Restart