If you are bothered by the fact that you need to change language every time you start Windows to be able to access some symbols used in your password, you can change this by adjusting some settings in control panel.
Open your Control Panel
Go to Regional and Language Options
Select Keyboards and Languages tab
Click on Change keyboards... button
Change your Default input language and keyboard layout to suit your needs.
Click OK (screenshot)
Go to Administrative tab
Click on Copy to reserved accounts...
Select the checkboxes and click OK (screenshot)