There is a number of different Umlauts you can try:
ß: Hold alt and type 0223 (On the Number Pad)
ö: Hold alt and type 0246(On the Number Pad)
å: Hold alt and type 0274(On the Number Pad)
There are a number of different combination's. But to do it is holding the Alt button and doing various numbers on the Number Pad