Basically, in the keyboard layout settings, set the Compose key. In Fedora 18 Gnome 3.6 this is in Keyboard -> Shortcuts -> Typing.
I use Right Alt for this. And then type key combinations to get umlauts:
- ä = compose, ", a
- ö = compose, ", o
- ü = compose, ", u
- ß = compose, s, s