It helps me to consider the user interface as part of gameplay, rather than an unappreciated chore.

Even changing settings is an immersive experience that could be considered akin to play, since you can feel as if you're taken out of the game window if the UX is poor.

UX is extremely important even though players won't notice it if it's good. It's difficult for a game to be fun if the controls are bad, so I don't feel bad about spending a lot of time on it.