Typically if its ambient sounds, or atmospheric ones - like from Desert Stalker, it'll be on. Otherwise off as if it that type, it usually is detrimental to the experience.
it's good to have some music and sfx
but I turn them down to very low
or off when I'm just holding the ctrl key to skip dialog (especially when an update isn't compatible with old saves)