There is a /mutebgm and /mutese command in game.
Mutes background music and mutes sound effects until you zone.
There is also a "play sounds in background" toggle in the FFXI config out of game.
Both are only a choice between sound and no sound though.