Kinda depends on the style of music, doesn't it? Quiet instrumental music for which no lyrics exist is probably helpful. Loud patriotic marches, or bombastic opera, maybe not so much. For me, even instrumental versions of popular songs or of hymns don't work, because I sing along.
If you find music distracting, try white noise or nature sounds.