HDMI audio questio

I run my retro consoles with scart cables into a scart switch box then to XRGB then HDMI to TV no issues sound is great same with picture.
But I recently ran out of HDMI ports so I bought a hdmi switch box 1/4ports but if I use it no audio comes out. If I use the hdmi box for just modern consoles directly in and out to tv no issue....

For reference, which HDMI switch are you using? I've heard of video issues with them before, but never anything just specific to audio.

Nothing nice on the hdmi box rocketfish Canadian brand I believe cheap.. the scart switches are shinybow.