If the sound starts after a couple seconds you might just have auto-polling on. Try switching that off for that input and see (hear ;-) ) what happens.

When I had (recent update fixed it) the no audio problem, I would have to cycle through the dolby modes to fix it. Not switching sources like you mentioned.