Try removing it and readding on Google home app from your phone

Did you speak to the device directly? If so, probably get rid of the device name do the trick, just say "switch to HDMI 1".