My first KVM switch was in the price range you mentioned, but switching caused the screen to go black for a while due to some HDMI stuff. The more expensive one I have now keeps both connections open at the same time, and switching takes a second or so.

I dunno, I started thinking of it like switching from one game server to another, if you (somehow) do it in the middle of a game, stuff is bound to explode.