Ah, that looks like the right way to go. I did a bit of research, and found that something like a Denon AVR-791 would do the job.
I could hook my PS2 into the component/optical, and use HDMI for everything else, and it should switch with impunity, if I read the specs right.
The only hangup...