!
Well, usually, it's Left/Mono, and Right. Just putting the plug in the left one gets you monaural sound, therefore, your problem. I've seen signal splitters but not the other way around, but isn't there a headphones jack also on that thing?
If not, I think there are two-pronged headphones you can buy or maybe your speakers have a headphone jack in them.
I wish mine did