@00g
I had exactly the same problem (also a Sony remote, probably not a coincidence)
I can confirm that setting the sensitivity to 0 via the command line fixed the problem. A value of 3 doesn't work, I've not tried 1 or 2.
I guess the down and left buttons work on very similar frequencies.