Midi triggering latency

[pushtobreak]

I put this at the end of another post but figured I should really start a new thread.

I know I need more RAM (512). I'm running Live5.2.1, OSX 10.4.7, 2Ghz Dual G5. Should be able to handle it.

Has anyone else had this problem? Terrible midi triggering latency. I've gotten rid of it by restarting Live, but not really sure what the cause is or if that really solved it as it has come back a few times. I have a set up where the midi comes in on one track is routed to another track end then to the master fader. When I trigger the sound I see midi input spot on in track one, the second channel is a bit delayed and the master fader even more so. So, by the end it's almost a second late! Even more strange is that when I hit the space bar the entire thing stops a second late. All audio is delayed, yet I see my midi input perfectly entering the input. I've tried changing all buffer preferences eliminating inputs. If I take out just about all plugins it goes away, but 'hey' I need those plugins, and they worked fine for the past 16 hours! And 'poof' now they're working again perfectly. This problem appeared around the same time as the cpu issue I posted in an earlier thread, yet somehow seems unrelated.
Any ideas?