I have had the same issue, plus some others including the lights on various buttons turning off (then sometimes Push restarting), play stopping by itself, play starting by itself and scenes duplicating by themself in a loop with the only way to stop it by turning Push off or quitting Live. I put in a support request near the start of May and have been going back and forth since then. It was supposedly fixed in 12.4.2 but I was too busy to download and test. I downloaded 12.4.3 a few days ago and still have the same issues. For some reason 12.4.2 isn't on the archive. Everything works perfectly in 12.3.8.
When I push the note/session buttons the symbol next to the track name display changes, so I can see that the buttons are doing something. Sometimes I get a garbled version of note/session. Sometimes I can go to a different track and then it will change. It's very unpredictable. Overall with the other issues it makes 12.4 unusable with Push 2 (it works fine if I turn Push off) so I hope they can fix it soon. I'd love to try some of the new 12.4 stuff.
Push 2 Weird state with 12.4
Re: Push 2 Weird state with 12.4
Please keep on submitting your findings to Support, the devs are working on this. Sorry for the hassle.
Ableton Forum Moderator