I was able to fix this by going into my existing account settings (I have two of them), opening up the “Fetching mail” settings, then “Incoming server”, making no changes and then pressing Next. Since I did that for both accounts, IMAP push seems to be working again. Note that a reboot previously did not fix the problem, only accepting the current settings worked.