Good work from Jason Puncheon down the right found Zaha at the far post to volley home before Delaney converted Pape Souare's knock down to double the advantage.
Nathan Redmond gave his side hope with a fine dipping effort from 25 yards as the game entered the final stage but Cabaye settled the game in injury time as Norwich lost on their return to the top flight.
