Pompey booked their place in the last 16 of the Papa John's Trophy in dramatic fashion.
A 3-2 victory at Exeter means that they will now travel to Cambridge in the next round on Tuesday evening.
Danny Cowley's side took an early lead through George Hirst's header, but Matt Jay immediately levelled and Archie Collins struck again for the Grecians after the break.