Pompey were undone by another late goal, as they were held to a draw by Oxford.
They dominated for much of the contest and Gareth Evans scored from the spot following a trip on Ben Close.
But in the final minute of the 90, Matty Taylor headed home James Henry's cross to secure a point for the visitors.