Pompey had to settle for a point in their first League One contest for 17 days.
Danny Cowley's side broke the deadlock when Aiden O'Brien slotted neatly home early in the second half.
But Kieran Sadlier converted a penalty following an alleged foul on Elias Kachunga to ensure the contest finished 1-1.