Pompey scored and conceded in stoppage-time to ensure they would leave Accrington with a point.
Danny Cowley's men trailed at the break to goals from Colby Bishop and Cameron Burgess, but hit back in the second half.
They drew level thanks to a couple of strikes in quick succession from leading marksman John Marquis and substitute Ryan Williams.