Brett Pitman scored a stoppage-time penalty to ensure Pompey avoided a home defeat to Burton.
The striker confidently converted from the spot to secure a 2-2 draw after Ellis Harrison had been brought down in the box.
Joe Sbarra and Kieran Wallace had earlier given the Brewers a commanding early lead, only for John-Joe O'Toole to get sent off.