Pompey had to fight from behind before eventually securing a comfortable victory at Burton.
Marcus Harness opened the scoring with just 79 seconds on the clock, only for the hosts to hit back through Lucas Akins and a Tom Naylor own-goal.
But Harness' cheeky back-heel got Kenny Jackett's side back on level terms and Jack Whatmough soon poked them into the lead.