Pompey suffered back-to-back league defeats for just the second time this season after losing an uneventful clash with Blackpool.
Neither side created much, although Rasmus Nicolaisen headed narrowly wide from a Charlie Daniels corner and then saw an effort cleared from the line.
But it was the visitors who secured all three points when Jerry Yates burst clear and drilled into the bottom corner late on.