Matt Clarke found the target as Pompey continued their impressive run by seeing off Bury at Fratton Park.
They were on top for most of the contest, but were just lacking a clinical touch in front of goal against League One’s bottom club.
Their persistence was rewarded in the second half, however, when Clarke converted a Gareth Evans corner to seal the victory.
Kenny Jackett made one change from the side that won at Charlton the previous week.
Conor Chaplin dropped to the bench, with Kyle Bennett taking his place in a central attacking role against his former club.
There had perhaps been too much festive overindulgence on Friday evening, with the atmosphere feeling flatter than usual.
Not that there was too much to inspire them on the pitch in a first half that the hosts controlled, without looking overly threatening.
A tame Brett Pitman effort was comfortably dealt with, while the crossing of Evans was providing some problems for Bury.
Danny Rose had the first of three decent opportunities for the Blues, unleashing a thunderous 30-yard drive that Leo Fasan did well to tip over on 15 minutes.
Bennett and Clarke both had half-chances, as Pompey continued to probe away without getting any reward.
But those other two notable openings came on 34 minutes and there was a touch of fortune about both of them.
First up was a jinking run into the box by Jamal Lowe, with the ball ricocheting kindly into Evans’ path.
He was left with just the keeper to beat, but Fasan did well to spread himself as big as possible and make the save.
Then, just seconds later, an attempt from Lowe took a massive deflection, sending the ball fizzing inches past the post.
Half Time: Pompey 0 Bury 0
There was a change just after the restart for the second week in a row, with Stuart O’Keefe withdrawn for Ben Close in the engine room.
But it was Bury who initially started stronger and a free-kick from Jay O’Shea had to be punched clear by Luke McGee.
O’Shea was also involved moments later, whipping in a corner from the right that skipper Nathan Cameron headed narrowly over.
Jackett made a second switch on the hour mark as Pompey continued their hunt for a goal, with Chaplin replacing Bennett.
And they did forge ahead moments later when Evans whipped in an excellent corner and CLARKE came charging in at the far post to emphatically head home.
Bury then replaced one former Blues striker with another to try to force an equaliser, with Michael Smith given a warm reception as he made way for Chris Maguire.
The new man immediately had an opportunity to level when he was brought down by Lowe, only to send his free-kick straight into McGee’s arms.
Pompey were still looking to get forward themselves, though, and a left-footed attempt from Evans dipped narrowly over.
The Shakers got more men forward as the seconds ticked down, but a lack of firepower meant they never really looked like getting anything from the game.
And it might have been a heavier defeat for the visitors, with Fasan getting down well to palm clear a snap-shot from Close late on.
Pompey (4-2-3-1): McGee; Thompson, Burgess, Clarke, Haunstrup; O’Keefe (Close 46), Rose; Evans, Bennett (Chaplin 60), Lowe; Pitman (c)
Goals: Clarke 62
Booked: Bennett, Evans
Subs not used: Bass, Talbot, Donohue, Kennedy, Main
Bury (4-1-2-1-2): Fasan; Edwards, Cameron (c), O’Connell, Leigh; Ince; Tutte (Mayor 65), Reilly; O’Shea; Smith (Maguire 69), Ajose
Booked: O’Connell
Subs not used: Maloney, Aldred, Williams, Dawson, Laurent
Referee: John Brooks
Attendance: 17,549 (176 away fans)