Pompey climbed back up to fourth in the League One standings with a victory at in-form Oxford.
Harvey White grabbed the only goal just after the interval, with a fine header to convert Callum Johnson's delivery.
The visitors were mostly in control from that point on, although survived a late flurry of United chances, with Craig MacGillivray making three stoppage-time saves.