Kidderminster battled back from two goals down only for Kris Gate to grab a late winner for Gateshead.
Jon Shaw put the visitors in front from the penalty spot after Chris Carruthers handled before Michael Cummins' met Eddie Odhiambo's centre for 2-0.
Nick Wright reduced the deficit with a well-placed shot and Kyle Storer levelled the scores when he headed home Callum Gittings' corner.
Gate gave the Heed the win when he got on the end of Yemi Odubade's cross.
Kidderminster: Lewis, Vaughan, Jones, Marshall, Mike Williams, Storer, Vincent, Gittings (Phelan 68), Wright, Guinan (Matt 77), Marc Williams (Medley 63). Subs Not Used: Lyness, Sharpe.
Goals: Wright 20, Storer 25.
Gateshead: Farman, Odhiambo, Clark, Curtis, Carruthers, Cummins (Nix 79), Gate, Turnbull, Odubade (Mulligan 83), Shaw, Fisher (Moore 63). Subs Not Used: Baxter, Porter.
Goals: Shaw 4 pen, Cummins 19, Gate 80.
Ref: Stephen Martin (Staffordshire).