Sandy Clark celebrated his first win as Berwick boss, as the Borderers claimed victory in Stirling for the first time since 1983.
Berwick remain bottom of the table but are within striking distance of Alloa and Arbroath and, at a frosty Forthbank, showed they had the hunger for the battle ahead.
A first shut-out of the season and a first league win since the opening day were just reward – Stirling got what they deserved on the day, as manager Allan Moore later admitted.
The only goal came after just six minutes when Pat Clarke flicked the ball into the path of Darren Smith, who cracked a superb shot just inside the post from around 12 yards.
Berwick should have increased their lead in 32 minutes after Chris Scotland fouled Ian Little in the box but Andy Seaton sent his spot-kick wide of the left-hand upright.
Both sides had plenty chances in the first half, with Berwick keeper Gary O'Connor denying Martin Glancy and Steven Hutchison as Albion failed to make the most of their opportunities.
Mark Cowan twice came close to killing the game off in the second period but he headed wide then fired over after a pair of David Murie corners.
Albion's Scott McLean wasted a great, late chance to level after being put through by Conor Gethins but his control let him down and O'Connor gathered the ball. In any case, an equaliser would have been harsh on Berwick.