They'd just shut off a section of the water main, redirect the water and call it a day...in a big city, I doubt they'd let something like that be a problem for more than a few hours (fixing it entirely would take a long while though).