Williams has said, in the days following his firing by NPR, that a lot of his assumptions came tumbling down — he was a Liberal because he thought that Liberals were tolerant, open minded folk.
If a building tumbles down, it collapses or parts of it fall off, usually because it is old and no-one has taken care of it. The outer walls looked likely to tumble down in a stiff wind