I leave mine closed. If you would happen to spring a leak, then you would lose all your gas.
And gas aint cheap these days
Most regulators will switch automatically, so if you know one tank is getting low, leave both valves open and the regulator should automatically switch.