A dry cell battery releases electricity through a chemical reaction that takes place between the zinc alloy outer can (the anode) and an electrolyte paste inside the battery (the cathode.)
A porous cardboard separator keeps cathode and anode apart. The electricity is conducted through a carbon rod in the center of the battery.
When a circuit is closed, current flows through the battery. It can move in either direction, depending upon circuit design and conductive material.