We experimentally study the influence of the binding energy on nondipole effects in K-shell single-photon ionization of atoms at high photon energies. We find that for each ionization event, as expected by momentum conservation, the photon momentum is transferred almost fully to the recoiling ion. The momentum distribution of the electrons becomes asymmetrically deformed along the photon propagation direction with a mean value of 8/(5c)(E_{γ}-I_{P}) confirming an almost 100 year old prediction by Sommerfeld and Schur [Ann. Phys. (N.Y.) 396, 409 (1930)10.1002/andp.19303960402]. The emission direction of the photoions results from competition between the forward-directed photon momentum and the backward-directed recoil imparted by the photoelectron. Which of the two counteracting effects prevails depends on the binding energy of the emitted electron. As an example, we show that at 20 keV photon energy, Ne^{+} and Ar^{+} photoions are pushed backward towards the radiation source, while Kr^{+} photoions are emitted forward along the light propagation direction.