We present a numerical strategy to efficiently estimate bipartite entanglement measures, and in particular the entanglement of formation, for many-body quantum systems on a lattice. Our approach exploits the tree tensor operator tensor network Ansatz, a positive loopless representation for density matrices which, as we demonstrate, efficiently encodes information on bipartite entanglement, enabling the upscaling of entanglement estimation. Employing this technique, we observe a finite-size scaling law for the entanglement of formation in 1D critical lattice models at finite temperature for up to 128 spins, extending to mixed states the scaling law for the entanglement entropy.