Human pre-implantation embryonic development involves extensive changes in chromatin structure and transcriptional activity. Here, we report on LiCAT-seq, a technique that enables simultaneous profiling of chromatin accessibility and gene expression with ultra-low input of cells, and map the chromatin accessibility and transcriptome landscapes for human pre-implantation embryos. We observed global difference in chromatin accessibility between sperm and all stages of embryos, finding that the accessible regions in sperm tend to occur in gene-poor genomic regions. Integrative analyses between the two datasets reveals strong association between the establishment of accessible chromatin and embryonic genome activation (EGA), and uncovers transcription factors and endogenous retrovirus (ERVs) specific to EGA. In particular, a large proportion of the early activated genes and ERVs are bound by DUX4 and become accessible as early as the 2- to 4-cell stages. Our results thus offer mechanistic insights into the molecular events inherent to human pre-implantation development.