Agarose (AP) from red algae has a long history as food ingredients in East Asia. Agaro-oligosaccharides (AO) derived from AP have shown potential prebiotic effects. However, the human gut microbes responsible for the degradation of AO and AP have not yet been fully investigated. Here, we reported that AO and AP can be degraded and utilized at various rates by fecal microbiota obtained from different individuals. Bacteroides uniformis L8 isolated from human feces showed a pronounced ability to degrade AO and generate D-galactose as its final end product. PCR-DGGE analysis showed B. uniformis to be common in the fecal samples, but only B. uniformis L8 had the ability to degrade AO. A synergistic strain, here classified as Escherichia coli B2, was also identified because it could utilize the D-galactose as the growth substrate. The cross-feeding interaction between B. uniformis L8 and E. coli B2 led to exhaustion of the AO supply. Bifidobacterium infantis and Bifidobacterium adolescentis can utilize one of the intermediates of AO hydrolysis, agarotriose. Growth curves indicated that AO was the substrate that most favorably sustained the growth of B. uniformis L8. In contrast, κ-carrageenan oligosaccharides (KCO), guluronic acid oligosaccharides (GO), and mannuronic acid oligosaccharides (MO) were found to be unusable to B. uniformis L8. Current results indicate that B. uniformis L8 is a special degrader of AO in the gut microbiota. Because B. uniformis can mitigate high-fat-diet-induced metabolic disorders, further study is required to determine the potential applications of AO.