Fully bio-based and biodegradable all-cellulose composites were prepared in the form of films by partial dissolution of two cellulose sources: a commercially available microfibrillated cellulose (MFC) and filter paper (FP). The solvent selected for this work was the ionic liquid 1-butyl-3-methylimidazolium chloride ([C4mim]Cl). Both cellulose sources were partially dissolved at 80 °C and consolidated by partial dissolution, resulting in excellent mechanical properties. X-ray diffraction and electron microscopy demonstrated that partial dissolution was a viable path to transform FP into a continuous paracrystalline matrix reinforced with cellulose I crystallites. In contrast, partially dissolved MFC was not as thoroughly dissolved and large amounts of undissolved material were still visible along the center line of the films after the longest dissolution times. Consequently, partially dissolved MFC retained its initially high crystallinity. The degree of polymerization of the materials after dissolution was significantly reduced.