This paper proposes a deep semantic binarization model, PLM-Res-U-Net, for enhancing palm-leaf manuscripts. PLM-Res-U-Net is a lightweight model comprising encoding and decoding blocks with skip connections. The model enhances the palm leaf manuscript by efficiently retaining the text strokes by removing the degradations such as uneven illumination, aging marks, brittleness, and background discolorations. Two datasets of palm leaf manuscript collections with multiple degradation patterns and diverse textured backgrounds are used for experimentation. PLM-Res-U-Net is trained from scratch with 50 epochs with a learning rate of1e−8 with three sampling strategies. The performance of state-of-the-art deep learning models ResUnet, Pspnet, U-Net++, and Segnet are also evaluated along with two diverse benchmark datasets. Analysis shows that results obtained by the proposed PLM-Res-U-Net prove generalizability and computational efficacy with a dice score of 0.986. Additionally, PLM-Res-U-Net successfully preserves the edge strokes of the text compared with state-of-the-art models.