This study introduces an ensemble-based deep learning approach for monitoring and detecting submerged arc weld defects in weld beads and adjacent zones during Non-Destructive Testing (NDT). The methodology utilizes an open-source image dataset to categorize submerged arc weld conditions into three defect types: cracks, lack of penetration and porosity, and ideal welds (no defects). To enhance image analysis, we employ preprocessing and feature extraction in both spatial and frequency domains using segmentation techniques like grey level difference method (GLDM), grey level co-occurrence matrix (GLCM), discrete wavelet transform (DWT), Fast Fourier Transform (FFT), and texture analysis. Following image preparation, the preprocessed data undergoes training and testing in our proposed ensemble-based deep learning model. The model's performance is thoroughly assessed using key metrics such as precision, recall, F1 score, receiver operating characteristics (ROC) curve, and a confusion matrix, resulting in an impressive accuracy rate of 93.12% for detecting and classifying weld faults. In comparing our model to state-of-the-art techniques in existing literature, our ensemble-based deep learning approach consistently demonstrates a high fault detection and classification performance in the face of a simplistic MLP-based core architecture, ratifying the robustness of our feature ensemble approach. The study concludes that this model has significant potential for integration into current inspection systems, offering an efficient and robust solution for real-time condition monitoring of welds along weldment joints.