Image contrast enhancement refers to an operation of remapping the pixels’ values of an image to emphasize desired information in the image. In this work, we propose a novel pixel-based (local) contrast enhancement algorithm, based on the human visual perception. First, we make an observation that pixels with lower regional contrast should be amplified for the purpose of enhancing the contrast and pixels with higher regional contrast should be suppressed to avoid undesired over-enhancement. To determine the quality of the regional contrast in the image (either lower or higher), a reference image will be created using a proposed global based contrast enhancement method (termed as Mean Brightness Bidirectional Histogram Equalization in the paper) for fast computation reason. To quantify the abovementioned regional contrast, we propose a method based on human visual perception taking Just Noticeable Difference (JND) into account. In short, our proposed algorithm is able to limit the enhancement of well-contrasted regions and enhance the poor contrast regions in an image. Both objective quality and subjective quality experimental results suggested that the proposed algorithm enhances images consistently across images with different dynamic range. We conclude that the proposed algorithm exhibits excellent consistency in producing satisfactory result for different type of images. It is important to note that the algorithm can be directly implemented in color space and not limited only to grayscale. The proposed algorithm can be obtained from the following GitHub link: https://github.com/UTARSL1/CHE.