A large part of the railway track geometry maintenance burden concerns local maintenance activates conducted to rectify isolated defects. Isolated defects are short irregularities in the track geometry that can dramatically increase the dynamic forces between the wheel and rail, which in turn will accelerate the growth or occurrence of internal rail defects. The dynamic force between the wheel and rail is dependent on the shape of the isolated geometry defects. However, the severity of isolated defects is mainly defined only by their amplitude. Therefore, in addition to amplitude, other characteristics of geometry defects must be considered to analyze severity of defects and to prioritize local maintenance actions. This study aims to use the first- and second-order derivatives of the longitudinal level defects to plan local maintenance activities. The derivatives of geometry defects provide useful information about the shape of defects. The information is used to categorize the isolated defects based on their severities and prioritize maintenance actions. In this regard, K-means clustering technique is applied. The results of this study will support the decision-making process regarding the planning of local maintenance activities. The foot-by-foot track geometry data collected from Main Western Line in Sweden is used to implement and test the model.