In this study, a superconducting high gradient magnetic separator (HGMS) with a matrix vibration system in dry mode was utilized to purify fine calcite and quartz powders smaller than 38 μm. The effects of the operating parameters (particle size, magnetic field/average air velocity (B0/V0), the amplitude of vibration as well as the aperture size of the expanded metal matrix) have been presented. The mechanically-based matrix vibration with the air blowing was recognized to be effective for dry purification of fine powdered materials at high magnetic fields. The function of the matrix vibration has been discussed. In addition, the results have been empirically correlated with the operating parameters used for the purification in the separator.