ISEM (Infrared Spectrometer for ExoMars) is a pencil-beam infrared spectrometer that will measure reflected solar radiation in the near infrared range for context assessment of the surface mineralogy in the vicinity of the ExoMars rover. The instrument will be accommodated on the mast of the rover and will be operated together with the panoramic camera (PanCam), high-resolution camera (HRC). ISEM will study the mineralogical and petrographic composition of the martian surface in the vicinity of the rover, and in combination with the other remote sensing instruments, it will aid in the selection of potential targets for close-up investigations and drilling sites. Of particular scientific interest are water-bearing minerals, such as phyllosilicates, sulfates, carbonates, and minerals indicative of astrobiological potential, such as borates, nitrates, and ammonium-bearing minerals. The instrument has an ∼1° field of view and covers the spectral range between 1.15 and 3.30 μm with a spectral resolution varying from 3.3 nm at 1.15 μm to 28 nm at 3.30 μm. The ISEM optical head is mounted on the mast, and its electronics box is located inside the rover's body. The spectrometer uses an acousto-optic tunable filter and a Peltier-cooled InAs detector. The mass of ISEM is 1.74 kg, including the electronics and harness. The science objectives of the experiment, the instrument design, and operational scenarios are described.