This article focuses on a spacecraft trajectory planning algorithm that allows observation of multiple site locations on the asteroid surface, while avoiding any collision with debris objects trapped in the asteroid’s gravity field. Asteroids provide a challenging target for satellite based visual coverage missions, since they are partially illuminated, rotating, irregular shaped celestial bodies with a low but also irregular gravity field. For addressing this problem, an optimization approach for visual coverage is proposed with an objective to determine the sequence of the imaging site locations and the associated safe and fuel efficient trajectories, while considering rotational dynamics of the asteroid, changing illumination condition for each site, irregular gravity constraints of the asteroid and the safe separation distance from the moving debris object. Numerical simulations are performed to demonstrate the ability of the trajectory planner to ensure successful optimal coverage of all the desired asteroid site locations.