Yes, you can shoot smaller ammo but do not expect the best performance.
You will not have as great of band life and the shot speed will probably not increase. It is best to trim your bands to a higher percentage elongation for your draw length to get more speed from your slingshot ammo.