Use this tag properly, but use it. It belongs on every image on your site (sometimes it will be empty).
In the case of linking an image, the alt attribute acts as though you added anchor text on a page. Don’t stuff this though; we have seen this as part of penalty actions when that has been done.
Remember this is a tag for the blind. Treat it with respect.