Not if the spammers use a botnet to change the email's source for each retry. Anyone who thinks spam originates from a fixed server name and IP is living in the past. More here:
http://www.arachnoid.com/lutusp/antispam.html
http://www.arachnoid.com/anti_spam/pic2_crop_small_trans.gif
Also, an easy way for a legitimate sender to be redefined as a spammer is for them to send copies of an e-mail until they get a reply.
> Your concern is definitely one we are keeping an eye out for but haven't seen it yet.
Like Bitcoin thefts, you won't see any sign of it until it's too late.
This idea violates the most basic civilized e-mail rule -- if you don't get a reply, don't badger the recipient. Spammers, of course, don't care about civilized behavior and will find this idea very appealing.