Are all comments with links spam?

Google’s Webmaster Guidelines discourage forum signature links but what about links from comments? Is link building by commenting against Google Webmaster Guidelines? What if it’s a topically relevant site and the comment is meaningful?
Chase, A, Denver, CO