Multiple Email Signatures in Salesforce

there are now 2 separate accounts in Salesforce “user1” and “user 2”. So what we thought is to use a single email temaplte for our sending emails and the signature would be carried from the respective account email settings. But when we are trying this its not working.
Can any one please suggest ?