SOQL query with cross object criteria

Is it possible to have a Where clause that references a field on a parent/child object rather than a hard coded value? Something along the lines of:

SELECT External_Id__c, Corp_Branch__c, Account.Agency_Number__c from Contact where Corp_Branch__c != Account.Branch__c (Does not execute)