Rejecting Leads Assigned to You From a Queue/Assignment Rule

I am trying to figure out how I can have Salesforce not auto-assign leads via Assignment Rules to reps that are too busy with too many leads (I know- most are only complaining for more) or are taking time off. How can this be done?