What is the best way of preventing this?

The problem is that f.ex.  a sales rep can remove/replace previously attached quotes or other attachments from an opportunity after it has been closed.

The opportunity itself is locked for editing, so it seems this should apply to attachments too.