Just thinking realistically, would you really keep four-plus copies of your top-secret blueprints to your castle lying around some basement where someone might accidentally stumble into them?

I think there's a way to handle this such that will get some awesome CR between everyone, but it'll take at least some combination of people meeting, if not all at once.