Then you have to use two kingdom spots with graverobber and hireling. Perhaps black market with scheme and hermit/madman in it would be better? (And young witch, etc.)
EDIT: nvm, better to have graverobber and hireling in the BM deck, so you can keep all 10 madmen.