Yunus's karma effect: "If any player would take a Dogma action, first you may return a card. If you do, you have the sole majority in its featured icon until the end of the action."
The "its" refers to the card you returned. So returning Oars gave you castle majority, which isn't any use for a factory card.