My gut says Wharf-BM or Wharf-Envoy-BM beats Village/Wharf here, though it is reasonably close. You really only need 2 or 3 Wharves with money to make an effective deck: as you increase your money density, the Wharves becomes less likely to collide, so 7 is overkill and while you're taking the time getting that set up, Envoy/Wharf-BM can push ahead of it. Note that he spent $47 and 11 buys on actions while you spent $55 and 12 buys. Meanwhile, he was also able to amass 3 Golds, which definitely made a difference for him: you had less money to spend and bought more setup cards. The Trader is not a terrible idea to pick up Silvers for Copper with your extra buys, though. Also keep in mind he was first player, which gave him a pretty big advantage on this board from the get-go.
This game also illustrates how significant gaining a couple more cards can be. Wharf is awesome, but it 'only' draws 2 cards for your next turn whereas Envoy draws you 4.
Anyway, I think the most significant difference is probably the Gold. The decks are similar, you just chose to focus on Silver and couldn't get enough to compete. I'm sure someone else can give a better analysis, but those are my thoughts.