Unfortunately, there is no easy answer to this problem. the strength of early treasure maps depends on a) how much support is there to collide them, b) how good is it to get 4 gold. Both depends heavily on the board, so it's hard to make general statements. However, Treasure maps are not very strong, so you should win the majority of games by ignoring them (and I'm pretty sure only having Seaside + Intrigue doesn't change that). I think this might be similar to playing engines vs BM (Big Money). At the start, you'll lose a lot of games, because money is easier to play, but once you get better, you will start winning a lot.
To give hints for at least a few boards, if there is any one of: minion, hag, ambassador, (fishing village + any draw), (wharf + any village), (torturer + any village), then Treasure maps are most likely a bad idea.