well, mathematical theory states that there is an infinite number of finite numbers. thus, you have infinite different possibilities of how often you want to play your throne room, but you're never playing it for an infinite amount of times.
as for the vp thing, i imagine that to be pretty unexciting, because it's the same as "once this is played, when the game ends, the person who played this most recently wins." If i play infinite monument and make myself a million VP Tokens, my opponent can just make 2 millions next. If i make 10^(10^100) my opponent can just make 2*10^(10^100). it doesn't matter how high the number is, really, because the next guy can always just double it. whoever played it most recently wins.
if noone has gotten infinite tokens yet, it's actually better to play a market, then you win the game instantly