My native language is french, and I live in Belgium.
People who use esperanto regularly are not rare, usually they use it in meetings around the world (I have met some of my best friends, including french people, there), or for couchsurfing (using esperanto as the main language instead of english).
In fact there are many ways to make use of esperanto, even if only a few people learned it.