Stay away from areas where the naive and unwilling are. Then you will not encounter this issue. But, you may encounter this same response from fellow enthusiasts depending on what you attempt.
But does it matter in the end?
Who are you doing this all for anyway.
I tune them all out, regardless who they may be. They all just get in the way.
PS: One man's "crazy" is another mans normal. All depends on one's abilities, focus level, dedication and gifts.