Composing an association that has not been specifically designed and sold as an association is difficult. First, there is no basis upon which to compose an association, such as shared real estate assets, which is usually the case with an intended association.
If you do not agree to the association, you should not be forced to pay for it -- unless, the association develops assets that owners own in common, such as a community pool or park. In which case, if you expect to be able to take advantage of this community asset, you should be willing to pay for it.