You are certainly not alone! From what I understand, you are completely within your rights to refuse participation.

I believe they advertise a larger monetary fine for falsifying information than for not complying totally.

No, they don't "hound you to death". They don't even call beyond 1 time.

Some here will criticize those who wish to not participate in surveys, govt or private entity. Hopefully they'll post their phone #s so that those declining participation can end the conversation on a positive note for the govt surveyor by saying, ".....however, even though I'm not interested, please call John Smith @888-555-1212. He has expressed a high desire to share his information with you....". That will make 3 people happy. You, the surveyor, and those that encourage such participation.