For too many secular people, sin is something they believe only comes from and applies to the religious. On some level, it is as if they think that deciding not to believe in God frees them from the consequences of not living up to their own ideal. They know very well that it does not.
No amount of disbelief in the faith of others will free you of the guilt you feel for violating your own conscience.