God does not disregard “little” or “infrequent” sins. Any deviation whatsoever, no matter by what degree or at what frequency, separates you from God.
God does not average a person’s works. Any sin, and even just one of them, alienates a person from God:
But when the righteous turneth away from his righteousness, and committeth iniquity, and doeth according to all the abominations that the wicked man doeth, shall he live? All his righteousness that he hath done shall not be mentioned: in his trespass that he hath trespassed, and in his sin that he hath sinned, in them shall he die. (Ezekiel 18:24)
The scriptures include a warning against excusing “little” or “infrequent” sin:
And there shall also be many which shall say: Eat, drink, and be merry; nevertheless, fear God—he will justify in committing a little sin; yea, lie a little, take the advantage of one because of his words, dig a pit for thy neighbor; there is no harm in this; and do all these things, for tomorrow we die; and if it so be that we are guilty, God will beat us with a few stripes, and at last we shall be saved in the kingdom of God. (2 Nephi 28:8)
One of the problems with “little” or “infrequent” sins is that they are not obviously indicative of the true depth of their cause. The problem is never just the “little” or “infrequent” sins themselves, but the much larger, much deeper character flaws that make them possible in the first place.
What many don’t realize is that the sins they notice are just the part of the weed above the soil. The truth is that by the time these “small” sins show their head, an extensive root system has already developed underground, leading to both other current sins and the ability to do very bad things under the right circumstances.
Who you are in God’s eyes isn’t just what you do under ideal circumstances. The goal of the gospel is to forge you into a person who does not sin under any circumstances. Whether a person is a sinner or not is determined by how they are at their worst, not at their best.