The important thing to remember about Christ is that He removed all guilt. We have no need to feel guilt if we accept His free gift AND repent when we mess up. We can be imperfect—and we all are—yet live with a clear conscience.

"How much more shall the blood of Christ, who through the eternal Spirit offered himself without spot to God, purge your conscience from dead works to serve the living God? And for this cause he is the mediator of the new testament, that by means of death, for the redemption of the transgressions that were under the first testament, they which are called might receive the promise of eternal inheritance."
—Hebrews 9:14-15


If a "church" is weighing people down with guilt, I would consider whether they are really teaching accurately from the Bible, which is the basis for our faith in Christ.

On the other hand, if a church is teaching people to fear and revere God, and as a result we experience guilt, it would be good to first examine ourselves to see if there is any good reason for the fear that may reveal an impure conscience or if we are simply being "oversensitive" emotionally, and if that is the case, to retrain our conscience.

"And every man that hath this hope in him purifieth himself, even as he is pure."
—1 John 3:3