Self-discovery comes in stages that can be compared to an astronaut in a space station. The first stage is investigating inside the space station, which is akin to how normal people interrogate life.
The second stage is investigating outside the space station while being tethered to it. This is akin to having defined periods of bounded contemplation, for example, when you are alone and clear-minded. In this stage, introspection is something that feels like it is outside of the “real” you. Here, only some of the products from your introspection cross the thought-action barrier into your external life.
The third stage is when you cut the tether to the space station. In this stage, you are consummately dedicated to self-discovery. Your contemplative self is your “real” self. Everything from your introspection makes it through the thought-action barrier into your external life.
Perhaps surprisingly, the amount of introspection you conduct and how much of it translates into external action is a factor of your honesty. It is easy to fill your life with the cumbersome activities and concerns of normal life. Like being on a hamster wheel, it will keep you occupied without really providing any lasting value. On the other hand, being consummately dedicated to real improvement yields a constant supply of precious fruit in all aspects of life:
8 Verily I say unto you, all among them who know their hearts are honest, and are broken, and their spirits contrite, and are willing to observe their covenants by sacrifice—yea, every sacrifice which I, the Lord, shall command—they are accepted of me.
9 For I, the Lord, will cause them to bring forth as a very fruitful tree which is planted in a goodly land, by a pure stream, that yieldeth much precious fruit. (D&C 97)
It is possible to go through your entire life in what you think is deep change, but is really just cosmetic change to your exterior. This is not what life is about, and it can’t provide the deep joy attained by those who are constantly remodeling the interior of their character. It is honesty in these “inward” and “hidden” parts of ourselves where the deep and meaningful progress is made:
6 Behold, thou desirest truth in the inward parts: and in the hidden part thou shalt make me to know wisdom.
8 Make me to hear joy and gladness; that the bones which thou hast broken may rejoice.
16 For thou desirest not sacrifice; else would I give it: thou delightest not in burnt offering.
17 The sacrifices of God are a broken spirit: a broken and a contrite heart, O God, thou wilt not despise. (Psalm 51)
The inner voice that calls us toward introspective self-discovery and self-improvement is God’s voice. It is our conscience. As we follow that voice, we will improve and literally and figuratively come to God:
49 And the whole world lieth in sin, and groaneth under darkness and under the bondage of sin.
50 And by this you may know they are under the bondage of sin, because they come not unto me.
51 For whoso cometh not unto me is under the bondage of sin.
52 And whoso receiveth not my voice is not acquainted with my voice, and is not of me.
53 And by this you may know the righteous from the wicked, and that the whole world groaneth under sin and darkness even now. (D&C 84)
We will fight the darkness, and we will free ourselves from sin, which is doing less than what we know is our best (see James 4:17).