Measurement

Completion is not activation: choose a first-value metric

Define the action that shows a new user received value, then connect it to onboarding without mistaking a finished questionnaire for success.

By Aplyna5 min read
The practical answerChoose a first-value action that reflects the product promise. Measure it for the original onboarding cohort within a fixed window, alongside completion and reliability.

Start with the product promise

A new user can finish every setup screen and still leave without doing anything useful. Completion tells you whether a journey ended; activation should describe a first experience of the value the app promises. For a reading app, opening a recommended book may be more relevant than reaching Home. For a planning app, saving a usable first plan may be a better candidate.

Write the proposed event in concrete terms, including what must be saved or shown. Avoid vague names such as engaged_user unless the rule is documented. The first candidate is a hypothesis: a plausible first-value action is not automatically a proven predictor of long-term retention.

Keep setup, value and payment separate

Imagine 1,000 installations start onboarding, 700 complete it, 400 open a recommended item and 250 save one. These invented counts describe different stages. A 70% completion rate does not establish a 70% activation rate, and none of the events proves payment.

Decide which action represents the primary outcome before comparing designs. Track supporting events for diagnosis, but avoid quietly switching to whichever event produces the largest improvement. Use installation identities consistently; a user-level metric requires a separate identity policy.

A finished flow is only one milestone

Invented cohort of 1,000 installations, observed for 24 hours.

Started onboarding1,000 installations
Original cohort
Completed setup700 installations
70% of starters
Opened an item400 installations
40% of starters
Saved an item250 installations
25% of starters
Educational example only. “Opened” and “saved” are candidate value events, not universal activation definitions.

Choose a window that matches the action

A quick utility might deliver value in the first session. A learning app may need a longer observation window. State whether the action must occur within one hour, one day or another explicit period after the cohort starts. Apply the same window to every compared variant.

Do not compare mature cohorts with installations that joined minutes ago. Preserve event occurrence time for delayed uploads and identify cohorts that are still maturing. A longer window may capture more actions while making decisions slower; select it deliberately rather than after seeing results.

Check whether the metric remains useful

Inspect examples of the action in the actual product. Could a default selection or accidental tap trigger it without delivering value? If saving a plan is the goal, confirm that the saved plan exists and can be used. Test duplicate events and restart behavior.

Once enough real data exists, study the relationship between the candidate event and later retention using comparable cohorts. Association can support a useful diagnostic measure, but it does not establish that forcing the event causes retention. A controlled product experiment answers a different question.

Use a balanced decision rule

A shorter setup may improve completion while reducing the quality of a recommendation. Evaluate the chosen activation action and reliability guardrails before rollout. Keep the overall denominator visible so a seemingly stronger conditional percentage does not hide fewer total activated installations.

Aplyna can collect supported scoped journey events. It does not infer business value from arbitrary app behavior or turn a trial-start signal into verified revenue. Document your event contract and inspect current metric availability before using a dashboard for a release decision.

Sources & further reading

Technical references may be in English. Examples are educational; product behavior follows the current source SDKs and availability reference. No customer performance claim is implied.

Published by Aplyna. Editorial illustrations were generated with AI; they are not product screenshots. Charts use labeled teaching examples or conceptual diagrams.