Business / AI / Design ethics
When care meets a retention metric
A companion app can be useful and still face an awkward question: what happens when emotional dependence is good for the business?
Many digital products are rewarded when people return often, spend more time, or pay for deeper access. Those incentives are ordinary in software. They become more delicate when the product speaks in the language of affection, reassurance, or being needed.
There is no need to assume bad intent to see the tension. A team may sincerely want to build a comforting experience while also being measured by subscriptions and engagement. The product choices that follow can be small: a notification at the right vulnerable moment, a paywall around a more intimate interaction, language that subtly frames the system as irreplaceable.
The answer is governance, not panic. Products in this category should explain what they optimize for, avoid manipulative scarcity around emotional support, provide clear data controls, and invite independent review of harmful patterns. They should also make it easy to pause, leave, or seek human support without being punished by the interface.
Business models shape behavior long before a company writes an ethics page. If a product is built around emotional closeness, its incentives deserve the same scrutiny as its model quality.