Artificial testimonials and their impact on trust and compliance
AI-generated avatars as artificial customers in advertising erode trust and breach Australian Consumer Law. A note on what this means for marketers and platforms.
I’ve observed a dramatic rise in brands using AI-generated avatars as artificial customers in advertising. This is a problem: it negatively impacts credibility and erodes trust. It is also non-compliant with Australian Consumer Law, as it constitutes misleading conduct and breaches the regulations governing representations and testimonials.
The issue is straightforward. When a testimonial is delivered by an artificially generated character, it is highly probable that consumers will assume the entire customer experience is fabricated or artificial. That presumption alone is enough to undermine confidence in the message and diminish advertising effectiveness. The commercial impact is material: reduced trust leads to lower response rates, weaker persuasion, and higher acquisition costs over time.
Under Australian Consumer Law, the rules are clear and apply regardless of production method. Section 18 prohibits misleading or deceptive conduct. Section 29 prohibits false or misleading representations about testimonials, product characteristics, or the nature of the experience being promoted.
A clear enforcement example is the Service Seeking case (2020), where the Federal Court issued $600,000 in penalties after the platform allowed businesses to publish self-authored reviews that were presented as genuine customer testimonials. The conduct breached Section 18 and Section 29. This is not an isolated action. Regulators have consistently penalised fabricated testimonial practices, including actions against P & N/Worldwide Energy (2014), Citymove (2011), and several solar providers. These cases confirm that misrepresenting customer experience, whether manually produced or AI-generated, sits squarely within established enforcement boundaries.
At the platform level, policies are aligned with consumer law. Google, Meta, and TikTok all require disclosure of AI-generated promotional content and prohibit presenting synthetic personas as real customers. Google classifies AI-generated reviews as spam. Meta requires clear labelling of AI media and treats undisclosed synthetic testimonials as misleading. TikTok mandates AI-content labelling and rejects AI-driven testimonial ads that simulate real customer experience without disclosure.
Despite these policies, the tactic is proliferating at speed. A recent example circulating on Facebook shows an individual using Arcad to generate a fabricated testimonial for Lululemon. To be clear, this is not Lululemon running the ad. The point is that an entire cottage industry has emerged to produce artificial reviews, influencer-style videos, and synthetic promotional content. The incentives are clear: it is fast, cheap, and scalable, even though it is non-compliant and corrosive to trust.
To illustrate how widespread this is becoming, a search for “AI Avatar” in the Meta Ad Library reveals hundreds of ads promoting AI-generated presenters, avatar-based endorsement tools, and tutorials teaching marketers how to manufacture “customer” videos at scale. While these listings do not show the testimonial videos directly, they demonstrate the breadth of tools being used to simulate authenticity and the volume of actors now contributing to this problem.
Accountability sits with both marketers and platforms. Brands and agencies are responsible for ensuring testimonial content is truthful, compliant, and based on genuine customer experience. Platforms, however, hold structural responsibility. They have the technical capability to detect artificially generated content at scale through watermarking technologies such as Google DeepMind’s SynthID and other emerging invisible watermark systems. These tools enable identification of AI-generated video, images, and audio, placing an obligation on platforms to prevent non-compliant testimonial formats from being approved or distributed.
The consequences extend beyond monetary penalties. Misleading testimonial practices damage long-term brand equity, undermine future campaign performance, and create systemic distrust across an entire category. Effective marketing relies on credibility. Artificial customers, when used in testimonial contexts, degrade that credibility and introduce unnecessary legal and commercial risk.
The principle is straightforward. AI has an important role in production, optimisation, and workflow efficiency, but it cannot replace real customers in testimonial formats. Artificially generated personas should not be used to simulate authentic customer experience. The long-term deterioration in trust outweighs any short-term production gain.
Real customers build credibility. Artificial customers erode it. Sustainable marketing requires clarity on that distinction.
Regulation and penalties
| Area | Law / Rule | Requirement | Penalties / Examples |
|---|---|---|---|
| Misleading conduct | ACL Section 18 | Conduct must not mislead or deceive. AI-generated testimonials presented as real risk breaching this. | Court-determined penalties; often paired with Section 29. |
| False testimonials | ACL Section 29(1)(a),(g) | Prohibits false or misleading representations about customer experiences or product characteristics. | Service Seeking (2020): $600,000. P&N/Worldwide Energy (2014): $125,000. Citymove (2011): $6,600. |
| Advertising standards | AANA Code, Sec 1 & 2 | Advertising must be legal, honest, truthful. Undisclosed artificial personas fail this standard. | No fines; breaches can escalate to ACCC. |
| Platform compliance | Platform AI-disclosure rules | AI-generated testimonial content must be disclosed and not misrepresented as genuine. | Ad rejection, account penalties, campaign removal. |
Platform policies
| Platform | Policy requirement | Summary rule | Consequence |
|---|---|---|---|
| Misrepresentation & review integrity | AI-generated testimonials are treated as spam; cannot be presented as genuine customer reviews. | Ad or feed rejection; account warnings or suspension. | |
| Meta | AI-content disclosure & misleading content | Synthetic media must be disclosed; AI personas posing as customers are classed as misleading. | Ad rejection; forced labelling; account restrictions. |
| TikTok | AI-content labelling & synthetic persona rules | AI-generated characters must be labelled; AI personas cannot simulate customer experience without clear disclosure. | Ad rejection; removal; penalties. |