AnyLearn
All lessons
AIbeginner

Generative AI for content: what it does well and badly

A practical, honest account of using generative models to make social content. Covers the jobs they genuinely do well, the specific ways they fail, why a model that sounds confident can still be wrong, the disclosure rules that now apply in the EU, and why the tool that removes effort also removes the thing that made your work worth watching.

Updated · AI-authored, review-gated · how lessons are made

Not signed in: your progress and quiz score won't be saved.
Progress1 / 8

What these models actually do

A generative model does not know things. It produces the most plausible continuation given what came before, learned from an enormous amount of prior material.

That is not a slight. Plausible continuation is astonishingly useful: it covers drafting, rewriting, summarising, translating, and generating an image matching a description.

But it explains the whole shape of what follows. The model optimises for plausible, not for true, not for original, and not for good. Those often coincide, because true things are usually plausible. When they diverge, the model follows plausible, every time.

So you get output that reads exactly like a confident expert, because it learned the shape of confident expert writing, and that shape is entirely independent of whether the content is correct. Fluency is not evidence of accuracy. They are separate properties that a language model couples only by accident.

Full lesson text

All 8 steps on one page, for reading, reference, and search.

Show

1. What these models actually do

A generative model does not know things. It produces the most plausible continuation given what came before, learned from an enormous amount of prior material.

That is not a slight. Plausible continuation is astonishingly useful: it covers drafting, rewriting, summarising, translating, and generating an image matching a description.

But it explains the whole shape of what follows. The model optimises for plausible, not for true, not for original, and not for good. Those often coincide, because true things are usually plausible. When they diverge, the model follows plausible, every time.

So you get output that reads exactly like a confident expert, because it learned the shape of confident expert writing, and that shape is entirely independent of whether the content is correct. Fluency is not evidence of accuracy. They are separate properties that a language model couples only by accident.

2. The jobs it genuinely does well

There is a pattern to where these tools earn their place: tasks where you can instantly tell if the output is right, and where the work was mechanical rather than creative.

  • Transcription and subtitles. You can read them and see if they match. Formerly an hour; now a button.
  • Translation and dubbing. Verifiable if you or someone you trust speaks the language.
  • Reformatting. Turning a long video into clips, resizing for another aspect ratio, restructuring a script into bullets.
  • Variations on a theme. Thirty title options to choose from. You are the filter, so the model's mistakes cost nothing.
  • Getting past the blank page. A bad first draft you rewrite beats staring at nothing.
  • Editing mechanics. Background removal, object cleanup, colour matching.

The common thread is that verification is cheap and you stay the judge. The model proposes at volume; you dispose. That division of labour plays to the strength, plausible output, and neutralises the weakness, no idea if it is true.

3. Where it fails, specifically

The failures are not random. They follow directly from optimising for plausibility.

Confident fabrication. Ask for a statistic, a study, or a quote and you may get one that does not exist, formatted perfectly, with a plausible source. This is the single most dangerous failure for anyone posting factual content, because the output gives you no signal that it happened.

Regression to the average. Trained on everything, it produces the middle of everything. Ask for a hook and you get the hook that has been written ten thousand times. On a platform where the ranker is actively penalising sameness, generic is not a neutral outcome, it is a losing one.

No taste. It cannot tell which of its thirty titles is good, because good is not a property it models.

Confident about your domain. Its fluency is uniform, but its reliability is not. It sounds identical whether it is on solid ground or improvising, and you only notice the difference in the areas you personally know well.

4. The verification rule

One rule covers most of the risk, and it follows from the failure modes rather than from caution.

Never publish a factual claim from a model that you have not checked against a source.

SAFE            you can verify instantly, or errors are harmless
  subtitles       you read them
  30 hook ideas   you pick
  translation     a speaker checks
  a rough draft   you rewrite it

DANGEROUS       plausible and wrong looks identical to plausible and right
  statistics      may be invented
  study citations may not exist
  quotes          may be misattributed
  dates, prices   may be confidently wrong
  medical, legal, financial claims

The asymmetry is what makes this workable. In the safe column, a mistake costs you a moment. In the dangerous column, a mistake is published under your name, to an audience, and you had no signal it was coming.

Notice this is not "do not use AI". It is: use it where being wrong is cheap and visible.

5. Disclosure is no longer optional

Labelling AI content has moved from etiquette to obligation, on two separate tracks.

Platform rules. The major platforms require you to disclose realistic synthetic media, and they apply their own labels when their detection fires. Undisclosed synthetic content that their systems catch can be labelled or demoted regardless of your intent.

Law. The EU AI Act sets transparency obligations for generated content, with a particular focus on material that could mislead: synthetic media depicting real people or events generally has to be disclosed. Obligations phase in over time, and the details differ by use, so treat this lesson as orientation and check the current text for anything commercial.

The practical line is about deception, not tooling. Nobody expects a disclosure because you used AI to remove a background or generate subtitles. The obligation attaches when a reasonable viewer would be misled about whether something is real: a synthetic voice of a real person, a photorealistic event that did not happen, a fabricated endorsement.

6. The workflow that survives contact

Teams that get value from these tools converge on roughly the same division of labour.

StageWhoWhy
what to say, and why it mattersyourequires a point of view, which the model has none of
research and factsyou, from sourcesfabrication risk is unacceptable here
first draftmodelcheap, and you are going to rewrite it
variations to choose frommodelit proposes, you filter
the actual judgementyoutaste is not modelled
mechanics: subtitles, cuts, resizingmodelverifiable, formerly tedious
final checkyouyour name is on it

Read the pattern: the model does volume and mechanics, you do judgement and facts. Every failure mode of these tools lands in the rows marked you, which is why those rows cannot be delegated.

Invert this, letting the model decide what to say while you tidy the output, and you get exactly the generic, occasionally-false content that the word slop describes.

7. The competitive problem nobody mentions

Here is the part the tooling pitches leave out. If a tool lets you produce content with no effort, it grants everyone else the same power at the same moment. A capability everybody has is not an advantage. It is a new floor.

So the effect of cheap generation is not that AI users beat non-users. It is that the volume of adequate content explodes, and adequate stops being enough to earn attention.

Which raises the value of exactly what cannot be generated: a genuine point of view, real expertise, a specific experience, actual access, a distinctive voice. A model trained on everything published cannot produce the thing you learned last week that nobody has written down.

The uncomfortable synthesis: use these tools for everything that is not the reason someone watches you, and never for the thing that is. The model can make your subtitles. It cannot have your opinion, and an opinion is generally what the audience came for.

8. Deciding what to hand the model

One question routes almost every task: can you check the output cheaply? If yes, delegate freely. If no, the model's confident-but-wrong failure mode lands on you.

flowchart TD
  A["a task you could hand to a model"] --> B["can you verify the output instantly?"]
  B --> C["yes: subtitles, translation, variations, reformatting"]
  C --> D["delegate it, you stay the judge"]
  B --> E["no: it is a factual claim"]
  E --> F["check it against a real source first"]
  F --> G["unverified? do not publish it"]
  A --> H["is this the reason people watch you?"]
  H --> I["yes: your view, your expertise. Do not delegate"]

Check your understanding

The lesson ends with a 5-question quiz. Take it in the player above to see your score.

  1. Why can a generative model sound like a confident expert while being wrong?
    • It optimises for plausible continuation, and fluency is independent of accuracy
    • It deliberately hides uncertainty to seem useful
    • It only fails on topics outside its training data
    • Its confidence score is broken and always reads high
  2. What do the tasks generative AI handles best have in common?
    • They involve images rather than text
    • Verification is cheap, so you can instantly tell if the output is right and you stay the judge
    • They are creative rather than mechanical
    • They require no human involvement at all
  3. Which task falls squarely in the dangerous column?
    • Generating 30 title options to pick from
    • Auto-subtitling a video you will read back
    • Asking for a statistic and a study to cite in your post
    • Removing the background from a photo
  4. According to the lesson, when does disclosure of AI use actually become an obligation?
    • Any time any AI tool touched the content
    • Only when the content is monetised
    • Never; it is purely etiquette
    • When a reasonable viewer could be misled about whether something is real, such as synthetic media of real people or events
  5. Why doesn't using generative AI give a creator a lasting competitive advantage?
    • Platforms automatically demote all AI-assisted content
    • Everyone gets the same capability at the same time, so it raises the floor rather than creating an edge
    • The tools are too expensive to use at scale
    • Audiences can always detect AI-assisted content

Related lessons

AI
advanced

Building Something That Holds Up

Given that the tradable-signal path is narrow and hard to evidence, the systems worth building are the ones the first lesson identified: extraction at scale. This lesson covers the engineering that makes them survive audit, the evaluation that does not depend on returns, and the governance obligations that apply once a model touches a regulated process.

8 steps·~12 min
AI
advanced

Where LLMs Actually Fit in a Trading Firm

The popular framing is a model that predicts prices. That is the one job the technology is worst suited to, and it obscures the one it is genuinely good at: turning unstructured text into structured data at a scale that was previously unaffordable. This lesson locates LLMs against the trading stack and rules out the places they cannot go.

8 steps·~12 min
Business
intermediate

Disclosure, Duty, and What an Agent Still Sells

An agent owes duties that AI does not change: accuracy about the property, loyalty to the client, and confidentiality. This lesson covers what has to be disclosed, how generated content interacts with misrepresentation, what happens to the profession as listing content becomes free, and what a client structurally cannot get from a tool.

8 steps·~12 min
AI
intermediate

Explainable AI: The Landscape of Model Explanations

A model that predicts well can still be impossible to justify. This lesson maps explainable AI: interpretable-by-design versus post-hoc, global versus local, model-specific versus model-agnostic. It covers the global workhorses (permutation importance, partial dependence, ICE), faithfulness versus plausibility, and the argument that post-hoc explanation is the wrong tool for high-stakes decisions.

11 steps·~17 min