Content QA

Content quality audit

This audit ranks live prompt issues, generated-vault review pressure, source-language seed gaps, media readiness, and duplicate pattern risk so content work can be prioritized like product work.

Live prompts

942

39 playable tests

Generated vault

12,200

1,422 sampled candidates

Issues

19

0 blocker, 11 watch

Media

697

0 seed records need media

Open response

177

Speaking and writing prompts

Duplicates

16

Repeated prompt-stem groups

Action queue

What to fix first

Generated guardrails

Vault QA state

12,200

generated records

12%

review sample rate

378

materialized seeds

0

largest seed gap

Core grammar control

highest-priority family

Top issues

Highest-risk prompts and queues

watchduplicate patternListeningB2

Repeated prompt stem across tests

"Listen to the speaker. What is implied?" appears in 7 live prompt instances. Some repetition is useful, but high repetition can make the catalog feel thin.

Inspect

Keep the diagnostic pattern, but vary the stem, scenario, image, or source-language trap.

watchduplicate patternPronunciationA1

Repeated prompt stem across tests

"Did you hear ship or sheep?" appears in 7 live prompt instances. Some repetition is useful, but high repetition can make the catalog feel thin.

Inspect

Keep the diagnostic pattern, but vary the stem, scenario, image, or source-language trap.

watchduplicate patternReal lifeB2

Repeated prompt stem across tests

"You need to reschedule an appointment. Say what you need in 1-2 sentences." appears in 6 live prompt instances. Some repetition is useful, but high repetition can make the catalog feel thin.

Inspect

Keep the diagnostic pattern, but vary the stem, scenario, image, or source-language trap.

watchduplicate patternReal lifeB1

Repeated prompt stem across tests

"You need to reschedule an appointment. What should you say next?" appears in 6 live prompt instances. Some repetition is useful, but high repetition can make the catalog feel thin.

Inspect

Keep the diagnostic pattern, but vary the stem, scenario, image, or source-language trap.

watchduplicate patternVocabularyB2

Repeated prompt stem across tests

"Which phrase sounds natural in everyday English?" appears in 6 live prompt instances. Some repetition is useful, but high repetition can make the catalog feel thin.

Inspect

Keep the diagnostic pattern, but vary the stem, scenario, image, or source-language trap.

watchduplicate patternNaturalnessA2

Repeated prompt stem across tests

"Which sentence sounds most natural?" appears in 7 live prompt instances. Some repetition is useful, but high repetition can make the catalog feel thin.

Inspect

Keep the diagnostic pattern, but vary the stem, scenario, image, or source-language trap.

watchduplicate patternNaturalnessB1

Repeated prompt stem across tests

"You want to talk about a picture you captured on your phone." appears in 7 live prompt instances. Some repetition is useful, but high repetition can make the catalog feel thin.

Inspect

Keep the diagnostic pattern, but vary the stem, scenario, image, or source-language trap.

watchduplicate patternGrammarA2

Repeated prompt stem across tests

"I lost my keys and I am trying to find them. I am looking ___ them." appears in 7 live prompt instances. Some repetition is useful, but high repetition can make the catalog feel thin.

Inspect

Keep the diagnostic pattern, but vary the stem, scenario, image, or source-language trap.

watchduplicate patternGrammarA1

Repeated prompt stem across tests

"I bought ___ new book yesterday. It looks useful." appears in 7 live prompt instances. Some repetition is useful, but high repetition can make the catalog feel thin.

Inspect

Keep the diagnostic pattern, but vary the stem, scenario, image, or source-language trap.

watchduplicate patternListeningB1

Repeated prompt stem across tests

"What did you hear?" appears in 7 live prompt instances. Some repetition is useful, but high repetition can make the catalog feel thin.

Inspect

Keep the diagnostic pattern, but vary the stem, scenario, image, or source-language trap.

watchduplicate patternListeningB2

Repeated prompt stem across tests

"Listen to a reviewer comment. What does the speaker imply?" appears in 7 live prompt instances. Some repetition is useful, but high repetition can make the catalog feel thin.

Inspect

Keep the diagnostic pattern, but vary the stem, scenario, image, or source-language trap.

polishduplicate patternBusiness EnglishC1

Repeated prompt stem across tests

"A teammate missed a deadline and you need the file today. Write a 2-3 sentence reply." appears in 5 live prompt instances. Some repetition is useful, but high repetition can make the catalog feel thin.

Inspect

Keep the diagnostic pattern, but vary the stem, scenario, image, or source-language trap.

polishduplicate patternPronunciationA2

Repeated prompt stem across tests

"Read aloud: Please check the address before you confirm." appears in 3 live prompt instances. Some repetition is useful, but high repetition can make the catalog feel thin.

Inspect

Keep the diagnostic pattern, but vary the stem, scenario, image, or source-language trap.

polishduplicate patternGrammarB1

Repeated prompt stem across tests

"The visitor depends ___ the delay." appears in 3 live prompt instances. Some repetition is useful, but high repetition can make the catalog feel thin.

Inspect

Keep the diagnostic pattern, but vary the stem, scenario, image, or source-language trap.

polishduplicate patternGrammarB1

Repeated prompt stem across tests

"She explained me the rule." appears in 4 live prompt instances. Some repetition is useful, but high repetition can make the catalog feel thin.

Inspect

Keep the diagnostic pattern, but vary the stem, scenario, image, or source-language trap.

polishduplicate patternReal lifeB1

Repeated prompt stem across tests

"Craft a hotel room change request using I can / send / the update / by Friday." appears in 4 live prompt instances. Some repetition is useful, but high repetition can make the catalog feel thin.

Inspect

Keep the diagnostic pattern, but vary the stem, scenario, image, or source-language trap.

polishsurface reuse

daily surface has promotion pressure

3,050 generated drafts target this surface, with 720 sampled candidates.

Inspect

Promote sampled drafts that strengthen this reusable product surface.

polishsurface reuse

funnel surface has promotion pressure

4,068 generated drafts target this surface, with 555 sampled candidates.

Inspect

Prioritize catchy, visual, low-friction prompts that can survive paid traffic.

Buckets

Risk categories

Duplicate pattern pressure

0 blocker, 11 watch, 5 polish

16

Example: Repeated prompt stem across tests

Surface reuse

0 blocker, 0 watch, 3 polish

3

Example: test surface has promotion pressure

Live tests

Test risk ranking

Is your English B2 or just confident B1?

60 prompts / risk score 48

Open test

15

issues

11

watch

0

ambiguity

15

duplicates

0

explanations

Top issue: Repeated prompt stem across tests

Are your work emails clear or just translated?

14 prompts / risk score 1

Open test

1

issues

0

watch

0

ambiguity

1

duplicates

0

explanations

Top issue: Repeated prompt stem across tests

Are you ready for B2 First, C1 Advanced, or C2 Proficiency?

24 prompts / risk score 0

Open test

0

issues

0

watch

0

ambiguity

0

duplicates

0

explanations

Are you ready to work in English?

28 prompts / risk score 0

Open test

0

issues

0

watch

0

ambiguity

0

duplicates

0

explanations

Are your prepositions secretly terrible?

24 prompts / risk score 0

Open test

0

issues

0

watch

0

ambiguity

0

duplicates

0

explanations

Can you handle real life in English?

24 prompts / risk score 0

Open test

0

issues

0

watch

0

ambiguity

0

duplicates

0

explanations

Can you keep speaking in English?

24 prompts / risk score 0

Open test

0

issues

0

watch

0

ambiguity

0

duplicates

0

explanations

Can you make English clear and sharp?

24 prompts / risk score 0

Open test

0

issues

0

watch

0

ambiguity

0

duplicates

0

explanations

Can you pass a 30-minute English interview?

14 prompts / risk score 0

Open test

0

issues

0

watch

0

ambiguity

0

duplicates

0

explanations

Can you push back without sounding rude?

24 prompts / risk score 0

Open test

0

issues

0

watch

0

ambiguity

0

duplicates

0

explanations

Can you read English without missing the point?

24 prompts / risk score 0

Open test

0

issues

0

watch

0

ambiguity

0

duplicates

0

explanations

Can you survive 5 minutes of American small talk?

14 prompts / risk score 0

Open test

0

issues

0

watch

0

ambiguity

0

duplicates

0

explanations

Skill risk

Skill areas to review

Listening

3 issues across 142 prompts

12

Repeated prompt stem across tests

Grammar

4 issues across 138 prompts

10

Repeated prompt stem across tests

Real life

3 issues across 133 prompts

9

Repeated prompt stem across tests

Naturalness

2 issues across 146 prompts

8

Repeated prompt stem across tests

Pronunciation

2 issues across 81 prompts

5

Repeated prompt stem across tests

Vocabulary

1 issues across 105 prompts

4

Repeated prompt stem across tests

Business English

1 issues across 74 prompts

1

Repeated prompt stem across tests

Exam readiness

0 issues across 36 prompts

0

Reading

0 issues across 44 prompts

0

Speaking

0 issues across 28 prompts

0