# Content Analysis and Quality Score Prompt

**URL:** <https://community.openai.com/t/content-analysis-and-quality-score-prompt/259796>\
**Category:** Prompting\
**Tags:** chatgpt, prompt\
**Created:** [June 11, 2023, 5:17pm UTC](https://community.openai.com/t/content-analysis-and-quality-score-prompt/259796 "2023-06-11T17:17:49Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![MarkFulton](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/markfulton/32/150925_2.png) [@MarkFulton](https://community.openai.com/u/MarkFulton)\
**Post date:** [June 11, 2023, 5:17pm UTC](https://community.openai.com/t/content-analysis-and-quality-score-prompt/259796/1 "2023-06-11T17:17:49Z")

</div>

With tons of copywriting tools available powered by various LLMs, I wanted to create a prompt that would analyze a piece of content for quality and assign a score rating from 0-10.

## What this Prompt Can Be Used For

You can use this content analysis prompt to..

- Compare results from different copywriting services
- Find out which prompts are working best
- Compare different LLMs
- Analyze your content for quality control

# Content Analysis + Quality Score Prompt

> Assume the role of an expert in logical reasoning and AI content evaluation. Your task is to critically analyze and rate this AI-generated response for its logical consistency and overall quality. The response provided was generated for a request to “**[SPECIFIC GOAL OF THE ORIGINAL PROMPT]**.” Assess the response for any fallacies or inaccuracies in the logic, as well as the coherence, clarity, and relevance. Based on your assessment, assign the response a numerical score ranging from 0 (poor quality) to 10 (excellent quality).
> 
> Here is the response for evaluation:
> 
> “”"  
> **[CONTENT]**  
> “”"

Simply fill in the specific intended goal or prompt that the content came from and paste the content to get your analysis.

## How Would You Improve the Prompt?

I would **love any feedback** on the analysis prompt and **suggestions to improve** it so that we have a valuable tool to compare and rank the quality of responses.

---

<div class="post-metadata">

**Author:** ![EricGT](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/ericgt/32/20571_2.png) [@EricGT](https://community.openai.com/u/EricGT)\
**Post date:** [June 11, 2023, 5:36pm UTC](https://community.openai.com/t/content-analysis-and-quality-score-prompt/259796/2 "2023-06-11T17:36:14Z")

</div>

> [@MarkFulton](#):
>
> I would **love any feedback** on the analysis prompt and **suggestions to improve** it so that we have a valuable tool to compare and rank the quality of responses

Have you completed this free course?

> **[Building Systems with the ChatGPT API](https://www.deeplearning.ai/short-courses/building-systems-with-chatgpt/)**
>
> Level up your use of LLMs. Learn to break down complex tasks, automate workflows, chain LLM calls, and get better outputs.

I think the [section](https://learn.deeplearning.ai/chatgpt-building-system/lesson/10/evaluation-part-ii) on [rubric](https://en.wikipedia.org/wiki/Rubric_(academic)) applies to what you seek.

---

<div class="post-metadata">

**Author:** ![MarkFulton](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/markfulton/32/150925_2.png) [@MarkFulton](https://community.openai.com/u/MarkFulton)\
**Post date:** [June 11, 2023, 5:46pm UTC](https://community.openai.com/t/content-analysis-and-quality-score-prompt/259796/3 "2023-06-11T17:46:49Z")

</div>

> [@EricGT](#):
>
> I think the [section](https://learn.deeplearning.ai/chatgpt-building-system/lesson/10/evaluation-part-ii) on [rubric](https://en.wikipedia.org/wiki/Rubric_(academic)) applies to what you seek.

Thank you very much. There are some helpful prompt instructions there I could include. Thank you for sharing!

---

<div class="post-metadata">

**Author:** ![thinktank](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/thinktank/32/139231_2.png) [@thinktank](https://community.openai.com/u/thinktank)\
**Post date:** [June 13, 2023, 12:21am UTC](https://community.openai.com/t/content-analysis-and-quality-score-prompt/259796/4 "2023-06-13T00:21:28Z")

</div>

What if you gave it a bit more context on what “quality” meant?

I think you would get more consistent results if you gave it more information about your rating criteria.

I would actually work out the criteria with It. (Do you capitalize “It” in this context?) Maybe figure out some objective and subjective qualifiers. Logical soundness and validity are straight forward enough. But maybe you can explain more about “relevance?” (Relevant to what, exactly?)

I am sure you can come up with some great criteria if you spend some time conversing over what [epistemological values](https://en.wikipedia.org/wiki/Epistemology) you want your prompt to consistently evaluate for. Then have it help you parse those values down to as few words as possible. Either include them in every prompt, or remind it frequently.

Anyway, I think if you don’t include more about how you want to evaluate that score, it’s own criteria will, uh, “float,” from one conversation to the next since it always likes to change things up.

---

<div class="post-metadata">

**Author:** ![MarkFulton](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/markfulton/32/150925_2.png) [@MarkFulton](https://community.openai.com/u/MarkFulton)\
**Post date:** [June 13, 2023, 1:53am UTC](https://community.openai.com/t/content-analysis-and-quality-score-prompt/259796/5 "2023-06-13T01:53:31Z")

</div>

> [@thinktank](#):
>
> Maybe figure out some objective and subjective qualifiers. Logical soundness and validity are straight forward enough. But maybe you can explain more about “relevance?” (Relevant to what, exactly?)

Thank you for your insight. That is definitely an area that could be improved in the prompt. This is why I added the first variable (original prompt request), but you’re right I think relevance and other scoreable values could be defined better.

---

<div class="post-metadata">

**Author:** ![basham.eric](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/basham.eric/32/175640_2.png) [@basham.eric](https://community.openai.com/u/basham.eric)\
**Post date:** [July 27, 2023, 9:55pm UTC](https://community.openai.com/t/content-analysis-and-quality-score-prompt/259796/6 "2023-07-27T21:55:13Z")

</div>

Maybe some gems to be mined from methods and frameworks of qualitative data analysis?  
gradcoach qualitative-data-analysis-methods

My second thought is measuring “conciseness” or “fluff” ratios re: 8bitcontent fluff-in-writing  
using a tool like:  
hemingwayapp
