AI Detection Tools – Deep Dive Into Content at Scale

Jonatan Parski CEO

Do you want to take your content to the next level? Our crew can help! Request a free sample of 5,000 words, or speak with a founder.

Facebook
Twitter
LinkedIn
WhatsApp
AI Detection Tools - Deep Dive Into Content at Scale

With the rise of AI in various industries, as a content creation agency, we set out to evaluate how effective AI detection tools are. Since these are tools that can be very beneficial to ensure our work is original and human created, we’ve been interested in using them from the start. However, we don’t want to falsely accuse our writers of using AI generation tools because the detection ones aren’t accurate.

We set out to test these AI detectors for ourselves and see how accurate they truly are. Content at Scale is one of the tools that comes highly recommended when consulting numerous best-of articles on AI detection tools. Aside from that, this is also one of the tools that we’ve used for testing articles our writers submit. As such, we were already quite familiar with it, and after seeing it highly recommended, we had to include it in our own test.

Content at Scale Logo 2

Overview of Content at Scale

Content at Scale was first launched in September 2022. Content at Scale doesn’t only focus on creating an accurate AI detection tool, but rather an entire content production solution. Part of their goal is embracing the benefits of AI in content creation without risking your reputation or regurgitating the same old AI generated output.

They have a dedicated team that consists of individuals with backgrounds in content creation, marketing, writing and SEO. This becomes apparent when you start looking at the tool and who they cater to. Their solutions are clearly marketed towards marketing executives, content agencies, writers, and large site publishers.

As mentioned, Content at Scale offers more than just an AI detector. A key part of the solution they offer is their generative AI tool that helps to create human-like content that doesn’t get picked up as AI by detection tools. We didn’t test this part of their offering as that would require a separate test. 

When it comes to their AI detector, which is what we tested, Content at Scale is very open about how their tool is trained. We love it when tools are transparent about their training models! In this case, Content at Scale’s AI detector is trained on a wide range of content formats that include blog posts, Wikipedia entries, essays, and other online articles alongside multiple large language models (LLMs). The tool claims to be able to detect content created with tools like ChatGPT, GPT-4, Bard, Claude, and Gemini.

Content at Scale Dashboard 2
Content at Scale’s dashboard.

Key Features of Content at Scale

AI detection tools, especially those with a paid subscription, often offer multiple features that add to how useful the tool can be. In some cases, these can be additional tools to improve your writing and remove AI instances, or it can be features like grammar or fact checkers. Before we dive straight into how Content at Scale performed in our testing, let’s take a look at some of the key features of the tool. 

Generative AI

Content at Scale offers an AI generator that can create SEO optimized content based on a keyword or prompt. The tool is trained on other popular AI generators to provide impressive content that’s thorough and high quality. You’re able to use the tool to improve your existing content by only rephrasing certain sections, or you can create whole articles using your own prompts and instructions. The tool also has AI agents that are able to generate specialized content.

RankWell SEO Optimizer

Another useful feature of Content at Scale is their proprietary RankWell suite. Working directly within the tool you immediately gain access to a number of powerful SEO tools. For a start, you can use the tool to research keywords and identify topic clusters. This enables you to find ranking opportunities without having to switch between different third party tools. 

AI Detector

The AI detector, the main reason for our test, is included in Content at Scale’s suite of content creation tools. The detector provides a simple scoring which provides a percentage as well as a clarification on whether the content is AI, human written, or if it sounds AI. The tool further breaks down the results sentence by sentence so that you can see exactly which sections sound robotic. This enables you to address those sections to make it more human.

AI Humanizer

Another important feature of Content at Scale is their AI humanizer. Once you’ve tested your content for AI you can use this tool to rewrite any section identified as AI. The humanizer is also useful if you need to create bulk articles and don’t mind using AI generators, but don’t want to be penalized in search results. However, as with any tool, this might require further testing to evaluate its efficacy.

Pricing

The AI detector has a free version that can be very useful for quickly testing an article for AI. However, the free version is limited to only 2500 words per scan. This means you might have to run longer articles through the tool in batches. The free version does display whether the content is human or AI generated, but doesn’t display a percentage like the paid version.

The free version will also highlight the sentences in colors so that you can see where the tool picked up AI content so that you can adjust your content sentence by sentence. With the paid version, this becomes automated as you can use the humanizer to adjust the sentences picked up as AI.

Depending on the volume of work that you’ll need the tool to cover, costs start from $49/month for the Generative AI plan. This plan includes the AI generator, and AI detector, humanizer.

Results of the Test

We used our very own dataset along with our testing methodology to evaluate all of the tools in our list. Our methodology included creating all of the test articles in-house. We used human-written pieces created by our experienced writers, alongside articles generated with ChatGPT, and an additional set that was created with ChatGPT and edited by one of our editors. 

We didn’t use AI based humanizers to change or adjust the edited content. We also didn’t put the text through an AI detector and then make changes based on the results. This ensures we have untampered results.

Content at Scale AI Detector 1
Content at Scale’s AI detector in action.

Let’s take a look at how Content at Scale performed in our independent testing.

Accuracy

The accuracy of an AI detector is calculated as a percentage of the predictions that were identified correctly. However, on its own this metric doesn’t give you a full picture of how reliable a tool really is as it doesn’t take precision or recall into account. 

Content at Scale was able to correctly identify the bulk of our test articles, with only a few positives. However, there were quite a number of articles that the tool struggled to identify whether AI was used or not. This was especially apparent in the articles that were generated using an AI tool and was then edited by a human. In these cases, the tool detected just over 50% of AI content. While borderline, it detected enough to be classified as a true positive. However, this is something to be wary of, as it indicates that the tool can be fooled.

During our independent test, Content at Scale scored 91.67% for accuracy.

Precision

The precision of an AI detection tool demonstrates that fewer false positives were identified. This is crucial as incorrectly labeling content as AI generated when it was written by a human can cause false accusations. This has become transparent in news headlines, especially in the academic sector, where students and teachers wrestle with the reliability of these tools. Content at Scale performed quite well when it came to precision. However, there were still a few instances where articles were wrongfully identified as AI.

This led to the tool scoring a 85.71% precision in our independent testing.

Recall

Recall demonstrates how many false negatives the tool identifies. Ideally you don’t want the tool to identify AI as human written as that just goes against the whole goal and intention of using the tool. When it came to recall, Content at Scale performed remarkably well. There were absolutely no false negatives.

This means that the AI detection tool had a 100% recall.

F1-Score

The F1-score is the true representation of how reliable and accurate an AI detection tool really is. The F1-score combines precision and recall into a single metric. This gives a much more balanced overview of the reliability of the tool, especially when comparing multiple tools. When it came to the F1-score, Content at Scale performed very well.

Due to the high precision and recall scores, the final F1-score was 92.31%.

Pros and Cons

Let’s take a look at the pros and cons of Content at Scale’s AI detection tools: 

Pros

  • Accurate AI detection 
  • Many useful content creation features (AI-based)

Cons

  • Expensive
  • Free version is limited

Our Opinion on Content at Scale

From the results of our independent test we discovered that Content at Scale is a fairly accurate tool to use in the process of identifying AI content. However, we also saw that the tool isn’t 100% accurate all the time. This means that there are a few miss identified results which could lead to false accusations.

From what we’ve seen, and from reports corroborated by other industries, no AI detector is currently 100% accurate. From our experience, even a good F1-score of 92.31% leaves too much margin for error.

As such, we recommend not relying solely on the results of any AI-detector. Rather, we feel it can be used alongside other tools and real human experience to narrow down the odds of content being created by AI.

As far as reliable options for AI detection goes, Content at Scale is currently one of the best tools to use. Their full suite of features also make them a great option for content creators, writers, and marketers.

Final Thoughts

AI is starting to influence many different industries. While these tools can be beneficial when it comes to inspiring writers to create high quality work there are limitations. Similarly, the tools used to identify AI content is just not yet accurate enough for us to rely on completely. 
If you’re looking for a content agency that’s at the forefront of AI development, that still creates human written content, reach out to Captain Words.

Share This Article

Facebook
Twitter
LinkedIn
WhatsApp

Leri Koen

After spending several years in the fields of Education, Child Development, and Hospitality, Leri decided to embrace her passion for content. Today, she is helping businesses grow digitally through her skills as a content specialist.

Get 5,000 Words Free!

Contact our team to find out how we can help you scale your content to reach a global audience!

Get 5,000 Words Free!

We’d love to show you how our team of passionate writers can help boost your ROI and improve your content. Just fill out the form below for a free, no obligation sample!