AI Detection Tools – Deep Dive into Winston AI

Jonatan Parski CEO

Do you want to take your content to the next level? Our crew can help! Request a free sample of 5,000 words, or speak with a founder.

Facebook
Twitter
LinkedIn
WhatsApp
AI Detection Tools - Deep Dive into Winston AI

AI is gaining traction across multiple industries, but none as much as content creation. However, this also comes with ethical issues and other concerns. While using AI generators can be a great way to gain inspiration and streamline certain aspects of the creation process, there are also limitations. Using AI generators to create articles or content can be unethical in certain situations. For example, when students need to submit essays or papers to demonstrate their understanding of certain topics or if a client pays for original work.

As we started setting up our test for AI detection tools, we started with research into some of the most highly recommended options. We consulted multiple best-of articles on the topic and cross referenced the options that appeared multiple times across different articles. Winston AI was a surprising find. It was surprising because I hadn’t come across the tool before and yet it seemed to be one of the top contenders in most review articles. After seeing that, I just knew it had to be included in our test.

Winston AI Logo

Overview of the Tool

Winston AI is a relative newcomer to the AI detection scene. The tool was launched in February 2023. Originally it  was mainly geared towards the education sector. However, since then it’s expanded to include other markets as well. Now, Winston AI markets itself to writers, educators, and web publishers.

The developers at Winston AI are confident that the tool can accurately detect content created through tools like ChatGPT, Copilot, Gemini (previously Google Bard), and many other large language models (LLMs). 

The co-founder has also stated that the primary goal of Winston AI is to ensure that writing is authentic and original. As such, they don’t offer features like humanizers or paraphrasers, but rather aim to detect content even if these tools have been used. As such, the additional features included with the tool is a plagiarism checker and chrome extension. 

The AI detector was trained on various large datasets used to train AI generators like ChatGPT, GPT-4, Gemini, and others. However, the developers make a point to note that the dataset used has been human reviewed. They claim this helps to remove more inaccuracies and biases than many competitors. We can respect the value in this notion.

The tool is also updated on a weekly basis to ensure it remains at the forefront of what AI detectors should be able to do. We haven’t come across any other tools that are transparent about how frequently they update their algorithms. Some might even argue that this is one of the reasons why Winston AI has been able to rise through the ranks so quickly, becoming a top contender in only one year.

Winston AI Dashboard
A look at Winston AIs dashboard.

Key Features of the Tool

Winston AI is focused on its AI detector. As such, there aren’t too many other features that would distract developers from focusing on improving the accuracy of the tool. Since it was originally created with educators in mind, it offers numerous features geared towards evaluating submitted content. Let’s take a look at some of the features that Winston AI offers users.

AI Content Detector

The AI detector will give a human score percentage when evaluating content. Aside from giving the score in a percentage format, you’ll also receive a readability score that indicates how complex your content is to read. The tool also gives you a sentence breakdown showing you which sentences were detected as AI so that they can be adjusted or improved. Another benefit of this AI detector is its OCR capabilities. This means that users can upload documents, images, and handwritten texts for evaluation. 

Plagiarism Checker

Winston AI also offers a plagiarism checker, further cementing itself as a tool for educators, editors, or content managers. The plagiarism checker is able to detect any instances where written work has been plagiarized. It also gives the user the source of the plagiarism, along with highlighting the content that’s plagiarized.

Chrome Extension

Winston AI also now offers an extension that can be installed on your Chrome browser. This gives users even more flexibility when evaluating content. With this extension enabled, you can quickly check any content you come across on the web for the use of AI. This can be useful if you need to evaluate your own website for AI content, in order to avoid being penalized in search results.

Word and Character Counter

Another testament to the origins of the tool, you’ll be able to use the tool to check the word count of submitted articles. This makes it easy to ensure that any submitted work falls within any set word count requirements or restrictions.

Pricing

Winston AI has a free and paid version. However, the free version is limited to only 2000 words. We also haven’t noticed that this limitation is renewed at the end of the month. When I checked back a month after our initial test of the free version, I still had no credits to run additional tests. As such, it’s really more of a limited trial than a free version. 

However, it should be noted that the free version still offered the OCR features which means you could upload documents, images, or handwritten texts for evaluation. The tool also offers both email and live chat support on the free version. As such, it’s a good way for people to get an idea of how the AI detector functions before buying the paid version.

The paid version removes many of the restrictions. On the entry-level paid plan, users can scan up to 80 000 words per month. You’re also still able to utilize the OCR features to scan documents, images, and handwritten text. The only additional feature that becomes available is the ability to download the results in a PDF report.

Now, if you’re wondering with which package the plagiarism checker and word counter comes in, these tools are available on any plan. However, using the plagiarism checker will contribute to your word count for the month.

Results of the Test

In order to test all of the AI detection tools and ensure everyone was given a fair chance to perform, we created our own dataset and testing methodology. This ensures we have full control over the content being tested to provide the best overview of how the tool will perform in real-life situations.

Our methodology included generating AI articles using ChatGPT, alongside articles written by our own in-house writers, as well as articles created using ChatGPT but edited by a human. No AI humanisers or paraphrasers were used and the edited articles weren’t put through an AI detector and corrected from there. This was essential for us as we wanted untampered results as much as possible.

Let’s take a look at how Winston AI performed in our independent test.

Accuracy

In order to calculate the accuracy of the AI detector we calculated the percentage of predictions that were identified correctly. However, it should be noted that this accuracy on its own doesn’t give a full picture of how reliable the tool is. 

During our testing, Winston AI was able to identify most of the instances correctly, with only a few false positives and no false negatives. The false positives were mostly identified in articles that had a slightly more complex and technical topic. 

Winston AI had an accuracy score of 83.33%.

Precision

Precision is another key metric when evaluating the overall reliability of AI detection tools. The higher the precision, the less false positives were identified. A false positive is when the tool incorrectly labels human written content as AI generated. This has turned out to be a major issue with AI detectors as this can lead to false accusations. While Winston AI performed well in its accuracy tests, there were a number of false positives which have led to a lower precision score. 

During our testing, the tool received a precision score of 75%.

Recall

Recall focuses on how many false negatives the tool identified. A false negative occurs when AI content bypasses the AI detectors and is identified as human-written content. This can cause a big issue if original content is required, or the use of AI generators is prohibited. Search engines also penalize websites for posting AI content, so having a detector miss instances of AI can be detrimental.

Winston AI didn’t identify any false negatives and ended with a recall score of 100%.

F1-Score

The F1-score is an important metric when it comes to evaluating multiple AI detectors. This score doesn’t only consider a single metric, but gives a more balanced overview of the true reliability and overall accuracy of the tool.

Winston AI had an F1-score of 85.71% in our independent test.

Winston AI Checker
A screenshot showing Winston AIs Detector in action.

Pros and Cons

Let’s take a look at the pros and cons of Winston AI: 

Pros

  • Fairly accurate
  • Ability to scan and upload documents, pictures, and handwriting
  • Additional features suited to educators, editors, and content managers

Cons

  • Limited word count on free version
  • Picked up slightly more false positives than other leaders

Our Opinion

Throughout our test of Winston AI we concluded that as far as AI detectors go, this one is fairly accurate when compared to competitors. It was a decent tool to use for identifying AI content and the additional features make it a good option for educators, content managers, and writers.

However, we also noticed that the tool did have a few false positives. This had a notable effect on the tool’s precision. In turn, this led to a lower F1-score. None of this is exactly new or odd when it comes to AI detection tools. These tools are notorious for not being 100% reliable, and these thoughts have been corroborated by developers themselves.

As such, we feel Winston AI can be a good tool to use for detecting AI alongside other measures. None of the tools we’ve come across have shown that they can be a reliable measure for detecting AI on their own. As such, we recommend that you use other measures alongside Winston AI to ensure original content.

We must admit though that we respect how much effort the developers at Winston AI put into their tool. Raising through the ranks and solidifying a spot as one of the best AI detectors in little more than a year is impressive. We hope they continue to invest as much time into the tool and we’re excited to see where they go from here.

Final Thoughts

AI detection is becoming a growing concern in the content creation sector. While many businesses strive to keep their content original and free from any AI influences, others can see the value that AI can have when it comes to the planning and research phases. However, we can all agree that using AI to generate complete articles without any human intervention isn’t recommended. AI detection tools offer a simple way to keep this from happening if only their reliability was better.
If you’re in need of human written content that won’t be penalized in search results for AI, then consider reaching out to Captain Words. At Captain Words we emphasize the importance of original content optimized for SEO.

Share This Article

Facebook
Twitter
LinkedIn
WhatsApp

Leri Koen

After spending several years in the fields of Education, Child Development, and Hospitality, Leri decided to embrace her passion for content. Today, she is helping businesses grow digitally through her skills as a content specialist.

Get 5,000 Words Free!

Contact our team to find out how we can help you scale your content to reach a global audience!

Get 5,000 Words Free!

We’d love to show you how our team of passionate writers can help boost your ROI and improve your content. Just fill out the form below for a free, no obligation sample!