Screaming Frog SEO Spider 18.4 is a specialized maintenance update to the industry-leading technical SEO auditing software, specifically released on March 16, 2023. While major updates like version 18.0 (codenamed "Willow") introduced significant features like GA4 integration and PDF parsing, version 18.4 primarily focuses on ensuring tool stability and addressing API breaking changes. Core Purpose of the 18.4 Update

Generative Engine Optimization (GEO): A recent "solid paper" titled "GEO: Generative Engine Optimization" by Aggarwal et al. explores how to rank in AI search results. Screaming Frog is the standard tool used to audit the technical factors mentioned in such papers, such as fluency optimization and citation anchoring.

Summary Checklist for a Quick Audit

  1. [ ] Check for 4xx/5xx errors.
  2. [ ] Identify Duplicate/Missing Page Titles.
  3. [ ] Identify Duplicate/Missing Meta Descriptions.
  4. [ ] Verify H1 tags (only one per page).
  5. [ ] Check for broken images (Internal tab > Images).
  6. [ ] Validate Structured Data errors.
  7. [ ] Export "Redirect Chains" report to fix chains (A -> B -> C should be A -> C).

The “Neverb-” in the title can be read as “Never verb.” In grammar, a verb implies action. But an SEO spider’s job is not to act—it is to observe. Screaming Frog does not change your website; it holds up a mirror. Version 18.4 shows you exactly where your HTTP headers are misconfigured, where your canonicals loop, and where your JavaScript blocks the largest contentful paint. It never asks for permission, never sugarcoats, and never forgets a single URL.

specifically labeled "18.4 -Neverb-" (the official sequence moved from 18.3 to version 19), the term likely refers to a community-patched or "portable" version often circulated in non-official forums.

Free vs. Paid: The Free Version allows for crawls up to 500 URLs, while a paid license unlocks unlimited crawling, scheduling, and full API integrations.

B. User-Agent

Go to Configuration > User-Agent.

  • Duplicate: More than one page with the same title/confusing for Google.
  • Missing: Empty tags.
  • Over 65 Characters (Titles) / 160 Characters (Desc): Truncated in search results.