Denwix SEO Crawler

Denwix SEO Crawler is SEO spider software that runs locally on a Windows PC. It crawls a website much like a search engine bot: you enter your home page URL, and the crawler goes through every link it finds while recording the status code, the page title, the headings and many other details for each URL. The result is a view of the entire site the way Google sees it, presented in a single table. It checks every page for broken links, redirects, weak title tags, heading and canonical issues, and AI search problems, and when the crawl ends it lists the fixes in order of importance. It is built for people doing technical SEO work across a whole site rather than a single page, and the free version crawls up to 1,000 URLs per crawl with no limit on how often you run it. The problem it addresses is scope. SEO tools typically check a single page of a website, but a crawler evaluates all pages of a website and displays the relationship between those pages. That difference matters when a broken link sits on page 400, when a redirect was overlooked by everyone, or when a page has no inbound links at all — issues that a page-by-page checker will never surface. Once a crawl does find those problems, a second problem appears: a list of 2,000 problems is hard to manage. Sorting, prioritising and explaining that list is as much of the job as finding it, which is why the product pairs its audit with a ranked fix plan rather than a raw dump of URLs. Every crawl runs the same audit on both the free version and the paid plans; the only limit on Free is the number of URLs in each crawl. The first group of checks covers response codes and redirects. The crawler records 2xx, 3xx, 4xx and 5xx answers along with timeouts and blocked URLs. It follows every hop of a redirect chain, flags loops, and distinguishes a 301 from a 302. On-page metadata is checked next: page titles and meta descriptions are flagged when they are missing, repeated across URLs, cut off for length or too thin, and headings are checked for missing or repeated H1 tags and skipped heading levels. Because these problems are reported per URL, you can see exactly which pages carry them and how widespread each pattern is. A second group of checks deals with indexing and page-level quality. The crawler examines canonical tags, meta robots and X-Robots-Tag, and reports how they conflict with each other. For images it finds missing, empty or over-long alt text. For content it measures word count and flags thin pages and near-duplicate pages. Link analysis covers crawl depth, inlinks, orphan pages and internal PageRank, so you can see which pages receive no internal links at all. Finally, structured data is validated: JSON-LD that does not parse or that misses required fields is reported. All of these checks run from the same single table, so a fix can be traced from an issue on one URL to the way that URL is linked from the rest of the site. The fix plan is where the findings become work. The crawler sorts the problems into groups and ranks each one by its impact on the site and the effort the fix takes. Every problem is explained in clear words: what it is, why it matters and how to solve it. The plan can be exported as an HTML report, a JSON file or a PDF audit report; the PDF report requires Chrome or Edge, and without either browser the application generates a page that can be printed. A separate AI search audit reads robots.txt the way the robots.txt standard (RFC 9309) describes it and reports the status of all 34 known AI bots. It also scans your llms.txt, the Content-Signals Cloudflare includes in robots.txt, and the structured data on your pages, and it evaluates how easy the main content of each page would be to quote. Training crawlers and AI answer crawlers are listed separately, so you can tell whether a block was intentional and whether it could cost you traffic. Sitemap generation and audit are included on every plan. Under the hood, the product takes a deliberately small approach. The engine is built on Node.js without a single outside npm package, relying only on what Node.js itself offers, such as the built-in SQLite database and fetch. That means no Java, no Docker and no third-party libraries that an attacker could replace with harmful code. Crawl data is kept in a database file inside your Windows user profile, so you can delete, rename, export or import your crawls whenever you need, and because the crawler runs on your own computer it can also reach staging sites and pages behind a firewall. The free version requires no account. Licence keys are checked offline: Denwix holds the Ed25519 private key used to sign every licence key, the matching public key lives inside the application, and at launch the app verifies your key locally with no login and no remote server. The application connects to denwix.com only to check for updates once a day on opening and to ask whether the key tied to a claim code is available after a purchase; it collects no telemetry. Premium features that use external services such as PageSpeed Insights or an AI model send requests directly from your PC to those services, and no AI-related activity happens before you enter your own API key. The benefits follow from those choices. Crawls run as often as you like within the URL limit, and a crawl can be paused, resumed or stopped at any moment while results fill the tabs live. Data stays local, so there is no service to log into and no crawler vendor holding a copy of your site's structure. The fix plan turns a large issue list into an ordered set of tasks, which is the difference between a report nobody reads and a queue of work someone can start on. Politeness controls protect the server being crawled: the crawler leaves a pause after each request, it slows down when a server says it has too many requests (429), is unavailable (503) or keeps answering with forbidden errors (403), and you can set the crawl speed and the number of threads. Concrete uses include a full technical SEO audit of a site, where the crawler surfaces redirect chains, mixed content, heading level jumps and missing canonicals in one place instead of one page at a time. A team working on a staging site can crawl it directly from a Windows PC because the crawler runs on the machine and can reach every site that computer can open, including local and staging sites that need no password. Anyone concerned about AI search can use the AI search audit to see which of the 34 known AI bots robots.txt allows or blocks and to separate training bots from answer bots. Premium users can render JavaScript-heavy pages with Chrome or Edge and compare the rendered page with the raw HTML, run custom search and custom extraction, compare two crawls to see what changed, and schedule crawls that e-mail reports. Agencies can turn the same findings into white-label PDF and HTML reports carrying their own company name, logo, colour and contact line. The product is aimed at anyone who does technical SEO on their own machine: solo consultants, in-house SEOs and development teams who want crawler data without uploading a site to a third-party service. System requirements are a 64-bit Windows 10 (version 1809 or higher) or Windows 11 PC; JavaScript rendering, screenshots and the PDF report also need Google Chrome or Microsoft Edge. Connections to Search Console, GA4, Moz, Majestic and Ahrefs are in beta, having been tested with sample data rather than real accounts, and an MCP server for AI assistants plus API access are Premium features. Pricing is clear: Free costs nothing and crawls 1,000 URLs per crawl with one seat; Premium is 150 USDT a year for one seat and adds unlimited URLs, JavaScript rendering, all 600+ bulk exports, scheduling and e-mail reports, crawl comparison, PageSpeed Insights, Search Console and GA4 data, MCP and API access, custom search and extraction, and external link checking; Agency is 399 USDT a year with unlimited seats, white-label reports and priority email support. Both licences last one year, are paid in USDT or via Binance Pay, and every new version is free to download. After a year the app returns to the 1,000-URL free limit with saved crawls intact. The app is Windows-only and English-only, with no macOS or Linux build yet. Denwix SEO Crawler is a focused technical SEO tool rather than a platform. It crawls a site the way a search engine bot does, records what it finds URL by URL, ranks the problems by impact and effort, and explains each fix in plain English, while keeping every byte of crawl data on the Windows PC that produced it. The free tier crawls 1,000 URLs per crawl with no sign-up and no expiry, and the paid tiers remove the URL limit and add rendering, scheduling, comparison and white-label reporting. For teams that want an affordable, local, offline-licensed alternative to desktop crawlers, the offer is straightforward: install it, enter a home page, and read the ranked fix plan.