SEOCORE

Abstract

1. Introduction

SEOCore is an enterprise-grade, high-performance SEO auditing and site crawling platform. It combines a concurrent crawler, Cheerio-based scrapers, a declarative Rules Engine, and Graph Theory to analyze link structures, calculate authority scores, track redirects, and score site health across multiple dimensions.

2. Objective

Enterprise-grade, multi-threaded SEO Crawler, Rule Engine, and Link Graph Analyzer. Built in TypeScript for speed, compliance, and deep site health audits.

This project demonstrates how TypeScript can be applied to a real-world Digital Marketing & SEO problem.

3. Key Features / Modules

• Execution Tier System:
• Tiers drive everything from crawl limits to rule selection and scoring behavior
• Fast: Core rules only, 1 page, static HTML
• Standard: + Performance, 100 pages, simulated CWV
• Deep: + All modules, 500 pages, Playwright rendering
• Enterprise: + Plugins, 5000 pages, Lighthouse sampling
• High-Performance Concurrent Crawler:
• Built-in rate-limiting, custom backoff delays, retry policies, and timeout handlers.
• Respects robots.txt directives and extracts URLs from sitemap.xml automatically.
• Path Filtering (Inclusions/Exclusions):

4. Technology Stack

• Runtime: Node.js (v20+) & TypeScript
• Monorepo Manager: Nx Monorepo
• Crawler: Custom HTTP engine powered by Bottleneck (rate-limiting) & p-queue (concurrency)
• Headless Browser: Playwright (optional, for client-side JavaScript rendering)
• HTML Parser: Cheerio (fast server-side DOM selection)
• Validation & CLI: Zod (configuration schema enforcement) & Commander.js
• Test Runner: Vitest

5. System Requirements

General requirements for this technology stack — check the README for exact versions.

• Node.js (LTS) and npm / yarn / pnpm
• VS Code or any code editor
• Git (to clone the repository)

6. Installation & Setup

git clone https://github.com/codepurse/SEOCORE.git
cd SEOCORE

Full setup instructions are in the project README.

7. Future Enhancements

Suggested extensions you can add to make this your own project.

• Export reports to Google Sheets or PDF
• Schedule weekly automated reports
• Add competitor comparison

8. Viva / Review Questions

Common questions examiners ask for projects in this domain.

1. Which marketing or SEO problem does this tool solve?
2. Which data sources or APIs does it use (Search Console, Analytics, social platforms)?
3. Which metrics or KPIs does it report and how are they calculated?
4. How could the output help a business make decisions?
5. How would you schedule it to run automatically?

9. Source Code & License

This project is developed by codepurse and published on GitHub under the MIT License. Please follow the license terms and credit the original author when you use or modify this code.