What This OKF Bundle Generator Tells You graphic
What This OKF Bundle Generator Tells You

The Free OKF Bundle Generator scans your domain, sitemap, llms.txt file, or raw text, to extract your core web pages and convert them into clean Markdown concept files. 

These files are packaged inside a downloadable Open Knowledge Format (OKF v0.1) bundle that you can host on your website, allowing easy access to human users and AI agents.

At the same time, this tool audits your AI Knowledge Base Readiness to expose technical bottlenecks like heavy JavaScript dependency or missing schema. These gaps may prevent AI crawlers from accurately retrieving key concepts about your brand or product.

Why Open Knowledge Format (OKF) Matters for AI Accessibility graphic
Why Open Knowledge Format (OKF) Matters for AI Accessibility

Traditional search engines rely on rendered HTML, but AI agents operate best on structured, token-efficient Markdown.

AI assistants are most helpful when they have the right context to work with. Open Knowledge Format (OKF v0.1) lets you structure your knowledge, allowing AI to reference important concepts to build the necessary context for tasks and answers.

Combining an OKF bundle with a well-structured llms.txt file gives AI agents an instant, high-density source of truth about your products, data, and brand authority.

How Does the OKF Bundle Generator Transform Your Site into AI-Ready Knowledge graphic
How Does the OKF Bundle Generator Transform Your Site into AI-Ready Knowledge

The generator scans your site architecture and performs these actions:

  • Markdown Concept File Conversion: Automatically transforms web pages into clean Markdown files labeled by specific entity types (Organization, Product, Article, Category, or Tool) complete with auto-generated structured data.
  • Internal Link Graph Mapping: Tracks and quantifies internal link connections across sampled pages so AI engines have a clear representation of how your site's concepts connect to one another.
  • JavaScript Reliance Audit: Detects whether critical text is rendered dynamically via client-side JavaScript, hindering AI crawlers.
  • Structured Data & Entity Verification: Scans for JSON-LD and structured entity metadata, highlighting missing markup that could obscure key business details from search and LLM models.
Understanding Your AI Knowledge Base Readiness Score graphic
Understanding Your AI Knowledge Base Readiness Score

Your scan generates an overall AI Knowledge Base Readiness Score rated from 0 to 100 based on structured data presence, metadata, text clarity, and script reliance:

  • 70 – 100 (AI-Ready): Ideal formatting. Your content is clean, structured data is present, and AI agents can seamlessly digest and cite your material without JS rendering bottlenecks.
  • 50 – 69 (Good Readiness): Solid foundation, but critical gaps (such as missing schema markup or JavaScript rendering dependencies) are limiting your reach to AI crawlers.
  • Below 50 (High Risk): Significant accessibility issues. AI bots will likely encounter missing concepts, dynamic load errors, or unmapped entity signals, leading them to favor competitors in AI responses.
Preview and Hand-Pick Your Highest-Impact Concept Pages graphic
Preview and Hand-Pick Your Highest-Impact Concept Pages

The OKF Bundle Preview gives you complete visibility into your converted dataset before you ever deploy it to your server.

The interactive preview table lets you inspect every generated Markdown file and its entity classification.

It’s possible that the tool skips conceptually important and high-traffic pages that warrant representation in your OKF bundle and knowledge structure.

Use the preview to spot missing pages and ensure your top-performing organic assets are included, even if they sit deeper in your site navigation.

Gauge Your Search & AI Footprint with Semrush Metrics graphic
Gauge Your Search & AI Footprint with Semrush Metrics

To provide actionable search context alongside your OKF generation, the report integrates Semrush Domain Analytics directly into your dashboard:

  • Authority Score: Benchmark your domain’s overall trust rating and competitive weight.
  • Ranking Keywords: Track total indexed positions across top search results.
  • Referring Domains: Evaluate your backlink profile strength.
  • AI Visibility & Citations: See how frequently your brand appears in generated answers and direct citations across leading AI search engines.
Who Is the OKF Bundle Generator For? graphic
Who Is the OKF Bundle Generator For?
  • SEOs & Generative Engine Optimizers (GEO): Prepare client websites for the shift from traditional SERPs to AI assistants by uploading wiki-style OKF markdown.
  • AI Developers & Engineers: Rapidly extract site content into clean, pre-tagged Markdown datasets for RAG pipelines and custom agent workflows.
  • E-commerce & SaaS Brands: Ensure that product features, pricing matrices, and solution pages are accurately parsed and recommended by shopping AI agents.

Exploding Topics Pro is trusted by 1,200+ teams worldwide.

How We Find Trends

We track topics across the internet to identify under-the-radar trends before they go mainstream.

1

Analyze

Our trend identification process begins with a comprehensive data collection from a variety of online sources.

  • Social media platforms
  • Search engines
  • Online forums and communities
  • News articles and blogs
  • E-commerce websites
  • Podcasts
2

Identify

Our proprietary machine learning models are designed to detect the absolute earliest signs of an emerging trend.

  • Analyze historical data to identify growth patterns
  • Predict future trends based on current data trajectories
  • Detect sudden spikes in interest or activity around specific topics
3

Curate

While our algorithms are powerful, human expertise is crucial for contextual understanding, ensuring quality topics.

  • Review the top-scoring trends identified by our models
  • Validate the authenticity and relevance of these trends
  • Filter out fads (movies, TV shows, celebrity gossip, etc.)
  • Provide qualitative insights to complement quantitative data

Get Exclusive Access to Emerging Trends

Stay ahead of the competition with a 7-day free trial of Exploding Topics Pro.

1.1M+ trends in our growing database. Pro plans starts at $1.29/day.

FAQ

Everything you need to know about using our features and getting the most out of them.

Is the OKF Bundle Generator completely free, and are there usage limits?

Yes, it is 100% free with no login or credit card required.

You can run multiple free checks per day with customizable page caps of 10, 25, or 100 pages per scan. You get instant access to preview the extracted files, inspect internal link connections, check Semrush domain authority context, and download your final ready-to-deploy .zip bundle.

What is Open Knowledge Format (OKF v0.1) and why does my site need it?

Open Knowledge Format (OKF) is an open standard designed to convert complex website structures into lightweight, machine-readable Markdown concept files (.md).

Traditional AI crawlers spend significant processing power stripping away HTML, CSS, dynamic scripts, and navigation menus. An OKF bundle packages your most critical pages, entity tags, and internal link graphs into a standardized directory structure served at /okf/. That way, LLMs like ChatGPT, Claude, and Perplexity get a frictionless knowledge base or wiki to reference when answering questions about your brand.

How does the generator choose which pages to convert into Markdown?

By default, the automated crawler samples your site depth, XML sitemap, or input URL, prioritizing top-level pillar pages and capping repetitive template pages (like too many pages appearing under the same top-level hierarchy).

Since the tool selects pages based on site architecture rather than traffic, you can also paste a custom list of specific high-value URLs or raw text to hand-pick the exact product, pricing, and solution pages you want in your final bundle.

What does the downloaded .zip file contain?

The downloaded zip file includes markdown concept files, YAML style metadata, and an internal link relationship graph representing conceptual connections.

How should I choose the right page cap for my scan?

Choosing the right page cap depends on the depth of your website architecture. 

The 10-page scan is ideal for startups, single-product SaaS sites, or quick testing. Use this when you want to focus strictly on high-priority pages like Homepage, Pricing, Key Features, and About.

The 25-page scan is the most balanced depth level. It’s good for established websites and growing blogs since it captures your core entity pages and landing pages without overwhelming the knowledge graph and with minimal repetitiveness.

The 100-pages scan works best for enterprise sites, extensive documentation portals, and large e-commerce catalogs that require a broad dataset for RAG or site-wide AI readiness audits.

Is an llms.txt file a good source for preparing an OKF bundle?

This tool supports llms.txt for generating your OKF bundle. It’s a good source to use if you have a well-constructed llms.txt file.

A good llms.txt file acts as a hand-curated map of your site's most important pages for AI models. When you use llmx.txt as the source, this tool will effectively upgrade your lightweight llms.txt directory into a full, hostable OKF knowledge base directory.

What happens if my site has more pages than the maximum page cap?

This is normal and the tool accounts for websites with more pages than the max cap.

When your site exceeds the selected limit, the tool intelligently filters the crawl. It prioritizes top-level navigation hubs, product pages, and pillar pages to process first.

The tool also puts a cap on repetitive templates (like dynamic tag pages or paginated blog archives).

And since the tool logs skipped URLs, you can simply paste those specific links into the Custom URL list input mode to build a custom bundle. 

Do I need a Semrush account to use the OKF Bundle Generator?

No, you do not need a Semrush account to use the OKF Bundle Generator. However, a free Semrush account unlocks AI search analysis, traffic analytics, and additional tools to help you build a more value-driven OKF bundle.

What is the difference between an llms.txt file and an OKF bundle?

Think of llms.txt as a map that points LLMs to important pages on your website and an OKF bundle as the library.

An OKF bundle includes the actual structured dataset containing processed Markdown concept files, entity classifications, meta tags, and internal link maps ready for instant LLM ingestion.

Combining both gives AI engines full knowledge discovery and direct reading access to your content.