1. Introduction
Modern AI systems benefit from structured, machine-readable content delivery rather than relying only on blind crawling, heuristic scraping, or ad hoc HTML interpretation. In this architecture, OLAMIP and MCP work together to provide a more deterministic content pipeline.
- OLAMIP / OLAMIP-DELTA: A semantic, hierarchical representation of website content plus incremental updates.
- MCP (Model Context Protocol): A standardized protocol for exposing tools, resources, and prompts to AI clients through structured interfaces.
Together, they support a high-signal pipeline:
Website → OLAMIP → OLAMIP-DELTA → MCP tools/resources → AI agents / RAG pipelines
This guide describes how to implement that architecture in a way that aligns with OLAMIP’s semantics and MCP’s current role as an integration protoco.
2. OLAMIP: The Semantic Snapshot Layer
OLAMIP (olamip.json) is the authoritative machine-interpretable representation of a website’s content structure and metadata. It is designed to provide a stable semantic layer that AI systems can use for ingestion, navigation, and grounding.
2.1 File discovery
Publishers should expose OLAMIP using dual discovery signals:
<link rel="olamip" href="https://yourdomain.com/olamip.json">
<meta name="olamip-location" content="https://yourdomain.com/olamip.json">
These signals make the file easier for crawlers, validators, and AI systems to discover consistently.
2.2 Core file structure
An OLAMIP file is a valid UTF-8 JSON document with:
protocol: Must be"OLAMIP".version: Protocol version, such as"1.0.0".identity: Site or organization identity.content: Overview, sections, subsections, and entries.metadata: File-level metadata such as language and update date.
2.3 Identity object
The identity object defines the website or organization represented by the OLAMIP file.
name: Required.type: Required.canonical_description: Required.tags: Optional.
2.4 Content object
The content object contains:
overviewsections- nested
subsections - leaf
entries
This supports multi-level hierarchies.
2.5 Section object
A section represents a major grouping of content such as a blog category, documentation category, product collection, or project group.
Required fields:
titlesummaryurlsection_typeentries
Optional fields:
policytagsprioritypublishedsubsectionslanguage
Allowed section_type values include:
blog_categorynews_sectionproduct_collectiondoc_categoryresearch_categoryproject_groupcontent_section
2.6 Entry object
An entry is the smallest unit of content in OLAMIP.
Required fields:
titlesummaryurlcontent_type
Optional fields:
policytagsprioritypublishedlanguagemetadata
Allowed content_type values include:
pagelanding_pagelegal_pageblog_articlenews_articleproductservicedoc_pageresearch_paperdatasetprojectmedia_itemresource
2.7 URL rules
The url field is the canonical identifier for each section or entry.
- It must be absolute.
- It must be stable.
- It must be used for deduplication and retrieval.
- It should map to the real-world location of the content.
2.8 Policy inheritance
The policy field controls whether AI systems may ingest a section, subsection, or entry.
- Valid values:
allow,forbid - Default behavior: if no policy is set anywhere in the ancestor chain, the effective policy is
allow. - Policies inherit downward through the hierarchy.
forbidis a strict prohibition on ingestion.allowpermits ingestion of the represented node.
2.9 Arrays and multi-value fields
Any field containing multiple values must be represented as a JSON array.
Examples include:
tags- custom lists within
metadata
Array rules:
- Use square brackets.
- Use comma-separated values.
- Each element must be a standalone string.
- Preserve ordering when order carries semantic meaning.
2.10 Metadata object
The file-level metadata object may store attributes such as:
last_updatedlanguagesource_urlcopyright
Example:
{
"metadata": {
"last_updated": "2026-01-21",
"language": "en",
"source_url": "https://www.yourwebsite.com/",
"copyright": "© year Copyright Holder"
}
}
2.11 Multilingual support
Language can be defined at the file, section, or entry level.
Use BCP-47 codes such as:
enesfrdept-BRzh-CNar
Guidelines:
- Match tags to the language of the entry unless the concept is globally standardized.
- Avoid mixing languages in a single tag.
- Use language metadata to improve retrieval, translation, and cross-language reasoning.
2.12 Tags
Tags provide compact semantic signals that help AI systems cluster related content, disambiguate similar topics, and improve retrieval accuracy.
Rules:
- Lowercase.
- Single-token format.
- ASCII-only.
- Hyphens allowed for multi-word concepts.
- No spaces.
- No punctuation except hyphens.
- No camelCase.
- No snake_case.
Best practices:
- Use 3–7 tags per entry as a typical range.
- Prefer stable, domain-specific concepts.
- Avoid duplicating hierarchy information.
- Avoid over-tagging.
- Treat tags as metadata, not marketing keywords.
Anti-patterns:
- Spaces.
- Underscores.
- CamelCase.
- Concatenation.
- Excessive tags.
- Tags that duplicate titles.
- Tags that duplicate each other.
2.13 Priority
The priority field is a categorical importance signal.
Allowed values:
highmediumlow
Guidance:
highfor flagship or mission-critical content.mediumas the default for most content.lowfor niche, outdated, or legacy content.- Keep
highrare so the signal stays meaningful.
2.14 Validation rules
OLAMIP files must be valid JSON and follow strict structural rules.
- Required fields must be present.
- URLs must be canonical and absolute.
- Summaries should stay concise, ideally under 500 characters.
- Subsections must follow the Section schema.
- Unknown fields may be ignored by parsers for forward compatibility, while publishers should validate against the latest schema.
2.15 Semantic alignment
OLAMIP complements schema.org and JSON-LD.
- schema.org describes what a page is.
- OLAMIP explains why it matters and how LLMs should interpret it.
Using both provides a stronger structured-data layer for AI systems.
3. OLAMIP-DELTA: The Incremental Update Layer
OLAMIP-DELTA (olamip-delta.json) is an optional companion file that contains only changes since the last refresh. It lets AI systems update their index without reprocessing the full OLAMIP snapshot.
3.1 Delta purpose
Delta files help AI systems stay synchronized with live website changes such as:
- New pages.
- Revised pages.
- Retired pages.
- New sections or subsections.
- Structural hierarchy changes.
3.2 Delta operations
Supported operations:
addedupdatedremoved
Rules:
addeditems are full OLAMIP objects for the affected type.updateditems may be partial or full.removeditems contain onlyurl.urlmust be canonical and absolute.- No URL should appear more than once in the same delta object.
3.3 Delta structure
A uniform delta object should include all three arrays, even when empty:
{
"date": "2026-03-02",
"added": [],
"updated": [],
"removed": []
}
3.4 File-level rules
For OLAMIP-DELTA files:
protocolmust be"OLAMIP-DELTA".versionmust follow the documented version scheme.window_days, if present, must be a positive integer.deltasmust be non-empty.- Each delta object must include an ISO 8601
date. - Delta objects should be sorted in ascending date order.
3.5 Rolling window
A rolling window retains recent changes for a defined period, commonly 7–30 days.
Why it helps:
- It reduces missed-update risk.
- It makes delayed ingestion safer.
- It prevents delta files from growing without bound.
Typical guidance:
- Daily updates: 7 days.
- Weekly updates: 14–30 days.
- Monthly updates: 30–60 days.
- High-volume sites: at least 30 days.
3.6 Versioned delta files
Versioned deltas store one day per file instead of a rolling window.
Example:
olamip-delta-2026-03-01.jsonolamip-delta-2026-03-02.jsonolamip-delta-2026-03-03.json
This can work well for:
- News sites.
- Large catalogs.
- Frequently updated documentation.
3.7 Discovery
In the OLAMIP model, olamip.json is discovered first through the standard discovery tags, and olamip-delta.json may be found in the same directory or via an agreed naming convention.
A safe implementation approach is:
- Discover
olamip.jsonfirst. - Check the same directory for delta files.
- Apply rolling or versioned deltas according to the site’s chosen packaging strategy.
3.8 Relationship to the base snapshot
olamip.jsonis the authoritative full snapshot.olamip-delta.jsonis the incremental change log.- Deltas are not replacements for the full snapshot.
3.9 Section and subsection deltas
The delta protocol applies to sections and subsections as well as entries.
Examples:
addedfor new sections or subsections.updatedfor renamed or revised sections or subsections.removedfor retired sections or subsections.
For section-level adds:
- Include a full section object.
- Use a canonical absolute URL.
- Use the correct
section_type.
For updates:
- Include
url. - Include only the changed fields, or the full object.
For removals:
- Include only
url.
3.10 Best practices
- Tie delta generation to CMS or deployment events.
- Update deltas whenever content changes.
- Keep timestamps accurate.
- Preserve a current full
olamip.json. - Use stable canonical URLs.
4. MCP: The Agent Integration Layer
MCP is a standardized protocol for exposing tools, resources, and prompts to AI clients. It is broader than retrieval, but it should still be described as an integration protocol rather than a general-purpose agent runtime.
MCP commonly supports:
- Capability discovery.
- Structured tool schemas.
- Structured outputs.
- Transport-level request/response interaction.
- Transport-supported streaming or progress updates where applicable.
- Resources and prompts alongside tools.
Recent MCP sources also point to a more stateless direction in the 2026-07-28 revision, with sessions and initialization removed from the protocol core.
5. MCP Tool Architecture for OLAMIP
5.1 Recommended tool set
| Tool | Purpose |
|---|---|
get_olamip_snapshot | Retrieve a full snapshot or supported partial snapshot. |
get_partial_snapshot | Retrieve specific sections, entries, or metadata. |
get_olamip_delta | Retrieve the latest delta file. |
get_delta_since | Retrieve updates since a given timestamp. |
list_sections | Enumerate the OLAMIP hierarchy. |
get_entry | Retrieve an entry by canonical URL. |
resolve_url | Fetch the HTML or canonical document for grounding. |
get_metadata_only | Return lightweight ingestion metadata. |
subscribe_deltas | Optional custom update workflow implemented by the server. |
5.2 Tool schema requirements
Each tool should define:
- Input schema.
- Output schema.
- Error schema.
- Schema version.
- Streaming support, if applicable.
5.3 Capability discovery
Describe MCP capability handling as discovery and feature selection.
A client may ask whether the server supports:
- Streaming or progress notifications.
- Partial snapshot retrieval.
- Delta retrieval by timestamp.
- Specific schema versions.
The server should expose only the capabilities it actually supports.
6. Implementing an MCP Server for OLAMIP
6.1 Implementation lifecycle
- Define tools.
- Implement handlers.
- Declare schemas and supported capabilities.
- Register tools with the server.
- Deploy the MCP server.
- Let the client connect.
- Let the client discover capabilities.
- Expose tools for use.
6.2 Handler responsibilities
Each handler should:
- Validate input.
- Return schema-validated output.
- Provide structured errors.
- Respect supported capability flags.
- Support partial retrieval when requested.
- Support streaming only where the transport and server implementation allow it.
6.3 Deployment options
Possible deployment targets:
- Cloud VM.
- Containerized microservice.
- CMS backend.
- Corporate network service.
- Edge-side integration.
As long as the client can reach the server and the chosen transport is supported, the tools can be discovered and used.
7. How AI Systems Use MCP + OLAMIP
7.1 Initial sync
- The client discovers supported capabilities.
- It retrieves a full or partial OLAMIP snapshot.
- It builds a local semantic index.
- It caches the snapshot for later use.
7.2 Incremental sync
- The client retrieves deltas since the last known timestamp, if supported.
- Or it polls for the latest delta file.
- It applies updates in chronological order.
7.3 Content retrieval
- The client fetches full HTML or canonical content via
resolve_urlwhen deeper grounding is needed. - It may request only partial content if the server exposes that option.
- It then embeds, summarizes, or indexes the content.
7.4 RAG integration
- OLAMIP summaries feed embedding and retrieval pipelines.
- Canonical URLs provide grounding.
- Tags and priorities help ranking.
- Policies guide what should or should not be ingested.
7.5 Continuous updates
- Delta files help keep the system synchronized.
- Reprocessing can often be reduced.
- Caching and freshness checks can lower bandwidth and compute use.
8. Best practices for webmasters
8.1 OLAMIP quality
- Maintain clean, validated JSON.
- Keep summaries concise.
- Use canonical URLs consistently.
- Normalize tags.
- Use BCP-47 language codes.
8.2 Delta management
- Automate delta generation.
- Support delta retrieval by timestamp if needed.
- Use rolling windows if operational simplicity matters.
- Keep removal rules deterministic.
8.3 MCP server best practices
- Use descriptive tool names.
- Declare schema versions explicitly.
- Return structured errors.
- Support streaming only where useful and supported.
- Offer partial snapshot endpoints when large content sets are involved.
- Design for client caching and freshness validation.
8.4 Performance
- Use ETags or timestamps where appropriate.
- Compress large responses.
- Stream large transfers if the transport and server support it.
- Prefer incremental updates over repeated full transfers when possible.
9. Architectural benefits
- No blind crawling: Compliant agents can use structured interfaces instead of heuristic discovery.
- No heuristic scraping: OLAMIP summaries provide meaning directly.
- Less ambiguity: Canonical URLs and policies reduce interpretation errors.
- Lower hallucination risk: Entries must exist in the structured source before they are treated as authoritative.
- Optional deep grounding: Full HTML can still be fetched when needed.
- Deterministic ingestion: AI systems receive predictable, validated data.
10. Conclusion
MCP and OLAMIP can form the foundation of an AI-ready web architecture:
- OLAMIP provides semantic structure.
- OLAMIP-DELTA provides incremental updates.
- MCP provides a standardized interface for tools, resources, discovery, and structured access.
Together, they can help AI systems understand, index, and retrieve content with higher reliability and less ambiguity than blind crawling alone. They do not eliminate the need for validation, refresh logic, or fallback fetching, but they do provide a much more controlled ingestion model.