Ceptile
Neural Information Retrieval

Semantic Search

Semantic search uses vector embeddings and natural language models to match the conceptual meaning of your query, finding relevant answers even when documents use completely different words.

Understanding Semantic Search

Traditional keyword search is bound by string-matching: if you search for "automobile repair," pages mentioning "car mechanic" might be penalized or missed entirely. Semantic search maps words, phrases, and documents into high-dimensional vector spaces. Queries and passages that share underlying meaning cluster together, allowing Ceptile to retrieve accurate answers regardless of surface-level vocabulary differences.

Semantic Search vs. Lexical Keyword Search

Comparing retrieval capabilities across common user query scenarios.

Semantic Search (Conceptual)

  • Understands synonyms, slang, colloquialisms, and regional spelling variants automatically.
  • Grasps relationships between entities (e.g. knowing that "macOS" is related to "Apple laptops").
  • Handles conceptual problem descriptions like "my website is loading white screen on mobile."
  • Evaluates passage intent, distinguishing tutorial guides from sales landing pages.

Lexical Search (Keyword Matching)

  • Strictly matches character sequences using algorithms like TF-IDF or BM25.
  • Vulnerable to vocabulary mismatch: misses relevant content if words differ.
  • Easily manipulated by keyword stuffing and repetitive SEO anchor spam.
  • Excels at exact identifier lookups: part numbers, error codes, and URLs.

Why Ceptile Uses Hybrid Search

Combining the conceptual intelligence of dense vectors with the precision of lexical matching.

Neither pure keyword search nor pure semantic vector search is optimal on its own. Pure vector search can struggle with rare proper nouns, exact code errors, or specific SKU numbers. Ceptile implements a Hybrid Search Architecture (BM25 + Dense Semantic Reranking):

1. Dense Retrieval

Pulls conceptually relevant documents using dense semantic embeddings.

2. BM25 Lexical Filter

Guarantees exact-match preservation for identifiers, quotes, and names.

3. Cross-Encoder Rerank

Jointly evaluates query and candidates to score true evidence quality.

Semantic Search FAQ

Key questions on embeddings, vector indexes, and query understanding.