Uploaded image for project: 'LLM AI Integration'
  1. LLM AI Integration
  2. LLMAI-192

A nonsense query returns dozens of low-score hits with nothing to tell the agent it matched noise

    XMLWordPrintable

Details

    • Improvement
    • Resolution: Unresolved
    • Minor
    • None
    • 0.10
    • None
    • Unknown

    Description

      query="zxqv-nothing-matches-this" returned "about 57" documents because the hyphenated string is tokenized and OR-ed; the only signal is the score band (4.9 and below, against ~24 for a real title hit).

       

      Expected / proposal: One of: (a) bind a minimum-should-match (mm) so that a majority of terms must match; (b) note the best score relative to a "strong match" threshold in the footer ("top score 4.9; scores under ~8 usually mean weak matches"); (c) add a sentence to the man page NOTES teaching the agent to compare scores across calls.

      Actual: A confident list of 57 results with a footer identical to a real search.

      Attachments

        Activity

          People

            Unassigned Unassigned
            ppantiru Paul Pantiru
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated: