Uploaded image for project: 'LLM AI Integration'
  1. LLM AI Integration
  2. LLMAI-191

Search snippets can be cut inside a multi-byte character

    XMLWordPrintable

Details

    • Bug
    • Resolution: Unresolved
    • Minor
    • None
    • 0.10
    • None
    • Unknown

    Description

      With hl.fragsize=200 the highlight fragment of emoji-rich content ends in U+FFFD replacement characters. (ex:  🚀🌟🔥🎉✨🌈🍀🍎���....)

       

      Expected: The fragment ends on a character (ideally word) boundary.

      Actual: Three replacement characters before the ellipsis.

      Attachments

        Activity

          People

            Unassigned Unassigned
            ppantiru Paul Pantiru
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated: