Uploaded image for project: 'LLM AI Integration'
  1. LLM AI Integration
  2. LLMAI-32

Improve the token management

    XMLWordPrintable

Details

    • Improvement
    • Resolution: Duplicate
    • Major
    • None
    • 0.1, 0.2, 0.2.1
    • None
    • Unknown

    Description

      Improve the token management for the LLM models with proper tokenizer.

      Attachments

        Issue Links

          duplicates

          Bug - A problem which impairs or prevents the functions of the product. LLMAI-173 Chunking is character-based and ignores the embedding model's maximum input length, so chunk tails are silently never embedded

          • Major - Major loss of function.
          • Open

          Activity

            People

              ppantiru Paul Pantiru
              MrSneaker Munoz Matéo
              Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: