Uploaded image for project: 'LLM AI Integration'
  1. LLM AI Integration
  2. LLMAI-229

Allow extensions to provide chunking methods for collections

    XMLWordPrintable

Details

    • Improvement
    • Resolution: Unresolved
    • Major
    • None
    • None
    • None
    • Unknown

    Description

      Collections have a "Chunking method" setting, but it offers a single value, "Max characters chunking", and the indexer ignores it. Chunking methods should be components selected by this setting, so that the application and other extensions can provide alternatives.

      • The current algorithm becomes the maxChars method; indexing results do not change.
      • The collection edit form lists the installed methods, like the document stores. A method that is no longer installed stays selected and is marked as such, instead of being replaced silently.
      • A blank setting means maxChars. An unknown method is rejected when it is set through REST or the script service, and indexing reports it instead of falling back silently.

      Attachments

        Activity

          People

            Unassigned Unassigned
            GOhrner Gunter Ohrner
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: