Uploaded image for project: 'LLM AI Integration'
  1. LLM AI Integration
  2. LLMAI-78

Translate context documents in the benchmark and use combinations of languages

    XMLWordPrintable

Details

    • Improvement
    • Resolution: Done
    • Major
    • 0.6
    • 0.3.1
    • None
    • Unknown

    Description

      At the moment, all context documents are in English while questions are in English, German and French. It would be interesting to also (automatically) translate all context documents to German and French and to evaluate all combinations of context and question language to better understand the limitations of the different models in terms of multilingual capabilities.

      Attachments

        Activity

          People

            ppantiru Paul Pantiru
            MichaelHamann Michael Hamann
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: