Uploaded image for project: 'LLM AI Integration'
  1. LLM AI Integration
  2. LLMAI-23

Support OpenAI hosted by Azure

    XMLWordPrintable

Details

    • Task
    • Resolution: Unresolved
    • Major
    • None
    • 0.1, 0.2
    • Unknown

    Description

      Main differences are:

      1. There is no /models endpoint when creating an Azure OpenAI deployment. There is only direct access to the chat/completions endpoint. The Azure chat/completions endpoint is, however, directly compatible with the corresponding OpenAI Endpoint, so not differences there.
      2. The Azure OpenAI API requires a query parameter that specifies the API version. So every request needs to be suffixed with for example "?api-version=2023-05-15"

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              MrSneaker Munoz Matéo
              Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

                Created:
                Updated: