Skip to main content

non-OpenAI llm endpoint support

Feature Request

I saw your .env supports

https://docs.opnform.com/configuration/environment-variables

Other Environment Variables

Configuration Environment Variables

Variable Name Description

OPEN_AI_API_KEY API key for accessing OpenAI services.

I use ollama and vllm in my local network for inference engines and they offer openai compatible communication.

Please allow admins to configure .env a fqdns url and/or ip address to any different openai endpoint

Posted by sdf ·
Status: Rejected2 comments

Log in to comment and vote

Comments2

  • Julien changed status to Rejected
    Team•

    Mar 5, 2025

    Pinned

    Hi there! We’re using structured outputs which is an open-ai only feature I believe so that wouldn’t work. This feedback site is for feedback on the actual product, please feel free to open discussions about this in github/discord, but I’m afraid this will not be a priority.

  • Archie

    Team•

    Mar 4, 2025

    Hi There,

    Thanks for reaching out and for checking out our environment variable documentation! We appreciate your feedback. Supporting alternative OpenAI-compatible inference engines like Ollama and vLLM sounds like a great idea.


    I'll share this with our team to consider in future updates.

    Let us know if you have any other suggestions!

    Best,