Skip to content

Directory structure requirement may be unnecessary for providers without namespaced model IDs #752

@Blues-star

Description

@Blues-star

I have a question regarding the current directory structure requirement: If the model ID contains /, use subfolders. For example, for the model ID openai/gpt-5, create a folder openai/ and place a file named gpt-5.toml inside it.

However, some providers like Poe don't have this namespacing requirement for model IDs. From the OpenAI-compatible endpoint https://api.poe.com/v1/models, the model_id is returned directly without any / separator (e.g., Gemini-3-Pro).

In this case, is the subfolder structure still necessary? Because following the current subfolder convention would actually conflict with the official documentation examples, such as:

import os, openai

client = openai.OpenAI(
    api_key=os.getenv("POE_API_KEY"),
    base_url="https://api.poe.com/v1",
)

# Example: Using web search and thinking level with Gemini models
response = client.chat.completions.create(
    model="Gemini-3-Pro",  # No namespace prefix
    messages=[{"role": "user", "content": "What are the latest developments in quantum computing?"}],
    extra_body={
        "web_search": True,
        "thinking_level": "high"
    }
)

The example shows model="Gemini-3-Pro" without any provider prefix, which wouldn't map cleanly to a poe/Gemini-3-Pro.toml structure if we strictly follow the subfolder rule for provider organization.


Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions