• UnethicalGallon@lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    ·
    7 hours ago

    A routing service is in the middle between you and the AI. You send your prompt to the router. It relays that to ChatGPT, Gemini, Grok, Qwen, etc.

    • sem@lemmy.blahaj.zone
      link
      fedilink
      English
      arrow-up
      0
      ·
      7 hours ago

      But when would somebody be using that? What is the context, as someone who has never heard of this.

      • humanspiral@lemmy.ca
        link
        fedilink
        English
        arrow-up
        0
        ·
        6 hours ago

        Opencode/zen go is the best monthly subscription plan. Also has decent free tier. Openrouter is similar. Its 10-30+ different model providers under one api including some closed US ones. It’s about juggling usage limits and routing simple requests to simpler models to preserve better model usage limits.

      • qaz@lemmy.world
        link
        fedilink
        English
        arrow-up
        0
        ·
        6 hours ago

        There are several public open weights models that anyone can host. There are a large number of companies offering e.g. DeepSeek or GLM. A router can automatically pick the cheapest offer and detects and works around outages of individual companies.