bosco

Updates

What's new in bosco

Releases, new features and fixes. Full history on GitHub.

  1. Announcement

    Welcome to getbosco.dev

    bosco has a home on the web. This page lists releases, new features and fixes as they land.

  2. Fix

    LLM substitutions can now be renamed

    Before this fix, you could only edit the list of LLMs to substitute. You can now edit the substitution name too.

  3. Feature

    LLM substitutions

    Associate one or more active LLMs of your farm with a model name. If a request asks for deepseek-r1:27b and no machine running it is free, but a machine with deepseek-r1:14b is, a substitution lets the 14b answer instead of waiting for the 27b.

  4. Announcement

    llm-router gets a new name

    The project leaves its working title behind for a real name, and a new era begins.

  5. Feature

    New /v1/systemone route for JEV calls

    A dedicated route to process JEV calls. Tested with nimble:latest and nimb-v3:9b.

  6. Feature

    X-Request-Time header

    Mark when a request really started. Any business timestamp passed in this header is used to compute a Total Request Time.