Skip to content

Build the model vault, runtime selection, fallback, and compatibility diagnostics #62

@KSemenenko

Description

@KSemenenko

Problem

Operators need one product surface for local-model inventory, runtime selection, fallback behavior, and compatibility insight.

Scope

  • Track model import, metadata, hashing, license provenance, runtime selection, fallback, and compatibility diagnostics
  • Cover how the vault informs session composition
  • Keep the surface usable for many local models

Out of scope

  • Cloud model hosting workflows
  • Provider toolchain installation for external CLIs

Implementation notes

  • Make the model vault the canonical local-model inventory
  • Keep fallback and compatibility explicit to the operator
  • Align the issue with LLamaSharp and ONNX Runtime planning

Definition of Done

  • The issue defines the model-vault responsibilities and minimum diagnostics
  • Later implementation can wire local runtimes into a single product surface

Verification

  • Review the issue against the feature spec and local-runtime abstraction issue

Dependencies

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions