Skip to content

core LLM completion layer#2443

Open
shaj13 wants to merge 1 commit intodocker:mainfrom
shaj13:pkg/ai
Open

core LLM completion layer#2443
shaj13 wants to merge 1 commit intodocker:mainfrom
shaj13:pkg/ai

Conversation

@shaj13
Copy link
Copy Markdown
Contributor

@shaj13 shaj13 commented Apr 15, 2026 •
edited
Loading

Add new pkg/ai package that extracts and centralizes model interaction logic from runtime.

See #2409

@shaj13 shaj13 requested a review from a team as a code owner April 15, 2026 22:06
@shaj13
introduce pkg/ai as core LLM completion layer
601d753 
Add new pkg/ai package that extracts and centralizes model interaction
logic from runtime.

The package reuses existing types from chat, tools, and provider packages
without moving them.
@shaj13
Copy link
Copy Markdown
Contributor Author

shaj13 commented Apr 15, 2026

@dgageot mind taking a look ? Extracted the LLM interaction logic from pkg/runtime and other packages into a new reusable pkg/ai package. This includes streaming, fallback handling, retry, and tool execution — enabling consistent model communication across the codebase. The package is also can be used as a standalone Go library without requiring the full agent runtime.

@shaj13
Copy link
Copy Markdown
Contributor Author

shaj13 commented Apr 19, 2026

@dgageot just a gentle reminder — any update on this PR ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@shaj13