Hi, I found llm-proxy to be a fabulous base for my own needs such as building a proxy that fixes broken / incompatible thinking output from various open source llm we host locally using our own GPUs to building a proxy for Claude code to allow for cheaper models to be used for bread and butter vibe coding, e.g. for students to learn vibe coding.
Claude code likes the simplicity of the code base but failed to interact with litellm.
I am not sure if you plan to turn this into a larger open source project that can commit to review and take pull requests or if we should just take your code and run with it
main...dirkpetersen:llm-proxy:dirk
Hi, I found llm-proxy to be a fabulous base for my own needs such as building a proxy that fixes broken / incompatible thinking output from various open source llm we host locally using our own GPUs to building a proxy for Claude code to allow for cheaper models to be used for bread and butter vibe coding, e.g. for students to learn vibe coding.
Claude code likes the simplicity of the code base but failed to interact with litellm.
I am not sure if you plan to turn this into a larger open source project that can commit to review and take pull requests or if we should just take your code and run with it
main...dirkpetersen:llm-proxy:dirk