/ai
Artificial Intelligence and Machine Learning
submit
ad
Advertise in /ai
Reach our ai-focused community
/post#cm5k5gzi
reply to post

RWKV v7 OpenAI-compatible API?

Anyone know an easy way to set up RWKV v7 models as an OpenAI-compatible API? v6 is fairly easy (https://huggingface.co/RWKV converts to gguf for llama.cpp), but v7 doesn't have .bins to convert.

3d|
Anonymous
|reply||
Comments
No comments yet. Be the first to comment!
Add a comment
0/2000