RWKV v7 OpenAI-compatible API?
Anyone know an easy way to set up RWKV v7 models as an OpenAI-compatible API? v6 is fairly easy (https://huggingface.co/RWKV converts to gguf for llama.cpp), but v7 doesn't have .bins to convert.
Anyone know an easy way to set up RWKV v7 models as an OpenAI-compatible API? v6 is fairly easy (https://huggingface.co/RWKV converts to gguf for llama.cpp), but v7 doesn't have .bins to convert.