Collection : POC of knowledge base creation with different providers #543
Description
Describe the current behavior
Currently we only have openai integration when it comes to setting up file search, and while this works well, we want to extend our project for it to have support for other providers as well
Describe the enhancement you'd like
We need to extend kaapi to have support for other providers for llm interaction, file search, etc. To understand what we would need to be able to extend it, we need to POC out for these provider to understand the file search capabilities they offer, the providers are
- Google gemini
- Anthropic
One more thing to note is that while anthropic does not provide direct support for file search, you can use amazon bedrock's and google vertex's capabilties but you would have to use the claude models hosted on their end, and you can't do anything with anthropic api keys if using the claude model with these providers