2024 · AI prototype
A multi-model Bedrock prototyping sandbox
a mobile services company · Ai/ML engineer
The problem
A company wanted an assistant for its documents, and five different foundation models had just become available. None had been tested on its kind of question.
What I built
I built a sandbox that runs the same questions through each model and compares the answers, with retrieval over the company's documents.
The result
The sandbox compares the models on the company's own questions.
Main tools
- Amazon Bedrock
- Claude
- Amazon Titan
- OpenSearch
- Python
This is the short version. The full case study is available on request.