Oct '23 in 💬 General
AutoGen
Does anyone else find Autogen super cool? Integrating it with other models outside of gpt-4 is interesting. I used claude-instant via Bedrock
Here's some docs to help you utilize other models:
Once you have the proxy, you can run the litellm models from the command line. Then you just create a config_list as such ->
config_list=[{"model": "bedrock/anthropic.claude-instant-v1", "api_base": "http://0.0.0.0:8000", "api_type":"open_ai", "api_key":"NULL"}]
and an llm config ->
llm_config={
"request_timeout": 600,
"seed": 42,
"config_list": config_list,
"temperature": 0,
}
Then you can pass that LLM config into the agents and start the Autogen agent escapades!
Try it out and let us know what you come up with! I'm going to do a bit more testing after work today.
16
23 comments
AutoGen
skool.com/data-alchemy
Your Community to Master the Fundamentals of Working with Data and AI — by Datalumina®
Leaderboard (30-day)
1
+618
2
+548
3
+479
4
+357
5
+352
powered by