Type something to search...
Camel AI Agent

Camel AI Agent

Camel AI Agent

4.5k 550
03 May, 2024
  Python

What is CamelAI ?

Camel AI 🐫 is a communicative Agents for “Mind” Exploration of Large Scale Language Model Society


Overview

The rapid advancement of conversational and chat-based language models has led to remarkable progress in complex task-solving. However, their success heavily relies on human input to guide the conversation, which can be challenging and time-consuming. This paper explores the potential of building scalable techniques to facilitate autonomous cooperation among communicative agents and provide insight into their “cognitive” processes. To address the challenges of achieving autonomous cooperation, we propose a novel communicative agent framework named role-playing. Our approach involves using inception prompting to guide chat agents toward task completion while maintaining consistency with human intentions. We showcase how role-playing can be used to generate conversational data for studying the behaviors and capabilities of chat agents, providing a valuable resource for investigating conversational language models. Our contributions include introducing a novel communicative agent framework, offering a scalable approach for studying the cooperative behaviors and capabilities of multi-agent systems, and open-sourcing our library to support research on communicative agents and beyond. The GitHub repository of this project is made publicly available on: https://github.com/camel-ai/camel.


Install CamelAI

From PyPI

To install the base camel library, simply run

Terminal window
pip install camel-ai

Some features reuqire extra dependencies.

To use hugging-face agent, run

Terminal window
pip install camel-ai[huggingface-agent]

To enable RAG or use agent memory, run

Terminal window
pip install camel-ai[tools]

To install with all dependencies, run

Terminal window
pip install camel-ai[all]

From Source

Install CAMEL from source with poetry (Recommended):

Terminal window
# Make sure your python version is later than 3.9
# You can use pyenv to manage multiple python verisons in your sytstem
# Clone github repo
git clone https://github.com/camel-ai/camel.git
# Change directory into project directory
cd camel
# Activate camel virtual environment
poetry shell
# Install camel from source
# It takes about 90 seconds to resolve dependencies
poetry install
# Or if you want to use "huggingface agent"
poetry install -E huggingface-agent # (Optional)
# do something with camel
# Exit the virtual environment
exit

Install CAMEL from source with conda and pip:

Terminal window
# Create a conda virtual environment
conda create --name camel python=3.10
# Activate camel conda environment
conda activate camel
# Clone github repo
git clone -b v0.1.0 https://github.com/camel-ai/camel.git
# Change directory into project directory
cd camel
# Install camel from source
pip install -e .
# Or if you want to use "huggingface agent"
pip install -e .[huggingface-agent] # (Optional)

Example

You can find a list of tasks for different set of assistant and user role pairs here

Run the role_playing.py script

First, you need to add your OpenAI API key to system environment variables. The method to do this depends on your operating system and the shell you’re using.

For Bash shell (Linux, macOS, Git Bash on Windows):

Terminal window
# Export your OpenAI API key
export OPENAI_API_KEY=<insert your OpenAI API key>
OPENAI_API_BASE_URL=<inert your OpenAI API BASE URL> #(Should you utilize an OpenAI proxy service, kindly specify this)

For Windows Command Prompt:

Terminal window
REM export your OpenAI API key
set OPENAI_API_KEY=<insert your OpenAI API key>
set OPENAI_API_BASE_URL=<inert your OpenAI API BASE URL> #(Should you utilize an OpenAI proxy service, kindly specify this)

For Windows PowerShell:

Terminal window
# Export your OpenAI API key
$env:OPENAI_API_KEY="<insert your OpenAI API key>"
$env:OPENAI_API_BASE_URL="<inert your OpenAI API BASE URL>" #(Should you utilize an OpenAI proxy service, kindly specify this)

Replace <insert your OpenAI API key> with your actual OpenAI API key in each case. Make sure there are no spaces around the = sign.

After setting the OpenAI API key, you can run the script:

Terminal window
# You can change the role pair and initial prompt in role_playing.py
python examples/ai_society/role_playing.py

Please note that the environment variable is session-specific. If you open a new terminal window or tab, you will need to set the API key again in that new session.


Use Open-Source Models as Backends

The basic workflow of using an open-sourced model as the backend is based on an external server running LLM inference service, e.g. during the development we chose FastChat to run the service.

We do not fix the choice of server to decouple the implementation of any specific LLM inference server with CAMEL (indicating the server needs to be deployed by the user himself). But the server to be deployed must satisfy that **it supports OpenAI-compatible APIs, especially the method openai.ChatCompletion.create **.

Here are some instructions for enabling open-source backends, where we use the FastChat and a LLaMA2-based model ( meta-llama/Llama-2-7b-chat-hf ) in the example. Please install FastChat in advance following their installation guidance.

  1. Before running CAMEL, we should firstly launch FastChat server following the guidance on https://github.com/lm-sys/FastChat/blob/main/docs/openai_api.md. The instructions summarized below should be kept running in separate processes:
Terminal window
# Launch the controller
python -m fastchat.serve.controller
# Launch the model worker(s)
python3 -m fastchat.serve.model_worker --model-path meta-llama/Llama-2-7b-chat-hf
# Launch the RESTful API server
python3 -m fastchat.serve.openai_api_server --host localhost --port 8000
  1. After observing the controller successfully receiving the heart beat signal from the worker, the server should be ready for use at http://localhost:8000/v1.

  2. Then we can try on running role_playing_with_open_source_model.py, where each agent in this example is initialized with specifying the model_path and server_url, similar to the example code below:

Terminal window
system_message = # ...
agent_kwargs = dict(
model=model_type,
model_config=OpenSourceConfig(
model_path="meta-llama/Llama-2-7b-chat-hf",
server_url="http://localhost:8000/v1",
),
)
agent = ChatAgent(
system_message,
**agent_kwargs,
)

Supported Models


Data (Hosted on Hugging Face)

DatasetChat formatInstruction formatChat format (translated)
AI SocietyChat formatInstruction formatChat format (translated)
CodeChat formatInstruction formatx
MathChat formatxx
PhysicsChat formatxx
ChemistryChat formatxx
BiologyChat formatxx

Visualizations of Instructions and Tasks

DatasetInstructionsTasks
AI SocietyInstructionsTasks
CodeInstructionsTasks
MisalignmentInstructionsTasks

Implemented Research Ideas from Other Works

We implemented amazing research ideas from other works for you to build, compare and customize your agents. If you use any of these modules, please kindly cite the original works: