AWS Bedrock Converse API support for unified tool calling across models.

The Converse API provides a standardized interface for tool calling that works across all Bedrock models (Anthropic, OpenAI, Meta, etc.) with consistent request/response formats.

Advantages

• Unified tool calling across all Bedrock models
• Simpler, cleaner API compared to model-specific endpoints
• Better multi-turn conversation handling

Disadvantages

• May lag behind model-specific endpoints for cutting-edge features
• Adds small translation overhead (typically low milliseconds)

API Format

Request:

{
  "messages": [
    {"role": "user", "content": [{"text": "Hello"}]}
  ],
  "system": [{"text": "You are a helpful assistant"}],
  "inferenceConfig": {
    "maxTokens": 1000,
    "temperature": 0.7
  },
  "toolConfig": {
    "tools": [
      {
        "toolSpec": {
          "name": "get_weather",
          "description": "Get weather",
          "inputSchema": {
            "json": {
              "type": "object",
              "properties": {...},
              "required": [...]
            }
          }
        }
      }
    ]
  }
}

Response:

{
  "output": {
    "message": {
      "role": "assistant",
      "content": [
        {"text": "Let me check the weather"},
        {
          "toolUse": {
            "toolUseId": "id123",
            "name": "get_weather",
            "input": {"location": "SF"}
          }
        }
      ]
    }
  },
  "stopReason": "tool_use",
  "usage": {
    "inputTokens": 100,
    "outputTokens": 50,
    "totalTokens": 150
  }
}