Downloads 296this week

GitHub stars 0

Extension repository on GitHub

Extension descriptor (YAML)

HTTP client extension for DuckDB with GET/POST/PUT/PATCH/DELETE and byte-range requests

Installing and Loading

INSTALL http_request FROM community;
LOAD http_request;

Example

-- Simple GET request
SELECT http_get('https://example.com/');

-- Access response fields
SELECT
    r.status,
    r.content_type,
    r.content_length,
    r.cookies[1].name as first_cookie
FROM (SELECT http_get('https://example.com/') as r);

-- GET with custom headers
SELECT http_get('https://httpbin.org/get', headers := {'Accept': 'application/json'}).body;

-- Byte-range request for partial content
SELECT http_get(
    'https://example.com/largefile.gz',
    {'Range': byte_range(0, 1024)}
);

About http_request

HTTP client extension providing scalar and table functions for making HTTP requests.

Features:

• All HTTP methods: GET, HEAD, POST, PUT, PATCH, DELETE
• Parallel execution: requests within a chunk run concurrently
• Custom headers via STRUCT parameter
• Query parameters via STRUCT
• Byte-range requests with helper function
• Auto-decompression of gzip/zstd responses
• Form-encoded POST with http_post_form()
• Multipart/form-data uploads with http_post_multipart()
• Parsed Set-Cookie headers into structured cookies array
• Convenience fields: content_type, content_length
• Respects duckdb http and proxy settings
• Configurable concurrency via http_max_concurrency setting (default: 32)

Uses DuckDB's built-in httplib for HTTP connections.

Added Functions

Added Settings