01
Search retained logs through LogQL
Stream selectors narrow the read while word indexes prune candidate granules before LogQL pipelines process the matching lines.
Open source observability in active development
Observability
Observability
data platform
PulsusDB is an open source observability data platform for high-volume telemetry. Ingest with OpenTelemetry, query through PromQL, LogQL and TraceQL, and keep existing clients and dashboards while ClickHouse® handles durable storage and analytical execution.
OpenTelemetry ingestion Query-optimised data models AGPLv3
OPEN TELEMETRY
logs12.8k/s
metrics48.2k/s
traces6.4k/s
profiles1.7k/s
PulsusDB compile + plan
COMPILED SQL
SELECT service, count() FROM log_samples PREWHERE ts BETWEEN … GROUP BY service query completed42 ms
INGEST AND QUERY INTERFACES
OpenTelemetry PromQL LogQL TraceQL ClickHouse database
Platform capabilities
Query performance for extreme telemetry volumes
Signal-specific data models, word indexes, automatic metric rollup routing and SQL pushdown reduce the amount of data each query reads and returns. Stateless readers add capacity without moving durable state out of the ClickHouse database tier.
02
Add stateless query capacity
Scale readers and writers independently without moving durable state away from the ClickHouse database tier.
03
Read the most efficient metric rollup
Automatically route eligible PromQL ranges to the coarsest resolution that preserves the requested result.
04
Run complex work beside the data
Compile filters, grouping, joins and eligible aggregation into SQL, reducing traffic between the stateless and database tiers.
The query is the contract
Familiar expressions compile into efficient database plans
PulsusDB parses each expression, selects the physical read path and pushes exact filters, grouping and eligible aggregation into the ClickHouse database. Only the required result crosses back to the stateless tier.
logs.queryLogQL
{service_name="checkout"} |= "timeout"Resolve labels first. Word indexes prune indexable terms; substring-only filters scan the selected streams.
generated.sqlCLICKHOUSE
SELECT ts, labels, body
FROM log_samples
PREWHERE ts BETWEEN $start AND $end
AND fingerprint IN (…)
WHERE body LIKE '%timeout%'
ORDER BY ts DESC LIMIT 100
primary key pruned4,096 rows read
metrics.queryPromQL
sum by (service) (rate(http_requests_total[5m]))Keep the Prometheus API. Push safe work into the ClickHouse database, evaluate the rest faithfully.
generated.sqlCLICKHOUSE
SELECT service, toStartOfInterval(ts, 60)
AS bucket, sum(value) AS samples
FROM metric_samples
PREWHERE metric_name = $metric
AND ts BETWEEN $start AND $end
GROUP BY service, bucket
primary key pruned4,096 rows read
traces.queryTraceQL
{ resource.service.name = "api" && duration > 1s }Search traces by the attributes engineers actually use, not only by trace ID.
generated.sqlCLICKHOUSE
SELECT trace_id, min(start_ts), max(end_ts)
FROM trace_spans
PREWHERE service = $service
AND start_ts BETWEEN $start AND $end
WHERE duration_ns > 1000000000
GROUP BY trace_id ORDER BY min(start_ts) DESC
primary key pruned4,096 rows read
Prometheus HTTP API Product-neutral query APIs Optional compatibility endpoints WebSocket live tail
Deployment model
Stateless PulsusDB processes
Stateful ClickHouse database tier
Start with one process, then scale ingestion and query independently as traffic changes. Durable telemetry, rollups and distributed execution remain in the ClickHouse database tier.
SHIP
OTel CollectorOTLP + remote write
logsmetricstracesprofiles
TRANSLATE
PulsusDBsingle Rust binary
STATELESS writerparse + batch
readerquery + plan
modeallwriterreader
STORE
ClickHouse databasedurable state + distributed compute
Start small with all mode and a single ClickHouse node.
Split writer and reader modes as the workload grows.
Restart and load-balance PulsusDB freely; caches are rebuildable.
Client and dashboard compatibility
Use the tools already built around these query APIs
Connect Prometheus-compatible clients and observability tools to the APIs they already understand while PulsusDB changes the storage and execution path underneath them. Product-neutral endpoints remain available alongside optional compatibility routes.
PULSUS_COMPAT_ENDPOINTS=true Open source development
Review the code and follow implementation decisions
PulsusDB is an AGPLv3 digitalis.io product under active development. Source code, architecture documents, query examples and implementation issues are public.
$ git clone digitalis-io/pulsusdb
Cloning into 'pulsusdb'...
$ cd pulsusdb
$