Emit samples from your application code (libraries provided)
Configure fluentbit to capture samples on hosts
Output from fluentbit to kafka
Consume samples from Kafka in SampleD consumer
SampleD will manage schema and store samples in ClickHouse
Query/visualize with Apache Superset
Infrastructure
graph LR
subgraph Host
subgraph Application
A(Libsampled)
end
B(Apache fluent-bit)
end
subgraph Infra
C(Apache kafka) -->
D(sampled-consumer) -->
E[(clickhouse)] -->
F(Apache Superset)
end
A --> B
B --> C
Consumer
go run ./consumer -logtostderr -sampled_config config.example.yaml