Quickstart • Docs • Guides • Integrations • Chat • Download • Container Images
Vector is a high-performance, end-to-end (agent & aggregator) observability data pipeline that puts you in control of your observability data. Collect, transform, and route all your logs and metrics to any vendors you want today and any other vendors you may want tomorrow. Vector enables dramatic cost reduction, novel data enrichment, and data security where you need it, not where it is most convenient for your vendors. Vector is 100% open source. The complete source code and all features are publicly available.
To get started, follow our quickstart guide or install Vector.
Vector is maintained by Datadog's Community Open Source Engineering team.
- Reliable - Built in Rust, Vector's primary design goal is reliability.
- End-to-end - Deploys as an agent or aggregator. Vector is a complete platform.
- Unified - Stable support for logs and metrics in one pipeline. Trace support is available in selected components, including the OpenTelemetry source. When building a trace pipeline, check each component's supported event types and limitations.
- Reduce total observability costs.
- Transition vendors without disrupting workflows.
- Enhance data quality and improve insights.
- Consolidate agents and eliminate agent fatigue.
- Improve overall observability performance and reliability.
- Vector powers observability pipelines at Atlassian, Riot Games, Comcast, FanDuel, Zerodha, Timescale, Quad9, OpenAI, Anthropic, and many more.
- Contributors
All user documentation is available at vector.dev/docs.
To build and verify a pipeline:
- Develop a configuration and transform events with VRL.
- Validate the configuration with
vector validate. - Test transform behavior with
vector test. - Inspect a running pipeline with
vector topandvector tap.
Other Resources:
The following table shows historical throughput benchmarks from the Vector test harness, in MiB/s. Higher values are better.
Performance varies with workload, configuration, hardware, and software versions. Benchmark your own pipeline with current software.
| Test | Vector | Filebeat | Fluent Bit | Fluentd | Logstash | Splunk UF | Splunk HF | Highest throughput |
|---|---|---|---|---|---|---|---|---|
| TCP to Blackhole | 86 | n/a | 64.4 | 27.7 | 40.6 | n/a | n/a | Vector |
| File to TCP | 76.7 | 7.8 | 35 | 26.1 | 3.1 | 40.1 | 39 | Vector |
| Regex Parsing | 13.2 | n/a | 20.5 | 2.6 | 4.6 | n/a | 7.8 | Fluent Bit |
| TCP to HTTP | 26.7 | n/a | 19.6 | <1 | 2.7 | n/a | n/a | Vector |
| TCP to TCP | 69.9 | 5 | 67.1 | 3.9 | 10 | 70.4 | 7.6 | Splunk UF |
The following correctness tests are not exhaustive, but they demonstrate fundamental differences in quality and attention to detail:
| Test | Vector | Filebeat | FluentBit | FluentD | Logstash | Splunk UF | Splunk HF |
|---|---|---|---|---|---|---|---|
| Disk Buffer Persistence | ✓ | ✓ | ⚠ | ✓ | ✓ | ||
| File Rotate (create) | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| File Rotate (copytruncate) | ✓ | ✓ | ✓ | ||||
| File Truncation | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| Process (SIGHUP) | ✓ | ⚠ | ✓ | ✓ | |||
| JSON (wrapped) | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
To learn more about our correctness tests, please see the Vector test harness.
Vector is an end-to-end, unified, open data platform.
| Vector | Beats | Fluentbit | Fluentd | Logstash | Splunk UF | Splunk HF | Telegraf | |
|---|---|---|---|---|---|---|---|---|
| End-to-end | ✓ | ✓ | ||||||
| Agent | ✓ | ✓ | ✓ | ✓ | ✓ | |||
| Aggregator | ✓ | ✓ | ✓ | ✓ | ✓ | |||
| Unified | ✓ | ✓ | ||||||
| Logs | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| Metrics | ✓ | ⚠ | ⚠ | ⚠ | ⚠ | ⚠ | ⚠ | ✓ |
| Traces | Partial | |||||||
| Open | ✓ | ✓ | ✓ | ✓ | ||||
| Open-source | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ||
| Vendor-neutral | ✓ | ✓ | ✓ | ✓ | ||||
| Reliability | ✓ | |||||||
| Memory-safe | ✓ | ✓ | ||||||
| Delivery guarantees | ✓ | ✓ | ✓ | |||||
| Multi-core | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
⚠ = Not interoperable, metrics are represented as structured logs
Developed with ❤️ by Datadog - Security Policy - Privacy Policy