xl-lighthouse
新一代全景式实时业务监控系统,承载1000万个监控项,每天可高效处理5000亿条消息。XL-LightHouse是一套支持超大数据量、支持超高并发的实时业务指标监控系统【同时支持单
What is xl-lighthouse?
新一代全景式实时业务监控系统,承载1000万个监控项,每天可高效处理5000亿条消息。XL-LightHouse是一套支持超大数据量、支持超高并发的实时业务指标监控系统【同时支持单机版】。常见的应用场景包括:PV、UV统计;电商销售额、下单用户数统计;日志量统计;接口调用量、异常量、耗时情况统计;服务器运维监控等功能,系统支持多维度统计,支持各种复杂的条件筛选和逻辑判断,一键部署,一行代码接入,轻松实现业务全链路数据监控,帮助企业快速搭建数据指标监控体系。
Overview of xl-lighthouse
What it is
XL-LightHouse is a real-time business metrics monitoring system that supports extremely large data volumes and high concurrency. It can manage 10 million metrics and process 500 billion messages per day. In addition to the big data version, it also offers a standalone edition. The system integrates data writing, computation, and visualization, covering various streaming statistics scenarios.
Key features
- Supports streaming statistics operations: count, sum, max, min, avg, distinct, topN/lastN.
- Allows multi-dimensional computation and custom statistical periods (minute, hour, day).
- Includes built-in functions for data transformation and expression parsing for complex filtering and logic.
- Provides a visualization query interface and API for querying results, plus metric management, permission control, and rate limiting.
- Supports time-series data storage and retrieval.
- Designed for cost-efficient reuse of compute units, enabling large-scale metrics without proportional resource increase.
Use cases
XL-LightHouse can be applied across business domains for monitoring key indicators. Examples include:
- E-commerce: transaction amounts, order counts, paying users, average order value.
- Product analytics: PV, UV, click-through rates for any UI element.
- Operations: new user acquisition, channel traffic, ad click metrics.
- Development: API call volume, errors, latency; stress testing support.
- Algorithm: model training time, AB test evaluation metrics.
- DevOps: CPU, memory, load, I/O monitoring for clusters.
- IoT/IIoT: device status, sensor data aggregation.
- Video streaming: play count, likes, comments, completion rate.
Getting started
# Quick deployment with Docker (as mentioned in README)docker run ...For detailed instructions on creating data metrics and other steps, please see the repository README.
License and pricing
Licensed under Apache-2.0. The project is open source and free.
Based on the project's public README and repository metadata.