InfluxDB

来自开放百科 - 灰狐
（版本间的差异）
跳转到： 导航, 搜索
小 (→‎指南)
小 (→‎指南)
 
（未显示1个用户的47个中间版本）
第6行： 第6行：
 
* [https://influxdata.com/time-series-platform/chronograf/ Chronograf] 数据可视化
 
* [https://influxdata.com/time-series-platform/chronograf/ Chronograf] 数据可视化
 
* [https://github.com/influxdata/kapacitor Kapacitor] 监控告警&ETL
 
* [https://github.com/influxdata/kapacitor Kapacitor] 监控告警&ETL
 +
注：InfluxDB从0.12版本开始不再将其cluster源码开源。
 +
 +
==应用场景==
 +
* 定制DevOps监控(Custom DevOps Monitoring)
 +
* 实时分析(Real Time Analytics)
 +
* 物联网和传感器数据(IoT and Sensor Data)
 +
* 云计算(Cloud & OpenStack)
 +
* 异常检测(Anomaly Detection)
 +
* 消息(Messaging)
 +
* 个性化(Personalization)
 +
* 股票交易(Equities Trading)
 +
* 市政基础设施管理(Municipal Infrastructure Management)
 +
* GPS服务(GPS Services)
 +
* 量子物理研究(Quantum Physics Research)
 +
* POS系统(Point of Sale Systems)
 +
* 制造业和家庭自动化(Manufacturing & Home Automation)
 +
* 运输和物流(Transportation & Material Logistics)
  
 
==指南==
 
==指南==
 +
OS X 安装
 +
$ brew update
 +
$ brew install influxdb
 +
$ brew install telegraf // 数据采集
 +
$ brew install homebrew/binary/chronograf // 数据可视化
 +
$ brew install kapacitor // 告警、数据处理
 +
$ influxd
 +
$ influx
 +
Visit https://enterprise.influxdata.com to register for updates, InfluxDB server management, and monitoring.
 +
Connected to http://localhost:8086 version 0.9.6.1
 +
InfluxDB shell 0.9.6.1
 +
> create database mydb
 +
> show databases
 +
> use mydb
 +
> insert cpu,host=serverA,region=us_west value=0.64
 +
> select * from cpu
 +
> insert temperature,machine=unit42,type=assembly external=25,internal=37
 +
> select * from temperature
 +
> show series
 +
> show measurements
 +
> show tag keys
 +
> show field keys
 +
 +
创建数据库
 +
curl -G 'http://localhost:8086/query' --data-urlencode "q=CREATE DATABASE mydb"
 +
插入数据
 +
curl -XPOST 'http://localhost:8086/write?db=mydb' -d 'cpu,host=server01,region=uswest load=42 1434055562000000000'
 +
curl -XPOST 'http://localhost:8086/write?db=mydb' -d 'cpu,host=server02,region=uswest load=78 1434055562000000000'
 +
curl -XPOST 'http://localhost:8086/write?db=mydb'-d 'cpu,host=server03,region=useast load=15.4 1434055562000000000'
 +
查询数据
 +
curl -G http://localhost:8086/query?pretty=true --data-urlencode "db=mydb" --data-urlencode "q=SELECT * FROM cpu WHERE host='server01' AND time < now() - 1d"
 +
分析数据
 +
curl -G http://localhost:8086/query?pretty=true --data-urlencode "db=mydb" --data-urlencode "q=SELECT mean(load) FROM cpu WHERE region='uswest'"
 +
sample数据集
 +
curl https://s3-us-west-1.amazonaws.com/noaa.water.database.0.9/NOAA_data.txt > sample-data.txt
 +
influx -import -path=sample-data.txt -precision=s
 +
提示信息: 2016/02/23 10:32:35 Processed 76290 inserts
 +
> use NOAA_water_database
 +
> show measurements
 +
> select count(water_level) from h2o_feet
 +
> select * from h2o_feet limit 5
 +
Web管理接口
 +
http://localhost:8083/
 +
创建管理员
 +
> CREATE USER admin WITH PASSWORD 'admin'
 +
> GRANT ALL PRIVILEGES TO admin
 +
> show users
 +
user  admin
 +
----  -----
 +
hupo  false
 +
admin true
 +
 +
==Grafana==
 +
[[Grafana]] 是面向 [https://github.com/graphite-project Graphite], InfluxDB & [[OpenTSDB]] 可视化仪表盘。
 +
 +
==Telegraf==
 +
Telegraf数据采集，[https://github.com/influxdata/telegraf/tree/master/plugins 一个插件驱动的服务器代理]。
 +
$ telegraf --help
 +
$ telegraf -sample-config -input-filter cpu -output-filter influxdb
 +
 +
==Chronograf==
 +
$ Chronograf
 +
http://127.0.0.1:10000
 +
 +
==Kapacitor==
 +
启动Kapacitor
 +
kapacitord config > kapacitor.conf
 +
kapacitord -config kapacitor.conf
 +
http://localhost:9092/
 +
 +
Kapacitor 使用 [https://docs.influxdata.com/kapacitor/v0.10/tick/ TICKscript] DSL 来定义任务(tasks)。
 +
 +
如：cpu_alert.tick
 +
stream
 +
    // 从sample数据库获得cpu测量值
 +
    .from().measurement('cpu')
 +
    .alert()
 +
        .crit(lambda: "usage_idle" <  70)
 +
        // 写入日志文件
 +
        .log('/tmp/alerts.log')
 +
写入task
 +
kapacitor define \
 +
    -name cpu_alert \
 +
    -type stream \
 +
    -tick cpu_alert.tick \
 +
    -dbrp mydb.default
 +
运行task
 +
kapacitor record stream -name cpu_alert -duration 20s
 +
获取数据
 +
kapacitor list recordings $rid
 +
返回类似数据
 +
ID                                      Type    Size      Created               
 +
32bc3657-4a96-472e-a982-11afc1bfb51a    stream  0 B      23 Feb 16 17:42 CST   
 +
ff90d6c3-f4a5-441c-b69d-7b23ee753398    stream  0 B      23 Feb 16 17:48 CST 
 +
Kapacitor控制台返回类似数据
 +
[httpd] 2016/02/23 17:49:57 I! ::1 - - [23/Feb/2016:17:49:57 +0800] GET /recordings?rids= HTTP/1.1 200 173 - Go-http-client/1.1 cc17e978-da12-11e5-8019-000000000000 362.8µs
 +
[httpd] 2016/02/23 17:50:10 I! ::1 - - [23/Feb/2016:17:50:10 +0800] GET /recordings?rids= HTTP/1.1 200 173 - Go-http-client/1.1 d42f803b-da12-11e5-801a-000000000000 1.570713ms
 +
[httpd] 2016/02/23 17:50:30 I! ::1 - - [23/Feb/2016:17:50:30 +0800] GET /recordings?rids= HTTP/1.1 200 173 - Go-http-client/1.1 dfc64c93-da12-11e5-801b-000000000000 1.266153ms
 +
 +
==Relay==
 +
*[https://github.com/influxdata/influxdb-relay Relay @ GitHub]
 +
*[https://www.influxdata.com/high-availability/ Introducing InfluxDB Relay: Open Source High-Availability for InfluxDB]
 +
 +
==存储==
 +
*[https://www.influxdata.com/new-storage-engine-time-structured-merge-tree/ The New InfluxDB Storage Engine: Time Structured Merge Tree]
 +
 +
==比较==
 +
*[https://www.influxdata.com/influxdb-markedly-outperforms-opentsdb-in-time-series-data-metrics-benchmark/ InfluxDB Markedly Outperforms OpenTSDB in Time-Series Data & Metrics Benchmark]
 +
*[https://www.influxdata.com/influxdb-vs-cassandra-benchmark-time-series-metrics/ InfluxDB Tops Cassandra in Time-Series Data & Metrics Benchmark]
 +
*[https://www.influxdata.com/influxdb-is-27x-faster-vs-mongodb-for-time-series-workloads/ InfluxDB is 27x Faster vs MongoDB for Time-Series Workloads]
 +
*[https://www.influxdata.com/influxdb-markedly-elasticsearch-in-time-series-data-metrics-benchmark/ InfluxDB Markedly Outperforms Elasticsearch in Time-Series Data & Metrics Benchmark]
 +
 +
==语言==
 +
InfluxDB支持的各种编程语言
 +
*[http://buransky.com/programming/introducing-the-reactiveinflux-non-blocking-influxdb-driver-for-scala-and-java-supporting-apache-spark/ Introducing the ReactiveInflux: non-blocking InfluxDB driver for Scala and Java supporting Apache Spark]
 +
 +
==用户==
 +
*[http://docs.huihoo.com/infoq/qconbeijing/2016/day2/%E5%A4%A7%E6%95%B0%E6%8D%AE%E7%94%9F%E6%80%81%E6%9E%84%E5%BB%BA%EF%BC%88%E5%8E%82%E5%95%86%E5%85%B1%E5%BB%BA%EF%BC%89/9-4-%E4%BB%8EInfluxDB%E7%9C%8B%E6%97%B6%E5%BA%8F%E6%95%B0%E6%8D%AE%E7%9A%84%E5%A4%84%E7%90%86-%20%E9%99%88%E8%B6%85.pdf 七牛从InfluxDB看时序数据的处理]
 +
*[https://www.influxdata.com/testimonials/#testimonial29 滴滴打车]
 +
*[https://www.influxdata.com/testimonials/#testimonial108 Mirantis OpenStack]
 +
[https://www.influxdata.com/customers/ 更多用户>>>]
  
 
==图集==
 
==图集==
 
<gallery>
 
<gallery>
 +
image:influxdata-architecture.jpg|架构
 +
image:influxdata-tick-stack.jpg|TICK堆栈
 
image:InfluxData-Platform-TICK-Stack.png|TICK堆栈
 
image:InfluxData-Platform-TICK-Stack.png|TICK堆栈
 +
image:influxdb-relay-high-availability.png|Relay高可用
 +
image:influxdb-and-iot.jpg|IoT
 +
image:openstack-and-influxdb.jpg|OpenStack告警日志指标管理
 +
image:realtime-analytics-with-influxdb.jpg|实时分析
 +
image:devops-monitoring.jpg|DevOps监控
 +
image:influxdb-time-series-data-write-ahead-log.png|WAL(Write Ahead Log)
 +
image:influxdb-web-admin-interface.png|Web管理接口
 +
image:influxdb-chronograf-wal.png|Chronograf数据可视化
 
</gallery>
 
</gallery>
  
第17行： 第165行：
 
*[https://influxdata.com/ InfluxDB官网]
 
*[https://influxdata.com/ InfluxDB官网]
 
*[https://github.com/influxdb/influxdb InfluxDB @ GitHub]
 
*[https://github.com/influxdb/influxdb InfluxDB @ GitHub]
 +
*[https://influxdata.com/blog/ InfluxData Blog]
 +
*[https://influxdata.com/blog/how-to-send-sensor-data-to-influxdb-from-an-arduino-uno/ How to send sensor data to InfluxDB from an Arduino Uno]
 +
*[https://www.influxdata.com/how-to-create-iot-influxdb-google-cloud-platform-part-1/ How-to Create an IoT Project with the TICK Stack on the Google Cloud Platform]
 +
*[https://zhuanlan.zhihu.com/p/23924022 使用 StatsD + InfluxDB + Grafana 搭建 Node.js 监控系统 (一)]
 +
*[https://zhuanlan.zhihu.com/p/26981364 使用 StatsD + InfluxDB + Grafana 搭建 Node.js 监控系统 (二)]
  
 
[[category:database]]
 
[[category:database]]
 +
[[category:time series database]]
 
[[category:go]]
 
[[category:go]]
 
[[category:monitoring]]
 
[[category:monitoring]]
 
[[category:Internet of Things]]
 
[[category:Internet of Things]]

2018年3月13日 (二) 07:28的最后版本

InfluxDB 是一个 Go 语言开发的开源(MIT)分布式时间序列数据库。

目录

[编辑] TICK堆栈

注：InfluxDB从0.12版本开始不再将其cluster源码开源。

[编辑] 应用场景

  • 定制DevOps监控(Custom DevOps Monitoring)
  • 实时分析(Real Time Analytics)
  • 物联网和传感器数据(IoT and Sensor Data)
  • 云计算(Cloud & OpenStack)
  • 异常检测(Anomaly Detection)
  • 消息(Messaging)
  • 个性化(Personalization)
  • 股票交易(Equities Trading)
  • 市政基础设施管理(Municipal Infrastructure Management)
  • GPS服务(GPS Services)
  • 量子物理研究(Quantum Physics Research)
  • POS系统(Point of Sale Systems)
  • 制造业和家庭自动化(Manufacturing & Home Automation)
  • 运输和物流(Transportation & Material Logistics)

[编辑] 指南

OS X 安装 

$ brew update
$ brew install influxdb
$ brew install telegraf // 数据采集
$ brew install homebrew/binary/chronograf // 数据可视化
$ brew install kapacitor // 告警、数据处理
$ influxd
$ influx
Visit https://enterprise.influxdata.com to register for updates, InfluxDB server management, and monitoring.
Connected to http://localhost:8086 version 0.9.6.1
InfluxDB shell 0.9.6.1
> create database mydb
> show databases
> use mydb
> insert cpu,host=serverA,region=us_west value=0.64
> select * from cpu
> insert temperature,machine=unit42,type=assembly external=25,internal=37
> select * from temperature
> show series
> show measurements
> show tag keys
> show field keys

创建数据库 

curl -G 'http://localhost:8086/query' --data-urlencode "q=CREATE DATABASE mydb"

插入数据 

curl -XPOST 'http://localhost:8086/write?db=mydb' -d 'cpu,host=server01,region=uswest load=42 1434055562000000000'
curl -XPOST 'http://localhost:8086/write?db=mydb' -d 'cpu,host=server02,region=uswest load=78 1434055562000000000'
curl -XPOST 'http://localhost:8086/write?db=mydb'-d 'cpu,host=server03,region=useast load=15.4 1434055562000000000'

查询数据 

curl -G http://localhost:8086/query?pretty=true --data-urlencode "db=mydb" --data-urlencode "q=SELECT * FROM cpu WHERE host='server01' AND time < now() - 1d"

分析数据 

curl -G http://localhost:8086/query?pretty=true --data-urlencode "db=mydb" --data-urlencode "q=SELECT mean(load) FROM cpu WHERE region='uswest'"

sample数据集 

curl https://s3-us-west-1.amazonaws.com/noaa.water.database.0.9/NOAA_data.txt > sample-data.txt
influx -import -path=sample-data.txt -precision=s

提示信息: 2016/02/23 10:32:35 Processed 76290 inserts 

> use NOAA_water_database
> show measurements
> select count(water_level) from h2o_feet
> select * from h2o_feet limit 5

Web管理接口 

http://localhost:8083/

创建管理员 

> CREATE USER admin WITH PASSWORD 'admin'
> GRANT ALL PRIVILEGES TO admin
> show users
user  admin
----  -----
hupo  false
admin true

[编辑] Grafana

Grafana 是面向 Graphite, InfluxDB & OpenTSDB 可视化仪表盘。

[编辑] Telegraf

Telegraf数据采集，一个插件驱动的服务器代理。 

$ telegraf --help
$ telegraf -sample-config -input-filter cpu -output-filter influxdb

[编辑] Chronograf

$ Chronograf
http://127.0.0.1:10000

[编辑] Kapacitor

启动Kapacitor 

kapacitord config > kapacitor.conf
kapacitord -config kapacitor.conf
http://localhost:9092/

Kapacitor 使用 TICKscript DSL 来定义任务(tasks)。

如：cpu_alert.tick 

stream
   // 从sample数据库获得cpu测量值
   .from().measurement('cpu')
   .alert()
       .crit(lambda: "usage_idle" <  70)
       // 写入日志文件
       .log('/tmp/alerts.log')

写入task 

kapacitor define \
   -name cpu_alert \
   -type stream \
   -tick cpu_alert.tick \
   -dbrp mydb.default

运行task 

kapacitor record stream -name cpu_alert -duration 20s

获取数据 

kapacitor list recordings $rid

返回类似数据 

ID                                      Type    Size      Created                
32bc3657-4a96-472e-a982-11afc1bfb51a    stream  0 B       23 Feb 16 17:42 CST    
ff90d6c3-f4a5-441c-b69d-7b23ee753398    stream  0 B       23 Feb 16 17:48 CST

Kapacitor控制台返回类似数据 

[httpd] 2016/02/23 17:49:57 I! ::1 - - [23/Feb/2016:17:49:57 +0800] GET /recordings?rids= HTTP/1.1 200 173 - Go-http-client/1.1 cc17e978-da12-11e5-8019-000000000000 362.8µs
[httpd] 2016/02/23 17:50:10 I! ::1 - - [23/Feb/2016:17:50:10 +0800] GET /recordings?rids= HTTP/1.1 200 173 - Go-http-client/1.1 d42f803b-da12-11e5-801a-000000000000 1.570713ms
[httpd] 2016/02/23 17:50:30 I! ::1 - - [23/Feb/2016:17:50:30 +0800] GET /recordings?rids= HTTP/1.1 200 173 - Go-http-client/1.1 dfc64c93-da12-11e5-801b-000000000000 1.266153ms

[编辑] Relay

[编辑] 存储

[编辑] 比较

[编辑] 语言

InfluxDB支持的各种编程语言

[编辑] 用户

更多用户>>>

[编辑] 图集

  • 架构

  • TICK堆栈

  • TICK堆栈

  • Relay高可用

  • IoT

  • OpenStack告警日志指标管理

  • 实时分析

  • DevOps监控

  • WAL(Write Ahead Log)

  • Web管理接口

  • Chronograf数据可视化

[编辑] 链接

来自“http://wiki.huihoo.com/wiki/?title=InfluxDB&oldid=149078”
分享您的观点
个人工具
名字空间

变换
操作
导航
工具箱