Skip to content

fix: example in readme #2

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
jsbrain wants to merge 125 commits into
base: postgres
Choose a base branch
from
Open

fix: example in readme #2

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
125 commits
Select commit Hold shift + click to select a range
a1bd367
initial import of postgres output plugin
svenklemm Oct 19, 2017
0afa350
make address configurable
svenklemm Oct 20, 2017
bcca5c8
add helper functions for create table and insert
svenklemm Oct 22, 2017
a13ac44
add tests
svenklemm Oct 22, 2017
1a6b1c4
fix sql placeholder
svenklemm Oct 24, 2017
5ea8868
let pgx handle time conversion, remove old code
svenklemm Oct 24, 2017
8aa03cf
adjust test cases to datatype changes
svenklemm Oct 24, 2017
749e757
remove debug prints
svenklemm Oct 27, 2017
e157258
check if table exists before creating
svenklemm Oct 27, 2017
05df41b
allow skipping tags
svenklemm Oct 28, 2017
4c35bff
refactoring
svenklemm Nov 5, 2017
07dcf4e
implement TagsAsForeignkeys
svenklemm Nov 5, 2017
8348b7e
fix tests
svenklemm Nov 5, 2017
feee01c
add SampleConfig
svenklemm Nov 5, 2017
7b0315b
register driver
svenklemm Nov 5, 2017
cd4363f
update README
svenklemm Nov 5, 2017
8d5ad62
prepare for create table template
svenklemm Nov 6, 2017
a1e6b9a
quote identifier
svenklemm Nov 7, 2017
b87f066
refactor generateInsert
svenklemm Nov 7, 2017
22d8a1e
use timestamp for time column to allow pg10 partitioning
svenklemm Nov 7, 2017
212125f
remove nondeterministic tests
svenklemm Nov 8, 2017
c3874cf
use template for create table query generation
svenklemm Nov 8, 2017
d5f27b4
make TableTemplate configurable
svenklemm Nov 8, 2017
8ee4803
add quoteLiteral helper function
svenklemm Nov 18, 2017
7e3330c
add tests for quoting
svenklemm Nov 18, 2017
ee6fd6b
add TABLELITERAL to template variables
svenklemm Nov 18, 2017
236ddb9
fix template in doc
svenklemm Nov 18, 2017
09f311a
dont add primary key
svenklemm Nov 18, 2017
9dc0fed
allow using jsonb for fields and tags and make it default
svenklemm Nov 26, 2017
8fb25ae
document jsonb settings
svenklemm Nov 28, 2017
a0868dd
document template better
svenklemm Jan 17, 2018
05a9096
rework TagsAsForeignkeys to have produce 1 foreign key in measurement
svenklemm Jan 23, 2018
0fbbe99
make tag table suffix configurable
svenklemm Jan 23, 2018
079bf70
comment out noisy log messages when fk reference is not found
svenklemm Feb 5, 2018
b337ffd
handle missing columns
svenklemm Feb 5, 2018
4d58e93
remove dead code
svenklemm Feb 11, 2018
352a105
postgresql output: boolean columns
saaros Apr 16, 2018
9ddb5f0
postgresql output: batch inserts to the same table/column set
saaros Apr 17, 2018
7e989e0
use timestamptz for time column
svenklemm May 12, 2018
e50c752
adjust test to timestamptz change
svenklemm May 13, 2018
a7cf1c7
fix code formatting (gofmt)
svenklemm Jun 11, 2018
c33e057
include type in error message about unknown type
svenklemm Jul 5, 2018
b20dd45
handle uint64 as datatype
svenklemm Jul 5, 2018
41a5155
fix Printf call
svenklemm Jul 5, 2018
9178024
show all config parameters in readme
svenklemm Jul 17, 2018
b43071e
use CREATE TABLE IF NOT EXISTS
svenklemm Oct 16, 2018
f6fa727
remove commented out code, initialize vars with values
svenklemm Oct 25, 2018
99970bc
fix TABLELITERAL quoting
svenklemm Nov 27, 2018
150a2a7
pg output: Support defining schema for metrics tables
rikonen Nov 25, 2018
4adb096
pg output: Retry writing metrics after adding missing columns
rikonen Nov 29, 2018
3d2d42f
pg output: Don't try closing nil rows
rikonen Nov 29, 2018
bbfd604
adjust test output
svenklemm Nov 29, 2018
a76cbaa
add schema config settting to README
svenklemm Nov 29, 2018
046d52d
Fix adding tags when using tags as foreign key
svenklemm Nov 29, 2018
4c24bc3
Refactor PostgreSQL output plugin code
May 29, 2019
22aff8c
Optimize insert performance of metrics and tag_id lookup
Jul 14, 2019
e559ac5
Attempt reconnect to db if conn is lost and support PG env variables
Jul 18, 2019
44fabb8
error thrown on insufficient permissions
Dec 23, 2019
ac63696
outputs.postgresql: fix tag table creation to ignore template
phemmer Nov 11, 2020
bc10b00
outputs.postgresql: Use a deterministic tag key
phemmer Nov 11, 2020
680ea4b
outputs.postgresql: Sort columns on table creation
phemmer Nov 11, 2020
5966abd
outputs.postgresql: Use standard postgres data types
phemmer Nov 11, 2020
7a9d8d7
outputs.postgresql: use connection pool
phemmer Nov 11, 2020
a4b8a81
outputs.postgresql: add write concurrency support
phemmer Nov 12, 2020
2659ac5
outputs.postgresql: cache table structure
phemmer Nov 12, 2020
adcef5f
outputs.postgresql: refactor table structure management
phemmer Nov 14, 2020
79146a8
outputs.postgresql: drop unsupported fields when schema updates disabled
phemmer Nov 14, 2020
aff0c3e
outputs.postgresql: give more control over table templating
phemmer Nov 15, 2020
a344a3c
outputs.postgresql: Drop metrics with missing tag columns in DB
phemmer Nov 15, 2020
7f464f1
outputs.postgresql: Re-add population of the tag table
phemmer Nov 16, 2020
c6df522
outputs.postgresql: fix column sorting when creating new tables
phemmer Dec 9, 2020
e33f46f
outputs.postgresql: don't retry permanent errors when in single-conne…
phemmer Dec 9, 2020
9f206c5
identify tag columns using PG column comments
phemmer Jan 4, 2021
fec5a95
outputs/postgresql: split templating into its own package
phemmer Jan 4, 2021
9f1d8c1
outputs/postgresql: rename row_source -> table_source
phemmer Jan 4, 2021
05af57e
outputs/postgresql: use copy for loading tags
phemmer Jan 5, 2021
07d5d46
outputs/postgresql: update config documentation
phemmer Jan 5, 2021
c39a091
outputs/postgresql: update go modules
phemmer Jan 5, 2021
5759658
output/postgresql: Use a transaction for sequential writes
phemmer Jan 13, 2021
e87c9f6
outputs/postgresql: slight documentation cleanup
phemmer Jan 13, 2021
b51987f
outputs.postgresql: add tests
phemmer Apr 12, 2021
1a507bc
outputs.postgresql: add template documentation
phemmer Apr 12, 2021
eb03fda
outputs.postgresql: Reduce template type stutter
phemmer Apr 12, 2021
cd49b3e
outputs.postgresql: Add benchmark
phemmer Apr 18, 2021
ceb6d35
outputs.postgresql: add tag_id insert caching
phemmer Apr 19, 2021
5603641
outputs.postgresql: remove dbConnectedHook for clearing caches
phemmer Apr 19, 2021
517f02c
outputs.postgresql: simplify indexing of table columns
phemmer Apr 19, 2021
4fed553
outputs.postgresql: minor clean up tests
phemmer Apr 20, 2021
82c3170
update modules after rebase
phemmer Apr 20, 2021
a7e2b51
outputs.postgresql: fix index error on inconsistent tags
phemmer Jul 12, 2021
46f31cd
address 'go vet' unkeyed field complaints.
phemmer Jul 13, 2021
cd6203d
outputs.postgresql: remove panics on dropTagColumn & dropFieldColumn
phemmer Jul 15, 2021
2bd9699
outputs.postgresql: rename template package to sqltemplate
phemmer Jul 15, 2021
21bdd23
outputs.postgresql: use testutil.MustMetric
phemmer Jul 15, 2021
9a0ed7c
outputs.postgresql: remove postgres test server auto-detection
phemmer Jul 15, 2021
2d553db
outputs.postgresql: use struct for args to test batchGenerator
phemmer Jul 15, 2021
08ed5e7
outputs.postgresql: unexport WriteTagTable
phemmer Jul 15, 2021
93aec6f
outputs/postgresql: address PR comments
phemmer Aug 13, 2021
ff644a9
outputs/postgresql: Refactor initialization to use telegraf convention
phemmer Aug 13, 2021
fa5f937
Merge remote-tracking branch 'origin/master' into postgres
phemmer Aug 13, 2021
04d2764
outputs/postgresql: address linter complaints
phemmer Aug 14, 2021
a1316ae
outputs/postgresql: update licenses
phemmer Aug 16, 2021
55f071b
outputs/postgresql: remove maybeTempError
phemmer Aug 16, 2021
ed55f2f
outputs/postgresql: configure integration testing
phemmer Aug 16, 2021
50c8b39
outputs.postgresql: change default log level to warn
phemmer Aug 27, 2021
3f946a2
outputs.postgresql: fix error handling on sequential writes
phemmer Aug 27, 2021
48315bb
outputs.postgresql: don't try to detect mismatched data types
phemmer Aug 27, 2021
1936779
outputs.postgresql: add support for pguint
phemmer Aug 27, 2021
0038e57
outputs.postgresql: rewrite schema updates to address concurrency issues
phemmer Aug 31, 2021
1bcc5c2
outputs.postgresql: update README & add test to keep updated
phemmer Sep 1, 2021
94f0b74
outputs.postgresql: fix missing .allColumns template values
phemmer Sep 8, 2021
40ef1f9
outputs.postgresql: use timestamp without time zone
phemmer Sep 17, 2021
2d84174
outputs.postgresql: set pg connection application name
phemmer Sep 22, 2021
a00e292
outputs.postgresql: fixes for cache
phemmer Sep 22, 2021
10c0810
outputs.postgresql: add "connection" parameter to sample config
phemmer Oct 11, 2021
96a1b41
outputs.postgresql: better handling of DDL errors
phemmer Oct 13, 2021
04cfa33
outputs.postgresql: fix tests error logging & handling of %w
phemmer Oct 13, 2021
402b4ec
outputs.postgresql: fix column removal
phemmer Oct 26, 2021
02ee794
Merge remote-tracking branch 'origin/master' into postgres
phemmer Oct 26, 2021
0665544
outputs.postgresql: fix tags_as_foreign_keys typo in README
phemmer Feb 1, 2022
ddb5575
Merge remote-tracking branch 'origin/master' into postgres
phemmer Feb 18, 2022
0e511d6
outputs/postgresql: fix go test detection for pguint extension
phemmer Feb 18, 2022
e87744d
Merge remote-tracking branch 'origin/master' into postgres
phemmer Feb 18, 2022
e27281f
outputs/postgresql: update README for linter
phemmer Feb 18, 2022
efaecae
fix: example in readme
jsbrain Feb 25, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions docs/INTEGRATION_TESTS.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -52,6 +52,7 @@ Current areas we have integration tests:
| Outputs: MQTT | |
| Outputs: Nats | |
| Outputs: NSQ | |
| Outputs: Postgresql | |

Areas we would benefit most from new integration tests:

Expand Down
9 changes: 9 additions & 0 deletions docs/LICENSE_OF_DEPENDENCIES.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -17,6 +17,9 @@ following works:
- github.com/Azure/go-autorest [Apache License 2.0](https://github.com/Azure/go-autorest/blob/master/LICENSE)
- github.com/Azure/go-ntlmssp [MIT License](https://github.com/Azure/go-ntlmssp/blob/master/LICENSE)
- github.com/ClickHouse/clickhouse-go [MIT License](https://github.com/ClickHouse/clickhouse-go/blob/master/LICENSE)
- github.com/Masterminds/goutils [Apache License 2.0](https://github.com/Masterminds/goutils/blob/master/LICENSE.txt)
- github.com/Masterminds/semver [MIT License](https://github.com/Masterminds/semver/blob/master/LICENSE.txt)
- github.com/Masterminds/sprig [MIT License](https://github.com/Masterminds/sprig/blob/master/LICENSE.txt)
- github.com/Mellanox/rdmamap [Apache License 2.0](https://github.com/Mellanox/rdmamap/blob/master/LICENSE)
- github.com/Microsoft/go-winio [MIT License](https://github.com/Microsoft/go-winio/blob/master/LICENSE)
- github.com/Shopify/sarama [MIT License](https://github.com/Shopify/sarama/blob/master/LICENSE)
Expand Down Expand Up @@ -67,6 +70,7 @@ following works:
- github.com/cespare/xxhash [MIT License](https://github.com/cespare/xxhash/blob/master/LICENSE.txt)
- github.com/cisco-ie/nx-telemetry-proto [Apache License 2.0](https://github.com/cisco-ie/nx-telemetry-proto/blob/master/LICENSE)
- github.com/containerd/containerd [Apache License 2.0](https://github.com/containerd/containerd/blob/master/LICENSE)
- github.com/coocood/freecache [MIT License](https://github.com/coocood/freecache/blob/master/LICENSE)
- github.com/coreos/go-semver [Apache License 2.0](https://github.com/coreos/go-semver/blob/main/LICENSE)
- github.com/coreos/go-systemd [Apache License 2.0](https://github.com/coreos/go-systemd/blob/main/LICENSE)
- github.com/couchbase/go-couchbase [MIT License](https://github.com/couchbase/go-couchbase/blob/master/LICENSE)
Expand Down Expand Up @@ -135,6 +139,8 @@ following works:
- github.com/hashicorp/go-uuid [Mozilla Public License 2.0](https://github.com/hashicorp/go-uuid/blob/master/LICENSE)
- github.com/hashicorp/golang-lru [Mozilla Public License 2.0](https://github.com/hashicorp/golang-lru/blob/master/LICENSE)
- github.com/hashicorp/serf [Mozilla Public License 2.0](https://github.com/hashicorp/serf/blob/master/LICENSE)
- github.com/huandu/xstrings [MIT License](https://github.com/huandu/xstrings/blob/master/LICENSE)
- github.com/imdario/mergo [BSD 3-Clause "New" or "Revised" License](https://github.com/imdario/mergo/blob/master/LICENSE)
- github.com/influxdata/go-syslog [MIT License](https://github.com/influxdata/go-syslog/blob/develop/LICENSE)
- github.com/influxdata/influxdb-observability/common [MIT License](https://github.com/influxdata/influxdb-observability/blob/main/LICENSE)
- github.com/influxdata/influxdb-observability/influx2otel [MIT License](https://github.com/influxdata/influxdb-observability/blob/main/LICENSE)
Expand All @@ -151,6 +157,7 @@ following works:
- github.com/jackc/pgservicefile [MIT License](https://github.com/jackc/pgservicefile/blob/master/LICENSE)
- github.com/jackc/pgtype [MIT License](https://github.com/jackc/pgtype/blob/master/LICENSE)
- github.com/jackc/pgx [MIT License](https://github.com/jackc/pgx/blob/master/LICENSE)
- github.com/jackc/puddle [MIT License](https://github.com/jackc/puddle/blob/master/LICENSE)
- github.com/jaegertracing/jaeger [Apache License 2.0](https://github.com/jaegertracing/jaeger/blob/master/LICENSE)
- github.com/james4k/rcon [MIT License](https://github.com/james4k/rcon/blob/master/LICENSE)
- github.com/jcmturner/aescts [Apache License 2.0](https://github.com/jcmturner/aescts/blob/master/LICENSE)
Expand Down Expand Up @@ -182,8 +189,10 @@ following works:
- github.com/microsoft/ApplicationInsights-Go [MIT License](https://github.com/microsoft/ApplicationInsights-Go/blob/master/LICENSE)
- github.com/miekg/dns [BSD 3-Clause Clear License](https://github.com/miekg/dns/blob/master/LICENSE)
- github.com/minio/highwayhash [Apache License 2.0](https://github.com/minio/highwayhash/blob/master/LICENSE)
- github.com/mitchellh/copystructure [MIT License](https://github.com/mitchellh/copystructure/blob/master/LICENSE)
- github.com/mitchellh/go-homedir [MIT License](https://github.com/mitchellh/go-homedir/blob/master/LICENSE)
- github.com/mitchellh/mapstructure [MIT License](https://github.com/mitchellh/mapstructure/blob/master/LICENSE)
- github.com/mitchellh/reflectwalk [MIT License](https://github.com/mitchellh/reflectwalk/blob/master/LICENSE)
- github.com/moby/ipvs [Apache License 2.0](https://github.com/moby/ipvs/blob/master/LICENSE)
- github.com/modern-go/concurrent [Apache License 2.0](https://github.com/modern-go/concurrent/blob/master/LICENSE)
- github.com/modern-go/reflect2 [Apache License 2.0](https://github.com/modern-go/reflect2/blob/master/LICENSE)
Expand Down
16 changes: 13 additions & 3 deletions go.mod
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -15,6 +15,7 @@ require (
github.com/Azure/go-autorest/autorest/azure/auth v0.5.11
github.com/BurntSushi/toml v0.4.1
github.com/ClickHouse/clickhouse-go v1.5.1
github.com/Masterminds/sprig v2.22.0+incompatible
github.com/Mellanox/rdmamap v0.0.0-20191106181932-7c3c4763a6ee
github.com/Shopify/sarama v1.29.1
github.com/aerospike/aerospike-client-go v1.27.0
Expand Down Expand Up @@ -43,6 +44,7 @@ require (
github.com/bmatcuk/doublestar/v3 v3.0.0
github.com/caio/go-tdigest v3.1.0+incompatible
github.com/cisco-ie/nx-telemetry-proto v0.0.0-20190531143454-82441e232cf6
github.com/coocood/freecache v1.2.0
github.com/coreos/go-semver v0.3.0
github.com/coreos/go-systemd v0.0.0-20190719114852-fd7a80b32e1f
github.com/couchbase/go-couchbase v0.1.1
Expand Down Expand Up @@ -85,6 +87,9 @@ require (
github.com/influxdata/toml v0.0.0-20190415235208-270119a8ce65
github.com/influxdata/wlog v0.0.0-20160411224016-7c63b0a71ef8
github.com/intel/iaevents v1.0.0
github.com/jackc/pgconn v1.10.1
github.com/jackc/pgio v1.0.0
github.com/jackc/pgtype v1.9.1
github.com/jackc/pgx/v4 v4.14.1
github.com/james4k/rcon v0.0.0-20120923215419-8fbb8268b60a
github.com/jhump/protoreflect v1.8.3-0.20210616212123-6cc1efa697ca
Expand Down Expand Up @@ -181,6 +186,8 @@ require (
github.com/Azure/go-autorest/logger v0.2.1 // indirect
github.com/Azure/go-autorest/tracing v0.6.0 // indirect
github.com/Azure/go-ntlmssp v0.0.0-20200615164410-66371956d46c // indirect
github.com/Masterminds/goutils v1.1.1 // indirect
github.com/Masterminds/semver v1.5.0 // indirect
github.com/Microsoft/go-winio v0.4.17 // indirect
github.com/Microsoft/hcsshim v0.8.23 // indirect
github.com/alecthomas/participle v0.4.1 // indirect
Expand All @@ -205,6 +212,7 @@ require (
github.com/bitly/go-hostpool v0.1.0 // indirect
github.com/cenkalti/backoff v2.2.1+incompatible // indirect
github.com/cenkalti/backoff/v4 v4.1.2 // indirect
github.com/cespare/xxhash v1.1.0 // indirect
github.com/cespare/xxhash/v2 v2.1.2 // indirect
github.com/cloudflare/golz4 v0.0.0-20150217214814-ef862a3cdc58 // indirect
github.com/containerd/cgroups v1.0.1 // indirect
Expand Down Expand Up @@ -249,13 +257,13 @@ require (
github.com/hashicorp/go-rootcerts v1.0.2 // indirect
github.com/hashicorp/golang-lru v0.5.4 // indirect
github.com/hashicorp/serf v0.9.6 // indirect
github.com/huandu/xstrings v1.3.2 // indirect
github.com/imdario/mergo v0.3.12 // indirect
github.com/jackc/chunkreader/v2 v2.0.1 // indirect
github.com/jackc/pgconn v1.10.1 // indirect
github.com/jackc/pgio v1.0.0 // indirect
github.com/jackc/pgpassfile v1.0.0 // indirect
github.com/jackc/pgproto3/v2 v2.2.0 // indirect
github.com/jackc/pgservicefile v0.0.0-20200714003250-2b9c44734f2b // indirect
github.com/jackc/pgtype v1.9.1 // indirect
github.com/jackc/puddle v1.2.0 // indirect
github.com/jaegertracing/jaeger v1.26.0 // indirect
github.com/jcmturner/aescts/v2 v2.0.0 // indirect
github.com/jcmturner/dnsutils/v2 v2.0.0 // indirect
Expand All @@ -278,8 +286,10 @@ require (
github.com/mdlayher/netlink v1.4.2 // indirect
github.com/mdlayher/socket v0.0.0-20211102153432-57e3fa563ecb // indirect
github.com/minio/highwayhash v1.0.1 // indirect
github.com/mitchellh/copystructure v1.2.0 // indirect
github.com/mitchellh/go-homedir v1.1.0 // indirect
github.com/mitchellh/mapstructure v1.4.1 // indirect
github.com/mitchellh/reflectwalk v1.0.2 // indirect
github.com/moby/sys/mount v0.2.0 // indirect
github.com/moby/sys/mountinfo v0.4.1 // indirect
github.com/moby/term v0.0.0-20201216013528-df9cb8a40635 // indirect
Expand Down
Loading