pg_query_analyser is a C++ clone of the PgFouine log analyser.
Processing logs with millions of lines only takes a few minutes with this parser while PgFouine chokes long before that.
The normal overview:
The overview with the examples expanded:
Ubuntu (tested with 13.10):
apt-get install qt4-dev-toolsqmake
make
make test
sudo make installSet Postgres to use this `log_line_prefix`:
log_line_prefix = '%t [%p]: [%l-1] host=%h,user=%u,db=%d,tx=%x,vtx=%v 'After that we can start parsing data.
From stdin:
cat /var/log/postgresql/postgresql.log | head -n 100000 | ./pg_query_analyser -i -From file:
./pg_query_analyser --input-file=/var/log/postgresql/postgresql.logFor a full build+analyze on Ubuntu:
cd examples
fab -H <remote-ubuntu-postgres-server> build log_and_analyse# ./pg_query_analyser -h
Usage: ./pg_query_analyser [flags]
Options:
-h, --help=[false]
-u, --users=[]
-v, --verbose=[false]
-i, --input-file=[/var/log/postgresql/postgresql-9.1-main.log]
-d, --databases=[]
-t, --query-types=[SELECT,UPDATE,INSERT,DELETE]
-o, --output-file=[report.html]
--top=[20]