Parsing AWS Elastic Load Balancer log on the command line for fun and profit
Amazon Web Services Elastic Load Balancers are excellent bits of kit and one of the mot useful things they have is that you can enable logging easily. Every request that comes through gets a tonne of information logged about it and the log fires are dropped into an S3 bucket every 5 minutes (or more, this is configurable). Because of the time delay, monitoring ELB logs for real-time alerting is not something I’ve experimented with, but processing logs to figure out what went on is something I’ve spent a lot of time on recently....