discussion
[Top] [All Lists]

[Discussion] Compressibility of log files

To: "John Heffner" <jheffner@xxxxxxx>
Subject: [Discussion] Compressibility of log files
From: "Lachlan Andrew" <lachlan.andrew@xxxxxxxxx>
Date: Tue, 30 Oct 2007 10:58:58 -0800
Greetings all,

We're logging data using web100 and
web100_log_write/web100_snap_from_log, and it is taking up lots of
disk space.

The data would be much more compressible if there was a function
web100_log_write_delta  which only recorded the *increments* in the
variables instead of the current values.  As a simple surrogate, we
were thinking of just taking byte-wise differences of the entire data
structure.

Would anyone else find it useful to improve the compressibility of web100 logs?

John, if we implement this, would you support it in future releases of
 web100_userland?

Cheers,
Lachlan

-- 
Lachlan Andrew  Dept of Computer Science, Caltech
1200 E California Blvd, Mail Code 256-80, Pasadena CA 91125, USA
Ph: +1 (626) 395-8820    Fax: +1 (626) 568-3603
http://netlab.caltech.edu/~lachlan

_______________________________________________
Discussion mailing list
Discussion@xxxxxxxxxx
http://internal.web100.org/mailman/listinfo/discussion

<Prev in Thread] Current Thread [Next in Thread>