Here’s a how-to on configuring Apache’s cache expiration headers with .htaccess (link).

I get noticeable performance gain through this. The article’s headers settings allow my host‘s caching service (Squid accelerators), to serve unexpired, static content to clients without first sending 304 requests back to Apache.

EDIT: Squid reverse proxy examples