A Case for a Value-Aware Cache
Journal article, 2014

Replication of values causes poor utilization of on-chip cache memory resources. This paper addresses the question: How much cache resources can be theoretically and practically saved if value replication is eliminated? We introduce the concept of value-aware caches and show that a sixteen times smaller value-aware cache can yield the same miss rate as a conventional cache. We then make a case for a value-aware cache design using Huffman-based compression. Since the value set is rather stable across the execution of an application, one can afford to reconstruct the coding tree in software. The decompression latency is kept short by our proposed novel pipelined Huffman decoder that uses canonical codewords. While the (loose) upper-bound compression factor is 5.2X, we show that, by eliminating cache-block alignment restrictions, it is possible to achieve a compression factor of 3.4X for practical designs.

Author

Angelos Arelakis

Chalmers, Computer Science and Engineering (Chalmers), Computer Engineering (Chalmers)

Per Stenström

Chalmers, Computer Science and Engineering (Chalmers), Computer Engineering (Chalmers)

IEEE Computer Architecture Letters

1556-6056 (ISSN)

Vol. 13 1 1-4

Areas of Advance

Information and Communication Technology

Subject Categories

Other Engineering and Technologies

Electrical Engineering, Electronic Engineering, Information Engineering

DOI

10.1109/L-CA.2012.31

More information

Created

10/6/2017