Co-DIMM: Inter-Socket Data Sharing via a Common DIMM Channel
Paper in proceeding, 2016

To improve computing density, modern datacenters widely deploy server chassis with several processor sockets integrated as independent nodes. Distributed applications processing enormous datasets on such systems require frequent inter-node communication. Data sharing among distributed on-board socket nodes in the same server chassis via commodity networking and inter-socket connection technologies is inefficient, though. To address this problem, we propose inter-socket data sharing via normal memory access instructions. Co-DIMM eliminates the overheads of protocol-stack processing and data movement through the network. Instead of sharing data through centralized shared memory based on NUMA inter-socket connections, DDR switches allow Co-DIMM ownership to be changed dynamically to support asynchronous producer-consumer data sharing. We implement Co-DIMM in a custom in-house FPGA-based platform to generate preliminary results showing that data-sharing latency between two sockets is as low as 1.33 mu s. We present potential Co-DIMM usage scenarios and discuss implementation challenges.

Computer Science

Data sharing

DIMM channel

interconnect

Processor socket

Author

K. Zhang

Chinese Academy of Sciences

L. Yu

Chinese Academy of Sciences

Y. S. Chang

Chinese Academy of Sciences

R. Zhao

Chinese Academy of Sciences

H. X. Zhang

Chinese Academy of Sciences

L. Zhang

Chinese Academy of Sciences

M. Y. Chen

Chinese Academy of Sciences

Sally A McKee

Chalmers, Computer Science and Engineering (Chalmers), Computer Engineering (Chalmers)

Memsys 2016: Proceedings of the International Symposium on Memory Systems

Vol. 03-06-October-2016 133-141
978-1-4503-4305-3 (ISBN)

Subject Categories

Computer and Information Science

DOI

10.1145/2989081.2989112

ISBN

978-1-4503-4305-3

More information

Latest update

7/12/2024