The magnetic tape was the birth place of storage devices. A German engineer, Fritz Plfeumer patented it in 1928.
The delay line memory consists of imparting an information pattern into a delay path. A closed loop forms to allow for the recirculation of information if the end of the delay path connects to the beginning through amplifying and time circuits.
The hard drives we are common with today had its debut back in 1956. It had rotating platters that stores and retrieves bits of digital data on a flat magnetic surface. Offcourse it has evolved greatly since then.