This is one of the stories I read as a kid in a volume of Hugo winners that kindled my love for short science fiction.
Or All the Seas with Oysters by Avram Davidson (1958) — 3,539 words (about 14 minutes for the average reader)
Originally published in Galaxy Science Fiction Magazine, May 1958.
