Searching for light dark matter, from the early universe to direct detection