@thestrangelet @falcennial From what I can find, it seems dubious whether it should fall under the definition of "large", and it looks like they're handwaving a lot about whether they actually have rights to the corpus.
They say "KL3M doesn't 'scrape' websites in violation of their terms of services or use policy." but this suggests to me that maybe they do scrape and just deem their scraping not to violate ToS. AFAICT this might just mean they honor robots.txt, but lack of a robots.txt directive not to scrape does not imply license to produce derivative works.