STAC Catalog harvesting
STAC Catalog harvesting uses pystac to harvest. This downloads the catalog in a go, fetching all the files, building the catalog, then returning them at once. This is especially an issue with bigger catalogs (1000s of files)
The harvester was designed with streaming in mind, which would both decrease memory footprint, and also continuously stream items, which allows other components downstream to start the work.