[csw-maintainers] Populating private checkpkg databases via REST

[Maciej (Matchek) Bliziński]

While I'm wresting with the memory leak in catalog indexing, I got the
idea that instead of unpacking and indexing everything locally, we
could make people's private build hosts download data from our
buildfarm. What do you think?

Pros:
- simpler on the local buildfarm
- could work around the current memory leak problem

Cons:
- currently slow as hell because of the REST interface slowness
- more stress on the buildfarm, with a potential of inadvertently
DOSing the buildfarm remotely by sending too many requests at once
- more stress on the buildfarm network connection, because downloading
all the data would take up a lot of network bandwidth

Maciej