[csw-maintainers] Populating private checkpkg databases via REST

[Dagobert Michelsen]

Hi Maciej,

Am 30.01.2013 um 12:24 schrieb Maciej (Matchek) Bliziński <maciej at opencsw.org>:
> While I'm wresting with the memory leak in catalog indexing, I got the
> idea that instead of unpacking and indexing everything locally, we
> could make people's private build hosts download data from our
> buildfarm. What do you think?
> 
> Pros:
> - simpler on the local buildfarm
> - could work around the current memory leak problem
> 
> Cons:
> - currently slow as hell because of the REST interface slowness
> - more stress on the buildfarm, with a potential of inadvertently
> DOSing the buildfarm remotely by sending too many requests at once
> - more stress on the buildfarm network connection, because downloading
> all the data would take up a lot of network bandwidth


I have no clue how much traffic that would be. We can carry some more, but we are
limited to 6 mbps total. We probably have a chance to deploy a much faster
machine soon on much faster network where stuff could be replicated to.


Best regards

  -- Dago

-- 
"You don't become great by trying to be great, you become great by wanting to do something,
and then doing it so hard that you become great in the process." - xkcd #896