[Popcon-developers] encrypted popcon submissions

[Peter Palfrader]

On Thu, 16 May 2013, Bill Allombert wrote:

> On Sat, May 11, 2013 at 11:43:25AM +0200, Bill Allombert wrote:
> > > Why do you think this is too much for popov to handle? 
> > 
> > I did some benchmark. Currently popov CPU has about 20% of a real CPU.
> > Currently processing the popcon data takes between 6h30 and 8h30.
> > At this rate decrypting the report would take an additional 7h.
> 
> Sorry my benchmarks were completly wrong. Actually the bottleneck is the speed
> of the filesystem, especially for writing. Unfortunately popcon.debian.org
> has to process a lot of data. The database holds 10.5Gb and it receives about
> 1.4GB of submissions each days.

> Maybe I could try to schedule popcon cron job at a different time.

Our storage at ubc is pretty slow, probably overloaded.  We could
conceivably move the service to bytemark.  The HW is nice and shiny, and
for now not overloaded.

Let us know should that become necessary.

Cheers,
weasel
-- 
                           |  .''`.       ** Debian **
      Peter Palfrader      | : :' :      The  universal
 http://www.palfrader.org/ | `. `'      Operating System
                           |   `-    http://www.debian.org/