[Teammetrics-discuss] Updating commitstats

[Andreas Tille]

Additional hint:  I somehow think there is some systematics that the
problem of broken commitstats is affecting teams that either switched
from svn to git or use both in parallel.  IMHO we had to deal with this
in the past and it seems that the issue is not solved yet.

Kind regards

       Andreas.

On Tue, Apr 16, 2013 at 04:11:04PM +0200, Andreas Tille wrote:
> Hi again,
> 
> I finally come to the conclusion that commitstat import from scratch was
> a general failure.  I'm loosing again in debian-med commitstats and this
> simply *can* *not* *be*! ;-)
> 
> Several other graphs (not all) look very different from what we had before
> (debian-l10n, debian-science, debtags).
> 
> Please tell me whether you will have time to dive into this or whether
> we should restart from the old database dump.  Hmmmm, thinking twice
> about this I wonder whether the dump is sufficivent?  I somehow remember
> that the algorithm keeps some status data outside of the database...
> 
> So may be we need to fix this - and perhaps enhance it to keep also this
> status data inside the database to have some consistent restorable data
> store ...
> 
> Kind regards
> 
>        Andreas.
> 
> On Tue, Apr 16, 2013 at 04:05:00PM +0200, Andreas Tille wrote:
> > Additional note: the numbers in commitstat_debconf are also *very* different
> > from what we had on the old host.
> > 
> > On Tue, Apr 16, 2013 at 02:06:12PM +0200, Andreas Tille wrote:
> > > Hi Sukhbir,
> > > 
> > > On Sat, Apr 13, 2013 at 07:47:13PM -0400, Sukhbir Singh wrote:
> > > > Yes, this is expected because of the kernel repository :(
> > > 
> > > Hmmmm.
> > >  
> > > > The problem is, that the repository is so big that commitstat.py hangs
> > > > in between and doesn't go further.
> > > 
> > > I have not spend time to check this code but in any case we need to find
> > > a solution to somehow handle large repositories.
> > > 
> > > > I have tried to debug this and to
> > > > optimize it so that it works, but I was not successful. Initially, I
> > > > thought that this issue was limited to the first-run but I found it to
> > > > be there on subsequent runs also.
> > > > 
> > > > For now, I recommend that we run it removing the kernel repository.
> > > 
> > > This is what I did but as I wrote in another mail we are missing
> > > 
> > > SELECT * from commitstat where project in ('debconf-video', 'debian-desktop', 'debichem', 'fai', 'pkg-kolab', 'pkg-mc', 'pkg-mono', 'pkg-ocaml-maint', 'publicity', 'python-apps', 'python-modules', 'soc');      
> > > 
> > > The old server contained data for these projects.
> > > 
> > > > I
> > > > will look into this again, but I don't think we can make much progress
> > > > given how our "architecture" is.
> > > 
> > > ???
> > >  
> > > > Should I run it? Where do I put graphs after generating them (given the
> > > > new VM)?
> > > 
> > > The new VM has the very same directory structure as the old one and I
> > > moved all graphs I generated in an initial run to
> > > 
> > >    /var/lib/gforge/chroot/home/groups/blends/htdocs/liststats
> > > 
> > > so for the moment at least "some" graphs are there.
> > > 
> > > BTW, I have kept a DB dump from the old host that we could use as
> > > initial state as well but I would really prefer if our algorithm
> > > would be stable enouth to always work from an empty database.
> > > 
> > > Kind regards
> > > 
> > >     Andreas.
> > > 
> > > -- 
> > > http://fam-tille.de
> > > 
> > > _______________________________________________
> > > Teammetrics-discuss mailing list
> > > Teammetrics-discuss at lists.alioth.debian.org
> > > http://lists.alioth.debian.org/mailman/listinfo/teammetrics-discuss
> > > 
> > 
> > -- 
> > http://fam-tille.de
> > 
> > _______________________________________________
> > Teammetrics-discuss mailing list
> > Teammetrics-discuss at lists.alioth.debian.org
> > http://lists.alioth.debian.org/mailman/listinfo/teammetrics-discuss
> > 
> 
> -- 
> http://fam-tille.de
> 
> _______________________________________________
> Teammetrics-discuss mailing list
> Teammetrics-discuss at lists.alioth.debian.org
> http://lists.alioth.debian.org/mailman/listinfo/teammetrics-discuss
> 

-- 
http://fam-tille.de