BuzzerBeater Forums

BB Global (English) > The BB Training Crowd-Sourcing Project

The BB Training Crowd-Sourcing Project

Set priority
Show messages by
From: wozzvt
This Post:
4444
203921.1
Date: 12/03/2011 16:11:59
Overall Posts Rated:
227227
So, it's been about two years since the training analysis thread (78242.01) was updated. And while this thread was great at giving us a rough idea of how much training players get, it leaves a lot to be desired in terms of exact training rates, the effect of things like age, height, trainer level and partial minutes, not to mention things like the much-speculated elastic effect, and the new cross-training effects.

With that in mind, I'm looking for people who are interested in participating in a new crowd-sourcing project that I've created with the help of a few other BB managers. The project uses a greasemonkey script to send data directly from the BB Training page to a webpage where you can track your training history. It then uses the bbapi to automatically grab minutes and player info so that we can do some serious analysis of training speeds. We've been using this in the USA NT community for a few weeks now, and the quality of the data is top notch, but we need more users (and more weeks of training data) to start answering some of the really interesting questions. If you're interested, there's more info available at the website:

(http://training.bb-usa.net/)

You can log in with your bbapi user name and access key, and on the main page you'll see instructions on how to get and use the greasemonkey script, which will add a button to your training page. Then each week, all you have to do is click the button, and everything else will happen like magic.

So what's in it for you? A few things are available immediately:
- We've developed a pretty simple, but pretty useful interface for tracking training history and progress. Makes it easy to keep track of what you've trained and when, without having to worry about spreadsheets. Access it from anywhere!
- When you click on a player page, you'll get some useful additional information. In particular, it will tell you how much training he's had in each skill since the last time he popped, including primary and secondary training, so you can get a better sense of when they should pop again. You'll also get a full pop history (since you've started updating), an estimate of how close the player is to capping and their estimated salary, and an estimate of how much a pop in each skill will effect the salary and cap value.
- A training planner that let's you change a player's skills to see how the future skills will affect salary and cap values.

And of course, long term, all the training info we gather will be available to people who have been regularly updating their info, including:
- Estimates of how much each training type trains each skill.
- How much age, height and trainer level really matter.
- What fraction of training each player gets if they fall short of the 48+ minutes.
- Access to the raw data. All identifying information (player names, IDs, teams, etc) will always be kept anonymous, but the basic training data (minutes, training type, trainer info and skill pops) will be made available for anyone who's interested in doing their own analysis of the data.

Since this uses the BB Training page to get skill updates, supporters will be able to add info retroactively, but non-supporters will only be able to add the most recent data. Because of this, depending on how many supporters participate, we may be able to start getting some of the analysis in place pretty quickly since we've already got a head start from USA users that have been using this for the past month or so. Feel free to drop a note here or BB-mail me if you've got any questions.


(http://training.bb-usa.net/)

Last edited by wozzvt at 06/15/2012 06:39:55

From: wozzvt

This Post:
11
203921.2 in reply to 203921.1
Date: 12/03/2011 17:05:35
Overall Posts Rated:
227227
One thing I should have mentioned is that the greasemonkey portion of the script will probably only work if you're language is set to english (US). We'll work on resolving this, but for now unfortunately I think we're stuck with it.

This Post:
22
203921.3 in reply to 203921.1
Date: 12/03/2011 17:31:35
Overall Posts Rated:
887887
That's cool. About few days ago in our Brainiac fed we have discussed the training analysis based on DMI changing for players keeping GS 9. In this case the DMI changes only due to the skill-ups and is not affected by GS.

Btw.
Because of this, depending on how many supporters participate, we may be able to start getting some of the analysis in place pretty quickly

If the supporters changed the coach some time ago - then the script will send the data with the current coach level, but not with the one that was before. Right? That may lead to some incorrect results, so it's better not to send the data of trainings with the previous coach.

P.s. Training histry doesn't show any results for me. Chrome 15. English US is set.

Last edited by alexFerguson at 12/03/2011 17:33:32

This Post:
11
203921.4 in reply to 203921.3
Date: 12/03/2011 17:36:00
Overall Posts Rated:
227227
That's cool. About few days ago in our Brainiac fed we have discussed the training analysis based on DMI changing for players keeping GS 9. In this case the DMI changes only due to the skill-ups and is not affected by GS.

Yup, it's tracking both DMI and GS to make this possible. I'm not totally sold on the idea yet (comparing across players will be difficult given the relationship of DMI to various skills, etc), but that's one of the reasons I mentioned about making the data available to anyone who has ideas on how best to analyze it.

If the supporters changed the coach some time ago - then the script will send the data with the current coach level, but not with the one that was before. Right? That may lead to some incorrect results, so it's better not to send the data of trainings with the previous coach.

Yup, this is an unavoidable problem. In the meantime, anyone who wants to add old data and remembers when or about when they changed trainers can just bb-mail me and i'll fix it manually in the database.

Last edited by wozzvt at 12/03/2011 17:36:35

From: wozzvt

This Post:
22
203921.6 in reply to 203921.5
Date: 12/04/2011 10:44:28
Overall Posts Rated:
227227
Do you have some data protection policy for non-US NT players? If not, would you consider making one?

Hi Josef,

This is of course a concern with anything that uses the bbapi (buzzer-manager, etc), and all I can really do is promise that identifiable data certainly won't be shared in any way. In fact, even for the US version of this that we've been using we keep the data quite separate from our NT databases so that users can access this feature independently of whether their players are being tracked for NT purposes. I am the only one that has access to the database itself, and only venture in as far as is necessary to track down bugs.

As for the data-sharing portion of this project, skills themselves will never be shared. At some point we will be interested in looking at things like the "elastic effects" which require skills, but in these cases, the skills themselves will never be shared. I may look into whether certain summary statistics (mean/standard deviation across skills, etc) can be shared, but this will only happen if it can really be done without identifying the player. If this can't be done, I'll limit it to analyses that I run, and if people want to try out new analyses, they can do it through me.

As for a specific policy regarding non-US NT players, they get treated like everyone else. I don't want to exclude them because high skill players are going to be important for tracking down some aspects of training (and because we can't tell they're NT players through the bbapi). Their data certainly won't be shared, but that applies to all players, not just NTers.

I completely understand that not everyone will want to participate because of this though.

From: Kukoc

This Post:
11
203921.7 in reply to 203921.6
Date: 12/04/2011 12:53:05
Overall Posts Rated:
13361336
I think this project is a great idea!

This Post:
00
203921.8 in reply to 203921.1
Date: 12/04/2011 21:22:20
Overall Posts Rated:
6868
Looks interesting I'm in.

From: wozzvt
This Post:
66
203921.9 in reply to 203921.8
Date: 12/06/2011 11:11:58
Overall Posts Rated:
227227
Thanks to all those who have joined so far! If you haven't participated, you still can! Just head to (http://bb-training.comuf.com/)

We've already collected 441 weeks of training data, which when combined with what we have from the US database is starting to produce some good results.

I've added a link that takes you to an "Analysis" overview page, outlining the different results we're getting, and provides access to the raw data. For now, I've put up a basic "training speed analysis", which basically replicates the old thread here in BB-Global, but with more data and (hopefully) more accurate speed estimates. It will also update automatically as more data is added, so the estimates will continue to be refined. And you can specify an age range to look at, so you can set 18-25 to get a sense of relative speeds based on a very large sample, or set it to 18-18 to get a specific data point, but with potential small sample size issues (for now!).

As a teaser to those still on the fence, here are the training rates for JS Wingman training, based on players aged 18-25.

JS: 0.4
JR: 0.1
Hnd: 0.05
Drv: 0.03
IS: 0 (!)

And 1v1 for Forwards:
JS: 0.14
Hnd: 0.35
Drv: 0.39
IS: 0.18

And if you've ever wondered how those Hnd/Drv rates compare to 1v1 for Guards, you can see that as well.

If this looks like data you'd be interested in, join in! The more data we get, the better the quality of results will be. It's available to everyone who's added at least 2 weeks of training data, which should be everyone who's participated.

From: Manouche

This Post:
11
203921.10 in reply to 203921.9
Date: 12/06/2011 12:14:15
Overall Posts Rated:
699699
Great stuff as expected ! Some very surprising results for HN and DRV as secondaries despite what looks like a reasonable sample. It really seems way off.

But an awesome tool that will quickly help to solve those little mysteries and dirty secrets :)
Thank you !


edit : I want to add that more date is needed. Supporters, sign up !

Last edited by Manouche at 12/06/2011 12:18:37