21 posts tagged with "Computer Vision"

That clip up top: the machine's new view of the players. Yellow stick figures — wrists, elbows, hips, feet — drawn by a free model on real match frames, including the far player at ninety pixels tall. And one frame kept for honesty: the first version confidently drawing its skeleton on a ball kid.

Today the software stops seeing players as smudges and starts seeing swings. The question: does that finally move the forehand-or-backhand call that's been stuck for two weeks?

That clip up top: eight tournament courts, two overlays each. Green is the court fit a human built by clicking four corners. Orange is a free pretrained network's fit — zero clicks. On seven courts they're a few pixels apart. On the Roland Garros plate — the one that broke the old automatic fitter — the orange lands first try. And on the night match, the machine does something arguably better than fitting: it declines.

Today the software tries to take over the last job a human still does for every single match: teaching it where the court is.

That clip up top: a 15-shot rally from the Roland Garros final, with the soundtrack drawn as a strip along the bottom. Green ticks mark the moments the video pipeline detected a hit. Yellow spikes mark the moments the microphone heard an impact. The red zones are the seconds where the ball tracker recorded nothing at all — and the yellow spikes keep firing right through them.

Today the software gets a second sense: when its eyes blink, can its ears carry the point?

That clip up top: two real points from the US Open final. In each one, the yellow dots are the machine watching the ball fly — until the dots stop, mid-air, because the tracker loses it. Then the freeze-frame: a white line extends the flight the machine did see, racing toward two finish lines — the sideline and the baseline — and whichever it crosses first names the error. Both calls match what the human charter wrote.

Today the software learns to answer a question it has been failing, completely, since grading began: when a ball goes out, did it go out wide or deep?

That clip up top: the actual file, playing. All 134 points of the Sabalenka–Pegula US Open final draft scroll past, and 39 light up green — "trust this enough to correct instead of typing from scratch," a claim that held up 94% of the time on matches the model had never seen. Two green rows then play against their video clips, draft string and jump-to timestamp on screen. It ends with what the file admits it can't do yet, and a question for anyone who charts tennis for real.

For sixteen posts, this project has graded its own homework — checking drafts against charts it already had the answers to. Today, for the first time, a draft goes to a real judge: someone who charts tennis for a living, whose only job is to say whether it helped.