Back to the directoryFind in the timeline
Deep Neural Networks for YouTube Recommendations
Covington, Adams and Sargin (2016) describe YouTube's two-stage recommender, whose ranking stage predicts expected watch time. The paper is a description of the 2016 system hosted by Google Research, not an independent audit.
- Where it sits
- Consumer applicationUse of psychology, or claims about it, in commerce, policy or product design.
- Evidence level
- Company self-reportThe main evidence is the company’s own account. It has not been independently audited.
- Organizations
- YouTube, GoogleAn organization is listed where the sources concern it. The text says exactly how.
- Sources inspected
- 3 of 32 with the relevant text, company document or archive item checked, 1 as an abstract or reference article, 0 not verified.
What happened
In 2016 Paul Covington, Jay Adams and Emre Sargin presented a paper at the ACM Conference on Recommender Systems describing YouTube's recommendation system. It is hosted on Google Research's site. Its abstract calls the system among the largest and most sophisticated in existence and says the paper shares lessons from building and maintaining it. It is a company description of its own 2016 system.
The psychological idea
The system has two stages. A candidate generation network uses a user's watch history to narrow millions of videos to a few hundred. A ranking network then scores those candidates. According to two summaries of the paper, the ranking stage is trained with weighted logistic regression to predict expected watch time rather than clicks.
In practice
Two summaries, by The Morning Paper and InfoQ, report the stated reason for the watch-time target: ranking by clicks can promote clickbait or deceptive videos that users do not finish, while watch time better captures engagement. The Morning Paper reports about one billion model parameters and hundreds of billions of training examples. InfoQ reports that final decisions come from live A/B testing. Later versions of the system are not covered.
Why it mattered
The paper is a dated statement of what YouTube's engineers said the ranker optimized in 2016. It lets later claims about the algorithm be checked against a document, though it says nothing about outcomes for viewers.
Limits and qualifications
This is company self-report by the system's own engineers, not an independent audit. The paper's own text could not be read, so details rest on its abstract and two secondary summaries. The summaries give the reason for watch time as avoiding clickbait. They report nothing showing the design aimed to maximise time spent for its own sake or to push viewers toward extreme content, and effects on viewers are outside the paper.
Evidence behind the claims
The paper by Covington, Adams and Sargin appeared in the Proceedings of the 10th ACM Conference on Recommender Systems (2016) and describes YouTube as one of the largest and most sophisticated industrial recommendation systems, using a deep candidate generation model followed by a deep ranking model.
Candidate generation narrows a corpus of millions of videos to hundreds of candidates, which the ranking stage scores; both summaries agree.
The ranking model uses weighted logistic regression to predict expected watch time rather than click probability; both summaries agree.
The summaries report the stated reason: click-based ranking can promote clickbait or deceptive videos that users do not finish, and watch time better captures engagement.
The models learn about one billion parameters and train on hundreds of billions of examples, according to Colyer's summary of the paper.
InfoQ reports that offline metrics guide development but the final decision comes from live A/B testing, which is also used continuously to improve the ranking model.
People involved
- Paul Covington. Author; paper listed on Google Research's site
- Jay Adams. Author; paper listed on Google Research's site
- Emre Sargin. Author; paper listed on Google Research's site
In the Psy101 course
- OpenStax Psychology 2e, section 13.4: Human Factors Psychology and Workplace DesignChapter 13, Industrial-Organizational Psychology. Context. The section discusses this topic.The section covers human-machine interface design in general; it does not address recommender systems, and the paper names no psychological theory.
This is course relevance only. It is not evidence for the historical or corporate claims on this page.See the full course map.
Sources and inspection
3 of 3 sources were opened and read at the level shown. A source marked as not verified supports no claim on this page by itself.
- [1]Deep Neural Networks for YouTube RecommendationsCovington, P; Adams, J; Sargin, E. Google Research; Proceedings of the 10th ACM Conference on Recommender Systems, 2016. Journal article. Primary source.Abstract or publisher record onlyRead the abstract and venue on the Google Research page, which lists the publication as to appear. The PDF on Google's static host returned compressed binary that could not be read.
- [2]Deep neural networks for YouTube recommendationsColyer, A. The Morning Paper, 2016. News report. Secondary account.Relevant text checkedRead the summary as returned by the fetch tool: two stages, candidates in the hundreds, watch-time objective, clickbait reason, scale figures. It does not mention A/B testing.
- [3]How YouTube Recommendation WorksInfoQ. InfoQ, 2016. News report. Secondary account.Relevant text checkedRead the news summary as returned by the fetch tool: two stages, watch time, clickbait reason, A/B testing. It gives no scale figures.
Access note: The paper's PDF could not be read, so the stated reason for watch time rests on two secondary summaries that agree with each other. Check the exact wording before quoting.
Independent source review: Claude review agent, independent of the research agent, 2026-10-21. Verdict: pass-with-edits.