Objectives: Patterns of healthy leisure are dependent upon age, but people with disabilities are particularly susceptible to passive and disengaged types of activities. This study evaluates how individuals with disabilities spend their time in passive, active, social, and isolated forms of leisure over the life course, and how these patterns vary by age. Methods: Nationally representative data are analyzed from 70,165 respondents aged 15 and over in the 2008, 2010, and 2012-2016 American Time Use Survey. Linear regression models estimate the association between disability and leisure time, net of self-rated health and sociodemographic controls. Results: People with disabilities report significantly more, and poorer quality, leisure than people without disabilities. The isolated leisure time of people with disabilities is most different from people without disabilities in later life—whereas differences in total and passive leisure time, by disability status, are greatest in midlife. Patterns vary by type of functional limitation. Discussion: People with disabilities spend less time in health-promoting forms of leisure at all ages, but these patterns are unique across midlife and older age.