Celebrating 30 Years: Three Decades of IPUMS Data

By Diana L. Magnuson; Curator and Historian, ISRDI

"Celebrating 30 years: three decades of IPUMS data" display case with promotional materials, swag items, and historical IPUMS items
“Celebrating 30 years: three decades of IPUMS data” display case at ISRDI Headquarters

“Celebrating 30 Years: Three Decades of IPUMS Data,” the current exhibit at ISRDI Headquarters, highlights thirty years of data innovation at the University of Minnesota. In the late 1980s, the Social History Research Laboratory at the University of Minnesota’s History Department proposed “the creation of a single integrated microdata series composed of public use samples for every year … with the exception of the 1890 census, which was destroyed by fire.” The primary aim was to make the U.S. census microdata “as compatible over time as possible while losing little, if any, of the detail in the original datasets.” (Integrated Public Use Microdata Series: A Prospectus).

Steven Ruggles remembers the moment he went into the History Department lounge on the sixth floor of the Social Science Tower and said, “IPUMS! Integrated Public Use Microdata Series! Isn’t that a great idea?” The response from the graduate research assistants was not enthusiastic. “What a terrible name! You can’t call it that!” According to Ruggles, “It was universal; everyone thought it was just a horrible name … It wasn’t a bad idea to propose, just a terrible thing to call it.” After a brief quandary over pronunciation (Ī-pŭms or Ĭ-pŭms), the name has stuck and is now synonymous with social research, data innovation, and free access. And for the record, we don’t care how you pronounce it, just as long as you cite it!

Continue reading…

IPUMS Announces 2023 Research Award Recipients

IPUMS research awardsIPUMS is excited to announce the winners of its annual IPUMS Research Awards. These awards honor the best published research and nominated graduate student papers from 2023 that use IPUMS data to advance or deepen our understanding of social and demographic processes.

The 2023 competition awarded prizes for the best published and best graduate student research in eight categories:

  1. IPUMS USA, providing data from the U.S. decennial censuses, the American Community Survey, and includes full count data, from 1850 to the present.
  2. IPUMS CPS, providing data from the monthly U.S. labor force survey, the Current Population Survey (CPS), from 1962 to the present.
  3. IPUMS International, providing harmonized data contributed by more than 100 international statistical office partners; it currently includes information on over 1 billion people in more than 547 censuses and surveys from around the world, from 1960 forward.
  4. IPUMS Health Surveys, which makes available the U.S. National Health Interview Survey (NHIS) and the Medical Expenditure Panel Survey (MEPS).
  5. IPUMS Spatial, covering IPUMS NHGIS, IPUMS IHGIS, IPUMS Terra, and IPUMS CDOH. NHGIS includes U.S. census summary tables and GIS boundary files from 1790 to the present; IHGIS provides data tables from population and housing censuses as well as agricultural censuses from around the world; Terra (now decommissioned) provided data on population and the environment from 1960 to the present; CDOH provides access to measures of disparities, policies, and counts, by state and county, for historically marginalized populations in the US.
  6. IPUMS Global Health, providing harmonized data from the Demographic and Health Surveys and the Performance Monitoring and Accountability surveys, for low and middle-income countries from the 1980s to the present.
  7. IPUMS Time Use, providing time diary data from the U.S. and around the world from 1965 to the present.
  8. IPUMS Excellence in Research, The IPUMS mission of democratizing data demands that we increase representation of scholars from groups that are systemically excluded in research spaces. This award is an opportunity to highlight and reward outstanding work using any of the IPUMS data collections by authors who are underrepresented in social science research*.

Over 1,200 publications based on IPUMS data appeared in journals, magazines, and newspapers worldwide last year. From these publications and from nominated graduate student papers, the award committees selected the 2023 honorees.

Continue reading…

IPUMS Announces 2022 Research Award Recipients

IPUMS research awardsWe are excited to announce the winners of our annual IPUMS Research Awards competition. These awards honor outstanding published research and graduate student papers from 2022 that use IPUMS data to advance or deepen our understanding of social and demographic processes.

The 2022 competition awarded prizes for the best published and best graduate student research in eight categories:

  • IPUMS USA, providing data from the U.S. decennial censuses, the American Community Survey, and includes full count data, from 1850 to the present.
  • IPUMS CPS, providing data from the monthly U.S. labor force survey, the Current Population Survey (CPS), from 1962 to the present.
  • IPUMS International, providing harmonized data contributed by more than 100 international statistical office partners for over 500 censuses and surveys from around the world for 1960 forward as well as full count historical (NAPP) data.
  • IPUMS Health Surveys, which makes available the U.S. National Health Interview Survey (NHIS) and the Medical Expenditure Panel Survey (MEPS).
  • IPUMS Spatial, covering IPUMS NHGIS, IPUMS IHGIS, and IPUMS Terra. NHGIS includes GIS boundary files from 1790 to the present; IHGIS provides data tables from population and housing censuses as well as agricultural censuses from around the world; Terra provides data on population and the environment from 1960 to the present.
  • IPUMS Global Health, providing harmonized data from the Demographic and Health Surveys and the Performance Monitoring and Accountability surveys, for low and middle-income countries from the 1980s to the present.
  • IPUMS Time Use, providing time diary data from the U.S. and around the world from 1965 to the present.
  • IPUMS Excellence in Research, this award is an opportunity to highlight and reward outstanding work using any of the IPUMS data collections by authors who are underrepresented in social science research.

The awards committee reviewed hundreds of submissions; from these, we selected the 2022 winners.

Continue reading…

IPUMS FAQs: How do I open IPUMS microdata files in my stats package?

By Kari Williams

FAQ in speech bubble

As part of the IPUMS mission to democratize data, our user support team strives to answer your questions about the data. Over time, some questions are repeated. This blog post is an extension of an earlier series addressing frequently asked questions. Maybe you’ll learn something. Perhaps you’ll just find the information interesting. Regardless, we hope you enjoy it!

Here’s one of those questions:

How do I open IPUMS microdata files in my stats package?

You have honed your research question and analytical approach, identified an IPUMS data collection that suits your needs, learned to navigate the IPUMS interface to create a custom data extract, and just received an email notification that your data file is ready to download. You put your favorite song on the stereo and open your data file in Stata (or whatever statistical software package makes your data analysis dreams come true), and…

record scratch! You see a “file not Stata format” error.

Continue reading…

IPUMS Founder Steven Ruggles Awarded MacArthur Fellowship

By Stacy Nordstrom

Steven Ruggles standing with arms crossed in front of trees
Steven Ruggles, Historical Demographer, 2022 MacArthur Fellow, Minneapolis, MN

Dr. Steven Ruggles, Regents Professor of History and Population Studies and Director of the Institute for Social Research and Data Innovation at the University of Minnesota, has been honored by the John D. and Catherine T. MacArthur Foundation as one of this year’s MacArthur Fellows. Commonly known as the “genius grant”, the fellowship is regarded as one of the most prestigious awards in the United States for intellectual and artistic achievement.

A historical demographer, Dr. Ruggles is renowned for building IPUMS, the world’s largest publicly available database of population statistics, and an invaluable tool for comparative research across time and space.

“I first met Professor Ruggles when I was working at the National Science Foundation. We have since served on working groups together, and I have been repeatedly impressed by the intellectual rigor and human caring he brings to any problem,” said University of Minnesota Executive Vice President and Provost Rachel T.A. Croson. “His dedicated work on IPUMS has significantly advanced our scientific understanding of the human experience, and has provided data for untold numbers of scholars. This recognition is well-deserved and I am proud that Professor Ruggles is a member of our academic community.”

Continue reading…

Sharing IPUMS Extract Definitions Using ipumspy

By Renae Rodgers

What is an Extract?

IPUMS users will already be familiar with the concept of an extract, but for those who may just be joining us, we’ll do a brief recap. Public Use data files are often large, unwieldy blocks of data, many variables wide and many many records long. Most analyses will only require a small subset of the available variables in any given dataset, but downloading public data from government agencies is an all-or-nothing endeavor. In addition to offering public use data that is harmonized across time and place, IPUMS allows users to choose only their variables of interest for download. These individualized datasets and accompanying metadata are IPUMS extracts.

What is an Extract Definition?

In short, an IPUMS extract definition is all the information needed to create a user’s personalized extract data file and accompanying metadata – everything short of those files themselves.

An IPUMS extract is defined by:

  1. The name of the IPUMS collection (e.g. “usa”, “cps”)
  2. A list of sample names or IDs (to be) included in the extract file
  3. A list of variable names (to be) included in the extract file
  4. An extract description (e.g. “2022 ACS demographic variables”)

IPUMS users build these extract definitions piece by piece when they create an extract through the IPUMS website, selecting samples, variables, and formats.

Continue reading…

The Revival of Quantification

In November, our fearless leader, Steve Ruggles, gave his presidential address at the annual Social Science History Association (SSHA) conference in Chicago. It was titled “The Revival of Quantification.” Ruggles describes long-run trends in quantification in history. He also focused on the relationship of historical quantification to political activism, relativism (no absolute truth), and objectivism (one Truth and that Truth is reached through empirical observation). 

Continue reading…