Data Access – Use It for Good

IPUMS CPS Checks on Basic Monthly Data

April 9, 2025 by mpcblog

By Sarah Flood, Renae Rodgers, and Kari Williams

Federal data are critical for understanding much about the US population from its size and composition to its health and employment. The Current Population Survey (CPS) is our nation’s official source of information about the labor force. At the beginning of each month, we eagerly await the first Friday when the Employment Situation Summary (aka the monthly jobs report) will be released (it isn’t just us, right??). The monthly snapshot of the US labor force serves as a bellwether for how our economy is faring.

The Wednesday after the jobs report is released, we at IPUMS clear the decks in preparation for the release of the CPS Basic Monthly Survey (BMS) by the Census Bureau. The CPS BMS is the individual-level data from which the jobs report is generated. Our goal is always to process these data as soon as they’re released by the Census Bureau so that we can deliver them to IPUMS CPS users as quickly as possible. Those who rely on CPS BMS data each month might be familiar with coping strategies while waiting for the data–obsessive page refreshing, some nervous pacing, maybe wondering why they haven’t yet been released (iykyk).

While quickly processing CPS Basic Monthly data is a priority, so, too, is ensuring data quality. Each month, we carefully inspect CPS BMS data at several points in our process. First, we review all of the variables for codes that are undocumented or have suspicious frequencies. Second, we rely on a suite of tools during our integration process that alert us to any codes in the data that we haven’t accounted for in our variable-level harmonizations. After harmonization, we compare univariate statistics from the newest month data to the previous month of data. Generally we expect very little change across months and we have built tools that are designed to flag variable-level differences above a certain threshold as well as new codes on either end of the distribution.

Learning and Teaching Resources from IPUMS

August 20, 2024August 20, 2024 by mpcblog

By Kari Williams

In Minneapolis, MN at IPUMS HQ, the days are getting shorter, the nights are getting cooler, and school supplies are on sale in retail stores. Whether you approach “Back to School” season with enthusiasm, dread, or a mixture of the two, we want to remind you that IPUMS has great resources for students, faculty, and researchers!

Making Your Customized IPUMS MICS Data File

January 25, 2024January 24, 2024 by mpcblog

By Anna Bolgrien

The newest IPUMS data collection, IPUMS MICS, has many similarities with other IPUMS microdata collections. However, there is one major difference: the IPUMS MICS Data Extract System only uses Stata.

Yes, you read that right. Users of IPUMS MICS must use Stata to open and create their customized data file.

Let’s start with how using IPUMS MICS is the same as using other IPUMS microdata collections.

If you are an IPUMS user, you will find the process of browsing the variables, looking at documentation, and adding samples to your data cart completely familiar. If you are not familiar with IPUMS, you can read more about browsing and selecting variables.

However, when you finish choosing variables and samples in IPUMS MICS and click “Create Extract,” things start to look different.

Normally, you could change the data format, but the only option currently available for IPUMS MICS is a .dat (fixed-width text) file format.

Online Analysis Tool Now Exports CSV Output

September 29, 2021June 2, 2021 by mpcblog

By Matthew Sobek

IPUMS is pleased to announce a major usability upgrade to our online analysis tool: the ability to download tabular output as a CSV file. No more cleaning up html!

The IPUMS online analysis tool has been a big hit with our users, and we’ve made it available for most of the IPUMS data collections. If you haven’t tried it, you should. We even have a tutorial.

Despite its popularity with users, the SDA (Survey Documentation and Analysis) software that drives the system has always had a significant limitation: it produces tables in html format, which is fine for web display but highly inconvenient for cutting and pasting into documents.

In spring 2020 the SDA folks at the Institute for Scientific Analysis were looking for a new project and thoughtfully asked what change we thought users would most appreciate. We responded immediately “CSV downloads,” and within a few months, they had produced a working version of the software that incorporates the new feature. We have now upgraded all the IPUMS sites that offer online analysis to the new version of SDA.

Delivering data: Technology at the MPC

October 14, 2016October 14, 2016 by mpcblog

MPCSuperman (1)

“Good IT is invisible,” says MPC IT Core director Fran Fabrizio. “You want the users to have the idea that it’s a magic black box.” Though the intent is for the technology behind IPUMS and the other MPC data tools to seem effortless, Fabrizio understands the extent of the human work goes that goes into producing good technology. Getting 2.6 terabytes of data out to users each week requires no small amount of technology behind it.

Data For All: IPUMS-DHS Launches Training Workshops in Africa

August 4, 2016August 4, 2016 by mpcblog

IPUMS-DHS Workshop Participants and IPUMS-DHS Staff Pose in Front of the APHRC (Photo by APHRC) — IPUMS-DHS Workshop Participants and IPUMS-DHS Staff Pose in Front of the APHRC

If you are a student, faculty member, or researcher in the United States, you can learn about IPUMS data through an exhibit or workshop at professional conferences held on multiple occasions each year. Thousands of U.S. demographers, geographers, sociologists, economists, ecologists, health researchers, and others have learned about IPUMS through these events. But what if you are student, teacher, or researcher in Africa, where resources are far less plentiful?

A History of Data: Good People, Good Work

July 29, 2016 by mpcblog

talkdata

Bethel University Professor of History Diana L. Magnuson is documenting the growth of the Minnesota Population Center. Believing that preserving institutional memory is vital, the Center is supporting Magnuson’s work to capture oral histories of past and present MPC faculty and staff. This is the third in a three-part series of oral histories. This post features several senior research staff: Trent Alexander, Sarah Flood, Ron Goeken, Patricia Kelly Hall, Monty Hindman, and David Van Riper.