IPUMS FAQs: How do I open IPUMS microdata files in my stats package?

May 22, 2023January 18, 2023 by mpcblog

By Kari Williams

As part of the IPUMS mission to democratize data, our user support team strives to answer your questions about the data. Over time, some questions are repeated. This blog post is an extension of an earlier series addressing frequently asked questions. Maybe you’ll learn something. Perhaps you’ll just find the information interesting. Regardless, we hope you enjoy it!

Here’s one of those questions:

How do I open IPUMS microdata files in my stats package?

You have honed your research question and analytical approach, identified an IPUMS data collection that suits your needs, learned to navigate the IPUMS interface to create a custom data extract, and just received an email notification that your data file is ready to download. You put your favorite song on the stereo and open your data file in Stata (or whatever statistical software package makes your data analysis dreams come true), and…

record scratch! You see a “file not Stata format” error.

Malaria Transmission in Context: Linking Health, Census, and Ecological Data

January 18, 2023January 12, 2023 by mpcblog

by Yara Ghazal, Ilyana Hohenkirk, Tracy Kugler, and Kelly Searle

Malaria, like many vector-borne diseases, impacts health, economic growth, and society. The burden of malaria incidence and death is concentrated in Sub-Saharan Africa; in 2020, 95% of all malaria cases and 96% of all deaths occurred in Sub-Saharan Africa (WHO, 2022). Malaria impacts not only population health but also the economic growth of these 32 countries. It is estimated that up to 1.3% of economic growth in this region of Africa is slowed each year due to malaria (CCP-JHU, 2015). Understanding malaria transmission is essential to ending its spread and creating a healthier and more prosperous future for developing nations.

The literature on malaria transmission patterns has shown that several environmental factors impact mosquito and parasite vital rates, and thus affect the transmission intensity, seasonality, and geographical distribution of malaria (Castro, 2017). Temperature and precipitation are the primary climate-based factors that influence malaria transmission patterns. Temperature creates geographical constraints for vector and parasite development. Increasing temperatures have been found to shorten mosquito maturation time and increase feeding frequency. However, areas of extremely high temperatures usually yield smaller, less fecund mosquitoes. In parallel, because mosquitoes often breed in pools formed by rainfall and flooding, the frequency, duration, and intensity of precipitation have a significant influence on mosquito populations.

IPUMS at ICFP2022

November 30, 2022 by mpcblog

by Devon Kristiansen

IPUMS was proud to partake in the International Conference on Family Planning in Pattaya City, Thailand. We participated by hosting a pre-conference workshop, sponsoring the conference, staffing an exhibit both, and presenting research as part of the conference program. The conference, held between November 14th and 17th, 2022, had 3,500 in-person attendees, with many virtual participants, as well.

Research staff representing IPUMS PMA, IPUMS DHS, IPUMS MICS, and IPUMS International conducted a 2-hour pre-conference workshop, providing participants with an overview of each of the IPUMS data collections featuring international data as well as a website and data analysis demonstration.

Guidance for Pooling Multiple Years of NHIS Data

November 4, 2022November 4, 2022 by mpcblog

By Julia A. Rivera Drew

Introduction

Depending on their research question, analysts will commonly pool multiple years of the National Health Interview Survey (NHIS) data together in order to increase sample sizes of particular subpopulations of interest, such as bisexual adults, immigrants, or pregnant women. The complex design of the NHIS, however, requires analysts to take additional steps to correctly construct and analyze pooled NHIS datasets. Moreover, planned changes to the NHIS design implemented in 2019, as well as changes made in response to the COVID-19 pandemic, require additional special handling to correctly analyze datasets combining multiple years of NHIS data. The objectives of this blog post are to: (1) share tips to correctly construct and analyze pooled NHIS datasets and (2) identify resources for more information.

Tips to Correctly Construct and Analyze Pooled NHIS Datasets

1. Create a pooled sampling weight to use with your pooled dataset.

In general, when pooling multiple years of NHIS data together, you will need to create a new sampling weight to use with the pooled sample. To create this new sampling weight, divide the appropriate sampling weight by the number of years within each distinct sample design period. For example, if one wished to estimate the number of children living in families with low or very low food security (FSSTAT) using pooled 2020-2021 NHIS data (e.g., similar to this report), one would need to create a new sampling weight by dividing the sampling weight identified under the “weights” tab for FSSTAT, SAMPWEIGHT, by the number of years pooled together from the same sampling design period (in this case, two). The sum of the pooled weights would then represent the average annual population size for the pooled time period, rather than the total cumulative population size for the pooled time period. For any given combination of variables, refer to information under the “weights” tab for the variables included in your analysis to help select the appropriate sampling weight. The distinct NHIS sample design periods are 1963-1974, 1975-1984, 1985-1994, 1995-2005, 2006-2015, 2016-2018, and 2019-present.

IPUMS Founder Steven Ruggles Awarded MacArthur Fellowship

October 19, 2022October 19, 2022 by mpcblog

By Stacy Nordstrom

Steven Ruggles standing with arms crossed in front of trees — Steven Ruggles, Historical Demographer, 2022 MacArthur Fellow, Minneapolis, MN

Dr. Steven Ruggles, Regents Professor of History and Population Studies and Director of the Institute for Social Research and Data Innovation at the University of Minnesota, has been honored by the John D. and Catherine T. MacArthur Foundation as one of this year’s MacArthur Fellows. Commonly known as the “genius grant”, the fellowship is regarded as one of the most prestigious awards in the United States for intellectual and artistic achievement.

A historical demographer, Dr. Ruggles is renowned for building IPUMS, the world’s largest publicly available database of population statistics, and an invaluable tool for comparative research across time and space.

“I first met Professor Ruggles when I was working at the National Science Foundation. We have since served on working groups together, and I have been repeatedly impressed by the intellectual rigor and human caring he brings to any problem,” said University of Minnesota Executive Vice President and Provost Rachel T.A. Croson. “His dedicated work on IPUMS has significantly advanced our scientific understanding of the human experience, and has provided data for untold numbers of scholars. This recognition is well-deserved and I am proud that Professor Ruggles is a member of our academic community.”

New to IPUMS USA: The Adjust Monetary Values Feature

September 22, 2022September 22, 2022 by mpcblog

By Danika Brockman and the Adjust Monetary Values Team

Introducing the Adjust Monetary Values feature

The team at IPUMS is excited to introduce a brand-new extract feature, Adjust Monetary Values, which gives you the option to adjust monetary variables to constant units in the IPUMS data extract system. We know firsthand how tedious it can be to compare things like income and rent over time when you have to manually adjust for inflation. This feature allows you to request pre-adjusted monetary variables (e.g., INCWAGE) as part of your extract request! The feature is first being released on IPUMS USA, where you will be able to adjust monetary variables to 2010 dollars.

What does the Adjust Monetary Values feature do?

This feature gives you the option to adjust the monetary variables you have added to your data cart into constant dollars, so that all samples in your data cart are comparable across time for your selected monetary variables. IPUMS USA variables are adjusted to 2010 dollars using the Consumer Price Index for All Urban Consumers (CPI-U). For more information about why the CPI-U was chosen as the pricing index for this feature, see the Monetary Adjustment Feature page.

When you add an inflation-adjusted version of a variable to your data cart, the IPUMS data extract system applies the appropriate CPI-U adjustment factor for each sample year to the variable(s) you’ve selected. Your extract will include both the original monetary variable and the inflation-adjusted monetary variable. Special codes (e.g., NIU, missing) will not be affected by the inflation adjustment. Inflation-adjusted versions of variables will assign all specialty (i.e., non-monetary) codes to a code comprised exclusively of “9’s” with a width two digits greater than the largest value in the original variable (e.g., a variable where the maximum monetary value is “8500,” would assign all specialty codes to “999999” and apply a label of “Non-monetary.”) For details on the original specialty codes and their labels, consult the documentation for the original variable on the IPUMS USA website or cross-tab the adjusted and original variables in your statistical program (note that you may want to include a qualifying if statement so you see only the non-monetary codes).

Automating monthly workflows using IPUMS CPS and the IPUMS Microdata Extract API

September 22, 2022September 9, 2022 by mpcblog

By Renae Rodgers

As many readers will know, the Current Population Survey (CPS) is a monthly labor force survey that is, among other things, the data source for the monthly jobs report (or more formally the Employment Situation reports) from the Bureau of Labor Statistics.

In this blog post, I will show you how to create a reproducible, sustainable monthly workflow to update previous analyses using new data with IPUMS CPS data, IPUMS Microdata Extract API, and the ipumspy Python library.

If this is not your first CPS rodeo, you may already have a monthly workflow for working with IPUMS CPS data that suits your needs just fine – perhaps written in Stata. Did you know you can use ipumspy to make IPUMS CPS extracts from Stata?! Check out the set up instructions and template .do file in this blog post and optimize your monthly analysis even more with the IPUMS Microdata Extract API!

But I digress. In this blog post, I will first walk through a simple analysis using the IPUMS Microdata Extract API and ipumspy. I will then show you how to package that workflow so that it can be simply executed monthly when the most recent data becomes available from IPUMS CPS for refreshed analysis including the newest data.

An example IPUMS CPS, IPUMS Microdata Extract API workflow: teleworking due to COVID-19

Let’s suppose that we’re interested in looking at trends in telework due to COVID-19 over the course of the pandemic. The IPUMS CPS variable COVIDTELEW indicates whether the respondent worked from home at any time during the past 4 weeks due to COVID-19. This example will show us the overall trend in remote work due to COVID-19 as well as how teleworking breaks down by educational attainment. First we’ll define an IPUMS CPS extract that contains COVIDTELEW and EDUC variables and all months from May 2020 to June 2022.