TY - BOOK AU - Institute of Medicine AU - National Research Council A2 - Nancy Mathiowetz A2 - Gooloo S. Wunderlich TI - Survey Measurement of Work Disability: Summary of a Workshop SN - DO - 10.17226/9787 PY - 2000 UR - https://nap.nationalacademies.org/catalog/9787/survey-measurement-of-work-disability-summary-of-a-workshop PB - The National Academies Press CY - Washington, DC LA - English KW - Health and Medicine AB - The Social Security Administration (SSA) is engaged in redesigning its disability determination process for providing cash benefits and medical assistance to blind and disabled persons under the Social Security Disability Insurance (SSDI) program and the Supplemental Security Income (SSI) program (Title II and Title XVI of the Social Security Act). The agency has undertaken a multiyear research effort to develop and test the feasibility, validity, reliability, and practicality of the redesigned disability determination process before making any decision about its national implementation. Survey Measurement of Work Disability reviews and provides advice on this research. One of the major areas for review is the ongoing independent, scientific review of the scope of work, design, and content of the Disability Evaluation Study (DES) and the conduct of the study by the chosen survey contractor. This report identifies statistical design, methodological, and content concerns and addresses other issues as they arise. ER - TY - BOOK AU - National Research Council A2 - Michele Ver Ploeg A2 - Robert A. Moffitt A2 - Constance F. Citro TI - Studies of Welfare Populations: Data Collection and Research Issues SN - DO - 10.17226/10206 PY - 2002 UR - https://nap.nationalacademies.org/catalog/10206/studies-of-welfare-populations-data-collection-and-research-issues PB - The National Academies Press CY - Washington, DC LA - English KW - Behavioral and Social Sciences AB - This volume, a companion to Evaluating Welfare Reform in an Era of Transition, is a collection of papers on data collection issues for welfare and low-income populations. The papers on survey issues cover methods for designing surveys taking into account nonresponse in advance, obtaining high response rates in telephone surveys, obtaining high response rates in in-person surveys, the effects of incentive payments, methods for adjusting for missing data in surveys of low-income populations, and measurement error issues in surveys, with a special focus on recall error. The papers on administrative data cover the issues of matching and cleaning, access and confidentiality, problems in measuring employment and income, and the availability of data on children. The papers on welfare leavers and welfare dynamics cover a comparison of existing welfare leaver studies, data from the state of Wisconsin on welfare leavers, and data from the National Longitudinal Survey of Youth used to construct measures of heterogeneity in the welfare population based on the recipient's own welfare experience. A final paper discusses qualitative data. ER - TY - BOOK AU - National Research Council A2 - Don A. Dillman A2 - Carol C. House TI - Measuring What We Spend: Toward a New Consumer Expenditure Survey SN - DO - 10.17226/13520 PY - 2013 UR - https://nap.nationalacademies.org/catalog/13520/measuring-what-we-spend-toward-a-new-consumer-expenditure-survey PB - The National Academies Press CY - Washington, DC LA - English KW - Industry and Labor KW - Behavioral and Social Sciences KW - Surveys and Statistics AB - The Consumer Expenditure (CE) surveys are the only source of information on the complete range of consumers' expenditures and incomes in the United States, as well as the characteristics of those consumers. The CE consists of two separate surveys: (1) a national sample of households interviewed five times at three-month intervals; and (2) a separate national sample of households that complete two consecutive one-week expenditure diaries. For more than 40 years, these surveys, the responsibility of the Bureau of Labor Statistics (BLS), have been the principal source of knowledge about changing patterns of consumer spending in the U.S. population. In February 2009, BLS initiated the Gemini Project, the aim of which is to redesign the CE surveys to improve data quality through a verifiable reduction in measurement error with a particular focus on underreporting. The Gemini Project initiated a series of information-gathering meetings, conference sessions, forums, and workshops to identify appropriate strategies for improving CE data quality. As part of this effort, BLS requested the National Research Council's Committee on National Statistics (CNSTAT) to convene an expert panel to build on the Gemini Project by conducting further investigations and proposing redesign options for the CE surveys. The charge to the Panel on Redesigning the BLS Consumer Expenditure Surveys includes reviewing the output of a Gemini-convened data user needs forum and methods workshop and convening its own household survey producers workshop to obtain further input. In addition, the panel was tasked to commission options from contractors for consideration in recommending possible redesigns. The panel was further asked by BLS to create potential redesigns that would put a greater emphasis on proactive data collection to improve the measurement of consumer expenditures. Measuring What We Spend summarizes the deliberations and activities of the panel, discusses the conclusions about the uses of the CE surveys and why a redesign is needed, as well as recommendations for the future. ER - TY - BOOK AU - National Research Council A2 - Robert M. Bell A2 - Michael L. Cohen TI - Coverage Measurement in the 2010 Census SN - DO - 10.17226/12524 PY - 2009 UR - https://nap.nationalacademies.org/catalog/12524/coverage-measurement-in-the-2010-census PB - The National Academies Press CY - Washington, DC LA - English KW - Behavioral and Social Sciences KW - Surveys and Statistics AB - The census coverage measurement programs have historically addressed three primary objectives: (1) to inform users about the quality of the census counts; (2) to help identify sources of error to improve census taking, and (3) to provide alternative counts based on information from the coverage measurement program. In planning the 1990 and 2000 censuses, the main objective was to produce alternative counts based on the measurement of net coverage error. For the 2010 census coverage measurement program, the Census Bureau will deemphasize that goal, and is instead planning to focus on the second goal of improving census processes. This book, which details the findings of the National Research Council's Panel on Coverage Evaluation and Correlation Bias, strongly supports the Census Bureau's change in goal. However, the panel finds that the current plans for data collection, data analysis, and data products are still too oriented towards measurement of net coverage error to fully exploit this new focus. Although the Census Bureau has taken several important steps to revise data collection and analysis procedures and data products, this book recommends further steps to enhance the value of coverage measurement for the improvement of future census processes. ER - TY - BOOK AU - National Research Council A2 - Candace Kruttschnitt A2 - William D. Kalsbeek A2 - Carol C. House TI - Estimating the Incidence of Rape and Sexual Assault SN - DO - 10.17226/18605 PY - 2014 UR - https://nap.nationalacademies.org/catalog/18605/estimating-the-incidence-of-rape-and-sexual-assault PB - The National Academies Press CY - Washington, DC LA - English KW - Behavioral and Social Sciences KW - Surveys and Statistics AB - The Bureau of Justice Statistics' (BJS) National Crime Victimization Survey (NCVS) measures the rates at which Americans are victims of crimes, including rape and sexual assault, but there is concern that rape and sexual assault are undercounted on this survey. BJS asked the National Research Council to investigate this issue and recommend best practices for measuring rape and sexual assault on their household surveys. Estimating the Incidence of Rape and Sexual Assault concludes that it is likely that the NCVS is undercounting rape and sexual assault. The most accurate counts of rape and sexual assault cannot be achieved without measuring them separately from other victimizations, the report says. It recommends that BJS develop a separate survey for measuring rape and sexual assault. The new survey should more precisely define ambiguous words such as "rape," give more privacy to respondents, and take other steps that would improve the accuracy of responses. Estimating the Incidence of Rape and Sexual Assault takes a fresh look at the problem of measuring incidents of rape and sexual assault from the criminal justice perspective. This report examines issues such as the legal definitions in use by the states for these crimes, best methods for representing the definitions in survey instruments so that their meaning is clear to respondents, and best methods for obtaining as complete reporting as possible of these crimes in surveys, including methods whereby respondents may report anonymously. Rape and sexual assault are among the most injurious crimes a person can inflict on another. The effects are devastating, extending beyond the initial victimization to consequences such as unwanted pregnancy, sexually transmitted infections, sleep and eating disorders, and other emotional and physical problems. Understanding the frequency and context under which rape and sexual assault are committed is vital in directing resources for law enforcement and support for victims. These data can influence public health and mental health policies and help identify interventions that will reduce the risk of future attacks. Sadly, accurate information about the extent of sexual assault and rape is difficult to obtain because most of these crimes go unreported to police. Estimating the Incidence of Rape and Sexual Assault focuses on methodology and vehicles used to measure rape and sexual assaults, reviews potential sources of error within the NCVS survey, and assesses the training and monitoring of interviewers in an effort to improve reporting of these crimes. ER - TY - BOOK TI - A Valedictory: Reflections on 60 Years in Educational Testing DO - 10.17226/9244 PY - 1995 UR - https://nap.nationalacademies.org/catalog/9244/a-valedictory-reflections-on-60-years-in-educational-testing PB - The National Academies Press CY - Washington, DC LA - English KW - ER - TY - BOOK AU - Transportation Research Board AU - National Academies of Sciences, Engineering, and Medicine A2 - Olga Selezneva A2 - Dean Wolf A2 - Syed W. Haider A2 - Munum Masud TI - LTPP Data Analysis: Practical Tools and Procedures to Improve WIM Data Quality DO - 10.17226/27233 PY - 2023 UR - https://nap.nationalacademies.org/catalog/27233/ltpp-data-analysis-practical-tools-and-procedures-to-improve-wim-data-quality PB - The National Academies Press CY - Washington, DC LA - English KW - Transportation and Infrastructure AB - Highway agencies use weigh-in-motion (WIM) technology to collect vehicle weight and axle load data on roadways. NCHRP Web-Only Document 370: LTPP Data Analysis: Practical Tools and Procedures to Improve WIM Data Quality, from TRB's National Cooperative Highway Research Program, is a supplemental document to NCHRP Research Report 1070: Tools for Assuring WIM Data Quality: Practical Guide, and provides a research overview and data analyses to enhance understanding of different factors affecting WIM measurement accuracy and to develop practical tools and procedures to improve accuracy and increase the reliability of WIM data. The document describes the development and use of to develop practical tools and procedures aimed to improve the accuracy and increase the reliability of WIM data. Supplemental to the document are four presentations. ER - TY - BOOK AU - National Research Council A2 - Alexandra K. Wigdor A2 - Bert F. Green, Jr. TI - Performance Assessment for the Workplace, Volume II: Technical Issues SN - DO - 10.17226/1898 PY - 1991 UR - https://nap.nationalacademies.org/catalog/1898/performance-assessment-for-the-workplace-volume-ii-technical-issues PB - The National Academies Press CY - Washington, DC LA - English KW - Industry and Labor AB - Volume II covers a number of measurement and analytical issues in greater technical detail, including: range restriction adjustments, methods for evaluating multiple sources of error in measurement, comparing alternative measures of performance, and strategies for clustering military occupations. ER - TY - BOOK AU - Institute of Medicine A2 - Lyla M. Hernandez A2 - Jane S. Durch A2 - Dan G. Blazer II A2 - Isabel V. Hoverman TI - Gulf War Veterans: Measuring Health SN - DO - 10.17226/9636 PY - 1999 UR - https://nap.nationalacademies.org/catalog/9636/gulf-war-veterans-measuring-health PB - The National Academies Press CY - Washington, DC LA - English KW - Health and Medicine AB - Many individuals, groups, and federal agencies have a strong interest in finding answers to the numerous and complex questions regarding the health of Gulf War veterans. Various types of research and health measurement are needed to address these diverse issues. The Institute of Medicine (IOM) was asked by the Department of Veterans Affairs (VA) and the Department of Defense (DoD) to undertake a study to identify important questions concerning the health of Gulf War veterans and then to design a study to answer those questions. The committee determined that it is of fundamental importance to ask how healthy are Gulf War veterans? Are they as healthy as others? What characteristics are associated with differences between the health of Gulf War veterans and the health of others? To address these questions, it will be necessary to measure not only the health status of those who served in the Gulf War, but also to compare Gulf War veterans with other groups. Further, one must continue to follow these groups through time to determine whether the groups differ in the way their health status is changing. As the committee began to develop a design that would address the fundamental questions identified, it realized that such a study could have important implications for understanding not only the health of Gulf War veterans, but also the health of veterans of other conflicts. ER - TY - BOOK TI - Measurement and Interpretation of Productivity DO - 10.17226/9578 PY - 1979 UR - https://nap.nationalacademies.org/catalog/9578/measurement-and-interpretation-of-productivity PB - The National Academies Press CY - Washington, DC LA - English KW - Industry and Labor ER - TY - BOOK AU - Transportation Research Board AU - National Academies of Sciences, Engineering, and Medicine TI - An Investigation of the Cause of Variation in HMA Bulk Specific Gravity Test Results Using Non-Absorptive Aggregates DO - 10.17226/22064 PY - 2004 UR - https://nap.nationalacademies.org/catalog/22064/an-investigation-of-the-cause-of-variation-in-hma-bulk-specific-gravity-test-results-using-non-absorptive-aggregates PB - The National Academies Press CY - Washington, DC LA - English KW - Transportation and Infrastructure AB - TRB’s National Cooperative Highway Research Program (NCHRP) Web Document 66: An Investigation of the Cause of Variation in Hot-Mix Asphalt (HMA) Bulk Specific Gravity Test Results Using Non-Absorptive Aggregates investigates the cause of variation in relative density from the bulk test results. ER - TY - BOOK AU - National Research Council A2 - Henry Braun A2 - Naomi Chudowsky A2 - Judith Koenig TI - Getting Value Out of Value-Added: Report of a Workshop SN - DO - 10.17226/12820 PY - 2010 UR - https://nap.nationalacademies.org/catalog/12820/getting-value-out-of-value-added-report-of-a-workshop PB - The National Academies Press CY - Washington, DC LA - English KW - Education AB - Value-added methods refer to efforts to estimate the relative contributions of specific teachers, schools, or programs to student test performance. In recent years, these methods have attracted considerable attention because of their potential applicability for educational accountability, teacher pay-for-performance systems, school and teacher improvement, program evaluation, and research. Value-added methods involve complex statistical models applied to test data of varying quality. Accordingly, there are many technical challenges to ascertaining the degree to which the output of these models provides the desired estimates. Despite a substantial amount of research over the last decade and a half, overcoming these challenges has proven to be very difficult, and many questions remain unanswered--at a time when there is strong interest in implementing value-added models in a variety of settings. The National Research Council and the National Academy of Education held a workshop, summarized in this volume, to help identify areas of emerging consensus and areas of disagreement regarding appropriate uses of value-added methods, in an effort to provide research-based guidance to policy makers who are facing decisions about whether to proceed in this direction. ER - TY - BOOK AU - National Academies of Sciences, Engineering, and Medicine A2 - Emily A. Callahan TI - Approaches to Assessing Intake of Food and Dietary Supplements in Pregnant Women and Children 2 to 11 Years of Age: Proceedings of a Workshop Series SN - DO - 10.17226/26374 PY - 2022 UR - https://nap.nationalacademies.org/catalog/26374/approaches-to-assessing-intake-of-food-and-dietary-supplements-in-pregnant-women-and-children-2-to-11-years-of-age PB - The National Academies Press CY - Washington, DC LA - English KW - Food and Nutrition AB - A virtual workshop series titled Approaches to Assessing Intake of Food and Dietary Supplements in Pregnant Women and Children 2 to 11 Years of Age was convened in May, 2021 by the Food and Nutrition Board of the National Academies of Sciences, Engineering, and Medicine. The four-day workshop series explored the evidence on methodological approaches to assessing intake of food and dietary supplements in pregnant women and children 2 to 11 years of age. Obtaining reliable and valid dietary intake information for these population groups is particularly difficult - in pregnancy, rapid changes in nutrient needs and dietary intakes occur, and in young children, much of dietary intake is consumed outside the home and is often misreported by the children or their proxy reporters. To advance the quality of the science in these areas, the workshop had four goals: identify the suite of current methods used in dietary assessments, including food and dietary supplements, in pregnant women and children 2 to 11 years of age; identify the methodological challenges and opportunities in improving current methods; explore methodologies in other disciplines and their application in dietary assessments in those populations; and discuss factors to consider when implementing dietary assessment tools in those populations. This publication summarizes the presentations and discussions of the workshop series. ER - TY - BOOK AU - Transportation Research Board AU - National Academies of Sciences, Engineering, and Medicine A2 - Raghavan Srinivasan A2 - Bo Lan A2 - Caroline Mozingo A2 - James Bonneson A2 - Craig Lyon A2 - Bhagwant Persaud A2 - Geni Bahar TI - Reliability of Crash Prediction Models: A Guide for Quantifying and Improving the Reliability of Model Results DO - 10.17226/26517 PY - 2021 UR - https://nap.nationalacademies.org/catalog/26517/reliability-of-crash-prediction-models-a-guide-for-quantifying-and-improving-the-reliability-of-model-results PB - The National Academies Press CY - Washington, DC LA - English KW - Transportation and Infrastructure AB - The AASHTO Highway Safety Manual (HSM) provides fact-based, analytical tools and techniques to quantify the potential safety impacts of planning, design, operations, and maintenance decisions.The TRB National Cooperative Highway Research Program's NCHRP Research Report 983: Reliability of Crash Prediction Models: A Guide for Quantifying and Improving the Reliability of Model Results complements the HSM by providing methods for consistently ensuring model reliability.Supplemental to the report are NCHRP Web-Only Document 303: Understanding and Communicating Reliability of Crash Prediction Models, a communications plan, a flyer, and a PowerPoint presentation. ER - TY - BOOK AU - National Research Council TI - Forensic Analysis: Weighing Bullet Lead Evidence SN - DO - 10.17226/10924 PY - 2004 UR - https://nap.nationalacademies.org/catalog/10924/forensic-analysis-weighing-bullet-lead-evidence PB - The National Academies Press CY - Washington, DC LA - English KW - Behavioral and Social Sciences KW - Engineering and Technology AB - Since the 1960s, testimony by representatives of the Federal Bureau of Investigation in thousands of criminal cases has relied on evidence from Compositional Analysis of Bullet Lead (CABL), a forensic technique that compares the elemental composition of bullets found at a crime scene to the elemental composition of bullets found in a suspect's possession. Different from ballistics techniques that compare striations on the barrel of a gun to those on a recovered bullet, CABL is used when no gun is recovered or when bullets are too small or mangled to observe striations. Forensic Analysis: Weighing Bullet Lead Evidence assesses the scientific validity of CABL, finding that the FBI should use a different statistical analysis for the technique and that, given variations in bullet manufacturing processes, expert witnesses should make clear the very limited conclusions that CABL results can support. The report also recommends that the FBI take additional measures to ensure the validity of CABL results, which include improving documentation, publishing details, and improving on training and oversight. ER - TY - BOOK AU - National Research Council TI - Nutrient Adequacy: Assessment Using Food Consumption Surveys DO - 10.17226/618 PY - 1986 UR - https://nap.nationalacademies.org/catalog/618/nutrient-adequacy-assessment-using-food-consumption-surveys PB - The National Academies Press CY - Washington, DC LA - English KW - Food and Nutrition AB - Just how accurately can adequate nutrient intake be measured? Do food consumption surveys really reflect the national diet? This book includes a brief history of dietary surveys, and an analysis of the basis of dietary evaluation and its relationship to recommended dietary allowances. A discussion of how usual dietary intake may be estimated from survey data, a recommended approach to dietary analysis, and an application of the analysis method is presented. Further, an examination of the impact of technical errors, the results of confidence interval calculations, and a summary of the subcommittee's recommendations conclude the volume. ER - TY - BOOK AU - National Research Council TI - Research on Sentencing: The Search for Reform, Volume I SN - DO - 10.17226/100 PY - 1983 UR - https://nap.nationalacademies.org/catalog/100/research-on-sentencing-the-search-for-reform-volume-i PB - The National Academies Press CY - Washington, DC LA - English KW - Behavioral and Social Sciences ER - TY - BOOK AU - Institute of Medicine A2 - John C. Bailar III A2 - Emily Ann Meyer A2 - Robert Pool TI - Assessment of the NIOSH Head-and-Face Anthropometric Survey of U.S. Respirator Users SN - DO - 10.17226/11815 PY - 2007 UR - https://nap.nationalacademies.org/catalog/11815/assessment-of-the-niosh-head-and-face-anthropometric-survey-of-us-respirator-users PB - The National Academies Press CY - Washington, DC LA - English KW - Health and Medicine KW - Industry and Labor AB - NIOSH and the Occupational Safety and Health Administration (OSHA) share responsibility for overseeing respiratory protection in the workplace and have established regulations for this purpose. Specifically, NIOSH has issued regulations which define respirator testing and certification. OSHA has issued regulations which define conditions under which employers are required to maintain respiratory protection programs in general industry, shipyards, marine terminals, and construction. In 2005, NIOSH contracted with the Institute of Medicine (IOM) to study the NIOSH-sponsored Anthrotech study along with its supporting information and reports, and to examine and report on the adequacy and relevance of the study protocol, the analyses conducted, the resulting anthropometric dataset, and the appropriateness of the respirator fit-test panels derived from the new dataset. Assessment of the NIOSH Head-and-Face Anthropometric Survey of U.S. Respirator Users focuses on the establishment of the scientific base required for certification standards of respirators, not their use in the workplace. This report describes and analyzes the anthropometric measurements performed by Anthrotech for its NIOSH-sponsored study. This report looks at the survey methods used by Anthrotech in the study, and examines how Anthrotech analyzed its data to derive fit-test panels and suggests some ways that analysis could be improved. This report discusses future directions, pointing toward further analyses of the data and offers suggestions for moving from research to practice. ER - TY - BOOK AU - National Research Council TI - Research Priorities for Airborne Particulate Matter: I. Immediate Priorities and a Long-Range Research Portfolio SN - DO - 10.17226/6131 PY - 1998 UR - https://nap.nationalacademies.org/catalog/6131/research-priorities-for-airborne-particulate-matter-i-immediate-priorities-and PB - The National Academies Press CY - Washington, DC LA - English KW - Environment and Environmental Studies AB - New National Ambient Air Quality Standards for airborne particles smaller than 2.5 micrometers, called PM2.5, were issued by the U.S. Environmental Protection Agency (EPA) amidst scientific uncertainty and controversy. In response to a request from Congress, Research Priorities for Airborne Particulate Matter, the first of four books in a series, offers a conceptual framework for an integrated national program of particulate-matter research, identifies the 10 most critical research needs linked to key policy-related scientific uncertainties, and describes the recommended timing and estimated costs of such research. The committee concludes that EPA should devote more resources to investigating the relationships between fixed-site outdoor monitoring data and actual human breathing-zone exposures to ambient particulate matter and to identifying the most biologically important constituents and characteristics of particulate matter through toxicological studies. The recommended research activities are critical to determining actual exposures of human subpopulations most susceptible to harm from the most hazardous constituents of particulate matter. Future research will be an investment in public health and a means to ensure that resources spent on control technology and regulatory compliance will have a reasonable probability of success. ER - TY - BOOK AU - National Research Council TI - Proceedings, Second Workshop: Panel to Review the 2000 Census DO - 10.17226/10279 PY - 2001 UR - https://nap.nationalacademies.org/catalog/10279/proceedings-second-workshop-panel-to-review-the-2000-census PB - The National Academies Press CY - Washington, DC LA - English KW - Behavioral and Social Sciences ER -