Loading summary
KPMG
KPMG makes the difference by creating value like developing strategic insights that help drive M and a success, or embedding AI solutions into your business to sustain competitive advantage. KPMG make the Difference. Learn more at www.kpmg.us.
Ryan Reynolds
Insights Thrivent can help you plan your.
Thrivent
Finances for the people, causes, and community you love. What makes Thrivent different financial services and generosity programs are combined to help you build a financial roadmap for the future, while also creating opportunities to give back along the way. Visit thrivent.com to learn more. Where Money Means More.
KPMG
Bloomberg Audio Studios Podcasts Radio News.
Joe Weisenthal
Hello, and welcome to another episode of the Odd Lots Podcast. I'm Joe Weisenthal.
Tracy Alloway
And I'm Tracy Alloway.
Joe Weisenthal
Tracy, I've said this a bunch of times, and we've sort of danced around this issue on the podcast before, but I've said this a bunch of times. I'm sort of fascinated by the degree to which we sort of take numbers on the screen for granted. Like, you know, we look at a price of a stock and it exists on the screen. It's like, where did that come from? How did that get there? Or like the first Friday of the month, the jobs data flashes on the screen and we just start talking about what the data said, what the unemployment rate was, et cetera. But we don't really talk enough about, like, what had to happen behind the scenes to get that number to the screen.
Tracy Alloway
Right. I find this really interesting as well, because obviously there's the data collection portion of this. Like, you have to go out and talk to people for certain surveys, certain data points. But also there are so many qualitative and subjective adjustments that you can make to that data. So for instance, with cpa, cpi, I didn't know that CPI weightings are like, different depending on what city you're in. So for instance, like, food at home could matter a lot more in, I don't know, Minneapolis compared to Chicago. It's really interesting. And there's also qualitative adjustments. So if your fridge gets WI FI connectivity, then that gets incorporated into the price as well. So it's really interesting.
Joe Weisenthal
It's super interesting. And like I have, you know, this is the issue, we don't talk about data collection, but it's obviously some of the most interesting stuff there is. Because of course, you know, things like food at home in one city should be different than another city if you really want to collect a basket. And so it means that what you have is some of the most interesting economics work being done anywhere in A realm that virtually gets no attention. And when we talk about data collection, you know, you hear it a lot in politics, right? Surveys have gotten, you know, no one answers the phone. It's, you know, it's harder and harder to do high quality surveys. I think you've written about this, like response rates and just the actual cost of collection of all this data is on the rise.
Tracy Alloway
Yeah. So I have a bunch of thoughts on this. I'll just say talking about the economic data might be timely as well, because we know that Trump doesn't really respect, I guess, a lot of official economic data and he's also trying to cut back on costs or funding of a bunch of different government programs. So it's clear, clear that, you know, entities like the Bureau of Labor Statistics could potentially be in the crosshairs here. But you're right, response rates, lower response rates have been happening for a long time. And it's really easy to look up, like, just how bad things have gotten. If you look at the BLS website, for instance, look at response rates on the housing portion of CPI, that's gone from about 70% back in 2015 to just 57% now.
Joe Weisenthal
Wow.
Tracy Alloway
Response rates on jolts have gone from I think, 67% to just 30%.
Joe Weisenthal
Wow.
Tracy Alloway
So that's pretty amazing. And the other interesting thing here is it's not just a US Problem, right? Like, there's no US Exceptionalism here. You see the same pattern in other economies like the UK and New Zealand. And actually in the uk, just last month, the Office of National Statistics said it wasn't going to publish PPI because of a data quality issue. And also trade data had a problem because of errors in the data provided by HM Revenue and Customs. And now there's a task force to look at all of these mistakes and data problems at the ons. So something that goes beyond the US here.
Joe Weisenthal
This is a really big deal, especially when you just consider how much economic activity is based on being able to look at high quality data and make decisions from it, obviously in the market, but also in just sort of the, quote, real economy, et cetera. And anyway, without further ado, we really do have the perfect guest. Someone who knows a lot about how the sausage is made and why making the sausage is getting more expensive. We are gonna be speaking to Bill Beach. He was most recently the Commissioner of the BLS and he knows all about this. He was the 15th commissioner at the BLS, does research affiliated with the Economic Policy Innovation center, and he is gonna talk to us about all of These issues. Bill, thank you so much for coming on. Odd lots.
Ryan Reynolds
Oh man, it's great to be with you and Tracy, thank you very much. It's a great topic right here.
Joe Weisenthal
It's a great topic. I don't know when the process begins, but it's like I get this number, it says what the jobs report. It says how many jobs were created that month. How did that number get onto my screen or onto bls.gov and it gets there every month? Yeah, every month. Every month. It's never missed. Except maybe once in like a hurricane or something. Anyway, how did it get there?
Ryan Reynolds
Yeah, the first Friday report, the jobs report, which comes out at 8:30 Eastern Time on the first Friday, it consists of two surveys. So let me talk about the first one, which is the one you just mentioned. The number of jobs. That is a survey of about 400,000 firms out of 11.3 million firms in the United States. About 400,000 of them have agreed voluntarily to send in a pretty complex survey response every month. They send that survey to electronic collection centers. There's one in Chicago, there's one in Atlanta. And that survey has to contain the 12th day of the month, if it is a workday or the closest workday to that 12th of November or whatever. And the reason for that is we want to get at least one pay period in the report. Okay? So they submit that, that that data continues to be collected through almost the end of the month, not quite, but almost the end of the month. It goes from regional offices, these regional collection centers to the national headquarters in Washington where about 40 people, sometimes less out of the 2,000 people that work there, massage the data, which means that they take the data which is in the survey. It's a sample, it's just a fragment of the total population. And they multiply the responses by what are called weights and that gives us the national number. So that number is all done pretty much by Tuesday night preceding the Friday and on Wednesday the Commissioner gets to hear the data. The Commissioner, by the way, plays no role whatsoever in massaging the data or multiplying the survey results, times the weights. Then I would brief the White House. The White House would then brief the Federal Reserve Board Chairman, the Secretary of the treasury on Thursday. That Thursday night, usually they're sworn to secrecy. And then at 8 o'clock in the morning I would walk over to the Department of Labor because BLS's headquarters is about a 20 minute walk from the Department of Labor. I would brief the Secretary of Labor and for an hour from 8:30 to 9:30, the Secretary of labor and his staff had to remain quiet and then at 9:30 they could answer questions of the press. So that, that basically is the process for the jobs report. There's another survey there. Interrupt me at any time. But that's where we get the unemployment raise called the household survey. And that's a survey of 60,000 households selected out of a sampling frame we can talk about about that term to be representative of the entire United States by demographic segments. You know, how many people are in the, in a certain age group, male, female, the racial and ethnic comp and geographic locations. So it's a complex sample. That sample is done usually by Monday of the week prior to the release on Friday. And then again I get to see the results or the commissioner gets to see the results on Wednesday. So that's kind of the calendar. Both the household survey and the employment survey cover the same two week period in the month. Now there may be a day or two switch there. Sometimes the household survey has a few more days in it than the establishment survey, but they all have that 12th of the month because we're trying to get the middle of the month. By the way, that's real important because if you have a natural disaster that happens prior to the 12th or after the surveys are closed that does not affect the results, even though you would think since it happened in the month prior that the hurricane might have affected employers.
KPMG
KPMG makes the difference by creating value like developing strategic insights that help drive M and a success. And embedding AI solutions into your business to sustain competitive advantage. Or deploying tech enabled audits to deliver more accurate and transparent outcomes. Brighter insights, bolder solutions, better outcomes. It's how KPMG makes the difference every day. KPMG make the difference. Learn more at www.kpmg.us insights.
Ryan Reynolds
Ryan Reynolds here from Mint Mobile with a message for everyone. Paying big wireless way too much. Please, for the love of everything good in this world, stop with Mint. You can get premium wireless for just $15 a month. Of course, if you enjoy overpaying, no judgments. But that's weird. Okay, one judgment anyway. Give it a try. @mintmobile.com Switch upfront payment of $45 for.
Tracy Alloway
3 month plan equivalent to $15 per.
Ryan Reynolds
Month Required intro rate first 3 months.
Tracy Alloway
Only, then full price plan options available, taxes and fees extra. See full terms@mintmobile.com so one thing you mentioned is companies you know voluntarily responding to these surveys. I always wondered about is how. How I guess onerous or resource intensive is Responding to these surveys. So do I have to have like a person who's dedicated to doing this every month? Does it consume resources? How long is this going to take me? And then also does the BLS ever try to fact check some of these self reported data points?
Ryan Reynolds
Yes, those were, those are great questions. So the survey is, is not just one or two questions. It takes about 30 minutes to fill it out completely. We do get responses that are incomplete and we accept those incomplete responses. The survey is usually filled out by someone who can access the company's data on wages, on total employment, on employment by supervisory or non supervisory job functions. In other words, it's a person usually in the operations office of a company. Now we ask companies that are very large, you know, like the big box retailers all the way down to really small corporations or small firms and it becomes more and more of a difficulty for the smaller firms and we're very cognizant of that. So BLS has reduced the scope of the survey to get it as small as possible and as free of burdensome compliance as possible. It's also an electronic survey so they can fill it out on their computer screens and hit a submit button which, which greatly greatly improved our response rate by the way. So that survey is not so hard now to fill out though I think it still takes about 30 minutes, maybe more if you have to dig out the data, if you're not in possession of it. The household survey is a totally different beast. It is a long survey. It consists of over 120 questions. It really is hard to fill out if you kind of don't know the terminology. Let me just give you one. We asked the question on employment. Are you working or have you looked for work in the past four weeks? That's the key question. We've been asking that question for since 19, I think 1943. If they answer I'm working then they are considered employed. We'll have follow up questions about that, but their industry, about their tasks and so forth. If they say no, I'm not working then we say well did you look for work in the past four weeks? And they'll say well you know, maybe I thought about it. Well thinking about it's not, not enough. You can look for one day in the past four weeks and be considered in the labor force but unemployed. So sometimes we have to have a verbal follow up. Rather than they're just, you know, just filling out a form, there has to be a conversation. That's why we don't do more than 60,000 households. Because it is. It's burdensome for the person who's the questioner.
Joe Weisenthal
This, this leads right into, I think, what I was about to ask you, which is, you know, we're having this conversation April 2025. Your term of office at the BLS ended March 2023. So you were actually under both the two recent presidents under the first Trump administration, then Biden.
Ryan Reynolds
Right.
Joe Weisenthal
But let's say, okay, so let's say it's March 2023. How much costlier is that process of communicating with the households than it was, say, in 2013 or 2003?
Ryan Reynolds
It was more costly, certainly. And that's because of inflation and how inflation affected the wage bill for the survey.
Joe Weisenthal
Okay.
Ryan Reynolds
The survey is taken by the Census Bureau under a contract by bls. So we pay the Census Bureau to go out in the field and conduct the survey. Okay. Here's an idea of how much more expensive it was in 2019, which is the first year of my term. I didn't have to find any additional funding for the household survey. It might have been just small amount, but Nothing significant. By 2023, we were having to find almost 4 million, $5 million more. So the cost of the survey is.
Joe Weisenthal
That per year, per month.
Ryan Reynolds
That would be for the entire year.
Joe Weisenthal
Okay.
Ryan Reynolds
Okay. The cost of the survey went up significantly. Now your listeners will be thinking about the federal budget, which is in the trillions of dollars, and say, oh, that's not very much money. But the Bureau's budget has not really changed for almost a decade, and our costs have gone up progressively, especially during the period of significant inflation, which we had starting in 2021. So finding additional money is really hard. During the pandemic, I found millions of dollars of couch money. Unused conference fees, unused travel fees. So I could apply that couch money if it were, you know, to purposes like buoying up the CPS or building a data. We built a brand new data center out in the suburb of Washington. But once we were back in business and fully using our entire budget, it was very difficult to find those dollars to fill the hole. And I think you could safely say I've been arguing this now for over two years. Our surveys, but especially the Current Population Survey, the one that gives us the unemployment rate, the labor force data are dying. They're decaying. They're in very serious trouble. And we will have, unless we modernize that survey, we will see a time when we will be like the British. Right. Unable to publish portions of it that just don't have sufficient sample for Statistical release.
Tracy Alloway
Okay, I'm going to ask the obvious question here, but why have costs of conducting these surveys, gathering this data actually gone up? And I understand, you know, building data centers is probably an expensive process, but on the other hand, you know, going electronic instead of mailing out thousands and thousands of surveys, in theory, I would imagine maybe that saves you some money. So what exactly is causing the increase in expenses here?
Ryan Reynolds
The problem is not with the electronic surveys. They will eventually be very costly. And there we're suffering from a different problem, which is just public support for the electronic surveys. So the jobs report, that is that portion of it that's electronically captured by these collection centers in Chicago and Atlanta. I think those are going along all right for the time being. Our real problem is in the surveys, the data of which is collected by people, survey field survey people. They go out and they talk to the households. And there the cost is the obvious one. It is the wage bill. These people are highly skilled interviewers. They are not high school graduates. And I have nothing against high school graduates, but they are educated, very trained, oftentimes economists who will go out and speak to people and do follow up interviews. My gosh. And they'll spend hours and hours doing this. I'll be all, okay, fine, that's great. But it costs a lot to keep those people employed. They have other opportunities. So we have to have competitive wages. The wage bill is driving that. Collection costs are a little bit higher, that is the processing costs. But the big part of that is the wage bill. And the wage bill is not going to go away. That's just going to continue to go up. So we need to do with the household survey what we have done with the establishment survey, the firm survey, and that is modernize it so it is more electronically collected. And then we also need to integrate data which can be obtained through the Internet on households. Households maybe go onto a platform and with a tablet or something and supply, you know, maybe we go to a million households and they supply five or six questions and we combine that or blend it with person to person collected data. That's what we call modernization. It may not sound so innovative to your listeners, but it's very innovative for the statistical system. Unless we do that, the cost will continue to rise. The response rates, by the way, are continuing to decline. So that's public support. And we will be, we just won't have these surveys in the future. They're too expensive.
Joe Weisenthal
I want to get to the modernization in a second, but just talk to us about, about, I mean, I Think you said the survey is dying, which is pretty dramatic given the centrality of this. Between the response rates, the increased wage bill, et cetera. How severe is this crisis? How much time are we talking about? Because I imagine it gets harder and harder to find that couch change to keep it going.
Ryan Reynolds
Yeah, Actually, we're out of time. We have to cut down on the sample. And I'll give you. I'll give you the evidence. My successor, the current Commissioner of Labor Statistics, announced at the end of last year that we would have to reduce the sample in the CPS, that's the household survey, by 5,000 households, in order to just publish the rest of the sample. Okay. By cutting back on the sample, you cut back on publishing details in the current report. You may not have enough to publish on teenagers anymore on certain demographic groups. You may not be able to publish details on certain age intervals, like everyone between the ages of 55 and 60 or 65 and 75. Every time you reduce the sample or your response rate falls and it kind of reduces it for you. We can talk about that next. What suffers are the details. Let's go to the cpi, which BLS also does. The CPI is a very big survey, very important survey, but it is oftentimes the case that we don't have details for certain parts of the basket of goods. And so we will average across the months and publish for another month based on averages of prior months. But then we run out of the integrity of that average and we can't publish the bread price or something like that. That happens more and more because we're getting less and less cooperation by retailers that. To allow our surveyors into their stores and to go around grabbing the potato chip bag and counting the number of potato chips in the back. So we've had to innovate on the cpi, on the producer Price index, on the import Export Price indexes. I hope you haven't noticed the innovations because you're not supposed to, but. But those innovations have saved, absolutely saved the import and export prices. We. We had response rates down in the 20 percentiles. Completely unpublishable detail. During the time I was commissioner, we went to using data from the Commerce Department that is collected by the customs officials. And it's working out just great. So we completely left the surveys there. The PPI has problems just like the British are having now. Not as bad. And we're using more and more data from private companies who will give us their data from the Internet where we collect that data. And we combine that with the Survey data to keep the things alive on the cpi. It's very interesting. We get all of our retail gas prices now from a private company that aggregates gas prices for the, the retail gasoline industry. And it's a very good source a lot of our housing prices. Now you mentioned housing. We're going to more and more to aggregators, private aggregators. So we. There are strategies for saving the survey by blending in private data with the survey data. That is not the case with the household survey of the labor force. Nobody really collects that data except bls. And that's why these demographic surveys, Census has a bunch of them. Health, the Health Department, the Department of Health has a lot. They're in very serious trouble.
Tracy Alloway
So I take the point about innovations, but one of the things that's been happening recently is we have been seeing bigger and bigger revisions in a lot of the data is that because of the response issue. So more late responses mean that, you know you're going to get revisions later on as those responses are incorporated. And the reason I ask is I remember speaking to someone at the BLS and here shout out to the people working at the BLS because you can actually just call them and ask questions. They're really, really responsive. Amazingly, like the only government department that I really know where they'll just pick up the phone and talk to you about methodology. Anyway, I was asking about revisions to PPI for mayonnaise, of all things. And the data there had been Revised from like 5% to 10%, which is a pretty big change in the space of a couple months. And he was talking about how the PPI is subject to revision up to four months after it's published and it gets updated as new replies come in. So I imagine if response rates are going lower, then maybe that's contributing to some of the revision issue.
Ryan Reynolds
By and large, our issues have to do with response rate. You're absolutely right and I'm. Before I go further, I'm very, very happy you said that about bls, because BLS prides itself in being responsive and transparent, by the way. So that's a good thing. So I think there are two sources of this problem. The first is really hidden and no one talks about it. So let me just mention when we refresh a survey, and you have to do this because people are asked to give their survey responses only for a few months, right? And then they drop out and you have to find new people. The regional offices, there's six of them in the United States for the bls. They have people who Go out and do what's called initiate a new survey respondent. It's getting more and more difficult now to initiate that respondent. Well, people are saying, we just don't have time. You know, oh my gosh, there's so many important things to do. Or you. We don't want to give you our data because if we give you our data, then the IRS is going to be after us or we're going to have some kind of OSHA. You know, we, we don't. BLS's data is completely protected from the law enforcement aspects of the federal government. It absolutely only for statistical purposes. That does not prevent how people saying, oh, it's going to happen. You know, so if your initiations are dropping and it's harder and harder, no wonder the response rates are dropping because people are less enthusiastic. Even if they say, yeah, I'd love to be a part of it, they're not as enthusiastic as they were a generation ago. So the real problem starts at the initiation level. And we're seeing that not only in the household survey and in the price area, but we're also seeing that in another survey we haven't talked about, the National Compensation Survey, which is a wonderful survey on how much people are getting in union houses, union households and non union households in Northeast and Southwest is terrific about that. The Jolts report, the job openings and labor turnover survey that you mentioned at the opening, its response rate has fallen dramatically, and it's largely because people are less enthusiastic generally about participating in government surveys. It's going to be hard to stem that tide. And I think the only way we can do it is by going to these platformed surveys, that is, surveys that use the Internet as the main platform, integrating a lot of private data and being highly original in the way we think about preparing a statistic for public use. We're just not going to be facing a different world overnight of really happy people wanting to give all their data to the government.
Joe Weisenthal
It's really a fallen world sometimes. I'll say that we won't let you in. Distorted. You know, look at the price of bread anyway. What would it take to get there? Can this be done unilaterally within the bls, this sort of big upgrade? Would it need to be something involved with Congress? Would it need a budget allocation that would come from Congress? What would need to happen to get this sort of modernized statistical collection system that you would like actually in place?
Ryan Reynolds
I think we have to approach this like we might approach roads and bridges. Right. Once Congress becomes aware that there's political liability and ignoring a problem, they generally focus on it until it's fixed. And that was the case with our national highway system. Still is the case with our national highway system. We still have a lot of problems. When I go to Congress and I talk about the CPS and response rate, how we're going to lose the unemployment rate, I get immediate response. And nobody. The Communists, no one's ever said that to me, okay, oh, let's fix it. So in the last congressional continuing resolution, which is passed a few weeks ago, BLS got 6 million more in funding just to fill that hole that we've been talking about on the wage bill. And that was an amazing thing to get in a continuing resolution, an increase in funding. So I think Congress, presented with a plan or the administration President Trump has, is wide open to disruption and change. I think if we develop an aggressive, bold, comprehensive plan about how to rebuild the statistical system so that we're using our resources much more efficiently, perhaps combining some agencies together, instead of having the 24 separate statistical agencies, maybe we ought to have just a handful and then going from there to a highly innovative, different way of collecting and disseminating data, then our roads and bridges, statistically speaking, won't be disintegrating or decaying. We will have new concrete, we'll have new structures, and you can see a future for the statistical system. I think right now, speaking as a former director of an agency, one of the most important statistical agencies and not the most important statistical agency in the world, that future looks grim to me. And so change is required. It has to happen. I think that's what we have to do. Presented with the plan, let Congress see what we're going to do and have them fund modernization, not continuation, of the current system.
Tracy Alloway
This is a little out there, but could you. If the problem is the response rates and incentivizing people to actually answer these surveys, could you potentially pay them to do it?
Ryan Reynolds
Tracy, we've tried that. It's been tried a lot. Good suggestion. Yeah, pay them dollars. Okay, tried that. That didn't make much of a difference. Then we thought, well, maybe they'd like to have these cards you can take to retailers and buy anything you want, right?
Tracy Alloway
Gift cards.
Ryan Reynolds
Yeah, gift cards. So we tried that. Now, that's not the issue. It's not. I think you could pay people a lot of money, say $1,000 a month, and they might participate because that's a lot of money. But we can't afford that. That's not out there for the statistical system. So inducements may help at the margin, but they don't change the trend line, which is going negative on the response rate. I think we're going to live at that response rate for a while. I do believe it's generational. I think you can see in the really young kids now, not the ones that are under five, but in the ones that are in their teens. Kind of a return to doing things together, having more social events. Maybe I would say the bowling leagues are coming back and maybe that's a cultural change that leads to a more a greater sense of participation and support of public institutions. One could hope.
Tracy Alloway
I like the idea of all the kids coming together to answer surveys from the bls. That's great.
Ryan Reynolds
I think you'd get some really interesting answers there. But yes, short of that, we have to be innovating. We have to change. We have to think outside the box. Otherwise this infrastructure, which we all need, it runs our country. There's no economy without the Bureau of Economic Analysis and the GDP numbers. They don't grow on trees. That's going to be either going to go away or become less reliable.
KPMG
KPMG makes the difference by creating value like developing strategic insights that help drive M and A success and embedding AI solutions into your business to sustain competitive advantage. Or deploying tech enabled audits to deliver more accurate and transparent outcomes. Brighter insights, bolder solutions, better outcomes. It's how KPMG makes the difference every day. KPMG make the difference. Learn more at www.kpmg.us insights.
Thrivent
When your company has a position to fill, are you really seeing the best professional candidates? Sure, you get plenty of resumes, but you may be missing an untapped resource. Ideal candidates not currently job searching people not actively looking but who may be open to the right opportunity. It can be the difference between a good hire and a great hire. Specialized Recruiting Group is ready to find the talent you need. Go to srgpros.com and see how the recruiters with a deep understanding of the experience and expertise you need can find the right fit for your business. After all, you deserve to see the best candidates, both active and passive. Whether you're looking for a long term or project based professional, Specialized recruiting group is ready to find the talent you need. Go to srgpros.com right now to get started. That's srgpros.com Specialized Recruiting Group A Tailored Approach to Professional Hiring.
Joe Weisenthal
You know something that strikes me while listening to talk and like oh, you found a way to allocate unused travel spending so that you could keep the surveys going after the wage bill went up, et cetera, keep rustling the couch change. And I think about this in, you know, you mentioned, okay, well, maybe the new president is, you know, theoretically open to shaking things up and doing things a different way, which you argue pretty persuasively is necessary. On the other hand, you have the sort of DOGE kick, which is sort of premised on this idea that every agency in the government somehow is just egregiously wasteful. That all of these agencies must be so wasteful that you could cut aggressively and you almost certainly aren't actually going to hit any bone. Seems to be a sort of premise of some of the cutting. It doesn't sound like to me when you described the BLS in 2019 through 2023, that this was an agency that was just, you know, larded up and had plenty of fat that can be trimmed off.
Ryan Reynolds
No fat. No fat at all. But you know, this is the age old conflict, right, between the entrepreneur and the accountant.
Joe Weisenthal
Sure.
Ryan Reynolds
The entrepreneur always looking for innovation and change and higher return on investment, and the accountant is always looking for waste and abuse. Are we using our pencils until they're only three inches long? I think that's a fruitful thing. I think you have to have both of those forces working all the time and overtime right now. I don't doubt for one second that a lot of the federal government could use a thorough scrubbing on the things that DOGE is looking at. The statistical system has unfortunately, in my opinion, but fortunately now been through that scrubbing over the past 15 years. No real increase in budgets and yet an increase in responsibility. So efficiencies have been gained there just from the brutality of living year after year after year with the same dollar amount while your costs are going up, while inflation is changing. Don't mind that because efficiencies can occur and we can do more with fewer dollars. That's okay. Innovation, on the other hand, has to be kind of funded by your retained earnings and we don't have that in the statistical system. Congress has that. So we're not getting the dollars necessary to innovate and secure the future. That's the problem I want everybody kind of focus on.
Tracy Alloway
So you mentioned earlier that you had used Internet data to try to make up for the lack of a certain data point or a certain response from the surveys. And I'm curious, there is the sense nowadays that everything we do is tracked and recorded somewhere. Could you potentially use some of that type of data instead of Voluntarily reported responses.
Ryan Reynolds
So to an extent, you can use that. If you have an unambiguous signal and you can capture that unambiguous signal month after month, why not capture it? Why not capture, for example, certain pay bans or other things that are happening in the labor force or with wages or with working conditions? The restraint there is that not everything we want to know about the world is unambiguously signaled every month. And I go back to this seemingly easy question, are you working or looking for work? You would be surprised at the number of people who say, I'm working. But then we make that query, did you work for pay? No. Okay, I did the dishes. Okay, fine. Well, that doesn't see in the mind of the respondent. Work is defined differently than it needs to be defined in the statistics. Are you looking for work? Well, yeah, I'm looking for work. When did you look for work? Last year. Okay, all right. See, that doesn't count as the key determinant of whether or not you're in the labor force. You're in the labor force if you're working or looking for work in the past four weeks. So that seemingly simple question is not going to be unambiguously signaled by somebody answering an Internet question because of the many different ways we think about our lives and about what work is. We find this particularly true as our country becomes, I think it's a good thing. More and more culturally diverse people come in with very different views of what is work, of what is pay, of what is a family, you know, what is a household. And we have to work harder and harder and harder to make sure that their responses fit this continuous, since 1943, continuous stream of data that allows us to do these wonderful time series analyses. That's the issue, Tracy, with using Internet data. Some of it can be used and blended in, some of it from the private sector can be used and blended in, but some cannot. You still have to have that survey instrument out there asking the hard questions, doing the follow ups.
Joe Weisenthal
There are some people who simply do not believe the statistical agencies are honest or they do not trust. When academic economists explain why data gets revised a year later or something like that, and they assume that there is political influence of some sort, or they believe it and it goes back years. I remember 2000. What year? 12 years ago. Jack Welch, the Chicago guys will do anything. Can't believe these jobs numbers, et cetera. You were appointed in 2019 by President Trump, then you crossed over to Biden. What do you say to people who do not believe that they can trust these numbers?
Ryan Reynolds
Well, I can't dislodge their suspicions without going to some factual basis. So I take them through the simplest revision process, which is the jobs Revision. We had 818,000 preliminary estimates, estimate of a decrease in employment that was announced last August. And everybody, everybody President Trump was running for at the time, and he just said, look at this, this totally dishonest bls. Okay, so this happens every, every year we, we compare our numbers to the sampling frame, but all the, all the people who work in the entire country and we say, is our, is our estimate of total employment based on a much smaller sample than all the firms? Is it accurate? And when we go up there and we compare it every March to this total universe, we sometimes find we're spot on, less than 1/10 of a percent off. And sometimes we find we're as much as 2% or 3% off. We're off more often when the economy is either diving into recession or growing rapidly out of a recession or has a period of really bad time happening. So when I take them through the revision process, they usually come out and say, you know, I never knew that. And so the next time they think about, oh, the BLS is lying, they'll have that in their mind that really, we do this every year, it's the same way, and we're pretty good with those numbers.
Tracy Alloway
So I want to ask you about qualitative adjustments, because I find these so interesting. And the example I used was fridges that now have, I don't know, new and interesting features. And my understanding is that if a company is selling a basic refrigerator for like $1,000, and then the next year it sells this new advanced refrigerator for $1,150, and then it's also spending additional money, so like an extra hundred or whatever to make the more advanced fridge. In cases like that, the BLS would use a qualitative adjustment. And then the year on year PPI would be something like, I don't know, it would be 5% instead of the 15% change in the actual price. How do you actually go about making those qualitative adjustments? And I imagine they must have been getting harder as things become more technologically complex.
Ryan Reynolds
Well, you're absolutely right. It is very difficult to do that. But we do a lot of training. A lot of people don't know that at the national headquarters there is a training suite. I think it's on the second floor, at least to be before we moved out of that building. And so people from the Regions who are the CPI and PPI field teams that go out and do the survey, they come to the BLS for training. And in these training rooms are kitchens. There are grocery store aisles. We've recreated kind of the inventory you might find in a grocery store or a warehouse. And we will train people from time to time on the changes in the Items in the CPI, the 200 plus items in the CPI or the items that we're surveying at the, at the producer price level. So if there is a change all the way from the number of potato chips in a bag, which is a very important thing, and when we do the, we will look at fast foods and potato chips and so forth all the way to the technology involved in diamond cutting. We will be training people to observe the change and work that into their evaluation of the product when they're in the store, when they're in the warehouse. So the field person will literally pick up a jar of, if I could say, Pringles. Right. And they'll say, well, last month had 36 Pringles in here and this month it's the same price, but we only have 32 Pringles in here.
Tracy Alloway
Wow. True granularity.
Ryan Reynolds
Yeah. So that fits into now, ppp, the.
Joe Weisenthal
Price per Pringle keep going.
Ryan Reynolds
Exactly. But it has to be that way because what will happen is the retailer will keep the, or the producer will keep the price at the same level, but decrease the item count in the product bag. And that means that the product has actually gone up in price, have the same price. Let me just say one more thing. Great question, Tracy. We have, that's the reason why we can't go to the Internet and get all of our prices. Because when you go to the Internet, you can't sometimes see the quality adjustments that are there. You can't see that the fact that the hot dogs are just a little shorter than they used to be or the Apple's a little smaller than they used to be. I don't know about the Apple thing, but the shorter hot dogs is definitely the case. So we train these people. They're highly trained. They're also very expensive because they're highly trained people and they can see and know when to look and when to check for quality improvements. Electronics, definitely, you know, but a lot of times the producers of the electronics will heavily advertise the changes, make it known to everybody, because that's, that's what you're selling, new and improved. It's on these other items that it's more subtle and, you know, housing Housing is a big deal because the house is more valuable if it has improvements in it. And some of those improvements are completely invisible. So, so we're, we're very conscious of the fact that quality governs the price structure.
Joe Weisenthal
Bill beach, that was a fascinating conversation. I feel like some of these areas, like, even just like talking about the, the art of actually conducting an interview to see if someone's in the labor force. Really fascinating stuff. Really appreciate you coming on. There's something we want. We wanted to talk to. To talk to someone a long time. So appreciate you joining Outlaws.
Ryan Reynolds
It's been, it's been a pleasure. Thank you very much.
Tracy Alloway
Thank you so much. That was great.
Joe Weisenthal
Tracy. I thought that was great.
Tracy Alloway
I'm so glad we finally did that one. A couple points. So, first of all, I did not know that hot dogs have been getting shorter me ne and it's being incorporated into the inflation data.
Joe Weisenthal
So this is good to know.
Tracy Alloway
All the people complaining about shrinkflation, I guess, you know, it is mitigated.
Joe Weisenthal
They're aware of it.
Tracy Alloway
Yeah, exactly. And then the other thing I would say is I thought the point Bill was making about the loss of granularity in the data was really important. So the idea of getting to like the tails of the distribution or certain minorities. And the reason I say that is because. Because we've been seeing a lot of regional and social variation in a lot of these consumer surveys. Right. So obviously people who are poorer have been feeling terrible during the days of high inflation, and people who are rich feel, you know, pretty good. But also inflation in Florida has been higher than elsewhere in the country. So I think it does become more important to get really, really specific with some of these statistics as we see those differences increase.
Joe Weisenthal
It's really interesting to me to think about government, high quality government data as like, this public good. And try to imagine infrastructure. Right, infrastructure. And try to imagine the amount of economic activity that exists because this thing is offered for free that people don't have to pay for. And obviously in the investing world there's a tremendous amount of interest in all this, but it's obviously not just, just, you know, the investing world until all of these questions, whether you're starting a business or whatever it is, you know, on some level you can do because there is consistent, trustworthy data. And the thought of, like, that going away. And what I imagine would happen is, yeah, sure, you'd have like, private versions of varying quality that would try to replace it. And that exists today. You know, there's private measures of inflation et Cetera. But like that would like start to deteriorate the idea of like there being a gold standard. And so then you hear it's like, oh, here's like a. Oh, we needed to find a few more million dollars to pay the budget of the survey collectors. Like how many billions are riding on that few extra million?
Tracy Alloway
Oh, yeah, totally.
Joe Weisenthal
Like how many hundreds of billions in activity? So it's just really interesting. And then his thing explanation at the end, why like survey collection for something like this is a. Makes sense to do as a trained job. Right. And even like the subjectivity of like, are you working and what does that mean and et cetera. It's really interesting to think about why it's not trivial to just send out a survey or send out a high schooler or send out a volunteer or something like that.
Tracy Alloway
Absolutely. Also, I just love the idea of someone at the BLS counting how many potato chips are in a bag.
Joe Weisenthal
I know.
Tracy Alloway
Or a tube.
Joe Weisenthal
You know what I mean? I'm imagining like, I don't know, like someone with like a monocle or something.
Tracy Alloway
Like their eyes, a magnifying glass, examining the chips and seeing how big they are.
Joe Weisenthal
We have the. Yeah, we're having the same image in our mind, I'm sure. Right. Yeah.
Tracy Alloway
All right. Shall we leave it there?
Joe Weisenthal
Yeah, let's leave it there.
Tracy Alloway
This has been another episode of the All Thoughts podcast. I'm Tracy Alloway. You can follow me at Tracy Alloway.
Joe Weisenthal
And I'm Jill Weisenthal. You can follow me at the Stalwart. Follow our producers, Carmen Rodriguez at Carmenarmondashell, Bennett at Dashbot and Kale Brooks at Kalebrooks. For more Odd Lots content, go to bloomberg.comoddlawds where we have all of our episodes in the daily newsletter and you can chat about all of these topics 24. 7 in our Discord Discord GG oddlots.
Tracy Alloway
And if you enjoy Odd lots, if you like it when we talk about how these statistics sausage actually gets made, then please leave us a positive review on your favorite podcast platform. And remember, if you are a Bloomberg subscriber, you can listen to all of our episodes absolutely ad free. All you need to do is find the Bloomberg Channel on Apple Podcasts and follow the instructions there. Thanks for listening.
KPMG
KPMG makes the difference by creating value like developing strategic insights that help drive M and A success success or embedding AI solutions into your business to sustain competitive advantage. KPMG make the difference. Learn more at www.kpmg.us insights.
MITI Health
It's true that some things change as we get older. But if you're a woman over 40 and you're dealing with insomnia, brain fog, moodiness, and weight gain, you don't have to accept it as just another part of aging. And with MITI Health, you can get help and stop pushing through it alone. The experts at MITI understand that all these symptoms can be connected to the hormonal changes that happen around menopause. And MITI can help you feel more like yourself again. Many healthcare providers aren't trained to treat or even recognize menopause symptoms. MIDI clinicians are menopause experts. They're dedicated to providing safe, effective, FDA approved solutions for dozens of hormonal symptoms, not just hot flashes. Most importantly, they're covered by insurance. 91% of MITI patients get relief from symptoms within just two months. You deserve to feel great. Book your virtual Visit today@joinmidi.com that's joinmidi.com.
Odd Lots Podcast Episode Summary: "Some of America's Most Important Economic Data Is Decaying"
Release Date: April 30, 2025
Hosts: Joe Weisenthal and Tracy Alloway
Guest: Bill Beach, Former Commissioner of the Bureau of Labor Statistics (BLS)
In this enlightening episode of Bloomberg's Odd Lots podcast, hosts Joe Weisenthal and Tracy Alloway delve into a pressing issue facing America's economic infrastructure: the deterioration of critical economic data collection systems. Titled "Some of America's Most Important Economic Data Is Decaying," the episode explores the intricate processes behind the numbers that shape our understanding of the economy and the alarming challenges threatening their reliability.
Joe Weisenthal opens the discussion by highlighting a common oversight: the unquestioned trust in economic figures displayed daily. He muses, "We sort of take numbers on the screen for granted... But we don't really talk enough about what had to happen behind the scenes to get that number to the screen" ([01:06]).
Tracy Alloway echoes this sentiment, emphasizing the complexities involved in data collection and the qualitative adjustments necessary to maintain accuracy. She shares intriguing insights, such as how Consumer Price Index (CPI) weightings vary by city, affecting items like "food at home" differently in Minneapolis versus Chicago ([02:23]).
The conversation shifts to the declining response rates in economic surveys, a trend not confined to the United States. Tracy Alloway points out, "Response rates on the housing portion of CPI have gone from about 70% back in 2015 to just 57% now" ([03:54]). She further notes similar declines in other countries, citing the UK's Office of National Statistics struggling with data quality issues ([04:00]).
This decline poses a significant threat to the reliability of economic indicators, which are foundational for market decisions and policymaking. Joe Weisenthal underscores the gravity of the situation: "This is a really big deal... Without high-quality data, the real economy is at risk" ([04:37]).
Bill Beach provides an in-depth look at how essential economic data, such as the monthly jobs report, is gathered. He explains the dual-survey system involving approximately 400,000 firms and 60,000 households to generate employment and unemployment figures ([05:26]). The meticulous process includes data collection, weighting, and revisions to ensure accuracy.
Notable Quote:
"The Commissioner plays no role whatsoever in massaging the data or multiplying the survey results" ([05:50]).
Beach highlights the escalating costs of conducting these surveys, exacerbated by inflation and stagnant budgets. From 2019 to 2023, the household survey's expenses surged by nearly $5 million annually, straining the BLS's ability to maintain data quality ([15:04]).
Notable Quote:
"Our surveys, but especially the Current Population Survey, are dying. They're in very serious trouble unless we modernize." ([15:42]).
To combat data decay, Beach advocates for modernizing survey methods by integrating electronic data collection and leveraging private sector data sources. He stresses the necessity of legislative support and increased funding to overhaul the statistical system fundamentally.
Notable Quote:
"Change is required. It has to happen. Congress needs to fund modernization, not continuation, of the current system." ([28:32]).
Addressing skepticism towards government data, Beach explains the rigorous revision processes that enhance data accuracy over time. He shares an example where preliminary job estimates aligned closely with actual figures after thorough revisions, reinforcing the BLS's credibility ([40:19]).
Notable Quote:
"When we compare our numbers to the sampling frame, we sometimes find we're spot on, and sometimes we're off by 2 or 3 percent." ([40:19]).
Beach delves into the nuanced work of adjusting CPI and Producer Price Index (PPI) figures to account for product changes and quality improvements. He illustrates this with the example of potato chips, where reducing the number of chips per bag necessitates a "price per chip" adjustment to accurately reflect price stability ([42:41]).
Notable Quote:
"We train these people to observe changes and work that into their evaluation of the product when they're in the store." ([42:41]).
The decline in data quality and response rates threatens the integrity of economic indicators that inform critical decisions across financial markets, government policies, and business strategies. Without reliable data, the ability to assess economic health, craft effective policies, and make informed investment decisions becomes severely compromised.
Joe Weisenthal poignantly remarks on the foundational role of government data: "It's really interesting to think about government high-quality government data as like this public good... The thought of that going away is alarming" ([48:48]).
In closing, both hosts reflect on the indispensable nature of robust economic data systems. Tracy Alloway emphasizes the loss of data granularity, which hampers the ability to understand regional and social economic disparities ([46:37]). They underscore the urgent need for systemic reforms and innovative approaches to sustain the integrity of economic statistics.
Notable Quote:
"The statistical system runs our country. There's no economy without the Bureau of Economic Analysis and the GDP numbers." ([48:48]).
Critical Importance of Economic Data: Reliable data is fundamental for informed decision-making across various sectors.
Challenges Facing Data Collection: Declining response rates, rising costs, and budget constraints are undermining the quality of essential economic indicators.
Need for Modernization: Integrating electronic data collection and private sector data sources is imperative to revitalize the statistical system.
Trust and Transparency: Robust revision processes and transparent methodologies are vital to maintain trust in government data.
Impact on the Economy: The deterioration of economic data infrastructure poses significant risks to economic stability and policy effectiveness.
This episode of Odd Lots serves as a crucial wake-up call to the vulnerabilities within America's economic data collection frameworks. By featuring insights from Bill Beach, listeners gain a comprehensive understanding of the complexities and urgent challenges facing the Bureau of Labor Statistics. The discussion underscores the need for immediate action to preserve the integrity of economic data, ensuring its continued role as a cornerstone of the nation's economic health.
For more detailed discussions and insights, listen to the full episode on Bloomberg's Odd Lots podcast.