{"id":550,"date":"2020-06-26T03:26:41","date_gmt":"2020-06-26T03:26:41","guid":{"rendered":"http:\/\/podcasts.la.utexas.edu\/cepa\/?post_type=podcast&#038;p=550"},"modified":"2021-11-03T10:46:25","modified_gmt":"2021-11-03T15:46:25","slug":"richard-hahn-covid-19-interview","status":"publish","type":"podcast","link":"https:\/\/podcasts.la.utexas.edu\/cepa\/podcast\/richard-hahn-covid-19-interview\/","title":{"rendered":"Richard Hahn \u2013 COVID-19 Interview"},"content":{"rendered":"\n<p>Richard Hahn is an associate professor of Statistics at ASU. He develops probability models and computational techniques for applied data analysis, with a focus on the behavioral, social, and health sciences. His specific research interests include regression tree methods, causal inference from observational data, and foundations of statistics.<\/p>\n","protected":false},"excerpt":{"rendered":"Richard Hahn is an associate professor of Statistics at ASU. He develops probability models and computational techniques for applied data analysis, with a focus on the behavioral, social, and health sciences. His specific research interests include regression tree methods, causal inference from observational data, and foundations of statistics.","protected":false},"author":13,"featured_media":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_acf_changed":false,"_genesis_hide_title":false,"_genesis_hide_breadcrumbs":false,"_genesis_hide_singular_image":false,"_genesis_hide_footer_widgets":false,"_genesis_custom_body_class":"","_genesis_custom_post_class":"","_genesis_layout":"","episode_type":"audio","audio_file":"http:\/\/podcasts.la.utexas.edu\/cepa\/wp-content\/uploads\/sites\/21\/2020\/06\/2020-06-23_Policy-at-McCombs_Richard-Hahn.mp3","podmotor_file_id":"","podmotor_episode_id":"","cover_image":"","cover_image_id":"","duration":"","filesize":"75.92M","filesize_raw":"79608512","date_recorded":"26-06-2020","explicit":"","block":"","itunes_episode_number":"","itunes_title":"","itunes_season_number":"","itunes_episode_type":""},"tags":[98,99,97],"categories":[],"series":[2],"class_list":{"0":"post-550","1":"podcast","2":"type-podcast","3":"status-publish","5":"tag-probability-models","6":"tag-richard-hahn","7":"tag-statistics","8":"series-policymccombs","9":"entry"},"acf":{"related_episodes":"","hosts":[{"ID":693,"post_author":"38","post_date":"2020-10-29 17:58:44","post_date_gmt":"2020-10-29 17:58:44","post_content":"<!-- wp:paragraph -->\n<p>Carlos M. Carvalho is an associate professor of statistics at McCombs. Dr. Carvalho received his Ph.D. in Statistics from Duke University in 2006. His research focuses on Bayesian statistics in complex, high-dimensional problems with applications ranging from finance to genetics. Some of his current projects include work on large-scale factor models, graphical models, Bayesian model selection, particle filtering and stochastic volatility models.<\/p>\n<!-- \/wp:paragraph -->\n\n<!-- wp:paragraph -->\n<p>Before moving to Texas Dr. Carvalho was part of the faculty at The University of Chicago Booth School of Business and, in 2009, he was awarded The Donald D. Harrington Fellowship by The University of Texas, Austin.<\/p>\n<!-- \/wp:paragraph -->\n\n<!-- wp:paragraph -->\n<p>Dr. Carvalho is from Rio de Janeiro, Brazil and before coming to the U.S. he received his Bachelor's degree in Economics from IBMEC Business School (Rio de Janeiro) followed by a Masters's degree in Statistics from the Federal University of Rio de Janeiro (UFRJ).<\/p>\n<!-- \/wp:paragraph -->","post_title":"Carlos Carvalho","post_excerpt":"","post_status":"publish","comment_status":"closed","ping_status":"closed","post_password":"","post_name":"carlos-carvalho","to_ping":"","pinged":"","post_modified":"2020-10-29 17:59:59","post_modified_gmt":"2020-10-29 17:59:59","post_content_filtered":"","post_parent":0,"guid":"http:\/\/podcasts.la.utexas.edu\/cepa\/?post_type=speaker&#038;p=693","menu_order":0,"post_type":"speaker","post_mime_type":"","comment_count":"0","filter":"raw"}],"guests":[{"ID":798,"post_author":"38","post_date":"2021-03-24 18:32:47","post_date_gmt":"2021-03-24 18:32:47","post_content":"<!-- wp:paragraph -->\n<p>Richard Hahn is an associate professor of Statistics at Arizona State University. He develops probability models and computational techniques for applied data analysis, with a focus on the behavioral, social, and health sciences. His specific research interests include regression tree methods, causal inference from observational data, and foundations of statistics.<\/p>\n<!-- \/wp:paragraph -->","post_title":"Richard Hahn","post_excerpt":"","post_status":"publish","comment_status":"closed","ping_status":"closed","post_password":"","post_name":"richard-hahn-2","to_ping":"","pinged":"","post_modified":"2021-03-24 18:32:47","post_modified_gmt":"2021-03-24 18:32:47","post_content_filtered":"","post_parent":0,"guid":"https:\/\/podcasts.la.utexas.edu\/cepa\/?post_type=speaker&#038;p=798","menu_order":0,"post_type":"speaker","post_mime_type":"","comment_count":"0","filter":"raw"}],"transcript":"<p>Welcome to policy, Emma. A data focused conversation on tradeoffs.<br \/>\n\ue5d4<br \/>\nI&#8217;m Karla&#8217;s car value from the Save Them Center for Policy at the University of Texas at Austin.<br \/>\nSo we have with us today Professor of Statistics, Richard Horne from Arizona State University.<br \/>\nAnd there&#8217;s going to be a little bit of a different conversation, because Richard not only is a long time collaborator of mine,<br \/>\nbut also a friend. So perhaps this conversation to be a little bit more casual then than usual, but hopefully can<br \/>\nfetch a lot on issues that come of it in statistical terms. So,<br \/>\nRichard, thanks for being with us. Thanks. It&#8217;s going to be hot. So the way I&#8217;m trying to<br \/>\nhave this conversation is to try to go back to what we know when, you know, end the beginning at first,<br \/>\ntry to remember, recall how we&#8217;re thinking and how we&#8217;re judging the evidence that was in front of<br \/>\nus then. So first, when did you start to get like, huh? There&#8217;s something<br \/>\nimportant going on here. What was the first sort of like piece of information that that got your attention? So<br \/>\nfor me, it was in pieces because I work at Arizona State University<br \/>\nand we had a student from China who got one of the earlier cases in<br \/>\nthe US. So I&#8217;m thinking that was in January, maybe January or February.<br \/>\nAnd and it made kind of big news. But at that time, this was when.<br \/>\nIf you go and look at the timestamps of your articles online, this was back when The New York Times<br \/>\nwas saying it was no worse than the seasonal flu. Right. And so<br \/>\nwe didn&#8217;t take it too seriously. But it was kind of interesting. And all of my Chinese graduate<br \/>\nstudents were wearing masks. So they sort of like early on were like had been<br \/>\ntalking to people at home. They knew they knew something. And so that I thought was weird. The biggest<br \/>\nthing for me was that my classroom. I started seeing students with masks. And then there was a student.<br \/>\nBut what happened was that student got better. They did, you know, tracing or whatever. They found<br \/>\nhis contacts. They put them in quarantine. He was a young guy. He recovered. And I was kind<br \/>\nof the end of it. And then it started hitting the US. I had a trip planned<br \/>\nto Brazil in March and mid-March, I think 13.<br \/>\nNo, I must left on the 9th, something like somewhere around them. And<br \/>\nmy biggest concern. So I went. So that tells you what my personal risk was. I didn&#8217;t think it was a big deal. I<br \/>\nwasn&#8217;t scared of getting sick. I wasn&#8217;t scared of being a vector. I wasn&#8217;t going to get my family sick. At that time. I<br \/>\nwas my biggest fear was they were talking about closing down some airports. And so I was really worried that I might<br \/>\nget stuck in Houston, which is where my connecting flight was. So anyway, this is just my boring personal story. But<br \/>\nthe idea was I didn&#8217;t have models. I wasn&#8217;t worried when I was in Brazil.<br \/>\nThe Italians didn&#8217;t show up to the conference. And I was like, oh, OK. Because because all.<br \/>\nBut not because they were sick, but because all air travel had been canceled. But then a lot changed. Right. By the time<br \/>\nI got back on the story on March 13th. It was a whole<br \/>\na whole different world. We talked that day. We&#8217;re like, what&#8217;s going on? I<br \/>\nthink 48 hours after that, California had their shelter in place, order<br \/>\nin place. So I was bewildered. I mean, it&#8217;s funny. So not only am I the less<br \/>\nthe least illustrious guest that you&#8217;re speaking to, but I&#8217;m also probably the most clueless one. This is just going to be like, what?<br \/>\nWhat an average do to it? Yeah, I wasn&#8217;t scared at all. And then I was like, oh, this<br \/>\nis weird. I didn&#8217;t really get engaged. And and sort of intellectually<br \/>\nuntil the Ferguson paper, Ferguson at all, which was like a circa March<br \/>\nAnd in particular I had a good friend of ours. The onhe was at<br \/>\nthe conference in Brazil. She lives in London and we were talking at the time about how London<br \/>\nhas been at war. St. Peter College did. Did. Right. Yeah.<br \/>\nNo. I don&#8217;t want to be quoted on that. And so<br \/>\nI was we were saying like how great it is that London is keeping schools open. So at that time, I adamantly<br \/>\nbelieve the school should be open. And then that paper came out. And<br \/>\nBoris Johnson changed his mind overnight. There was a paper saying just that. Everybody,<br \/>\nRay. So. So this paper this paper basically said everyone&#8217;s<br \/>\ngoing to die unless we shut the world down. I don&#8217;t even remember the numbers. I remember<br \/>\nreading it and thinking, well, this is obvious hyperbole. So he said<br \/>\nif we don&#8217;t do anything in the US, 2.2 million people are going to die. Two point eighty eighty<br \/>\npercent of the people gonna get it. And it 2.2 percent of people are going to die by the summer. By July,<br \/>\nI think was the number and and five hundred thousand people in the UK. That was<br \/>\nthe number they had. Yeah. So if somebody gives you numbers like that and you think that they might be right.<br \/>\nYou start making different decisions. You start closing things down. You start hunkering<br \/>\ndown with your family and so forth and so on. I<br \/>\nnever liked that analysis from the from the get go.<br \/>\nWhat about it in particular? And the thing I didn&#8217;t like about it was that their decision making was clearly<br \/>\npessimistic. Right. Statisticians or economists might call it Mini Max. They were worried about.<br \/>\nThey were worried about the worst possible thing that could happen. And that&#8217;s generally not a great way to make decisions.<br \/>\nA classic example is driving and we drive all the time. But if we had a<br \/>\nworst case attitude about the driving risks, none of us would ever be able to drive a car. Worst case,<br \/>\nget in the car again. Because the worst case is that you end up in a head on collision with a truck and<br \/>\nit&#8217;s over. But on average, it doesn&#8217;t happen. No, not on average and not<br \/>\nvery often. Right. So it&#8217;s important when dealing with decision making under uncertainty that you figure<br \/>\nout what is your criteria. What is your criteria for evaluating this? Do I want<br \/>\nit to be. Go on, be right on average? Or am I going to have a lot of regret if I make a decision,<br \/>\nwrong decision theorist study this stuff. By and large, that&#8217;s<br \/>\nnot how policymaking is done in policymaking in the real world as lots of stakeholders. And<br \/>\nit&#8217;s a lot more based on gut gut reactions, I guess, and it can go both ways. Sometimes people are<br \/>\ntoo risky. I think sometimes they&#8217;re none of that. This case I think was very unique<br \/>\nin that a scientific body wrote this report.<br \/>\nIn a very aggressive way. To make their point<br \/>\nnow, if they had been right and this had been Ebola level deadly or something like that. And plus the<br \/>\ncontagiousness, the Navy would be saying that they were heroes because they sort of overstated<br \/>\nthings and saved lives. But frankly, the science wasn&#8217;t there. I mean,<br \/>\nby phrasing it in terms of the worst case, they were making a value judgment in terms of their<br \/>\nemphasis. Right. And when you say the science wasn&#8217;t there. So I think there was a paper that came<br \/>\naround the same time by another group of experts in<br \/>\nOxford, I believe. And what did that paper say? So<br \/>\nthat that paper came out a bit like a week later or maybe less. And<br \/>\nit basically said it said the opposite. Or at least that&#8217;s how it was reported in the press.<br \/>\nSo I want to talk about both of those things because I think they&#8217;re kind of interesting. So what did the press say? What did the paper<br \/>\nsaid? So this paper came out and it basically said, look, it could possibly be the case<br \/>\nthat actually way more people are already infected than we thought. And if that&#8217;s the case, that<br \/>\nthe denominator of the number of people that have this is much higher than we thought. Meaning<br \/>\nthat the death rate or the infection fatality rate is a lot lower than we thought.<br \/>\nIn which case maybe one, we&#8217;re closer to immunity than we thought already because more people have it.<br \/>\nAnd also, it&#8217;s not as scary as we thought it was. So that<br \/>\npaper that paper said this is a possibility. And again, it&#8217;s a matter<br \/>\nof emphasis, because the fact of the matter is, neither of the papers knew for<br \/>\nsure. Nor is it knowable. So the technical idea for this. Think I think this is why<br \/>\nyou got here to talk about this is there&#8217;s this idea called identify ability or identification. And<br \/>\nit basically says based on the data that&#8217;s available to you. Can you<br \/>\nrule out certain stories or explanations to the exclusion of all others?<br \/>\nSorry. Can you can you or can you say that this is the right one for the people here? Is this set<br \/>\nof plausible things? Well, so that&#8217;s the thing. Like, generally speaking, you can&#8217;t so like if you&#8217;re doing physics,<br \/>\nif you&#8217;re doing mechanics or something like that, you can do an experiment. And on the basis of that, you can rule<br \/>\nout theory. And you can therefore adopt a theory or something like that. More complicated<br \/>\nproblems in social sciences and epidemiology. What will you do instead as you rule<br \/>\nthings out, you say this data is not consistent with these possibilities, but it is consistent. So<br \/>\nthis is what I mean, the data that we had available at that time, it was a mixed bag of stuff coming out of<br \/>\nSuhan and Italy and early cases in London and stuff like that.<br \/>\nNot good data. I mean, it had all sorts of problems, not a lot of it. And the tests were the<br \/>\ntest or a perfect. In fact, the tests are still not great. And because of all of<br \/>\nthese factors, there were not able to rule out lots of interesting possibilities. And so<br \/>\nI think that they think that the scientists both knew this, but the two<br \/>\npapers basically put a totally different slant on it. The one paper said we can&#8217;t rule<br \/>\nout the possibility that 2.2 million people are will die if we don&#8217;t think so. And that number<br \/>\nwas based on it could be the case that very few people are infected, but it is highly infectious<br \/>\nand then it kills 3 percent of people. Yes. The other paper said, well, it&#8217;s also concerned the data<br \/>\nthat we have available is also consistent with the case where many more people are infected. And it&#8217;s not as tough<br \/>\nas we thought. So forth and so on. And so, you know, in a sober world, what we would like<br \/>\nis that the media didn&#8217;t pick up on either paper, didn&#8217;t put them in juxtaposition. The scientists<br \/>\nwouldn&#8217;t talk about it. You know, it wouldn&#8217;t have sort of foregrounded one over the other.<br \/>\nYeah. So the fact is the data did not resolve things.<br \/>\nAnd so this is this has been a real case study that people think of science as being a collection of facts.<br \/>\nBut really science is a method for ruling out scenarios.<br \/>\nAnd in this particular case, the science method did not allow us to rule out<br \/>\nenough scenarios so that the decision making was obvious. And when that happens, you<br \/>\nhave to have to guess. Well, you have to guess. But then you have to think about what gives them<br \/>\nthe other side. Right. So so when we talk a lot about tradeoffs in our discussions in our group here,<br \/>\nthe classes that this made is gonna be shown, too. So here we are looking at<br \/>\na few different scenarios, a possibility associate with a progression of disease. There&#8217;s one path that is compatible,<br \/>\nthe data we&#8217;ve seen so far that would lead to something like two men in destiny. There&#8217;s another path.<br \/>\nThat&#8217;s a path that&#8217;s more like mile that maybe leads to two hundred thousand. That&#8217;s us now<br \/>\nhave to decide what to do. We can go in and say we&#8217;re going to lock down our economy, going to shut everybody<br \/>\nhouse arrest, or we&#8217;re gonna do what a country like, let&#8217;s say Sweden did, which is say<br \/>\nwe&#8217;re not gonna do it. We&#8217;re going to just tell people to be careful, you know, close some obvious things and then see how<br \/>\nthis thing goes. So, you know, there&#8217;s possibilities and there&#8217;s real costs<br \/>\nin one. If I&#8217;m wrong, go one direction. But also real cost if I&#8217;m wrong and the other direction. Yeah. So one of the things that got lost<br \/>\nin all of this. So I agree broadly with what you said. I don&#8217;t know if I&#8217;d use the word house arrest. It&#8217;s a little loaded.<br \/>\nNot in the U.S., but in places like Italy. You were in house arrest. Yeah. Anyway.<br \/>\nYeah. So. So typically in the in the academic scholarly literature on decision<br \/>\nmaking under uncertainty, there&#8217;s a big component played by the utility or the costs.<br \/>\nAnd those play a strong role. And ideally, we would be balancing those. And you can&#8217;t<br \/>\ndo it. You can&#8217;t do it exactly right. Let&#8217;s write the rules. But you want to at least be aware of it. And then,<br \/>\nyou know, you and I have been collecting articles. There were people that were sort of glaring this horn<br \/>\nsaying, hey, look, there&#8217;s costs. Economic costs, unemployment<br \/>\nand stuff like that. But I guess it&#8217;s just it&#8217;s hard.<br \/>\nAnd what I noticed, the thing that I personally was turned<br \/>\noff by what I saw in policymaking was that people<br \/>\nwere not being open about the trade offs and about<br \/>\nthe interpretation. So it wasn&#8217;t as if the<br \/>\nICL paper came out. I see it as I said I was. I get a bricolage.<br \/>\nPuracal, isn&#8217;t it right? I see. I do not UCL University College on it. Let&#8217;s do this. Why? So<br \/>\nI&#8217;m a pro. Right. So when that paper came out, it wasn&#8217;t. It wasn&#8217;t like<br \/>\nthey were like, well, this this, this, this. And worst case scenario and there&#8217;s<br \/>\nthese other costs, like it was a kind of a long report. But the tenor of it for sure<br \/>\nwas like we should do this thing. And they really never backed off.<br \/>\nSo it makes it hard to make decision making because the people downstream from that hear one story<br \/>\nand they don&#8217;t know what to do with it. I guess what I&#8217;m trying to say is<br \/>\nI think people have their own incentives for the way that they interpret this stuff and<br \/>\nthey they do not necessarily explain themselves. So you you know,<br \/>\nyou&#8217;re tiptoeing around this a bit, but I can say it more openly that that<br \/>\nour biases when we scientists, you know, generally speaking, you and I are scientists<br \/>\nand enough in Alaska. And when we write something, it&#8217;s really<br \/>\nhard not to let your your beliefs come in and say, oh, here&#8217;s what I think is<br \/>\nright or wrong with his analysis or so. Right. It&#8217;s really hard. And we have a process of peer reviewing<br \/>\nthat oftentimes is very frustrating. It sort of tries to mitigate that a bit. And, you know, it&#8217;s best<br \/>\ndone in its best format does that. It takes away some things that maybe I think that&#8217;s not a generic<br \/>\ngenetic enough claim to be made worth mentioning. Right. That neither of these two papers we&#8217;re talking about were peer reviewed<br \/>\nand they were very rushed. The one paper was from a government panel.<br \/>\nSo in that sense, it was a large group of people and they were sort of enlisted to do this<br \/>\ntype of work. The other group, I think it was a response paper because they saw the ICL paper<br \/>\nand they were like, wait a sec. Well, let me get those papers were not great scientifically.<br \/>\nI mean, I&#8217;m willing to go on the record and say that when I saw those models and when I saw what they had done,<br \/>\nhow they adapt with the uncertainty. I was not overly impressed. It looked tasty.<br \/>\nAnd it was you know, there was well documented. The code was not readily<br \/>\navailable in all the sort of standards that you typically hold for scholarly work.<br \/>\nWe&#8217;re sort of not met in either paper, which again, in some ways it is also is also understandable<br \/>\ngiven that the it was rushed to be produced and now that. Right. So<br \/>\nyeah, I don&#8217;t I mean, this is not coming across as a clear narrative. You were just asking me to talk about<br \/>\nthe sort of issues that are defined. But what I think is what I do, what I want what I want to say is that is that<br \/>\nyou mentioned is that people like to think about science and scientists as being somehow these<br \/>\narbiters like this, people in wearing robes, you know, are calling balls and<br \/>\nstrikes without any kind of. And every time you read a paper by an economist or by<br \/>\nme or by you or by them geologist, their preferred path is<br \/>\nthere in one way or the other. And I take that into account, because when a governor of a state<br \/>\nas big as California says, the decisions are going to be dictated by science. It&#8217;s<br \/>\nhim not doing his job because science cannot tell him what to do. Yes.<br \/>\nYeah. Yeah. I mean, I not thought about that. And I certainly don&#8217;t want to be I&#8217;m not on the bandwagon of like a scientist<br \/>\nsubjective. There&#8217;s certainly no scientist that&#8217;s objective. But but it has to be.<br \/>\nLet&#8217;s go this way. Science done well does eventually lead to facts. I mean,<br \/>\nI&#8217;m not a philosopher by trade like I&#8217;m a student of philosophy more than I am a philosopher. But, you know, they<br \/>\ncall this up. What&#8217;s the word? I swear that they use truth filmic. Like the idea is like the method<br \/>\nyou wanted to be leading to the tricks. And we think that it does. And that&#8217;s why the scientific method is so<br \/>\ngreat. Prior to arriving there, you<br \/>\nget to these places where you just can&#8217;t tell. And that&#8217;s especially true in fields like epidemiology.<br \/>\nSo, yeah, I don&#8217;t know like that. I agree that the governors are, you know, the people in charge.<br \/>\nSaying we&#8217;re going to let that. We&#8217;re going to follow the scientists. Yeah, it&#8217;s<br \/>\nweird. You&#8217;re going to follow which scientists write, if they follow the Oxford scientists, they would have made one decision. And if they&#8217;re<br \/>\ngonna follow the ICL scientists, they&#8217;re going to do another one. In a way, it seems like just a way to take cover. You<br \/>\npick a scientist that&#8217;s willing to say they think you want to do it and then you do<br \/>\nit. Scientists are people, right? It&#8217;s not like they don&#8217;t have agendas, incidentally. And I<br \/>\ndon&#8217;t know Professor Ferguson personally, but I read that article by<br \/>\nMatt Ridley, who pointed out that he&#8217;s made a career out of saying<br \/>\nthat the next pandemic is going to be the big one. He did it with mad<br \/>\ncow, did it with swine flu. It with Ebola. With Ebola. So so he has a<br \/>\ntrack record of like this. Clearly, his world view now as an economist and<br \/>\nyou&#8217;re more an economist than I am getting our station. But like we talk about incepted, you know,<br \/>\nkind of stuck with incentives a lot. Somebody said to me, you know, epidemiologists don&#8217;t get<br \/>\nin trouble with their pessimistic. If an epidemiologist says everybody is going to die, we should<br \/>\nshut down and then nobody dies. Everybody is just happy that nobody died. And because what<br \/>\nif the epidemiologist says, oh, it&#8217;s going to be cool. Not a big deal. And then everybody is a dying,<br \/>\nyou know, that epidemiologist is on the hook. So I think it&#8217;s pretty interesting,<br \/>\nthough, that you&#8217;re going to advice from a group of people who have every professional incentive<br \/>\nessentially to say that things are worse than they are. You know, it&#8217;s not just<br \/>\ntime. It may have changed this time because I&#8217;ll tell you so. So it&#8217;s not big<br \/>\nlike. We did something that you heard a large amount of defense. I mean, we<br \/>\nwere still going to spend years trying to debate whether, you know, was what was the cause of a fact here,<br \/>\nof what if we hadn&#8217;t shut down? What if. You know, and and relative to that,<br \/>\nwe&#8217;ve seen that already. That&#8217;s actually a lot of variability happened to us. Right. All states, they&#8217;re still closed.<br \/>\nThey&#8217;re open. We&#8217;re gonna actually learned a lot from from from experiments that we run.<br \/>\nAll right. So that was done anyway. So so recap. First point, those are these papers. Those are these<br \/>\ntwo hook sort of high-Profile papers, these pretty similar models. And those models were not<br \/>\nable to do everything we wanted them to do. And that&#8217;s right. That&#8217;s just<br \/>\ncompletely plausible within those models. A battle of a radically different. Radically different.<br \/>\nOK. So. So for people that are familiar with thinking this way, let me give an example that I worked on. So it&#8217;s sort<br \/>\nof like factoring in. No. OK, so five times six is thirty. Right.<br \/>\nSo let&#8217;s say I tell you that it&#8217;s 30. You don&#8217;t know if it came from five times six<br \/>\nor 10 times three. Those are very different things, right? So<br \/>\nso let&#8217;s say that, you know, that the revenue was 30. You don&#8217;t know if you sold 10<br \/>\nunits at $3 of $3 or 5 units at $6,<br \/>\netc., etc. And that&#8217;s it. That&#8217;s all it comes down to. You&#8217;ve got some data and then you&#8217;ve got an explanation<br \/>\nfor how that data came up and sometimes you&#8217;re not able to uniquely resolve it. If the number happened to be a prime number.<br \/>\nThat&#8217;s right, Tony. You can do it right. But you can&#8217;t tell us,<br \/>\nso I saw that if the first issue that nobody talked about, then fast<br \/>\nforward a bit. And now we are here in June 5th, 2020. And<br \/>\nwhat do we learn now and how do we think about those models and those predictions based on what we now now have<br \/>\nmore information about? So let&#8217;s talk about back testing. This<br \/>\nis going to place to do that. Is any back testing is a term that I first heard.<br \/>\nWe&#8217;re talking about financial markets. So let&#8217;s say that you&#8217;re building a stock picking algorithm and you<br \/>\nwant to know if it works. So what would you do? Well, you could take the past data<br \/>\nand then you would look at it and you try to predict the future date. Right. That&#8217;s that&#8217;s what this thing does.<br \/>\nSo what you could do is you could pretend that you collected the data in the 70s<br \/>\nand then used it in the 80s. Sitting in 2005. Right. So you get<br \/>\nthis why they call it back testing you basically you use your your algorithm, you place it into the past<br \/>\nand then run it for it. It&#8217;s a powerful method because it tells you if the patterns that you&#8217;re seeing would have<br \/>\npersisted. It&#8217;s just it&#8217;s a smart thing to do. We can do that with these epidemiologists.<br \/>\nRight. So everybody was trying to do forward prediction and they were taking those<br \/>\nfour predictions and they were saying this is what we should do now<br \/>\nthat we&#8217;re here. It would be really interesting to go and compare what those predictions<br \/>\nwere to what happened. Now it&#8217;s complicated. And the reason<br \/>\nit&#8217;s complicated is because there&#8217;s an extra degree of freedoms, which is the fact that we did things like<br \/>\ncrackdowns. Right. The degree is still the degree of social distance is a enormous<br \/>\ndegree of freedom. So, again, we&#8217;re in this case where we&#8217;re unidentified again.<br \/>\nSo why is that? So they have predicted that blahblahblah would have happened. The<br \/>\ncurve would have gone like this. Right. And then it didn&#8217;t. The curve kind of went like this.<br \/>\nThe question is, did the curve grow like that because the world wasn&#8217;t as bad as we thought it was? The<br \/>\ndisease wasn&#8217;t as bad in some ways. Or did that happen? Because we were all very,<br \/>\nvery good boys and girls. Stay inside talking. It&#8217;s probably some of each.<br \/>\nRight. Nonetheless, that&#8217;s the sort of analysis I&#8217;m excited about going forward. I think<br \/>\nwe have enough data to look at it now. And in particular, you&#8217;ll be able to say things like. Let&#8217;s assume<br \/>\nthat we had very high levels of social distancing. If the disease were<br \/>\nas bad as we thought, would it have still been? Would it have been slow? You know, I think the answer we&#8217;re starting to see is no<br \/>\nlight coming in from various quarters, sort of. It doesn&#8217;t seem like<br \/>\nit&#8217;s as deadly as it was. And it seems like they&#8217;re contagious. Contagion<br \/>\nmechanism is distinct from these models thought it was, which was that everybody is equally likely to.<br \/>\nI mean, that&#8217;s one of the implicit assumptions, right. Some of these models now<br \/>\nthat is anyway that there&#8217;s a particular in particular that what we learn is when you say not badly, we&#8217;re talking<br \/>\nmaybe an order of magnitude less deadly than people thought at first. Yeah. So. So it&#8217;s it&#8217;s a very<br \/>\npeculiar to my understanding. I am not a medical doctor, obviously.<br \/>\nBut that said, from what I&#8217;ve been reading, this is a disease that that hits<br \/>\nolder people harder than the flu. For various reasons. On the other<br \/>\nhand, it actually seems to be less bad than the few for younger people,<br \/>\nand that gives you a good. What happens because of that is that if you aggregate up over age group, you actually get a<br \/>\nsection fatality rate. That&#8217;s about five times higher. It&#8217;s<br \/>\ngetting to be less than that. Well, know, last I added more information. Yeah, it&#8217;s been follow it too closely.<br \/>\nBut. Overall, it seems to be from a couple of places that I&#8217;ve looked and unfortunately<br \/>\nI don&#8217;t have references. But when you do the age breakdown below 50,<br \/>\nit seems to be the case that it&#8217;s actually not as bad as the flu. Right. Which is one reason<br \/>\nthat I&#8217;m upset about the significantly larger. But above 50, significantly worse than<br \/>\nthe flu. Yes, yes, significantly. So, yes, it&#8217;s.<br \/>\nAnd then the super spreader thing. Apparently, it appears that not everybody. You know, there&#8217;s some weird mysteries<br \/>\nthat kids don&#8217;t seem to give it to their parents or to each other. In addition to not being symptomatic.<br \/>\nSome people seem to be super spreaders, meaning both that they come into contact with a lot of people, but also that they have<br \/>\na high degree of viral load and sneeze a lot or something. I don&#8217;t<br \/>\nknow, adult all the mechanisms are, but it changes every day. But the point is that has a lot<br \/>\nof that. It seems that a lot of heterogeneity there and not something that is homogeneous as they use it as a lot of those models.<br \/>\nYeah. So the models basically assume that everybody there&#8217;s some fraction, you know, it&#8217;s based on averages.<br \/>\nThese simple models are essentially estimate an average and then assume that the average<br \/>\nholds for everybody. So everybody in the model is equally likely to die of it. Everybody equally likely<br \/>\nto get it in the simplest models. All right. That&#8217;s what it looks like.<br \/>\nSo what we&#8217;re finding is not true. I don&#8217;t know, I like like<br \/>\nI guess the tenor of I am not going to come down and tell people that they should not be scared of this.<br \/>\nI just don&#8217;t feel comfortable doing that. But I do feel comfortable saying is that I&#8217;m not scared about.<br \/>\nJust my smites synthesis of the information. You know, sort of informally. Are you willing to<br \/>\ntake it or are you? I will. We want to put your children back in school. They go back on June<br \/>\nYes. So I don&#8217;t think I&#8217;m going to be doing a lot like. I&#8217;m a little bit. A little bit. Do you<br \/>\nwant to go to a crowded bar? I wouldn&#8217;t go to a bar anyway. Yeah. So sporting events?<br \/>\nProbably not. You know, a large, large, dense public transportation.<br \/>\nProbably not. We&#8217;ll just say that from a personal risk aspect or from like I don&#8217;t wanna be a vector.<br \/>\nBecause if I go to a crowded bar or to a sporting event, I&#8217;m being a vector. I&#8217;m more<br \/>\nlikely to become a vector when I help. That is right. I think both. I think<br \/>\nboth. I don&#8217;t I don&#8217;t consider this this kind of an interesting point. I don&#8217;t consider those two things<br \/>\nas distinct as some people. So this came up with with the discussion of masks. So people were talking about art<br \/>\nand the CDC screwed up. Right. Because in the sense that they was hold and they weren&#8217;t clear there when the W.H.O.<br \/>\nYes. Sort of across the board. The rationale for masks all<br \/>\nalong. If you&#8217;ve been paying attention to the way it used for decades in Asian countries is that<br \/>\nit&#8217;s a courtesy gestures to prevent you from getting other people sick. All of the scientific<br \/>\nstudies on this have been about does it protect you? And<br \/>\nI think the CDC rationale early on all that they can never say this and I don&#8217;t think they ever came out said this<br \/>\nwas that. They wanted to keep the personal protective equipment<br \/>\nfor the frontline workers so that they didn&#8217;t get sick, which is a totally reasonable thing. But rather than saying that apparently<br \/>\nthere was this paternalistic response where they just told people the masks aren&#8217;t effective.<br \/>\nDon&#8217;t use them because we need to save them for the. I mean, it just on the face of it, the logic of it doesn&#8217;t<br \/>\nmake sense. Don&#8217;t use the masks. They don&#8217;t work because we need them for the<br \/>\ndoctors. Like if they don&#8217;t like what? So there&#8217;s two debate. You know, this is a persistent confusion.<br \/>\nTwo different things that the mask do. Right. So the question is, when you go to a grocery store, should you wear<br \/>\na mask? And this gets to your question of, well, is it because you&#8217;re scared of infection? If it&#8217;s because you&#8217;re scared<br \/>\nof infection, the mask doesn&#8217;t help. But it kind of obviously helps<br \/>\nyou because it prevents you from sneezing on things. Right. Right. So if you&#8217;re the vector.<br \/>\nSo that&#8217;s kind of an interesting. You know, these are the sort of subtleties that. Have become<br \/>\ncommonplace in life now, but people are bad at it. People are bad at passing this sort of thing.<br \/>\nAnd it makes everybody anxious and then they fight over the masks. And then on top of that, there&#8217;s misinformation. People saying<br \/>\nthat the mask. Make you sick. Right. And he comes in and becomes a political<br \/>\nstatement. And it&#8217;s a mess. Anyway, going back to the point, I think<br \/>\nabout it as a community. And so I think about getting my kids teacher sick.<br \/>\nSo it&#8217;s I mean, it&#8217;s sort of self-interested in that way. It&#8217;s like I don&#8217;t have this very abstract notion of being elected.<br \/>\nBut but I do think about. I don&#8217;t want to get the bus drivers sick. Who then gets the teacher sick, who then gets<br \/>\nmy kid, you know? So I think that&#8217;s the right attitude. We&#8217;re kind of in this together<br \/>\nand we should just do what we need to do to keep people safe. But<br \/>\nthat doesn&#8217;t extend to question. One question I&#8217;m asking pretty much everybody that<br \/>\nI&#8217;m talking to is that what you&#8217;re talking about is that there&#8217;s an externality where there&#8217;s a cost. That&#8217;s not to you<br \/>\ndirectly. Personally, that&#8217;s B associate. So when you go out, you might have be facing<br \/>\nyour personal risk of deciding to go out to a bar or whatever. But that cost is<br \/>\nis you can decide to mitigate your cost, the weight that the cost of you getting sick, whatever you want, but<br \/>\nby you being out. That increases the transmission rate of disease out there. And that&#8217;s a cost to others that you<br \/>\nare Detroit creating. So we don&#8217;t internalize that would call that economics. We can talk about that in this class and externality.<br \/>\nRight. Interesting thing about this problem is that is very different than a typical example of action now<br \/>\nand pollution. I sent some stuff in the air. The air is polluted, not costing me anything directly.<br \/>\nBut everybody else, I&#8217;m not paying the price for it. So, you know, we need to somehow create a mechanism<br \/>\nto fix that. Right. But unlike pollution, the people there are really at risk here<br \/>\nhave a choice of not going out. So, you know, it&#8217;s not like I have a choice of not reading<br \/>\nthe air. Right. So in the series. Are you talking to captain? We will later. Yes.<br \/>\nOK. OK. Captain had a nice comment about this. But but. But here&#8217;s a part of the action now that I think. So,<br \/>\nyou know, I think that I&#8217;ve heard that part of the discussion and some people elaborate very clearly on that. Well, one thing<br \/>\nthat I&#8217;ve not heard yet is the fact that we also use vaccines. And again, I will talk about vaccines,<br \/>\nnot GLAAD&#8217;s, as an example of a positive action ality. By these vaccinating, I become<br \/>\nnow immune person in a system that therefore slows down the progression of the disease. Right.<br \/>\nBy the same logic, my kid. That is not at risk. Cap. Getting the disease<br \/>\nand becoming immune is actually a generator of a positive externality. So the action,<br \/>\nAli, there&#8217;s a third there&#8217;s a phase transition between when it&#8217;s negative versus when it&#8217;s possible in<br \/>\na world in which I could isolate all the people, they are really at risk and let everybody else hang<br \/>\nhang out to mingle. We&#8217;ll get to herd immunity and then they can come out. It ended<br \/>\nnow that people can come out. This was this this was the Sweden plan. Right. But they did a bad job at<br \/>\nstep one. Step one, which is hard. It might be impossible. Right. It might be impossible. That&#8217;s why I did a bad<br \/>\njob at step 1, which is that their nursing homes got super sick, but everyone stayed. Right. I mean, nobody<br \/>\ntook a job. It turns out to be very hard not to. And if you didn&#8217;t know if the things were<br \/>\nasymptomatic in the beginning, nobody knew and is already getting in. So, you know, it might be too late by the time we figure out it might<br \/>\nhave been too late. Right. We could have avoided sending Kovic positive patients<br \/>\nback into nursing homes. Like a lot of states. That&#8217;s different. Yes.<br \/>\nYeah, I think New York, New York and of course, thousand three hundred patients positive were sent back to nursing<br \/>\nhomes, which again, I don&#8217;t know what it what about. I mean,<br \/>\nit&#8217;s funny because the area in which I have any professional expertise is in is in this<br \/>\nthis idea of quantifying uncertainty or trying to do in some sense, there&#8217;s<br \/>\nnothing much to say. Like like there was a lot that we said already. I think some of the decision making part,<br \/>\nI think. I think you use a sentence before. To me that I think is interesting is that I think a lot of the ways people<br \/>\nare talking about it is they&#8217;re confusing the evidence with our values. Yeah. Right. And<br \/>\nI think in decision making, we have the evidence that has a lot of uncertainty. And then we&#8217;ll have to put that through a utility<br \/>\nfunction that says, OK, now let&#8217;s make a decision. And that&#8217;s what you&#8217;ll find is common. And it&#8217;s totally fine. You might have the<br \/>\nsame evidence. You and I might get to a different decision. That&#8217;s a big component of what we&#8217;d like to emphasize in this<br \/>\nglass. Right. So I need to get on to get on a soapbox here. I think this is super important for<br \/>\npeople these days in particular, because, you know, there&#8217;s this<br \/>\nphrase of like, you know, post truth world or post facts<br \/>\nor whatever. And I think that this is that problem. When you&#8217;ve got scientists putting out papers<br \/>\nand the papers are written in such a way that the value, their value. It makes<br \/>\nit seem like the facts are up here. And to some extent, some facts are up in the air, but<br \/>\nnot not. But they don&#8217;t disagree with each other. Like it like a proper reading of those two<br \/>\npapers is that they said the exact same thing. And that one group emphasized<br \/>\none thing and the other group emphasized another thing. So at least at the end of that interchange, like the<br \/>\ncorrect way to look at that is they analyzed data. They found a range of possibilities<br \/>\nthat were the truth. We don&#8217;t know which one it was. And then on top of that, you layer on the values.<br \/>\nRight. But at least in that context, people aren&#8217;t pointing fingers at each other saying you&#8217;re making up facts.<br \/>\nRight. Furthermore, it means that you can have cases that are not ambiguous.<br \/>\nThe polio vaccine is an amazing vaccine and it works. And to the best<br \/>\nof everybody&#8217;s knowledge, it doesn&#8217;t cause autism. You know, the idea is there should be<br \/>\nand we can have this like as long as you it like if people were<br \/>\nopen about when they didn&#8217;t know they would be more trustworthy when they<br \/>\nsaid they didn&#8217;t know. Right. That&#8217;s true. But if scientists go around saying<br \/>\nevery single time. I know, I know, I know, I know. Because science and then they&#8217;re wrong<br \/>\nnobody&#8217;s gonna believe them. And I have a huge fear here with epidemiology<br \/>\nthat&#8217;s happening is that, you know, they have a role to play whenever the play comes back.<br \/>\nRight. We&#8217;ll get to that. You guys that are you guys are at it again saying<br \/>\nthose things. They&#8217;re not going to happen in this book, which so that<br \/>\nI mean, on the on the other hand, you want it, you don&#8217;t want a broken clock is right twice a day. So if<br \/>\nthey keep out, Ferguson is going to be right. Maybe it&#8217;s time, maybe not in his lifetime, but<br \/>\nhe&#8217;s actually going to write eventually. Know not for the right reasons, but. Right, right.<br \/>\nYeah. It&#8217;s crazy. So one question I&#8217;m asking a lot of people is a question of,<br \/>\nyes, we all got into somehow for one way for one reason or the other. I don&#8217;t know. Maybe the Ferguson paper had a huge<br \/>\ninfluence on this. The majority of the Western world. Let&#8217;s focus on the Western world, the<br \/>\ndeveloped countries, the rich countries in the world. All of them except one decided to do the<br \/>\nsame thing. And, you know, as we spend a lot of time talking<br \/>\nabout here, it seems that he was not clear from the evidence that that was the path forward. It was not clear from the<br \/>\ntradeoff evaluation that was there, right? That&#8217;s right. So I think if we have any idea of why,<br \/>\na lot of thoughts on. So I think there are two interesting points here. So the first one,<br \/>\nwhich is not super controversial and it&#8217;s not really an opinion, is that in cases of great uncertainty,<br \/>\nif you&#8217;re interested in the global welfare, it is actually beneficial that<br \/>\npeople do different things, because if they do different things, you learn<br \/>\nfrom the places that did it wrong and you learn from places that did it right. And then you adapt.<br \/>\nAnd then in the sort of medium term, everybody is better off. So it&#8217;s the term of<br \/>\nthat in our science, right? Explore, exploit. Or<br \/>\nMOTY Army Bandit&#8217;s, you know. I mean, so this idea is like if you don&#8217;t know and you want<br \/>\nto learn, you cannot learn if everybody in the world does the same exact<br \/>\nthing. All that&#8217;s gonna happen then is everyone&#8217;s going to have roughly the same outcomes or not. Yeah. And then<br \/>\nit&#8217;s very confusing. Whereas if everybody had done sort of different things,<br \/>\nwe would learn faster about it and we could have had better policies in months, too. I mean, hell, we&#8217;re on. But<br \/>\nthree of the four and a half. You know, if everybody had been doing slightly different things, maybe we<br \/>\ncould have this lot figured out by now. I would argue that that me, because of an example<br \/>\nand by you, kind of can rule out certain things by what we saw happening. So we did.<br \/>\nWell, I think that was right on last is a different virus. I think what happened swedens shows us that<br \/>\nby not locking down, by trusting the citizens to do reasonable things, they can<br \/>\navoid an exponential growth of disease. Yes. And they did not have<br \/>\na exact. That statement is uncontroversial. Whether that&#8217;s going to lead to a higher death rate after<br \/>\nthe whole epidemic is over, not I don&#8217;t know. I cannot argue that. But I can argue for sure that we are able to avoid a<br \/>\nexponential growth of disease by just crossing the city. So anyway, so that&#8217;s that&#8217;s the one angle which which<br \/>\nI have heard many people talk about. You know, from an ethical perspective, the claim might be, oh, well,<br \/>\neverybody should do the thing that they think is best. And if they all agree that this is the best, even though they&#8217;re not sure,<br \/>\nyou know, it&#8217;s understandable, you know. But then but then you can make the argument that will in the<br \/>\nlong run. Right. Yes. Antibiotic or learn if anybody&#8217;s going to be better. So<br \/>\nanyway, anyway, then the second thing, which is a little bit more loaded is just the amount of groupthink<br \/>\nand sort of social piling on due to social media, just due to human frailty, because<br \/>\npeople are weak at social is decreasing the number of people<br \/>\nthat all of a sudden were. One hundred I&#8217;m trying to think<br \/>\nof a good example of how crazy I think this all is. I mean, look, we know scientists,<br \/>\nright? Like like we have colleagues, they&#8217;re scientists and we know that they&#8217;re just people. You&#8217;ve seen the sausage made.<br \/>\nIt&#8217;s not always pretty. After a decade or two decades,<br \/>\nthings get polished up and they get presented. But in the short term, science<br \/>\nis a little messy. And I think because of that, people that do science are a little bit skeptical. Usually<br \/>\nI did not see that here. All of<br \/>\na sudden people got scared and they were very willing to say, like angrily, maybe this is just my little<br \/>\nbubble. I&#8217;ve got a bunch of well-educated friends. But by and large, everybody was like, trust the experts.<br \/>\nFlatten the curve. There there was not a lot at home.<br \/>\nIf you dare not to believe that stay at home was the right thing, you&#8217;re you&#8217;re you&#8217;re somehow. Oh, there is. There was a lot of value<br \/>\nto shaming going off for people that had differing opinions to the point where people<br \/>\nI know weren&#8217;t quite on board. They want to say thing.<br \/>\nSo I just I know that regardless of whether or not they&#8217;re right or wrong,<br \/>\nthe fact that they they felt chilled. You know, I heard about this in history books<br \/>\nabout this sort of phenomenon. This is the first time in my lifetime that I&#8217;ve really see shop<br \/>\nwhere I thought I thought that was kind of scary, just that people weren&#8217;t.<br \/>\nSo so let&#8217;s talk about expertise. OK. So I naturally and sort of<br \/>\nauthority averse, I guess. And so I&#8217;m a jerk. If somebody says do this,<br \/>\nI say, why? And that&#8217;s just how I&#8217;m fired. And I don&#8217;t think that&#8217;s necessarily right.<br \/>\nBut it&#8217;s also not right to just trust with the experts blindly. Right.<br \/>\nSo go back a few years. Do you remember when Nate Silver was crushing that prediction, all predicting all the election<br \/>\nresults and so forth? And he wrote in his book, This Big Thing about<br \/>\nthe death of experts and how data data driven was. Now<br \/>\nthe you know, you didn&#8217;t need an expert, you didn&#8217;t need a talking head. Around 2012<br \/>\nor so, there was this whole thing where people on the news would get on the news and they say it should go one way and<br \/>\nthen go the other way. Right. So screw the experts.<br \/>\nTrust the data. Trust the data. And boy, did that go out the window.<br \/>\nAll of a sudden, I was hearing the same people saying stuff like Danielle epidemiologist<br \/>\nhad been studying for this. Unless you have a degree in epidemiology, you can&#8217;t have an opinion on on the<br \/>\nsocial media platforms are filtering out clothes for people that did not have a degree in epidemiology or some<br \/>\nlike. That&#8217;s about that&#8217;s like scary. So is it you know,<br \/>\nit&#8217;s a theme of our times. That information is widely available and<br \/>\nthere&#8217;s more talking heads than ever and there&#8217;s credentials in it. It&#8217;s a sort<br \/>\nof side note of all of this is like when do we trust the experts? Like how how expert are the experts,<br \/>\nin my opinion? I guess I don&#8217;t take I&#8217;ll take some flak for this, but I have not<br \/>\nbeen overly impressed with epidemiology as a field. So I&#8217;ve got a few epidemiologists<br \/>\nthat that I follow professionally. Just a namedrop<br \/>\nSanders Greenland is Andrew GREENE, that is an epidemiologist I follow and out of UCLA<br \/>\nright at UCLA. Jeannie Robbins You know,<br \/>\nthere and there are people that that work in this area that I know there were professionally<br \/>\nI would say that are outliers in the with their careful. And and so,<br \/>\nyou know, simple differential equations model of a virus, not good enough.<br \/>\nNot up to the task, which is not really it&#8217;s not an indictment about I mean, it&#8217;s it&#8217;s hard,<br \/>\nright? It&#8217;s hard. And I&#8217;m not going to say it&#8217;s useless, but good God. Let&#8217;s not pretend that these things are<br \/>\nanything. I think that that forget about a judgment on on their field, on the models specifically.<br \/>\nI think that they got a good, as you said, a careful reading of any of those statements of those papers in<br \/>\nthe early days would say that we don&#8217;t know enough. Yes. Right. And then again.<br \/>\nSo for the purpose of policymaking, there are situations that the policymaker doesn&#8217;t know enough.<br \/>\nYou&#8217;ve tried their best to corroborate the information you have. And now we&#8217;re going to try to think about the tradeoffs you face.<br \/>\nAnd you might not know enough or the trade off took place either, because in this case, you don&#8217;t know what is going to be a better<br \/>\none. But you have to make a decision. You have to consider. Charles means Charles Minsky,<br \/>\nthe economist at Northwestern, has a line. We are talking about decision making under uncertainty.<br \/>\nAnd, you know, most people would say you want to do best on average. But in a case like this,<br \/>\nyou don&#8217;t get to realize the average is an individual. Right. And so he&#8217;s got this line that really stuck with<br \/>\nme. He says, we don&#8217;t want to maximize<br \/>\nour primary probabilities. He&#8217;s excellent. We don&#8217;t want to maximize ex-ante probability.<br \/>\nWe want to maximize ex-post outcomes. But you can&#8217;t<br \/>\ndo that. You can do that. Right. But it&#8217;s an interesting it&#8217;s an important thing to remember, because what it means<br \/>\nis that you can make a decision with the best of intentions, using the best of the data, using an honest utility function<br \/>\nand still get clobbered. But, you know,<br \/>\nthat&#8217;s of errors. But I think I think going back to just to close it up, one thing that<br \/>\nyou said in the beginning is the idea that people decided to to do plan on the worst case scenario<br \/>\nin one dimension, which was that let&#8217;s do everything it takes to reduce the number of<br \/>\ndeaths, whatever it is. Right. And and people tried to portray that as as<br \/>\na precautionary principle. Oh, we don&#8217;t know enough. Let&#8217;s be super careful. Right.<br \/>\nBut but, yes, what&#8217;s forgotten here is that, well, by doing this incredible<br \/>\ncredible measure, sledgehammer on people&#8217;s lives. Right. I mean, I&#8217;m not I didn&#8217;t know at the time<br \/>\nthat all of a sudden supply chains wouldn&#8217;t break down, that there&#8217;ll be no food in the grocery store. I didn&#8217;t know that. Yet<br \/>\nsomehow we know. Thank God for I mean, at least companies that kept doing their job like<br \/>\ndid we know that would happen for sure. So anyway, this goes back to this goes back to my statement about<br \/>\nhow the the incentives of a profession because epidemiologist<br \/>\nby training narrowly focus on deaths due to the disease. Right.<br \/>\nDisease specifically just sort of what they&#8217;re trained to do. So you can hardly fault them for it for when<br \/>\nthey write up the reports, even if they wanted to do a worst case analysis, which they should have been more honest about the worst<br \/>\ncase. But what you tell us, the makers are the ones the policymakers then need to recognize<br \/>\nthat that&#8217;s a narrow metric. And health economists are supposed to be the ones that sort of do the second step,<br \/>\nwhich is to say, OK, here&#8217;s all these other things. But I think also. But also psychiatrist and also sociologist.<br \/>\nAnd also like there&#8217;s a lot of different input that I think you&#8217;re I think that you&#8217;re right. There&#8217;s a logical fallacy<br \/>\nthere about how to interpret the data, but really focusing on<br \/>\nthese numbers. And by the way. We should not be reading these numbers daily. It is ridiculous<br \/>\nthat it&#8217;s like it&#8217;s posted up there and people. It&#8217;s like reading tea leaves people without training or watching these<br \/>\nnumbers going up and down and then deciding whether or not to go to work that day or or what<br \/>\nsentencing. And I have too many thoughts, too many<br \/>\nthoughts on this. I just one just left. So what do you think happens next? That&#8217;s more like now hour, just to<br \/>\nput you in a bad spot of making a prediction to close it up. I mean, I think.<br \/>\nWell, it certainly is. I&#8217;ll stick to my guns. I think that what&#8217;s going to happen is people are going to try to be very judicious<br \/>\nwith a lot of caution. And it&#8217;s sort of great inconvenience. They&#8217;re going to make four year olds wear<br \/>\nmasks and they&#8217;re going to open up schools at 40 percent capacity<br \/>\nand stuff like that. And I think that they&#8217;re doing that because there&#8217;s some regret driven decision making, which<br \/>\nmight be reasonable. And my forecast, as imperfect<br \/>\nas it might be as an informal as it is, is that people are not going to get sick<br \/>\nand that pretty right as much or as much as or as much and that and that pretty<br \/>\nrapidly people are going to stop adhering to the<br \/>\nmeasures because they don&#8217;t see them. Is doing anything, you know.<br \/>\nSo maybe I am an optimist. I&#8217;m I&#8217;m actually pretty optimistic about stuff. And I think that it&#8217;s going to sort<br \/>\nof. Go back to normal faster then I mean, faster relative, though, because this is already<br \/>\ndragged on longer than I don&#8217;t know what&#8217;s to stop it. But<br \/>\nyeah, we&#8217;ll see how it goes in the fall. I mean, I think higher education is going to be. I mean, this is me<br \/>\njust talking about. I know, but I think one of the more affected industries<br \/>\nis going to be higher education just because there&#8217;s a lot of flexibility. And<br \/>\nthe troops were already circling on some of the traditions. So kind of interesting.<br \/>\nI don&#8217;t like that. I don&#8217;t want to talk about models a little bit more. I want to yes, though.<br \/>\nFive more minutes. Otherwise, it gets too long. Nobody watches it. So there&#8217;s a famous there&#8217;s a famous quote in our field by<br \/>\nstatistician George Foxes. All models are wrong. Some models are useful. Right.<br \/>\nAnd so it&#8217;s a it&#8217;s an interesting quote in context, what he was saying was you&#8217;re probably not modeling<br \/>\nreality perfectly, OK? And that&#8217;s OK, because you don&#8217;t want your model<br \/>\nto be exactly perfect because there&#8217;s another saying this is the map is not the lamp. If you have a map that says<br \/>\nthat&#8217;s to scale as big as Rome, you know, it doesn&#8217;t do anything right. So you want something that you can understand<br \/>\nthat that captures the sort of key features. And then he says some models are useful. So<br \/>\nin other words, you can come up with a model there&#8217;s accidentally too simple and doesn&#8217;t capture<br \/>\nthe key features that you want. So people use this a lot as a defense<br \/>\nof their favorite simple model. In particular, a lot of times mathematicians<br \/>\nand statisticians would pick a model that they know how to analyze, meaning they know how to do the math to get it<br \/>\nto work. And then when somebody challenges them and says, well, you know, that&#8217;s not actually<br \/>\naccurate, they&#8217;ll say, well, all models are wrong, some models are useful. And actually what<br \/>\nthey typically do is they kind of elide. They just stop and say, well, all models are wrong. Dot, dot, dot,<br \/>\ndot. That&#8217;s OK. So I think in this case, we had<br \/>\na lot of that going on. People, how did these epidemiologic models, these infected,<br \/>\nexpose susceptible Assad? Is that the right tactics both<br \/>\nrecovered? I recovered more removed from what they can<br \/>\ndie? Exactly. You know, I saw some people talking<br \/>\nabout these and they&#8217;re like, yeah, they&#8217;re simplified. But to do it realistically is too hard.<br \/>\nYou can&#8217;t do it. That&#8217;s just that. So so in particular, what you need to try to do is elaborate the model<br \/>\njust enough, so that captures the features that you need because you literally learned nothing from a model<br \/>\nthat is like literally what you learned about as the model. And you<br \/>\nwant to make sure that your mom is qualitatively right. And but, you know, if you have<br \/>\nif the mechanism is is that a few super spreaders do it and you&#8217;re trying to evaluate<br \/>\nthe efficacy of a lockdown, things are going to look very different than that. And that&#8217;s actually<br \/>\nthat&#8217;s the difference between economic models. And you&#8217;ve been a critic of a lot of the econ models that<br \/>\nwe&#8217;ve seen before. I actually have a lot of similarities in its composition<br \/>\nto the geneology models. But the difference between the economists and the epidemiology is that<br \/>\neconomists are very careful when thinking about the policy variables in their models and<br \/>\ntrying to figure out what were the levers, the levers that actually, you know, you&#8217;re gonna<br \/>\nbe simplifying. But let&#8217;s have the levers in the model, at least the levers that we&#8217;re trying to understand. What happens if I do this<br \/>\nor whatever I do that. That&#8217;s not in the models of epidemiology. They didn&#8217;t have any leverage. There were meaningful leverage.<br \/>\nThat&#8217;s why the only thing they had the only thing they had was<br \/>\nsocial distancing. Let&#8217;s reduce it because the blindly across the board, because they didn&#8217;t have<br \/>\nany mechanism or maybe I mean, I&#8217;m not going to let the economist the models. I&#8217;ll go and say the models<br \/>\nthat I critical parts for the dynamics of plastic generalisable models,<br \/>\nbecause they&#8217;re like they&#8217;re so complicated that they&#8217;re almost as complicated as the world.<br \/>\nAnd yet we don&#8217;t know the ways that like. And so I&#8217;m going<br \/>\nto quote somebody, but without attribution, as I said. But somebody said, you know, those models<br \/>\nshould do two things. It should make good predictions or it should be simple enough that we can understand it.<br \/>\nAnd it doesn&#8217;t make good predictions that we probably wouldn&#8217;t trust the explanations.<br \/>\nAnd if they&#8217;re so complicated, we don&#8217;t understand them. We don&#8217;t know how to use how to use it. You<br \/>\nknow, some of these models have. So you can be wrong based, but so.<br \/>\nOK. That&#8217;s maybe a good place to close it up. The models that we&#8217;ve seen in this pandemic,<br \/>\nthey seem to fail on both. I can&#8217;t go if they&#8217;re not good enough to predict and<br \/>\nthey&#8217;re too complicated for anybody to understand. Yes. On that positive note,<br \/>\nand maybe I&#8217;m trying to think, you know, what does that leave us to do? Right.<br \/>\nAnd in cases like this, this data is data. I think the data I think that<br \/>\nwhat I&#8217;ve been what I&#8217;ve been focusing a lot my efforts on and this direction has been trying to learn<br \/>\nfrom just data on coming out of things, that data that allows me<br \/>\nto then help potentially inform the overall sledgehammer decision. But like<br \/>\nmore point wise decision making. For example, the fact that kids are<br \/>\nnow we have overwhelming evidence doesn&#8217;t rely on any model. There&#8217;s overwhelming evidence that children<br \/>\nare not at risk of dying. But some will, just like some kids, die of<br \/>\nmany things. That&#8217;s tragic. Every single death of a child is tragic. I have two little kids and I can&#8217;t wait to and have<br \/>\nthem go back to school. So so the overwhelming evidence that kids<br \/>\nare not separable and there&#8217;s plenty of evidence already of the fact that they are not big contributors to the spread<br \/>\nof the epidemic. So regardless of any other thing, those two pieces of evidence that are available<br \/>\ndon&#8217;t require a model and to have a huge outsized impact on people&#8217;s. So<br \/>\nI think to me, that&#8217;s enough. And I don&#8217;t understand why no government in the West, by the way, in Europe, every single<br \/>\ncountry near the schools are open right now. Every single one. Oh, I see. Well,<br \/>\nnobody&#8217;s willing to go and say it. No, I don&#8217;t think there&#8217;s so much to talk about. So. So New York is<br \/>\nso different than Austin. Austin is different. It&#8217;s geographically, politically,<br \/>\nsocially, demographically. Right. It is crazy that<br \/>\nwe&#8217;re looking to the federal government. In some sense, or even the World Health Organization for<br \/>\nlike Blink, give guidance on how to deal with this stuff as if.<br \/>\nI mean, Tucker, that&#8217;s a one size fits all policy, which seems like a disaster. Right. Clearly, like maybe<br \/>\nNew York should shut down. Right. Here&#8217;s the. York City. Me and New York City, maybe. New<br \/>\nYork City. Full on. Shut down, as you said. House arrest. No public transportation.<br \/>\nDon&#8217;t answer the door for anyone. All right. Maybe that&#8217;s the right move there. Is that the right? Is that<br \/>\nthe same move in Arlington, Texas? Probably. Probably not.<br \/>\nYeah. So. And going back to a point of view of yours from before, right, this<br \/>\nidea of experimentation is a huge thing for us to learn about what to do in<br \/>\nthe US. One of the one of the greatest things about our system is the system sedimentation fermentation. It comes from a federal system<br \/>\nthat we have. The 50 states have autonomy to do things. I love that aspect of it. I love that Texas can do things different<br \/>\nthan New York. But we went into groupthink. Everybody did the same thing. Now, it was actually interesting because<br \/>\nnow you have their ability. So you have you know, I am not in house arrest anymore in Texas.<br \/>\nYou know, my friends in California are. Yeah. So, you know, you can see whether<br \/>\nwhether what are the dynamics for those two different policies put in place that we&#8217;re going to learn a lot of things by the fall,<br \/>\nby the end of this year, there&#8217;ll be a lot of information that will rely on complicated black box<br \/>\nmodel information that we can just look at. And and, you know, yeah, some assumptions<br \/>\nare needed always. But but we&#8217;re going to be able to get I mean, if you call if you call these models black box models, they&#8217;re not black<br \/>\nbox. Understand? And while it&#8217;s like kinda right.<br \/>\nYou don&#8217;t understand the mapping back to the root is the problem. Like that. That&#8217;s the thing. Like the model it needs to overlay<br \/>\nthe the reality. Sort of in a reasonable way, in one way, it&#8217;s another<br \/>\nway to think about implications that you&#8217;ve got the map that you don&#8217;t know which or injection, you don&#8217;t<br \/>\nknow what transmission would say. That&#8217;s right. So, yeah, maybe you understand your map, but<br \/>\nif you don&#8217;t know how to make it now. Rambling. Thanks for having me. That&#8217;s<br \/>\ngreat. Thank you for joining us. And we&#8217;ll do it again. Thanks for listening to<br \/>\nPolicy McCombs.<\/p>\n"},"episode_featured_image":false,"episode_player_image":"https:\/\/podcasts.la.utexas.edu\/cepa\/wp-content\/uploads\/sites\/21\/2021\/05\/SC_PolicyMcCombs_Art-scaled.jpg","download_link":"https:\/\/podcasts.la.utexas.edu\/cepa\/podcast-download\/550\/richard-hahn-covid-19-interview.mp3","player_link":"https:\/\/podcasts.la.utexas.edu\/cepa\/podcast-player\/550\/richard-hahn-covid-19-interview.mp3","audio_player":null,"episode_data":{"playerMode":"light","subscribeUrls":{"apple_podcasts":{"key":"apple_podcasts","url":"","label":"Apple Podcasts","class":"apple_podcasts","icon":"apple-podcasts.png"},"google_play":{"key":"google_play","url":"","label":"Google Play","class":"google_play","icon":"google-play.png"},"google_podcasts":{"key":"google_podcasts","url":"","label":"Google Podcasts","class":"google_podcasts","icon":"google-podcasts.png"},"spotify":{"key":"spotify","url":"","label":"Spotify","class":"spotify","icon":"spotify.png"},"itunes":{"key":"itunes","url":"","label":"iTunes","class":"itunes","icon":"itunes.png"}},"rssFeedUrl":"https:\/\/podcasts.la.utexas.edu\/cepa\/feed\/podcast\/policymccombs","embedCode":"<blockquote class=\"wp-embedded-content\" data-secret=\"SCtsl6V7jN\"><a href=\"https:\/\/podcasts.la.utexas.edu\/cepa\/podcast\/richard-hahn-covid-19-interview\/\">Richard Hahn \u2013 COVID-19 Interview<\/a><\/blockquote><iframe sandbox=\"allow-scripts\" security=\"restricted\" src=\"https:\/\/podcasts.la.utexas.edu\/cepa\/podcast\/richard-hahn-covid-19-interview\/embed\/#?secret=SCtsl6V7jN\" width=\"500\" height=\"350\" title=\"&#8220;Richard Hahn \u2013 COVID-19 Interview&#8221; &#8212; Policy@McCombs\" data-secret=\"SCtsl6V7jN\" frameborder=\"0\" marginwidth=\"0\" marginheight=\"0\" scrolling=\"no\" class=\"wp-embedded-content\"><\/iframe><script type=\"text\/javascript\">\n\/* <![CDATA[ *\/\n\/*! This file is auto-generated *\/\n!function(d,l){\"use strict\";l.querySelector&&d.addEventListener&&\"undefined\"!=typeof URL&&(d.wp=d.wp||{},d.wp.receiveEmbedMessage||(d.wp.receiveEmbedMessage=function(e){var t=e.data;if((t||t.secret||t.message||t.value)&&!\/[^a-zA-Z0-9]\/.test(t.secret)){for(var s,r,n,a=l.querySelectorAll('iframe[data-secret=\"'+t.secret+'\"]'),o=l.querySelectorAll('blockquote[data-secret=\"'+t.secret+'\"]'),c=new RegExp(\"^https?:$\",\"i\"),i=0;i<o.length;i++)o[i].style.display=\"none\";for(i=0;i<a.length;i++)s=a[i],e.source===s.contentWindow&&(s.removeAttribute(\"style\"),\"height\"===t.message?(1e3<(r=parseInt(t.value,10))?r=1e3:~~r<200&&(r=200),s.height=r):\"link\"===t.message&&(r=new URL(s.getAttribute(\"src\")),n=new URL(t.value),c.test(n.protocol))&&n.host===r.host&&l.activeElement===s&&(d.top.location.href=t.value))}},d.addEventListener(\"message\",d.wp.receiveEmbedMessage,!1),l.addEventListener(\"DOMContentLoaded\",function(){for(var e,t,s=l.querySelectorAll(\"iframe.wp-embedded-content\"),r=0;r<s.length;r++)(t=(e=s[r]).getAttribute(\"data-secret\"))||(t=Math.random().toString(36).substring(2,12),e.src+=\"#?secret=\"+t,e.setAttribute(\"data-secret\",t)),e.contentWindow.postMessage({message:\"ready\",secret:t},\"*\")},!1)))}(window,document);\n\/\/# sourceURL=https:\/\/podcasts.la.utexas.edu\/cepa\/wp-includes\/js\/wp-embed.min.js\n\/* ]]> *\/\n<\/script>\n"},"_links":{"self":[{"href":"https:\/\/podcasts.la.utexas.edu\/cepa\/wp-json\/wp\/v2\/podcast\/550","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/podcasts.la.utexas.edu\/cepa\/wp-json\/wp\/v2\/podcast"}],"about":[{"href":"https:\/\/podcasts.la.utexas.edu\/cepa\/wp-json\/wp\/v2\/types\/podcast"}],"author":[{"embeddable":true,"href":"https:\/\/podcasts.la.utexas.edu\/cepa\/wp-json\/wp\/v2\/users\/13"}],"replies":[{"embeddable":true,"href":"https:\/\/podcasts.la.utexas.edu\/cepa\/wp-json\/wp\/v2\/comments?post=550"}],"wp:attachment":[{"href":"https:\/\/podcasts.la.utexas.edu\/cepa\/wp-json\/wp\/v2\/media?parent=550"}],"wp:term":[{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/podcasts.la.utexas.edu\/cepa\/wp-json\/wp\/v2\/tags?post=550"},{"taxonomy":"categories","embeddable":true,"href":"https:\/\/podcasts.la.utexas.edu\/cepa\/wp-json\/wp\/v2\/categories?post=550"},{"taxonomy":"series","embeddable":true,"href":"https:\/\/podcasts.la.utexas.edu\/cepa\/wp-json\/wp\/v2\/series?post=550"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}