10 Comments
Jun 22, 2022Liked by polimath

There are only a few possible explanations as to how such a glaring error could have made it into such an important paper.

(1) It was intentional. In my wildest suspicious moments, I can't believe this is the case. But the reason is not that I don't believe those that brought the paper are too honorable to lie, but that the would-be lie was so poorly hidden.

(2) It was the result of sloppy science due to the people performing the research having an idea of what the outcome should be prior to beginning the research.

I think explanation 2 is likely because we have plenty of instances of this happening on the regular before COVID. Now the researchers aren't just trying to make the person paying them happy (by selectively interpreting in a convenient way), but a political stance formed around many COVID-related topics before the research began, and it became abundantly clear that there was only one correct view. If these researchers came to the "wrong" conclusion, then their livelihood could be ripped from them.

I don't know what to do to reverse these trends, but I do look forward to hearing your thoughts, as always.

Expand full comment
Jun 22, 2022Liked by polimath

I think ultimately it stems from researchers spending too much time aware of the *impact* of their work, and optimizing for that. The original erroneous comparison (total pediatric covid deaths vs. annual pediatric cause morality) *only* makes sense to ever exist for persuasive purposes. There may indeed be valid persuasive arguments one could make with it: "hey, don't dismiss the impact COVID has had on kids, the total deaths from covid are not small. They're higher than some serious conditions kill every year." But the comparison has no real analytical value. If the persuasive value is ultimately what you care about, you will tend to invert your skepticism: that which is startling and shocking data will not get the "there's no way this is right, right?" second look. In fact, nearly every professional, financial, (and social) pressure causes you to desperately want that shocking finding to stay real, to the point that digging to find if it's false gives you a sense of dread and anxiety.

Expand full comment

Jared, I believe you are being generous in ascribing the error to explanation 2 (sloppy science). To quote from the post, “[n]ot only did it count the wrong number for pediatric COVID deaths, it compared all pediatric COVID deaths in a 26-month period to annualized deaths from other causes.” This seems to be deliberate. The big mystery is why so many credentialed reviewers either ignored the error or didn't catch it.

Expand full comment

It was deliberate, because the authors explicitly said in the Methods section that they would be calculating both cumulative and annualized COVID death rates. Their explanation was that they felt that the annualized rate from March 2020 until present would be skewed by the limited amount of virus spread and massive amount of NPIs used for children during the first part of the pandemic; therefore, using the both rates would provide a lower and upper bound to the expected COVID death rate in a post-NPI, Omicron-variant world.

Now, that isn't necessarily how I would go about modeling this, but I certainly understand their argument that the annualized rate - in and of itself - is likely an under estimate of the current death rate and some alternative calculation would be useful. And they were completely up front about it, too: it was in the introduction, labeled as such in the table entries and in the footnotes. So it isn't an "error" that needed to be caught - it is a deliberate modeling choice that may be useful.

Expand full comment

I found this substack post illuminating on at least how I read most things now: https://climateer.substack.com/p/numbers . Nothing is trustworthy on its face anymore and honestly probably never was, at least down to the detail of individual numbers.

Expand full comment

Thanks for the link. Excellent post — I just subscribed.

Expand full comment
Jun 22, 2022Liked by polimath

We are in an epistemology crisis.

Expand full comment
Jun 22, 2022Liked by polimath

On the green/blue anecdote from the short: during the Civil War, an under-age volunteer would place a piece of paper with "18" written on it in in his shoe so that he could reply to a question about his age "Over 18".

Expand full comment

What's most frustrating is Katelyn Jetelina doesn't even care there was a mistake made, nor that she repeated it. I would be mortified if I had spread incorrect information to a legion of trusting followers. I would also make sure I corrected the error, admitted my mistake, and try to uncover how it could have been made.

It's completely baffling that she does none of this. Not remotely concerned she's been duped by bad data, not remotely interested in getting correct data to her followers.

It's completely antithetical to science.

Expand full comment

Unfortunately, I have lost trust with most public health experts. It seems like they just want to give themselves more power. The only ones I listen to are the ones who initially signed the Great Barrington Declaration. They said what was clear to the laymen - protect the vulnerable and don't try to stop society; it is unethical and impossible.

2 weeks after the first lockdown, my husband was lying in bed, depressed, as he saw his life's work crumbling because the lockdowns were stopping him from working. That was enough for me to realize that the lockdowns were unethical, harmful, and evil. One of the worst things one can do to an adult is take away his or her ability to earn a living and feed his or her family. We decided then that we would do whatever we could to live a normal life. My husband moved his business to a state in the USA that was not closing down his business category. We told our kids that they must go out every single day and exercise outside, even when it was illegal. (I live in Israel and he works in the USA and at certain points, it was illegal to go more than 100 meters from your home!!!) We encouraged them to meet friends.....

But, the damage that public health officials have caused is done. My husband has many sympathies for the anti vax movement because he saw how health officials pushhed a covid vaccine that had not been tested for long on people who were safe from covid. I gave birth a year ago and when it was time for routine shots, my husband asked me why I was giving them to our daughter. After all, we know doctors have lied to us about the covid vaccine. Maybe they are lying to us about these vaccines too. In the end, he agreed that there is enough data that regular vaccines are safe. But, we will never take what doctors say at face value again. We do not trust them.

Expand full comment