EP331: Employers Buyer Beware! Six Tricks Wellness and Point-solution Vendors Use to Overstate Their Results, With Al Lewis, Cofounder and CEO of Quizzify
July 29, 2021
331
32:18

EP331: Employers Buyer Beware! Six Tricks Wellness and Point-solution Vendors Use to Overstate Their Results, With Al Lewis, Cofounder and CEO of Quizzify

My guest in this health care podcast, Al Lewis, was telling me before we hit record that employer customers are vastly worse at evaluating wellness and point-solution vendors today than they ever have been in the past. Let’s break this down.

One aspect leading up to the “worse than ever” is the proliferation of point-solutions lately and all the PE (private equity) dollars flowing into the health care space. You pick up any rock and you’ll find 25 health care startups underneath it.

A second aspect is this: and this is not going to be a newsflash for many, but employers really trust their brokers and their EBCs (employee benefit consultants) to put together a good benefit package on their behalf. If an EBC says, “buy it,” employers click their heels and buy it a lot of times.

And with that great power comes great... opportunity. We see an uptick in brokers and employee benefit consultants, enjoying themselves a little arbitrage-ish money grab by taking money from these startups/vendors under a variety of umbrellas while at the same time they call the employers their customers.

This is especially profitable and also slimy when done under the cover of darkness because, as with so many aspects of health care, these backroom deals often happen without the employer customer knowing that there’s a vig involved in the recommendation process.

Al Lewis says he works in the “Integrity Segment” of the market. He is well known for outing vendors for basically lies they tell in their marketing. The thing is though, if a vendor comes to Al and asks questions about how to do it right, Al is always happy to help. He has said that he wants people to learn and if you’re asking questions, it means you’re interested in learning.

Al has been on the show before, actually multiple times, but one full episode was episode 245, and we dig into wellness that’s done “to” employees, not “for” them in that episode. So, check that out after you listen to this one, if you want more Al. Al also founded the Validation Institute and he’s also CEO over at Quizzify.

On the show in this health care podcast, Al explains the six major logical fallacies, computational flaws, tricks, if you will, that wellness vendors or point-solution vendors may deploy to inflate their “proven cost savings.” The six “watch outs” I’d guess I say for employers are:

  1. Regression to the mean

  2. Participants vs nonparticipants or matched controls or propensity scoring

  3. The trend inflation trick

  4. Plausibility testing

  5. Actuaries and validation

  6. Overstating engagement

These six things are all of the different logical fallacies some vendors employ in order to overstate their results or outcomes.

The Validation Institute has a PDF write up of each of these flaws which you can find in the show notes.

Bottom line? Buyer Beware. And, also, get a broker or an EBC who you know for a fact they’re working for you if you’re an employer because they’ve committed in writing to not taking payola from the vendors that they’re recommending to you.

One footnote is that if you haven’t listened to episode 329 with Joe Connolly you might want to go back and do so. Joe gets into the trend of some services who could, potentially, start taking on risk. Said another way, if services like these create their own bundles of point solutions and take on the risk of offering said bundle to employers, that could be nice.

You can learn more at the Validation Institute.

You can connect with Al by emailing al@quizzify.com, visiting the website at quizzify.com, on LinkedIn, or on Twitter at @quizzify and @whynobodybeliev

Al Lewis wears multiple hats, both professionally and also to cover his bald spot.

Hat #1: Employee Health Literacy. He is the founder and “quizmeister-in-chief” of Quizzify, whose mission is to help companies teach their employees to utilize health care services appropriately, using a format best described as “Jeopardy meets Choosing Wisely meets Comedy Central.” Quizzify is the only vendor authorized to display the Harvard Medical School “Veritas” shield and has received excellent reviews from users.

Quizzify is also well known for its surprise billing “Prevent Consent” solution, which was recently featured in the New York Times. It can be taped to an insurance card, used as a stand-alone card, or downloaded into your Apple Wallet. Starting in 2022, use of this language prevents forced arbitration under the Surprise Billing Act and instead allows payment of 2x Medicare for non-elective care. 

His quiz-specific background includes authorship of the best-selling Newsweek Presents the Ultimate Trivia Game, which Games magazine lauded as having the best questions of any trivia game; hosting two quiz shows on Boston network affiliates; and appearing on Jeopardy.

Hat #2: Outcomes Measurement. As an author, his critically acclaimed category best-selling book on outcomes measurement, Why Nobody Believes the Numbers, chronicling and exposing the innumeracy of the health management field, was named digital health book of the year in Forbes. Cracking Health Costs, written in conjunction with Walmart alum Tom Emerick, was also a trade best seller.

He was the cofounder of the World Health Care Congress’s Validation Institute.

His expertise in outcomes measurement got him named one of the unsung heroes changing health care forever. 


04:49 Are brokers going to have to become more transparent about where their money is coming from?
07:33 Are carriers transparent?
08:09 What’s the goal of the Validation Institute?
08:55 “You either get a true statement put up or learn what you have to do in order to get a true statement put up.”
11:18 How is Regression to the Mean (RTM) used in a flawed way?
16:32 “If you do wellness for employees instead of to employees, the people who want the wellness will be able to access it.”
21:13 What is plausibility testing?
23:17 What about actuaries and validation?
23:40 “That’s one of the reasons the Validation Institute exists, is because actuaries are easily corrupted.”
25:18 What is a prime example of population health economics?
26:20 What does it mean to overstate engagement?
27:15 “How often did you use this and was it useful?”
28:55 “Are you validated by the Validation Institute, and if not, why not?”

healthcare,digital health,validation institute,quizzafy,healthcare vendors,
|

Episode Support Provided By

Special Thanks to Our 2026 Sustaining Monthly Donors

Kimberly CarlesonDylan YahnBenjamin LightMatt McQuideAnn KempskiSpencer AllenScott TromanhauserMarilyn BartlettSteven ElkinsMatthew Bunte.

Recent Episodes

EP505: The Death of the "What Is Value" Guessing Game for Clinical and Plan Decision-Makers Ready to Move On, With Ahilan Sivaganesan, MD
Relentless Health ValueApril 02, 2026
505
44:0240.31 MB

EP505: The Death of the "What Is Value" Guessing Game for Clinical and Plan Decision-Makers Ready to Move On, With Ahilan Sivaganesan, MD

Listen On Your Favorite App Hello, Relentless Tribe. Thank you so much for showing up today. All right … to start, let me lay out the goal of the episode today. This episode is for you if you are a self-funded employer looking to ensure your members are steered and tiered to real high-value care and...

EP504: A Back-to-Basics Roadmap Through the Perverse Incentives to Advanced Primary Care, With Ryan Jacobs
Relentless Health ValueMarch 26, 2026
504
33:3630.76 MB

EP504: A Back-to-Basics Roadmap Through the Perverse Incentives to Advanced Primary Care, With Ryan Jacobs

Listen On Your Favorite App It's been a while since we started from the beginning, so let's just take stock of the basics in this show, refresh ourselves if you're a longtime listener, or welcome if you're new around here. Today we are digging on and about what I would call the poster child for prov...

INBW46: Relentless Tribe Goings-On With Insights to Outwit the Hot Mess of the Non-Healthcare Market
Relentless Health ValueMarch 19, 202619:3717.96 MB

INBW46: Relentless Tribe Goings-On With Insights to Outwit the Hot Mess of the Non-Healthcare Market

Listen On Your Favorite App This inbetweenisode I wanna try something new for two reasons. One of them is that I need to check this episode off my to-do list because I am crushed for time. I'm going to be headed to Arizona tomorrow for the Collective Health Conference , which will have occurred thre...

EP503: Let's Go From Lazy PPO Networks to Smart Collaboration With Direct-to-Employer Specialty Care, With Ryan Wells; Leo Spector, MD, MBA; and Adam Stavisky
Relentless Health ValueMarch 12, 2026
503
46:1642.35 MB

EP503: Let's Go From Lazy PPO Networks to Smart Collaboration With Direct-to-Employer Specialty Care, With Ryan Wells; Leo Spector, MD, MBA; and Adam Stavisky

Listen On Your Favorite App Today we are digging into something I've said probably way too often: Collaboration is the next breakthrough innovation. And I'm doubling down on this because in the current healthcare landscape, two parties that actually should be talking—like burning up the phone wires ...

EP502: How Some Pretty Wild Medicare Fraud Sabotages ACOs and Also Independent Practices and Could Cost Plan Sponsors Such as Self-insured Employers a Lot of Zeros Downstream, With Brian Machut
Relentless Health ValueMarch 05, 2026
502
38:5835.67 MB

EP502: How Some Pretty Wild Medicare Fraud Sabotages ACOs and Also Independent Practices and Could Cost Plan Sponsors Such as Self-insured Employers a Lot of Zeros Downstream, With Brian Machut

You know, I always kind of wondered what the hackers were doing with all of the medical data that they've managed to get their mitts on over the past, I don't know, however many years. Now, I know at least one thing. If you're a hacker, you can use your stolen medical data to not actually send wildl...

EP501: Speaking of Infusions, Do You Want to Pay $135 or Do You Want to Pay $13,560 for the Exact Same Drug? With Ivana Krajcinovic, PhD
Relentless Health ValueFebruary 26, 2026
501
39:5736.57 MB

EP501: Speaking of Infusions, Do You Want to Pay $135 or Do You Want to Pay $13,560 for the Exact Same Drug? With Ivana Krajcinovic, PhD

Let us chat about today the inches all around us and also about how there is no market in healthcare all at once in this show. Today I am talking with Ivana Krajcinovic. And let me give you some examples of the inches. Two members of a plan get infusions at a hospital. And if these two members had g...

Take Two: EP398: Why Are Commercial Carrier Marketplaces Completely Boring? Maybe Because There Isn't a Marketplace, With Jacob Asher, MD
Relentless Health ValueFebruary 19, 202634:5231.91 MB

Take Two: EP398: Why Are Commercial Carrier Marketplaces Completely Boring? Maybe Because There Isn't a Marketplace, With Jacob Asher, MD

We have been doing a little series called "The Inches Are All Around Us," digging out waste in the $5.6 trillion healthcare sector where half an inch of waste can equal billions of dollars. I'm going to right now introduce another series that is complementary but has a slightly different focus. And ...

Listen and Follow

Sponsored by Aventria Health Group
©2026 BD Bridges LLC. All Rights Reserved.