How Does Veritula Work?
Showing only those parts of the discussion which lead to #2073 and its comments.
See full discussion·See most recent related ideasLog in or sign up to participate in this discussion.
With an account, you can revise, criticize, and comment on ideas.@dennis-hackethal you have regularly pointed out to me that it’s a mistake to assign strengths or weaknesses to arguments—for example, in #1809 and #1927. I’d love to get to the bottom of that.
On one hand, I see what you mean. A criticism can either be counter-criticized or it can be an unresolved error. If it’s a bad criticism, you quickly counter it—say, by clarifying why it’s irrelevant—and move on.
I also see why talking about a “gradient” or comparative strength between arguments is problematic: there’s no objective criterion to measure them against. We can only say one theory is better than another when both attempt to explain the same phenomenon—then we can evaluate them using properties such as hard-to-varyness and other criteria Deutsch describes. (We can get into that if you’d like, though I don’t think that’s our main disagreement.). But this comparison doesn’t apply when we’re dealing with very different criticisms of a single idea, because there’s no common standard to measure them against. Comparing their “strength” becomes arbitrary.
However, I still think there are good and bad criticisms, just as there are good and bad explanations (following Deutsch’s distinction: for instance, bad explanations are easy to vary or point to authorities to justify themselves rather than offering a hard-to-vary account of how and why something works). While I could simply counter-criticize bad criticisms and move on, there’s also the matter of efficiency and opportunity cost: I don’t want to waste time repeatedly countering poor criticisms, or worse, get stuck in circular debates with people who don’t recognize that some arguments aren’t good criticisms at all. I’d rather focus my attention on good criticisms.
To clarify what I mean, here’s an excerpt from my book:
The most important principle to remember while criticizing is: Criticize, don’t defend or attack. Good explanations invite criticism of their intrinsic content—whether the explanation itself works, solves the problem, and avoids worse side effects. Bad explanations, by contrast, deflect criticism onto irrelevant, extrinsic properties such as authority or track record—e.g., “this is the method that successful company X uses,” “I believe strongly in this approach,” or “it’s coming from person Y, so it’s worthless.”
That kind of “criticism” isn’t real criticism at all. It’s just attacking or defending. And when we play that game, the explanation itself stays untouched and stagnant. The idea doesn’t get scrutinized or improved—it only gets shielded or dismissed for irrelevant reasons.
That being said, I agree with the points you brought up in #2061, namely that there can be no positive arguments for an idea. By extension, if Veritula would require a specific format or mode of criticism, we’d fall into the very error Popper warns about with the Myth of the Framework—the mistaken belief that criticism requires a shared framework or language. So, Veritula should functionally remain as it is. At most, you might consider adding guidelines on what constitutes good versus poor criticism, so that critics can improve their skills. But I agree: the person who created the idea should remain solely responsible for addressing the criticisms they receive, not dismissing them as “bad” and moving on.
Tagging @bart-vanderhaegen because he and I have discussed this at length—in fact, I got the defending/attacking framing from him.
There’s another issue with disregarding ‘small’/‘weak’ criticisms: some criticisms may look small at first, but as you investigate, you realize they’re actually a big deal.
I realized this the other day on the topic of macOS UI bugs during a Twitter space. Somebody said that many of the issues I had pointed out with the new Tahoe OS were just minor UI glitches (in other words: ‘weak criticisms’). But then somebody else pointed out that those are still worrisome because severe security holes, like being able to bypass authentication, have presented as minor UI glitches in the past!
I agree with the premise that small does not mean insignificant. My current view is that the only meaningful dichotomy is good vs. bad. I may have used labels like weaker or stronger, smaller or bigger, minor or major in the past, but I now see that was a mistake—they have no place when judging a criticism. So in this case, I don’t think the criticism applies because we’re not in disagreement.
Well, you start #2074 by referencing the “mistake to assign strengths or weaknesses to arguments”, and calling a criticism small is a common way to call it weak. They’re often used as synonyms in this context.
I see where the confusion comes from, but I thought clarifying my current view in #2073 already addressed the criticism. What else would you suggest I do?
Fair enough – I wanted to point out a related problem since people often use terms like ‘weak’ or ‘small’ to dismiss criticisms illegitimately. But you didn’t do that.
You don’t need to do anything else to resolve this particular criticism. I’ll change #2070 to a non-criticism.
My current view is that the only meaningful dichotomy is good vs. bad.
You say yourself in #2071 that one should “always avoid positive arguments.” Calling a theory “good” would be a positive argument.
As I say in #2065, Popperian epistemology has no room for ‘good’ or any other justification. I’m not aware that anyone has successfully proposed a way to measure the ‘hard-to-varyiness’ of theories anyway. We can criticize theories for being arbitrary (which is another word for ‘easy to vary’). That’d be fine. But Popper wouldn’t give them points for not being arbitrary. And arbitrariness isn’t the only type of criticism a theory might receive anyway.
If we follow Popper and get rid of justification, we can’t use ‘good vs bad’ because we can’t use ‘good’. The only dichotomy left standing is ‘has some bad’ vs ‘has no bad’. Another word for ‘pointing out some bad’ is ‘criticism’. So this dichotomy can be rephrased as: ‘has pending criticisms’ vs ‘has no pending criticisms’, or ‘has reasons to be rejected’ vs ‘has no reasons to be rejected’. Note that there’s a difference: if you think some idea is bad, you submit a criticism. If you think it’s good, you can still submit a criticism because it might not yet be as good as you want it to be. So regardless of how good a theory might be, it can still have pending criticisms, and thus reasons to reject it. Think of Newtonian physics, which (I’m told) is a superb theory, but it’s false and (as I understand it) has plenty of pending criticisms.
‘Has pending criticisms’ vs ‘has no pending criticisms’ is directly comparable whereas ‘good’ and ‘bad’ aren’t directly comparable. And ‘has n pending criticisms’ vs ‘has m’ or ‘has 0 pending criticisms’ are even numerically comparable.
Veritula does not implement Deutsch’s epistemology. It implements Popper’s. I don’t think they’re compatible.
(As an aside, I’m not sure how I could implement Deutsch’s epistemology even if I wanted to. Would I give each idea a slider where people can say how ‘good’ the idea is? What values would I give the slider? Would the worst value be -1,000 and the best +1,000? How would users know to assign 500 vs 550? Would a ‘weak’ criticism get a score of 500 and a ‘strong’ one 1,000? What if tomorrow somebody finds an even ‘stronger’ one, does that mean I’d need to extend the slider beyond 1,000? And so on.)
In the future, be sure to make clarifications as part of a revision and then uncheck the criticism you think the revision addresses. This is to avoid breaking criticism chains.
(You don’t need to make any further revisions in this specific case, though.)