Search Ideas

What Does “Battle Tested” Mean?

One of @edwin-de-wit’s ideas recently got the blue label that says “battle tested” – well done, Edwin! – so he asked me what it means.

It means that the idea has at least three criticisms, all of which have been addressed.

The label is awarded automatically. It’s a tentative indicator of quality. Battle-tested ideas generally contain more knowledge than non-battle-tested ones.

When there are two conflicting ideas, each with no pending criticisms, go with the (more) battle-tested one. This methodology maps onto Popper’s notion of a critical preference.

The label is not an indicator of an idea’s future success, nor should it be considered a justification of an idea.

You can see all battle-tested ideas currently on Veritula on this page. Those are all the best, most knowledge-dense ideas on this site.

How Does Veritula Work?

Veritula (Latin for ‘a bit of truth’) provides an objective, partly automated way to tentatively determine whether a given idea is problematic.

It follows Karl Popper’s epistemology, which says that ideas are assumed true until refuted. This approach leaves us free to make bold conjectures and use the full arsenal at our disposal to criticize these conjectures in order to correct errors and seek truth. It’s a creative and critical approach.

Veritula is a programmatic implementation of Popper’s epistemology.

Consider an idea I:

1

              I

Since it has no criticisms, I is considered unproblematic. It is rational to adopt it, tentatively consider it unproblematic, and act in accordance with it. Conversely, it would generally be irrational to reject it, consider it problematic, or act counter to it.

Next, someone submits a criticism C1:

1
2
3

              I
              |
              C1

The idea I is now considered problematic so long as criticism C1 is not addressed. How do you address it? You can revise I so that C1 doesn’t apply anymore, which restores the previous state with just the standalone I (now called I2 to indicate the revision):

1
2
3
4

                   Revise
              I ------------> I2
              |
              C1

To track changes, Veritula offers beautiful diffing and version control for ideas.

If you cannot think of a way to revise I, you can counter-criticize C1, thereby neutralizing it:

1
2
3
4
5

              I
              |
              C1
              |
              C2

Now, I is considered unproblematic again, since C1 is problematic and thus can’t be a decisive criticism anymore.

If you can think of neither a revision of I nor counter-criticism to C1, your only option is to accept that I has been (tentatively) defeated. You should therefore abandon it, which means: stop acting in accordance with it, considering it to be unproblematic, etc.

Since there can be many criticisms (which are also just ideas) and deeply nested counter-criticisms, the result is a tree structure. For example, as a discussion progresses, one of its trees might look like this:

1
2
3
4
5
6
7

              I
           /  |  \
         C11 C12 C13
         / \       \
       C21 C22     C23
                   / \
                 C31 C32

In this tree, I is considered problematic. Although C11 has been neutralized by C21 and C22, C12 still needs to be addressed. In addition, C23 would have neutralized C13, but C31 and C32 make C23 problematic, so C13 makes I problematic as well.

But you don’t need to keep track of these relationships manually. Veritula marks ideas accordingly, automatically.

Because decision-making is a special case of, ie follows the same logic as, truth-seeking, such trees can be used for decision-making, too. When you’re planning your next move but can’t decide on a city, say, Veritula helps you criticize your ideas and make a decision. Again, it’s rational to act in accordance with ideas that have no outstanding criticisms.

All ideas, including criticisms, should be formulated as concisely as possible, and separate ideas should be submitted separately, even if they’re related. Otherwise, you run the risk of receiving ‘bulk’ criticisms, where a single criticism seems to apply to more content than it actually does.

Again, criticisms are also just ideas, so the same is true for criticisms. Submitting each criticism separately has the benefit of requiring the proponent of an idea to address each criticism individually, not in bulk. If he fails to address even a single criticism, the idea remains problematic and should be rejected.

The more you discuss a given topic, the deeper and wider the tree grows. Some criticisms can apply to multiple ideas in the tree, but that needs to be made explicit by submitting them repeatedly.

Ideas that are neither criticisms nor top-level conjectures – eg follow-up questions or neutral comments – are considered ancillary ideas. Unlike criticisms, they do not invert their respective parents’ statuses. They are neutral.

One of the main benefits of Veritula is that the status of any idea in a discussion can be seen at a glance. If you are new to a much-discussed topic, the rational course of action is to adopt the displayed status of the ideas involved: if they are marked problematic, reject them; if they are not, adopt them.

Therefore, Veritula acts as a dictionary for ideas.

One of the problems of our age is that the same discussions are had over and over again, sometimes by the same people. Part of the reason is widespread irrationality, expressed in the unwillingness to change one’s mind; another is that it’s simply difficult to remember or know what’s true and what isn’t. Discussion trees can get complex, so people shouldn’t blindly trust their judgment of whether some idea is true or problematic, whether nested criticisms have been neutralized or not. Going off of memory is too error prone.

Veritula solves this problem: it makes discussion trees explicit so you don’t have to remember each idea and its relation to other ideas. Veritula therefore also enables you to hold irrational people accountable: if an idea has outstanding criticisms, the rational approach is to either abandon it or to save it by revising it or addressing all outstanding criticisms.

Many people don’t like to concede an argument. But with Veritula, no concessions are necessary. The site just shows you who’s right.

Using Veritula, we may discover a bit of truth.

How Does Veritula Work?

Veritula (Latin for ‘a bit of truth’) provides an objective, partly automated way to tentatively determine whether a given idea is problematic.

It follows Karl Popper’s epistemology, which says that ideas are assumed true until refuted. This approach leaves us free to make bold conjectures and use the full arsenal at our disposal to criticize these conjectures in order to correct errors and seek truth. It’s a creative and critical approach.

Veritula is a programmatic implementation of Popper’s epistemology.

Consider an idea I:

1

              I

Since it has no criticisms, I is considered unproblematic. It is rational to adopt it, tentatively consider it unproblematic, and act in accordance with it. Conversely, it would generally be irrational to reject it, consider it problematic, or act counter to it.

Next, someone submits a criticism C1:

1
2
3

              I
              |
              C1

The idea I is now considered problematic so long as criticism C1 is not addressed. How do you address it? You can revise I so that C1 doesn’t apply anymore, which restores the previous state with just the standalone I (now called I2 to indicate the revision):

1
2
3
4

                   Revise
              I ------------> I2
              |
              C1

To track changes, Veritula offers beautiful diffing and version control for ideas.

If you cannot think of a way to revise I, you can counter-criticize C1, thereby neutralizing it:

1
2
3
4
5

              I
              |
              C1
              |
              C2

Now, I is considered unproblematic again, since C1 is problematic and thus can’t be a decisive criticism anymore.

If you can think of neither a revision of I nor counter-criticism to C1, your only option is to accept that I has been (tentatively) defeated. You should therefore abandon it, which means: stop acting in accordance with it, considering it to be unproblematic, etc.

Since there can be many criticisms (which are also just ideas) and deeply nested counter-criticisms, the result is a tree structure. For example, as a discussion progresses, one of its tree might look like this:

1
2
3
4
5
6
7

              I
           /  |  \
         C11 C12 C13
         / \       \
       C21 C22     C23
                   / \
                 C31 C32

In this tree, I is considered problematic. Although C11 has been neutralized by C21 and C22, C12 still needs to be addressed. In addition, C23 would have neutralized C13, but C31 and C32 make C23 problematic, so C13 makes I problematic as well.

But you don’t need to keep track of these relationships manually. Veritula marks ideas accordingly, automatically.

Because decision-making is a special case of, ie follows the same logic as, truth-seeking, such trees can be used for decision-making, too. When you’re planning your next move but can’t decide on a city, say, Veritula helps you criticize your ideas and make a decision. Again, it’s rational to act in accordance with ideas that have no outstanding criticisms.

All ideas, including criticisms, should be formulated as concisely as possible, and separate ideas should be submitted separately, even if they’re related. Otherwise, you run the risk of receiving ‘bulk’ criticisms, where a single criticism seems to apply to more content than it actually does.

Again, criticisms are also just ideas, so the same is true for criticisms. Submitting each criticism separately has the benefit of requiring the proponent of an idea to address each criticism individually, not in bulk. If he fails to address even a single criticism, the idea remains problematic and should be rejected.

The more you discuss a given topic, the deeper and wider the tree grows. Some criticisms can apply to multiple ideas in the tree, but that needs to be made explicit by submitting them repeatedly.

Ideas that are neither criticisms nor top-level conjectures – eg follow-up questions or neutral comments – are considered ancillary ideas. Unlike criticisms, they do not invert their respective parents’ statuses. They are neutral.

One of the main benefits of Veritula is that the status of any idea in a discussion can be seen at a glance. If you are new to a much-discussed topic, the rational course of action is to adopt the displayed status of the ideas involved: if they are marked problematic, reject them; if they are not, adopt them.

Therefore, Veritula acts as a dictionary for ideas.

One of the problems of our age is that the same discussions are had over and over again, sometimes by the same people. Part of the reason is widespread irrationality, expressed in the unwillingness to change one’s mind; another is that it’s simply difficult to remember or know what’s true and what isn’t. Discussion trees can get complex, so people shouldn’t blindly trust their judgment of whether some idea is true or problematic, whether nested criticisms have been neutralized or not. Going off of memory is too error prone.

Veritula solves this problem: it makes discussion trees explicit so you don’t have to remember each idea and its relation to other ideas. Veritula therefore also enables you to hold irrational people accountable: if an idea has outstanding criticisms, the rational approach is to either abandon it or to save it by revising it or addressing all outstanding criticisms.

Many people don’t like to concede an argument. But with Veritula, no concessions are necessary. The site just shows you who’s right.

Using Veritula, we may discover a bit of truth.

The idea is considered false until all criticism is resolved.

It’s not necessarily considered false. It depends on the criticism.

A criticism pointing out a typo doesn’t necessarily make an idea false.
A criticism pointing out that an idea is arbitrary doesn’t necessarily make it false. For example, if an idea says ‘the laws of physics did it’ in response to a physics problem, that idea will be criticized as arbitrary even though it’s true.

Refutations mean an idea is false. A refutation explains why an idea must be false/cannot be true. Not all criticisms are refutations.

I suggest you revise #1935 to say that ideas with outstanding criticisms are considered problematic.

Fair enough. I’ve marked your idea as a criticism since I was wrong when I wrote “I don’t think you made this change on purpose. I’m guessing it was an error.”

I started with looking it up, whether to include the ‘s’ in ‘criticism’ to find that it didn’t matter much.

Can you give an example of a flawed idea you think is true and want to act on?

PS: You forgot to @mention me. Again, if you want me to get notified, check the section that says ‘Replying to’ above the textarea when you write the comment. If it doesn’t list me, @mention me.

Done as of ea37007.

I tried removing hover effects on links in dev and the user experience suffered as a result.

Especially for smaller links, like the hash links in idea headers, it’s nice getting that visual feedback that you are in fact hovering over the link and your click won’t miss it.

Reverted as of f8ed700.

cc @edwin-de-wit re ‘strong’ vs ‘weak’ criticism

The idea is considered false until all criticism is resolved. Since the goal is to live a rational life, we wouldn't act in accordance with that idea.

To someone unfamiliar with Veritula, this may sound like you’re suggesting not to live according to an idea even after all its criticisms have been resolved.

I recommend changing it to ‘we wouldn't act in accordance with an idea that has outstanding criticisms.’

We accept that idea as true until it receives criticism.

‘until it is criticized’ would be more idiomatic, I think.

Edwin says to be consistent. Either have hover effects for all clickable items or none of them.

I could remove hover effects from links. macOS links in System Settings don’t have a hover effect either. (They don’t even have a pointer cursor but IMO that’s going too far.)

Having implemented this, a problem has surfaced: when linking to an old version of an idea, the alert “You’re about to comment on an old version of this idea. Are you sure …” shows. That’s jarring if you didn’t want to comment but merely look at the idea.

Great, looks like you learned something new. You’ve found a bit of truth :)

As of acb14e3, the revision button is an icon button that lives next to the collapse icon button.

Therefore, the button doesn’t need to be hidden anymore.

Done as of acb14e3.

The idea is not good if it has outstanding criticisms.

Don’t worry about which ideas are better than others. That’s a remnant of justificationism. Only go by whether an idea has outstanding criticisms.

You’ve since made the change to “a few changes” (as of #1894) but I think that change was premature.

Don’t make changes you don’t understand. Take questions literally and answer them.

https://www.britannica.com/dictionary/eb/qa/The-Difference-Between-Few-and-A-Few-

No.

I went over it first and made a few changes. After that, Grammarly recommended that I remove the 'a' before 'criticism' and to remove the 'they are'.

This comment doesn’t belong here. It should have been a comment on #1885. And you shouldn’t have removed #1885. I’ll recover it.

It could go both ways. Someone may have already read an idea and just wants to revise it, in which case having to scroll to the bottom is cumbersome.

Then the autofocus on the textarea would force a scroll basically to the bottom of the page. For sufficiently long ideas, that means scrolling past content the user wants to see.