Hard to Vary or Hardly Usable?

Showing only those parts of the discussion that lead to #3707 and its comments.

See full discussion·See most recent related ideas
  Log in or sign up to participate in this discussion.
With an account, you can revise, criticize, and comment on ideas.

Discussions can branch out indefinitely. Zoom out for the bird’s-eye view.
Dennis Hackethal’s avatar
4th of 4 versions leading to #3707 (4 total)

Deutsch’s stance in my own words:

The distinguishing characteristic between rationality and irrationality is that rationality is the search for good explanations. All progress comes from the search for good explanations. So the distinction between good vs bad explanations is epistemologically fundamental.

A good explanation is hard to vary “while still accounting for what it purports to account for.” (BoI chapter 1 glossary.) A bad explanation is easy to vary.

For example, the Persephone myth as an explanation of the seasons is easy to change without impacting its ability to explain the seasons. You could arbitrarily replace Persephone and other characters and the explanation would still ‘work’. The axis-tilt explanation of the earth, on the other hand, is hard to change without breaking it. You can’t just replace the axis with something else, say.

The quality of a theory is a matter of degrees. The harder it is to change a theory, the better that theory is. When deciding which explanation to adopt, we should “choose between [explanations] according to how good they are…: how hard to vary.” (BoI chapter 9; see similar remark in chapter 8.)

Criticized14*
Dennis Hackethal’s avatar

Deutsch contradicts his yardstick for understanding a computational task. He says that you haven’t understood a computational task if you can’t program it. His method of decision-making based on finding good explanations is a computational task. He can’t program it, so he hasn’t understood it.

Criticism of #3780 Battle tested
Dennis Hackethal’s avatar

Isn’t this basically asking for a specification of the creative program? Isn’t this effectively an AGI project?

Criticism of #3707Criticized1
Dennis Hackethal’s avatar
2nd of 2 versions

No, see #3706. I’m open to user input (within reason). That covers creative parts. The non-creative parts can be automated by definition.

Criticism of #3709
Dennis Hackethal’s avatar

Isn’t this asking for a formalization of creativity, which is impossible?

Criticism of #3707Criticized2
Dennis Hackethal’s avatar

No, it’s asking for a formalization of rational decision-making, which is a related but separate issue. Given a set of explanations (after they’ve already been created), what non-creative sorting algorithm do we use to find the best one?

Criticism of #3711
Dennis Hackethal’s avatar

Popper formalized much of his epistemology, such as the notions of empirical content and degrees of falsifiability. Why hold Deutsch to a different standard? Why couldn’t he formalize the steps for finding the quality of a given explanation?

Criticism of #3711
Dennis Hackethal’s avatar

Maybe Deutsch just means hard to vary as a heuristic, not as a full-fledged decision-making algorithm.

Criticism of #3707Criticized1
Dennis Hackethal’s avatar

A heuristic or heuristic technique (problem solving, mental shortcut, rule of thumb) is any approach to problem solving that employs a pragmatic method that is not fully optimized, perfected, or rationalized, but is nevertheless "good enough" as an approximation or attribute substitution.

None of this means a heuristic couldn’t be programmed. On the contrary, heuristics sound easier to program than full-fledged, ‘proper’ algorithms.

I’d be happy to see some pseudo-code that uses workarounds/heuristics. That’d be a fine starting point.

Criticism of #3749
Dennis Hackethal’s avatar

@dirk-meulenbelt suggested in a space (at 21:30) that a bunch of epistemology is underspecified. There are many epistemological concepts (like criterion of democracy, falsifiability, etc.) that we don’t know enough about to express in code.

Criticism of #3707Criticized3
Dennis Hackethal’s avatar

Yes, many ideas fail Deutsch’s yardstick. But so what? That doesn’t make things better.

Criticism of #3797
Dennis Hackethal’s avatar

Deutsch’s yardstick applies to computational tasks. It’s not meant for other things. It’s not clear to me that the criterion of democracy is a computational task.

Criticism of #3797
Bart Vanderhaegen’s avatar

Yes, the criterion for democracy is not a computational task, but an abstraction that constrains computational tasks. In the same way: the criterion for HTV is also not a computational task, it constrains the possible computational tasks that attempt to quantify HTV.

We understand computational tasks by being able to program them (as per Deutsch' criterion). But we understand criteria/ principles/ axioms/ theories ... (non computational tasks) in another way: by varying them and eliminating the variants that do not solve the problem the principle purported to solve.
For example:
a+b=b+a (in arithmetic) is a principle/ axiom that we understand by elimination of possible variants (a+b =/= a ... a+b =/=b ... etc)
but 3+5=5+3 is a specific transformation that should be understood via a computational task: adding 5 to 3 and then 3 to 5 and comparing both outcomes, via a program.

Bart Vanderhaegen’s avatar
2nd of 2 versions

So my criticism is that the HTV criterion is not a computational task (but a principle, universal statement) and Deutsch's criterion of understanding (you need a program) only applies to computational tasks.

With principle/ universal statement/ theory, I mean for example: for all masses, there is a force proportional to the inverse square of their distances/ for all integers, addition is commutative/ for all species, their evolution is governed by variation and selection, for all interpretations of moral actions, they are moral relativism when ... applies to that interpretation/ ....

  • Principles/ universal statements/ theories are not computable because they speak about sets of (possible) transformations (not 1 in particular which would be a computation) and they offer a constraining criterion to those transformations in the set.
  • Whereas a computer program is an abstraction capable of causing 1 particular transformation (between sets of inputs and sets of outputs)

There may be a way to quantify HTV, and thus deal with specific evaluations of how HTV of one theory is higher than another. That would be a computational task. But that is different from the criterion for HTV (which is by definition not computable). And having no program for that computational task does not imply that the criterion for HTV is irrelevant or not usable, or even fluff.

Compare for example to the theory of evolution: the theory of "variation and selection" is the criterion for a set of allowable transformations (of species), but not having a specific program (e.g. for how a particular species can evolve in some particular niche) does not imply that the criterion is useless or fluff.

I think the usefulness of the HTV criterion becomes clear when you link it to Constructor Theory, then one can argue that HTV criterion adds more than criticisms alone can do. But that's a whole other story we could get into.

Criticism of #3835Criticized2
Dennis Hackethal’s avatar

You criticized your own idea. Presumably that’s not what you meant to do.

Criticism of #3862
Dennis Hackethal’s avatar

HTV isn’t a principle even by your own definition. What on earth are you talking about man.

Even if HTV itself is not a computational task, the decision-making method Deutsch proposes is one, and it depends on HTV. But even if we sidestep that issue and outsource HTV completely to the user, we still run into all kinds of issues. This has all been addressed. No fancy talk about sets or constraints is going to change that.

You previously claimed you’re an engineer. I don’t think you are. You just pasted some code that was clearly written by AI and didn’t even compile, twice.

You talk about ‘sets’ and ‘constraints’ and ‘computations’ but I don’t think you understand any of them. No offense but I think those concepts are all distractions so you don’t need to actually address HTV. That’s why you need to use those big words.

Discussing with you is a waste of time. Again, no offense but I don’t think you’re qualified to weigh in on this discussion. Prove me wrong and submit working, handwritten code for HTV or Deutsch’s decision-making method. I’ll delete any further comments from you in this discussion that don’t contain working code. If you keep commenting anyway, I’ll lock your account.

Criticism of #3862Criticized0
Dennis Hackethal’s avatar

As I write in my article:

… Popper did formalize/specify much of his epistemology, such as the notions of empirical content and degrees of falsifiability. So why couldn’t Deutsch formalize the steps for finding the quality of a given explanation?

Criticism of #3797
Dennis Hackethal’s avatar

Liberty said (at 1:38:39) hard to vary isn’t a method of decision-making. It’s a factor people take into account when they make decisions, but decision-making itself is a creative process.

Criticism of #3707Criticized2
Dennis Hackethal’s avatar

I’m not saying hard to vary is a decision-making method. I’m saying it’s an integral part of Deutsch’s decision-making method. As I write in my article:

He argues that “we should choose between [explanations] according to how good they are…: how hard to vary.”

Criticism of #3808
Dennis Hackethal’s avatar

Liberty responded (1:39:46) that that quote is misleading because it makes it sound like hard to vary is the only criterion people use when making decisions, which can’t be true. There are other criteria, like “consistency with data”, “logical consistency”, “fitting in with existing theories”, etc.

Criticism of #3809Criticized2
Dennis Hackethal’s avatar

The quote may be false, but I don’t see how it’s misleading. I’m not quoting Deutsch in isolation or cherry-picking information or anything like that.

Criticism of #3811
Dennis Hackethal’s avatar
2nd of 2 versions

It does sound like Deutsch thinks all these different criteria boil down to being about hard vs easy to vary, see #3814.

Criticism of #3811
Dennis Hackethal’s avatar

I’m fine allowing user input to sidestep the creativity problem, see #3802.

Criticism of #3808