Doing the Lord’s work in the Devil’s basement

  • 0 Posts
  • 67 Comments
Joined 4 months ago
cake
Cake day: May 8th, 2024

help-circle







  • What is complicated about alchemy is that it’s a tradition that is thousands of years old and it has so many layers it’s hard to make sense of.

    Originally you have metallic alchemy, a precursor to chemistry and metallurgy. An insanely valuable corpus of knowledge if you think about ancient times - good metallurgy made good armies which made empires. It was technology so advanced it might as well have been magic. The literature that has survived is very opaque by design, and hard to read because of cultural jetlag, but they are technical texts - tutorials and explainers for the various chemical and alloying operations that were known at the time.

    utility outside of use as a metaphor : 10/10 if you’re kind of done with Bronze and want to boost your kingdom into the Iron Age

    Then around the Renaissance, when antique stuff started becoming hot again, those texts started buzzing and they were re-interpreted with a generous flavouring of Renaissance spirituality. That’s pretty easy with antique technical texts because they are always written with a lot of religious and astrological terminology. It could be about plumbing and you’d still have Apollo fighting Hades as an allegory of you unclogging a pipe or whatever. So, to a modern mind it made sense to see them as spiritual guidebooks through the transformation and purification of the self. That’s also when they started pumping the gas on the “philosophical stone” ideas of turning mercury into gold, becoming immortal etc… The technical aspects of the texts started fading in the background.

    utility outside of use as a metaphor : 0/10 although you’ll get some beautiful, evocative literature out of it. Some seriously trippy stuff if you’re into that sort of things.

    Then you have the 19th century onwards where it’s a literal explosion of books and treatises and translations, and it gets even more divorced from the source material, as the academic work gets shoddier and shoddier. At this point the technical aspects are mostly lost on the readers because they make no sense in the context of early-industrial metallurgy and chemistry.

    utility outside of use as a metaphor : 0/10, kind of new-agey to my taste. It has a lot of cultural relevance, though. Being well-read in early modern hermeticism is kind of the Rosetta stone of popular culture lol.










  • Then these models are stupid

    Yup that is kind of the point. They are math functions designed to approximate human tasks.

    These models should start out with basics of language, so they don’t have to learn it from the ground up. That’s the next step. Right now they’re just well read idiots.

    I’m not sure what you’re pointing at here. How they do it right now, simplified, is you have a small model designed to cut text into tokens (“knowledge of syllables”), which are fed into a larger model which turns tokens into semantic information (“knowledge of language”), which is fed to a ridiculously fat model which “accomplishes the task” (“knowledge of things”).

    The first two models are small enough that they can be trained on the kind of data you describe, classic books, movie scripts etc… A couple hundred billion words maybe. But the last one requires orders of magnitude more data, in the trillions.