Formerly /u/Zalack on Reddit.e

Also Zalack@kbin.social

  • 0 Posts
  • 19 Comments
Joined 11 months ago
cake
Cake day: August 3rd, 2023

help-circle






  • Sorry you’re right that I wasn’t being precise with my terminology. It’s not a DDOS but it could be used to slow down targeted features, take up some HTTP connections, inflate the target’s DB, and waste CPU cycles, so it shares some characteristics of one.

    In general, you want to be very very careful of implementing features that allow untrusted parties to supply potentially unbounded resources to your server.

    And yeah, it would be trivial to write a set of scripts that pretend to be a lemmy instance and supply an endless number of fake communities to the target server. The nice thing about this attack vector is that it’s also not bound by the normal rate limiting since it’s the target server making the requests. There are definitely a bunch of ways lemmy could mitigate such an attack, but the current approach of “list communities current users are subscribed to” seems like a decent first approach.





  • While that’s true, we have to allow for the fact that our own intelligence, at some point, is an encoded model of the world around us. Probably not through something as rigid as precise statistics, but our consciousness is somehow an emergent phenomenon of the chemical reactions in our brains that on their own have no real understanding of the world either.

    I do have to wonder if at some point, consciousness will spontaneously emerge as we make these models bigger and more complex and – maybe more importantly – start layering specialized models on top of each other that handle specific tasks then hand the result back to another model, creating feedback loops. I’m imagining a nueral network that is trained on something extremely abstract like figuring out, from the raw input data, what specialist model would be best suited to process that data, then based on the result, what model would be best suited to refine that data. Something we train to basically be an executive function with a bunch of sub models available to it.

    Could something like that become conscious without realizing it’s “communicating” with us? The program executing the LLM might reflexively process data without any concept that it’s text, but still be emergently complex enough when reflecting its own processes to the point of self awareness. It wouldn’t realize the data represents a link to other conscious beings.

    As a metaphor, you could teach a very smart dog how to respond to certain, basic arithmetic problems. They would get stuff wrong the moment you prompted them to do something out of their training, and they wouldn’t understand they were doing math even when they got it “right”, but they would still be sentient, if not sapient, despite that.

    It’s the opposite side of the philosophical zombie. A philosophical zombie behaves exactly as a human would, but is a surface-level automaton with no inner life.

    But I propose that we also consider the inverse-philosophical zombie, an entity that behaves like an automation, but has an inner life that has not recognized its input data for evidence of an external world outside it’s own bounds. Something that might not even recognize it’s executing a program the same way we aren’t consciously aware of the chemical reactions our brain is executing to make us think.

    I don’t believe current LLMs are anywhere near complex enough to give rise to that sort of thing, but they are also still pretty early in their development and haven’t started to be heavily layered and interconnected the way I think they’ll end up.

    At the very least it makes for a fun Sci-fi premise.





  • I agree with the other poster that you need to define what you even mean when you say free will. IMO, strict determinism is not incompatible with free will. It only provides the mechanism. I posted this in another thread where this came up:

    The implications of quantum mechanics just reframes what it means to not have free will.

    In classical physics, given the exact same setup you make the exact same choice every time.

    In Quantum mechanics, given the same exact setup, you make the same choice some percentage of the time.

    One is you being an automaton while the other is you being a flipped coin. Neither of those really feel like free will.

    Except.

    We are looking at this through an implied assumption that the brain is some mechanism, separate from “us”, which we are forced to think “through”. That the mechanisms of the brain are somehow distorting or restricting what the underlying self can do.

    But there is no deeper “self”. We are the brain. We are the chemical cascade bouncing around through the neurons. We are the kinetic billiard balls of classical physics and the probability curves of quantum mechanics. It doesn’t matter if the universe is deterministic and we would always have the same response to the same input or if it’s statistical and we just have a baked “likelihood” of that response.

    The way we respond or the biases that inform that likelihood is still us making a choice, because we are that underlying mechanism. Whether it’s deterministic or not it’s just an implementation detail of free will, not a counterargument.