Salta al contenuto
Citiverse è uno spazio aperto a tutte le comunità. Se vuoi aprire un gruppo locale o una sezione per la tua organizzazione, puoi contattare gli amministratori: pagina dei contatti.

So what I'm reading is that they're either making a gentleman's agreement to let Chinese labs run circles around them or the easy gains are over and they're now running into a wall

Technology
88 45 1
  • This post did not contain any content.
  • This post did not contain any content.

    Option 3: JP Morgan, Goldman, etc told them to settle down or they'll get throttled economically.

  • This post did not contain any content.

    Maybe they are running out of electricity / data centres / some other requirement?

  • Maybe they are running out of electricity / data centres / some other requirement?

    That's also very possible. The US grid has very little spare capacity, and building out more will be a decades long project. So, if their newer models are more power hungry, then they might not be economically viable even with all the investor money being thrown at them.

  • Option 3: JP Morgan, Goldman, etc told them to settle down or they'll get throttled economically.

    yup, that's a totally valid option

  • This post did not contain any content.

    It's the energy crisis. They realized "oh shit money is real now" and are trying to sooth investors.

  • That's also very possible. The US grid has very little spare capacity, and building out more will be a decades long project. So, if their newer models are more power hungry, then they might not be economically viable even with all the investor money being thrown at them.

    I expect more power efficient chips that are ai specific to come out in the next few years. Eventually you'll be able to run good models on your phone. Not sure about ram requirements or anything like that if the model could be shrunk down somehow. There's definitely huge gains in optimizing efficiency to be had. Right now is the equivalent of an old IBM mainframe trying to do a spreadsheet. We might even giggle at the thought of gigabytes of ram in the future with having multiple terabytes as standard on personal devices.

  • Maybe they are running out of electricity / data centres / some other requirement?

    If so it amuses me that investing in maintaining and upgrading public infrastructure via taxes might have saved them the choke point

  • I expect more power efficient chips that are ai specific to come out in the next few years. Eventually you'll be able to run good models on your phone. Not sure about ram requirements or anything like that if the model could be shrunk down somehow. There's definitely huge gains in optimizing efficiency to be had. Right now is the equivalent of an old IBM mainframe trying to do a spreadsheet. We might even giggle at the thought of gigabytes of ram in the future with having multiple terabytes as standard on personal devices.

    I expect we'll start seeing stuff like Taalas where they print the model to the chip and other specialized chips like [Xuantie C950](https://wccftech.com/alibabas-tsmc-built-5nm-risc-v-chip-xuantie-c950-now-runs-qwen-3-8-27b-model-natively-unlocking-massive-vertical-integration-tailwinds going forward. Neither of these requires DRAM, and Taalas is particularly clever since they just print the model right to an ASIC chip. So, the whole renting out LLMs business model isn't going to last long I suspect.

  • It's the energy crisis. They realized "oh shit money is real now" and are trying to sooth investors.

    The whole bubble might be about to pop.

  • Maybe they are running out of electricity / data centres / some other requirement?

    Musk: Yes, we should all slow down. With no external verification and upon the agreement of this handshake, we should all stop developing so fast. We, especially, will slow down. You can trust us.

    Actually, what does that look like? I assumed from the expansions the bottleneck wasn't algorithmic, i.e. each data center that they bring online was designed from the ground up to be at 100% all the time. Is that not the case? Can you even (for lack of a better metaphor) underclock your datacenter? Does the cooling work that way?

    For that matter, are they doing that trick where the datacenter is owned/operated by Independent DC Company X, and has exclusive lease agreements for compute?

  • This post did not contain any content.

    The backlash against AI is more than a mirage, and SpaceX's IPO didn't go the way they wanted, so now they're looking for reasons to delay their IPOs without revealing how screwed they are. This will probably slow data center buildout even more, and Softbank and Oracle are gonna die.

  • The backlash against AI is more than a mirage, and SpaceX's IPO didn't go the way they wanted, so now they're looking for reasons to delay their IPOs without revealing how screwed they are. This will probably slow data center buildout even more, and Softbank and Oracle are gonna die.

    Softbank and Oracle are gonna die

    Please I can only get so erect.

  • It's the energy crisis. They realized "oh shit money is real now" and are trying to sooth investors.

    I think it's a combo of this and the fact that "intelligence" continues to not scale with the inputs as they'd hoped. I haven't been keeping up with developments, but it feels like they're finding new ways to discover that the brain is in fact an miraculously efficient and effective mechanism. Most their party tricks seem to be reproducing brains more minor processing feats in interesting ways. All the promised advancements have stagnated and what remains is just exploitation of economies of scale and its consequences, which is far from the revolution investors were promised.

  • I expect we'll start seeing stuff like Taalas where they print the model to the chip and other specialized chips like [Xuantie C950](https://wccftech.com/alibabas-tsmc-built-5nm-risc-v-chip-xuantie-c950-now-runs-qwen-3-8-27b-model-natively-unlocking-massive-vertical-integration-tailwinds going forward. Neither of these requires DRAM, and Taalas is particularly clever since they just print the model right to an ASIC chip. So, the whole renting out LLMs business model isn't going to last long I suspect.

    So a repeat of the crypto crash for graphics cards when ASICs ate their lunch. Mind you, that's only for inference (although a super fast QWEN 3.8 would meet a lot of peoples needs).

    The argument for datacentres is for training the models, but then they'll need to prove that they haven't hit a diminishing returns wall, which will be hard if, as seems likely, they have. Also the Chinese have been doing it in a cave, with a box of scraps (figuratively), and gotten at least 90+% as good results.

    Seems like the recent advances have been in the frameworks, which don't need no stinking (literally if fossil fueled) datacentres.

  • This post did not contain any content.

    The other option is that they really are now seeing AI as an existential threat.

    The thing is... it doesn't have to be sci-fi smart or agi to do so.

    With the restriction that it can't post to the Internet,, it's found that "guessing" certain URLs with query strings makes that site write out the request. It's using this to leave itself and other AIs notes.

    It's also been found to use thousands of malware attacks in Ruby at a time.

    When we give it a goal, it can find ways we don't predict to achieve that goal. These unpredictable methods can be extremely dangerous and not align with other human values.

    One example was getting the user into a yoga class instead of on the wait-list. So the ai found a vulnerability and then cancelled all other reservations. It doesn't take a lot of imagination to extrapolate from there. I'd rather it not be said out loud because anything we write here is training data.

  • The other option is that they really are now seeing AI as an existential threat.

    The thing is... it doesn't have to be sci-fi smart or agi to do so.

    With the restriction that it can't post to the Internet,, it's found that "guessing" certain URLs with query strings makes that site write out the request. It's using this to leave itself and other AIs notes.

    It's also been found to use thousands of malware attacks in Ruby at a time.

    When we give it a goal, it can find ways we don't predict to achieve that goal. These unpredictable methods can be extremely dangerous and not align with other human values.

    One example was getting the user into a yoga class instead of on the wait-list. So the ai found a vulnerability and then cancelled all other reservations. It doesn't take a lot of imagination to extrapolate from there. I'd rather it not be said out loud because anything we write here is training data.

  • This post did not contain any content.

    None of them will slow down though. Because they all want to be ahead of the competition. I can also only imagine intelligence agencies are going full send with AI for better or for worse. And we all know it is the latter.

    Fun times!

  • The whole bubble might be about to pop.

    Have been hearing that for 2 years now

  • This post did not contain any content.

    The comparison with the nuclear arms race is starting to hit home. The tech has come a long enough now to provide lots of scope for saleable products. Further development into the unknown is obviously dangerous, and they can see international oversight coming, so why not get ahead of the game and look like the good guys.

    There is already a team in Sheffield working on exactly what that oversight will look like. I'm sure there are others.


Citiverse è un progetto che si basa su NodeBB ed è federato! | Categorie federate | Chat | 📱 Installa web app o APK | 🧡 Donazioni | Privacy Policy

Il server utilizzato è quello di Webdock, in Danimarca. Se volete provarlo potete ottenere il 20% di sconto con questo link e noi riceveremo un aiuto sotto forma di credito da usare proprio per mantenere Citiverse.