Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (Darkly)
  • No Skin
Collapse

Chebucto Regional Softball Club

  1. Home
  2. Uncategorized
  3. Here is a good overview on trends in datacenters.
A forum for discussing and organizing recreational softball and baseball games and leagues in the greater Halifax area.

Here is a good overview on trends in datacenters.

Scheduled Pinned Locked Moved Uncategorized
16 Posts 4 Posters 0 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • Hugo MillsD Hugo Mills

    @futurebird Unfortunately, you are also the goblin who has to mark the homework.

    myrmepropagandistF This user is from outside of this forum
    myrmepropagandistF This user is from outside of this forum
    myrmepropagandist
    wrote last edited by
    #5

    @darkling

    yeah... 😕

    1 Reply Last reply
    0
    • myrmepropagandistF myrmepropagandist

      Another overlapping perspective. There is an AI bubble. The "High Yield" video makes these data centers sound inevitable and unstoppable. But, what if all of this infrastructure isn't really producing any value? Or enough value?

      OpenAI has only a handful of customers and most of them are using it to do their homework for them. We discussed "Vibe Coding" last week and no one can agree on if it saves any time or not.

      Ed Zitro makes the case for the bubble on MR.

      🚲D This user is from outside of this forum
      🚲D This user is from outside of this forum
      🚲
      wrote last edited by
      #6

      @futurebird OpenAI only has a handful of customers? Loooots of companies building them in as a core part of their stack these days (which is itself terrifying on several levels).

      myrmepropagandistF 1 Reply Last reply
      0
      • 🚲D 🚲

        @futurebird OpenAI only has a handful of customers? Loooots of companies building them in as a core part of their stack these days (which is itself terrifying on several levels).

        myrmepropagandistF This user is from outside of this forum
        myrmepropagandistF This user is from outside of this forum
        myrmepropagandist
        wrote last edited by
        #7

        @dx

        Compared to the level of investment there just aren't as many people diving in. And some who dive in will find out it's not doing much and pull out.

        🚲D 1 Reply Last reply
        0
        • myrmepropagandistF myrmepropagandist

          @dx

          Compared to the level of investment there just aren't as many people diving in. And some who dive in will find out it's not doing much and pull out.

          🚲D This user is from outside of this forum
          🚲D This user is from outside of this forum
          🚲
          wrote last edited by
          #8

          @futurebird That’s fair. I think there is a bubble. But OpenAI calls are getting tossed into all sorts of software these days. Not to mention the large swath of startups that are basically just wrappers on top of OpenAI

          myrmepropagandistF 1 Reply Last reply
          0
          • 🚲D 🚲

            @futurebird That’s fair. I think there is a bubble. But OpenAI calls are getting tossed into all sorts of software these days. Not to mention the large swath of startups that are basically just wrappers on top of OpenAI

            myrmepropagandistF This user is from outside of this forum
            myrmepropagandistF This user is from outside of this forum
            myrmepropagandist
            wrote last edited by
            #9

            @dx

            what happens when they raise the price? are they indispensable? or all these things "chat bots" that try to talk to you while you use a website that could be easily scrapped?

            🚲D 1 Reply Last reply
            0
            • myrmepropagandistF myrmepropagandist

              @dx

              what happens when they raise the price? are they indispensable? or all these things "chat bots" that try to talk to you while you use a website that could be easily scrapped?

              🚲D This user is from outside of this forum
              🚲D This user is from outside of this forum
              🚲
              wrote last edited by
              #10

              @futurebird They’re mostly *not* chatbots. They’re mostly stuff like “look through this data and pull out these parts and format it as a json file”

              🚲D myrmepropagandistF 2 Replies Last reply
              0
              • 🚲D 🚲

                @futurebird They’re mostly *not* chatbots. They’re mostly stuff like “look through this data and pull out these parts and format it as a json file”

                🚲D This user is from outside of this forum
                🚲D This user is from outside of this forum
                🚲
                wrote last edited by
                #11

                @futurebird The expectation among c levels is that prices will fall, not rise.

                myrmepropagandistF 1 Reply Last reply
                0
                • 🚲D 🚲

                  @futurebird They’re mostly *not* chatbots. They’re mostly stuff like “look through this data and pull out these parts and format it as a json file”

                  myrmepropagandistF This user is from outside of this forum
                  myrmepropagandistF This user is from outside of this forum
                  myrmepropagandist
                  wrote last edited by
                  #12

                  @dx

                  Is that what’s making all the terrible websites that come up in search?

                  1 Reply Last reply
                  0
                  • 🚲D 🚲

                    @futurebird The expectation among c levels is that prices will fall, not rise.

                    myrmepropagandistF This user is from outside of this forum
                    myrmepropagandistF This user is from outside of this forum
                    myrmepropagandist
                    wrote last edited by
                    #13

                    @dx

                    I am but a simple school teacher, so perhaps I’m missing something these businesses-folk see that I do not— however: why do they think the price would go down? I thought this stage of the AI business model was like the early days of uber and amazon wherein they corner the market, addict the consumer and then the hammer comes down and big profits emerge (or not)

                    🚲D 1 Reply Last reply
                    0
                    • myrmepropagandistF myrmepropagandist

                      @dx

                      I am but a simple school teacher, so perhaps I’m missing something these businesses-folk see that I do not— however: why do they think the price would go down? I thought this stage of the AI business model was like the early days of uber and amazon wherein they corner the market, addict the consumer and then the hammer comes down and big profits emerge (or not)

                      🚲D This user is from outside of this forum
                      🚲D This user is from outside of this forum
                      🚲
                      wrote last edited by
                      #14

                      @futurebird Moore’s law adjacent reasons. They expect compute to become cheaper and for models to become more efficient. In the 15 years I’ve been doing this stuff, so far this has held. Models that were too big to fit on one gpu now train easily on a normal laptop that is sipping power. The LLMs of today are inconceivably large compared to models from not that many years ago.

                      toerrorT 1 Reply Last reply
                      0
                      • 🚲D 🚲

                        @futurebird Moore’s law adjacent reasons. They expect compute to become cheaper and for models to become more efficient. In the 15 years I’ve been doing this stuff, so far this has held. Models that were too big to fit on one gpu now train easily on a normal laptop that is sipping power. The LLMs of today are inconceivably large compared to models from not that many years ago.

                        toerrorT This user is from outside of this forum
                        toerrorT This user is from outside of this forum
                        toerror
                        wrote last edited by
                        #15

                        @dx @futurebird The only thing they'll be able to retain in the new data centers they are making to run this stuff is the floor space ( if the hardware becomes obsolete ) , so at the very least, most of the current investment has to be paid for in addition to the new moore's lawed hardware before they can reach profitability. Assuming that it is indeed possible to scale the processor capabilities without linearly increasing costs.

                        🚲D 1 Reply Last reply
                        0
                        • toerrorT toerror

                          @dx @futurebird The only thing they'll be able to retain in the new data centers they are making to run this stuff is the floor space ( if the hardware becomes obsolete ) , so at the very least, most of the current investment has to be paid for in addition to the new moore's lawed hardware before they can reach profitability. Assuming that it is indeed possible to scale the processor capabilities without linearly increasing costs.

                          🚲D This user is from outside of this forum
                          🚲D This user is from outside of this forum
                          🚲
                          wrote last edited by
                          #16

                          @toerror @futurebird To be clear, I do think a bubble is coming. I think the data centre investment is *insane*. But it’s important to understand these models are not merely being used for end user applications like chat and code completion. They are absolutely getting integrated into major features. It makes me skin crawl that folks wiring in a 3rd party api in some of the things I’ve seen, but it is happening. Many, many companies will have a reckoning if costs balloon or if OpenAI implodes.

                          1 Reply Last reply
                          0
                          • myrmepropagandistF myrmepropagandist shared this topic

                          Reply
                          • Reply as topic
                          Log in to reply
                          • Oldest to Newest
                          • Newest to Oldest
                          • Most Votes


                          • Login

                          • Don't have an account? Register

                          • Login or register to search.
                          Powered by NodeBB Contributors
                          • First post
                            Last post
                          0
                          • Categories
                          • Recent
                          • Tags
                          • Popular
                          • World
                          • Users
                          • Groups