• bizarroland@lemmy.world
    link
    fedilink
    English
    arrow-up
    13
    arrow-down
    10
    ·
    1 day ago

    LLMs are pretty good for office jobs where you have huge amounts of documents to churn through, chunking them into a RAG, and then asking the documents questions about itself that you can then verify by getting the page and line number that it pulled the reference from is super handy.

    • mushroommunk@lemmy.today
      link
      fedilink
      arrow-up
      22
      arrow-down
      3
      ·
      1 day ago

      We’ve had tools for fuzzy searching files for ages. Didn’t need to steal all human work and burn the planet to make search a tiny bit easier

      • bizarroland@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        arrow-down
        1
        ·
        7 hours ago

        You may be right, but the question was, “How do we use AI to help people?” Not, “Is AI ethical?”

        • mushroommunk@lemmy.today
          link
          fedilink
          arrow-up
          1
          ·
          7 hours ago

          But if using the AI perpetuates the worst side effects, then it’s not actually helping people in the long run, it’s making things the tiniest bit easier in the very moment at the expense of their future. Doesn’t sound helpful to me

      • xavier666@lemmy.umucat.day
        link
        fedilink
        English
        arrow-up
        7
        arrow-down
        3
        ·
        19 hours ago

        Local LLMs, or SLMs, are surprisingly efficient at document handling with vague inputs, which was a weakness of traditional search algorithms. You can use a mid tier GPU for that.

        When the bubble pops, that’s where the research community will go.