• BillyTheKid2@lemmy.ca
    link
    fedilink
    English
    arrow-up
    4
    ·
    4 days ago

    Yeah, that’s fair. If you have one problem and solve it with regex, now you have two problems.

    Though in this case the monthly inference budget ran out causing a system outage. I was on call, so, getting a page off hours makes me dislike the llm approach even more haha

    • frongt@lemmy.zip
      link
      fedilink
      English
      arrow-up
      2
      arrow-down
      2
      ·
      3 days ago

      If being out of tokens causes an outage, you have architectural problems

      • BillyTheKid2@lemmy.ca
        link
        fedilink
        English
        arrow-up
        3
        arrow-down
        1
        ·
        3 days ago

        On the contrary. If you architect to not fail when missing context critical to customer experience your architecture is irrelevant because you’re losing customers. The issue was the Layer8 decision to use inference when regex it’s a better fit.

        But lol imagine making deep assumptions when you don’t even know what the product is.

        Fail fast. Fail loud.