• frongt@lemmy.zip
    link
    fedilink
    English
    arrow-up
    2
    arrow-down
    2
    ·
    3 days ago

    If being out of tokens causes an outage, you have architectural problems

    • BillyTheKid2@lemmy.ca
      link
      fedilink
      English
      arrow-up
      3
      arrow-down
      1
      ·
      2 days ago

      On the contrary. If you architect to not fail when missing context critical to customer experience your architecture is irrelevant because you’re losing customers. The issue was the Layer8 decision to use inference when regex it’s a better fit.

      But lol imagine making deep assumptions when you don’t even know what the product is.

      Fail fast. Fail loud.