• Feyd@programming.dev
    link
    fedilink
    arrow-up
    3
    arrow-down
    1
    ·
    edit-2
    13 hours ago

    It’s literally researchers doing research which the blog links to. Most of the AI booster stuff is completely unsubstantiated, and it turns out when you measure things they are often full of shit.

    • P03 Locke@lemmy.dbzer0.com
      link
      fedilink
      English
      arrow-up
      2
      arrow-down
      2
      ·
      edit-2
      9 hours ago

      Bad research is still bad. The main paper is 9 pages with wide margins, outside of references. This was a few college students publishing their CS research assignment. The “Limitations” section is rather telling:

      Another interesting avenue opened by this work is how to improve the automatic generation of useful context files.

      Okay, so they already admitted that they started with useless context files, which sabotages their own test.

      You know how you fix useless context files? You iterate until they are useful context files!

      This whole research paper is XKCD 385, except with AGENTS.md files.