• P03 Locke@lemmy.dbzer0.com
    link
    fedilink
    English
    arrow-up
    11
    arrow-down
    8
    ·
    edit-2
    16 hours ago

    This is a load of shit. AGENTS.md is just a rules file for a repo like anything else. Properly-written rules files give good direction into how to interact with a project. If you don’t think it’s being read, ask the agent, and figure out why.

    Far too many of these LLM articles are:

    1. I did the thing
    2. The thing didn’t work for me
    3. Pretend it’s a hyper-scientific experiment and write an article about it
    4. Declare X is shit because my version of X is shit, or because most people don’t know how to make X.

    You don’t do the thing and pretend the first draft is going to work perfectly. You iterate, ask the agent directly why it didn’t work or what kind of improvements could be made, and improve the process.

    Most of the time when I’m running through a repetitive process with a skill, I ask, “hey, what pitfalls did we learn from this process and how can we improve this skill?” Boom, iteration.

    Also, Pivot-to-AI is just some guy’s anti-AI blog site. He does the same shit on YouTube.

    • Feyd@programming.dev
      link
      fedilink
      arrow-up
      3
      arrow-down
      1
      ·
      edit-2
      14 hours ago

      It’s literally researchers doing research which the blog links to. Most of the AI booster stuff is completely unsubstantiated, and it turns out when you measure things they are often full of shit.

      • P03 Locke@lemmy.dbzer0.com
        link
        fedilink
        English
        arrow-up
        2
        arrow-down
        2
        ·
        edit-2
        9 hours ago

        Bad research is still bad. The main paper is 9 pages with wide margins, outside of references. This was a few college students publishing their CS research assignment. The “Limitations” section is rather telling:

        Another interesting avenue opened by this work is how to improve the automatic generation of useful context files.

        Okay, so they already admitted that they started with useless context files, which sabotages their own test.

        You know how you fix useless context files? You iterate until they are useful context files!

        This whole research paper is XKCD 385, except with AGENTS.md files.

    • eremophila@lemmy.zip
      link
      fedilink
      arrow-up
      6
      arrow-down
      6
      ·
      16 hours ago

      Ai is shit because of the people behind it, and because of the crypto bro mentality of its users.