This is one of the first predictions in Scott Alexander et al's AI 2027. I wrote about this in my AGI Friday newsletter.

For the purposes of this market, this resolves according to whether I personally find such agents worth using and paying for on at least a weekly basis.

Ask clarifying questions (and suggest things I should be using such agents for)!

So far, my experiments with OpenAI's Operator have not exactly been a success.