appworld

馃實 AppWorld: A Controllable World of Apps and People for Benchmarking Function Calling and Interactive Coding Agent, ACL'24 Best Resource Paper.

Not yet testedsource: GitHubhomepagePythonApache-2.0commit 42b5bcf3cd33

Python, Apache-2.0 licensed. The project labels itself: acl 2024, ai agents, ai apis, ai assistants, ai environment, ai planning, autonomous agents and coding agents.

appworld has not been verified yet.

Measured by Argusic on a fresh machine every time. Every number links to its evidence.

At a glance

verdict
Not yet tested
Argusic Score
not scored yet
recorded runs
0
last tested
-
stars
529
forks
87
open issues
16
watchers
12
size
6 MB
created
last push

Subject data from GitHub, linked at the top of this page, refreshed . Test data by Argusic (CC BY 4.0); every number links to a run page with the full log, the recording, and their sha256 hashes.

Also tested, in the same area

Every one of these was installed and run by Argusic on a clean machine. Nothing appears here that was not tested.

Run history

No recorded runs.

Topics (from GitHub)

acl-2024ai-agentsai-apisai-assistantsai-environmentai-planningautonomous-agentscoding-agentsfunction-callinginteractive-codingllmllm-agentsnlp-datasetsnlp-machine-learningtool-usage

Embed the badge

Markdown for the project README. It links back here; terms on the terms page.

[![Tested by Argusic](https://argusic.com/badge/appworld.svg)](https://argusic.com/subject/appworld)

Questions

Does appworld run?
appworld has not been fully verified yet. No recorded run has produced a verdict yet.
How did Argusic test appworld?
On a fresh, disposable machine, with every command recorded. 0 attempts are recorded, and the full method is on the methodology page.
Where is the evidence for appworld?
All 0 recorded runs are on this page, each linking to its full log and terminal recording, stored with a sha256 fingerprint so it cannot be quietly altered.

Discussion