explaingit

yshmr/codex-goal-draft-policy

Analysis updated 2026-05-18

0JavaScriptAudience · developerLicense

TLDR

An installable Codex Skill that drafts a reviewable completion contract before enabling the long running /goal feature, alongside a strict, self reported evaluation harness.

Mindmap

mindmap
  root((repo))
    What it does
      Drafts completion contracts
      Reviews before goal activation
      Checks trigger accuracy
      Runs evaluation suite
    Tech stack
      JavaScript
      Node.js
      Codex
    Use cases
      Safer long running tasks
      Skill trigger testing
      Agent evaluation study
    Audience
      Developers
      Codex Skill builders

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

What do people build with it?

USE CASE 1

Draft a reviewable completion contract before letting Codex run a long, unattended /goal task.

USE CASE 2

Check whether a request should trigger goal drafting versus being handled as a normal one off task.

USE CASE 3

Run a predeclared evaluation suite to test whether a Codex Skill behaves as intended before trusting it.

USE CASE 4

Study a transparent, honestly reported example of an AI agent evaluation that includes inconclusive and rejected results.

What is it built with?

JavaScriptNode.jsCodex

How does it compare?

yshmr/codex-goal-draft-policy00kaku/gallery-slider-block0xkinno/vellum
Stars00
LanguageJavaScriptJavaScriptJavaScript
Last pushed2021-05-19
MaintenanceDormant
Setup difficultyeasyhard
Complexity2/54/5
Audiencedevelopergeneraldeveloper

Figures from each repo's GitHub metadata at analysis time.

Use freely for any purpose, including commercial use, as long as you keep the copyright notice.

In plain English

This project is an installable Skill for OpenAI's Codex, meant to be used before turning on Codex's long running /goal feature. Its job is to draft a completion contract, a written description of what counts as done, what evidence proves it, and when to stop, so a human can review it before any long running task actually starts. The Skill itself never activates a goal. It only produces a draft for a person to approve, which then gets turned into a real goal through a separate workflow. The problem the author is trying to solve is that turning a long task into a goal just by saying keep going leaves the finish line, the stopping conditions, and fair evaluation unclear, and the Skill might also fire when it should not, for example on a normal one off request instead of a real goal drafting request. So the project separates several questions: should the Skill even be used for this request, did it check the actual repository or files for evidence, did the draft honestly capture the outcome and stopping rules, and can a human then run the approved goal separately. Alongside the Skill, the repository includes a large evaluation setup: 16 test cases for whether the Skill triggers at the right times, 12 cases for draft quality, several end to end test cases, and a script that runs everything and grades it automatically where possible, with human review for cases judgment calls are needed. The README is unusually transparent about its own results. Basic checks that do not depend on an outside AI provider pass. But the comparison meant to prove the Skill actually helps, run against a baseline without it, is marked inconclusive due to test setup contamination across all attempts, and three separate remediation phases trying to fix that setup are each marked as rejected. Only one specific end to end test, run against an exact predefined goal, is reported as passing after a revision. The author is explicit that this does not prove the Skill generally works, and that further planned tests were never executed. The project is released under the MIT license and is aimed at people building or evaluating Codex Skills and agent workflows, not general end users.

Copy-paste prompts

Prompt 1
Use $goal-draft-policy to turn this long running CI improvement task into a reviewable /goal completion contract before activating it.
Prompt 2
Explain what a completion contract is and why this project separates drafting a goal from activating one.
Prompt 3
Walk me through how this project's trigger test cases decide when the Skill should or should not fire.
Prompt 4
Summarize why this project's provider comparison results were marked inconclusive instead of a clear pass or fail.
Prompt 5
Show me how to install this Skill into Codex using the skill-installer.

Frequently asked questions

What is codex-goal-draft-policy?

An installable Codex Skill that drafts a reviewable completion contract before enabling the long running /goal feature, alongside a strict, self reported evaluation harness.

What language is codex-goal-draft-policy written in?

Mainly JavaScript. The stack also includes JavaScript, Node.js, Codex.

What license does codex-goal-draft-policy use?

Use freely for any purpose, including commercial use, as long as you keep the copyright notice.

Who is codex-goal-draft-policy for?

Mainly developer.

Open on GitHub → Explain another repo

This repo across BitVibe Labs

Verify against the repo before relying on details.