io.github.Noshadi-sec/irp

What it mainly works on, as our AI model read its tool descriptions: files and code on the machine it runs on.

10 of 17 tools are described as changing something (creating, editing, deleting, sending or running). For 1 the reading was uncertain, so no mark is shown.

• fetch_papercreates or changes datadescribed as changing data

  “Create the study directory and fetch the paper into it: arXiv LaTeX source first (exact equations), the PDF as fallback and for page images.”

  Publisher declares: read-only no · destructive no · idempotent no · open-world yes

  5 inputs, 2 required

  • studystringrequired“Absolute path of the study directory.”
  • paperstringrequired“arXiv ID or URL (e.g.”
  • preferstring“Read LaTeX source when it exists (exact equations), else the PDF.”
  • parserstring“PDF text parser when no LaTeX is used.”
  • with_pdfboolean“Also download the PDF so get_page_image can show figures, tables and equations.”
• get_sectionon 13 other serversreads or searches

  “Read part of the paper with its original file and line numbers: a section, a table, figure, equation or algorithm, a LaTeX label, the abstract, a PDF page, a line range, or 'index' for the full outli…”

  Publisher declares: read-only yes · destructive no · idempotent yes · open-world no

  4 inputs, 2 required

  • studystringrequired“Absolute path of the study directory.”
  • idstringrequired“What to read: a section id ('sec:3', 'sec:3.2'), an item id ('tab:2', 'fig:1', 'eq:4', 'alg:1'), a LaTeX label ('eq:loss'), a section title, 'abstract', 'index…”
  • offsetinteger“Skip this many lines of the selection (paging).”
  • max_linesinteger“Return at most this many lines.”
• get_page_imageon 2 other serversreads or searches

  “Render one page of the paper PDF as a PNG image, for equations, figures and tables that text extraction loses.”

  Publisher declares: read-only yes · destructive no · idempotent yes · open-world no

  3 inputs, 2 required

  • studystringrequired“Absolute path of the study directory.”
  • pageintegerrequired“1-based page number of the paper PDF.”
  • dpiinteger“Rendering resolution; raise it for small math.”
• add_claimon 1 other servercreates or changes datadescribed as changing data

  “Record one number the paper claims, before writing any code (rule 5): the metric, the value as printed, where it appears and the success bar.”

  Publisher declares: read-only no · destructive no · idempotent no · open-world no

  16 inputs, 5 required

  • studystringrequired“Absolute path of the study directory.”
  • statementstringrequired“Short name of the claim, e.g.”
  • metricstringrequired“Metric name, e.g.”
  • valuestringrequired“The paper's number exactly as printed, e.g.”
  • wherestringrequired“Where the claim appears, as a reader would say it: 'Table 2, row 3', 'Figure 4', 'Section 5.2'.”
  • where_kindstring“Kind of place the claim appears.”
  • source_filestring or null“Paper file of the printed value, as get_section shows it (e.g.”
  • source_lineinteger or null“Line of the printed value in source_file.”
  • pageinteger or null“PDF page where the claim appears, if known.”
  • comparatorstring“'approx' for 'about this value', 'at_least' for lower bounds such as speed-ups, 'at_most' for upper bounds such as error rates.”
  • tolerance_relnumber or null“Reproduced if within this fraction of the paper's value (0.01 = 1%).”
  • tolerance_absnumber or null“Reproduced if within this absolute difference.”
  • close_relnumber or null“Close if within this fraction.”
  • close_absnumber or null“Close if within this absolute difference.”
  • seeds_in_paperinteger or null“Runs or seeds the paper averaged over, if stated.”
  • notesstring or null“Anything a reader should know about this claim.”
• list_claimson 14 other serversreads or searches

  “List every recorded claim with its success bar and current verdict.”

  Publisher declares: read-only yes · destructive no · idempotent yes · open-world no

  1 input, 1 required

  • studystringrequired“Absolute path of the study directory.”
• add_guesscreates or changes datadescribed as changing data

  “Record a detail the paper left out, the choice made and why (rule 2: never change the method to make a run succeed; record a guess instead).”

  Publisher declares: read-only no · destructive no · idempotent no · open-world no

  6 inputs, 4 required

  • studystringrequired“Absolute path of the study directory.”
  • missingstringrequired“The detail the paper left out, e.g.”
  • choicestringrequired“What was chosen, e.g.”
  • whystringrequired“Why, e.g.”
  • sourcestring or null“Where the choice comes from: a citation, a URL or 'common default'.”
  • claimsarray“Claim ids this guess can affect.”
• map_methodcreates or changes datadescribed as changing data

  “Link an equation or algorithm step in the paper to the file and line in code/ that implements it.”

  Publisher declares: read-only no · destructive no · idempotent no · open-world no

  7 inputs, 4 required

  • studystringrequired“Absolute path of the study directory.”
  • paper_elementstringrequired“The paper element, e.g.”
  • paper_refstring or null“Index id or LaTeX label of that element, e.g.”
  • code_filestringrequired“File inside the study's code/ directory, e.g.”
  • code_lineintegerrequired“First line that implements the element.”
  • end_lineinteger or null“Last line, when the implementation spans several.”
  • notestring or null“Why this line implements the element, if not obvious.”
• create_envon 1 other serverdescribed as changing data

  “Build a pinned environment for the study's code: a uv virtual environment (fast, not a sandbox) or a Docker image (isolated).”

  Publisher declares: read-only no · destructive no · idempotent no · open-world yes

  9 inputs, 1 required

  • studystringrequired“Absolute path of the study directory.”
  • namestring“Environment name; never reused.”
  • backendstring“'uv' builds a virtual environment (not a sandbox); 'docker' builds an image runs are isolated in.”
  • pythonstring“Python version, e.g.”
  • requirementsstring or null“Requirements file inside code/.”
  • packagesarray“Extra packages, e.g.”
  • base_imagestring or null“Docker base image; default python:<python>-slim.”
  • system_packagesarray“Debian packages for the Docker image.”
  • gpuboolean“Docker runs request all GPUs (--gpus all).”
• runon 45 other serversruns code or commandsdescribed as changing data

  “Run one command in code/ with the named environment.”

  Publisher declares: read-only no · destructive no · idempotent no · open-world yes

  12 inputs, 2 required

  • studystringrequired“Absolute path of the study directory.”
  • commandstringrequired“Shell command to run inside the environment, e.g.”
  • envstring or null“Environment from create_env; null uses the host environment (no lock file).”
  • scopestring“'full' is the faithful configuration and is the only scope that can count; 'shortened' (fewer steps or data) and 'smoke' never count.”
  • seedinteger or null“Seed, passed as IRP_SEED and PYTHONHASHSEED and recorded.”
  • cwdstring“Working directory inside code/.”
  • timeout_sinteger“Stop the run after this many seconds.”
  • waitboolean“Wait for the run to finish.”
  • networkboolean“Docker only: allow network access during the run.”
  • memory_limitstring or null“Docker only: memory cap such as '8g'.”
  • commitboolean“Commit code/ to git before the run so the report names the exact code.”
  • notestring or null“What this run is for, shown in the report.”
• run_statuson 3 other serversreads or searches

  “Report a run's status, exit code and the last lines of its output; optionally wait for it to finish.”

  Publisher declares: read-only yes · destructive no · idempotent yes · open-world no

  4 inputs, 2 required

  • studystringrequired“Absolute path of the study directory.”
  • run_idstringrequired“Run id, e.g.”
  • wait_sinteger“Wait up to this many seconds for the run to finish.”
  • tail_linesinteger“Lines of stdout and stderr to return.”
• run_remotedescribed as changing data

  “Run one command on a paid GPU provider (Modal today; RunPod and Hugging Face Jobs planned).”

  Publisher declares: read-only no · destructive no · idempotent no · open-world yes

  13 inputs, 4 required

  • studystringrequired“Absolute path of the study directory.”
  • commandstringrequired“Shell command to run in the remote sandbox.”
  • envstring“Environment whose requirements and Python version the sandbox uses.”
  • providerstring“Compute provider.”
  • gpustringrequired“GPU type, e.g.”
  • gpu_countinteger“Number of GPUs; multiplies the estimate.”
  • hoursnumberrequired“Time limit in hours; also the basis of the cost estimate.”
  • approvedboolean“Set true only after showing the person the cost estimate and receiving their approval.”
  • scopestring“'full' is the only scope that can count; see run.”
  • seedinteger or null“Seed, passed as IRP_SEED and recorded.”
  • outputsarray“Files under code/ to copy back after the run.”
  • waitboolean“Wait for completion; remote runs usually outlast tool timeouts.”
  • notestring or null“What this run is for, shown in the report.”
• extract_metricsreads or searches

  “Pull numbers from a completed run's stdout, stderr or the files it wrote, by key, regex, JSON pointer or CSV column.”

  Publisher declares: read-only no · destructive no · idempotent no · open-world no

  3 inputs, 3 required

  • studystringrequired“Absolute path of the study directory.”
  • run_idstringrequired“Completed run to read, e.g.”
  • specsarrayrequired“One spec per number to extract.”

Each quoted sentence is the first sentence of the publisher’s own description. The kind of tool and the “changes data” mark are our AI model’s reading of that description, not something we tested: two differently worded runs had to agree, otherwise no label is shown, and nobody has checked them by hand. A tool without the “changes data” mark is described as only reading, searching or calculating, or the two runs did not agree. No tool was called. Read the publisher’s full description before relying on it. “Publisher declares” lists the hints the server itself sends with the tool (MCP annotations: read-only, destructive, idempotent, open-world); they are the publisher's claims, not checked by us. Inputs are the parameters in the tool's own input schema: name, declared type, whether it is required, and the first sentence of its description. Read 2026-10-23.

The registry verifies a package once, when it is published, and does not re-check it. A difference below is about the listing, not a judgement of the publisher.