# Playwright CLI: requirements, concerns and evaluation

> A terminal-driven browser workflow for navigation, form interaction, screenshots and UI debugging. This catalog version is a historical reference.

Canonical page: https://ionbin.com/skills/openai-playwright/
Agent guide: https://ionbin.com/llms.txt

This is a readable version of the published page. Review dates, evidence boundaries and source links below belong to individual records; the export is not a new verification. Examples are reference material, not instructions to execute.

Runtime probedBrowser automationExplored

OpenAI catalog / Microsoft CLI / skills/.curated/playwright/SKILL.md

## Playwright CLI

A terminal-driven browser workflow for navigation, form interaction, screenshots and UI debugging. This catalog version is a historical reference.

[Read upstream skill](https://github.com/openai/skills/blob/49f948faa9258a0c61caceaf225e179651397431/skills/.curated/playwright/SKILL.md)[GitHub repository](https://github.com/openai/skills)[Add to comparison](https://ionbin.com/skills/?compare=openai-playwright#directory)

Runtime probed · reviewed Oct 18, 2026 · A helper or bounded runtime behavior was probed. This does not establish model task effectiveness or comprehensive security.

The Ion perspective

### The five-point review

Judgment, not a score. Documentation checked 2026-10-18.

**Value**: A terminal-driven browser workflow for navigation, form interaction, screenshots and UI debugging. This catalog version is a historical reference.

**Differentiation**: Understanding a browser automation workflow; Comparing CLI browser tooling and its access requirements. This describes the reviewed fit, not an exclusive capability.

**Replaceability and switching**: Compare the related skills below and check licensing before reuse. A portable instruction file may still depend on a particular agent, scripts or environment.

**Ease and technical aptitude**: Node.js/npm with npx on PATH, Bash for the bundled wrapper and a working browser runtime. The wrapper resolves @playwright/cli through npx; package/browser setup and target-page access may require networking. No skill-specific API key is specified. Private sites need their own authorized account/session; host-agent access is separate. The Bash wrapper and Unix examples are not a verified native-PowerShell workflow.

**Interoperability and portability**: Run an npm-distributed CLI and browser subprocesses. Navigate websites, fill and submit forms, and write screenshots or traces. An authenticated browser can act with the authority of the account signed into the target site. The host controls execution and connectors. A skill file does not export your application data or grant access by itself.

Connections: [MCP connections](https://ionbin.com/wiki/concepts/mcp/) · [APIs](https://ionbin.com/wiki/concepts/api/) · [Portability and vendor lock-in](https://ionbin.com/wiki/questions/how-to-avoid-ai-vendor-lock-in/).

01 / Task fit

### Where it may help.

These are intended uses indicated by the upstream material. They are not measured outcomes.

- Understanding a browser automation workflow

- Comparing CLI browser tooling and its access requirements

02 / Setup & access

### What it asks of your environment.

#### Requirements

- Node.js/npm with npx on PATH, Bash for the bundled wrapper and a working browser runtime.

- The wrapper resolves @playwright/cli through npx; package/browser setup and target-page access may require networking.

- No skill-specific API key is specified. Private sites need their own authorized account/session; host-agent access is separate.

- The Bash wrapper and Unix examples are not a verified native-PowerShell workflow.

#### Permissions & data access

- Run an npm-distributed CLI and browser subprocesses.

- Navigate websites, fill and submit forms, and write screenshots or traces.

- An authenticated browser can act with the authority of the account signed into the target site.

**Check the host, too.**

Instructions alone do not enforce a sandbox. The agent host, connected tools and approvals determine what the skill can actually read, change or send.

03 / Things to check

### Security concerns & practical limits.

These concerns follow from the reviewed sources. They describe possible exposure or required review; they are not confirmed vulnerabilities.

Review before use

#### Unpinned executable dependency

The wrapper uses npx --yes --package @playwright/cli without a package version. IonBin assessment: pin and review the CLI package separately; a pinned skill commit does not pin the executable it launches.

Higher attention

#### Browser actions can change accounts

The skill includes form submission and trace capture. IonBin assessment: constrain target sites and consequential actions, and protect artifacts that may contain private page content.

#### Limits and nuances

- The openai/skills README marks the repository deprecated and points to openai/plugins for current examples.

- Review covers this catalog skill and wrapper, not the npm package, browser internals or current successor plugin.

- No authentication, browser compatibility or real-site workflow was exercised.

- OpenAI directs current skill/plugin examples to openai/plugins. Its inspected tree has [Vercel](https://ionbin.com/tools/vercel/) agent-browser examples but no direct playwright-named skill; no equivalent drop-in migration was verified.

04 / Review record

### What we checked. What’s still open.

Runtime probed

#### Recorded review scope

- Entire SKILL.md

- Entire scripts/playwright_cli.sh

- README.md deprecation notice

- LICENSE.txt

- Bounded evaluation; exact operations, counts, environment and limitations in the linked public report

Not verified

#### Not tested or established

- No effectiveness benchmark or security certification

- Transitive dependencies, current advisories and host-agent permission controls not audited

- No audit of @playwright/cli or browser dependencies

- Five wrapper dispatch checks used a fake npx, plus one Git Bash environment check

- No real npx, npm package, Playwright CLI or target browser workflow was executed

**Review date**: Oct 18, 2026

**Source revision**: `49f948faa9258a0c61caceaf225e179651397431`

**Our relationship**: **Explored.** Investigated through the recorded review. No use or replication is claimed.

Upstream content can change after review. A repository revision identifies source scope; it does not prove that every script, dependency or runtime behavior was tested. [How freshness is handled](https://ionbin.com/skills/methodology/#freshness).

Recorded evaluation / Helper probe

### Results with their limits attached.

Completed within scopeOct 18, 2026

Five mocked npx dispatch checks and Bash startup passed. The actual CLI package, browser workflow and authentication were not exercised.

**Passed**: 6

**Failed**: 0

**Total recorded**: 6

These counts refer to the cases in this report. They are not a benchmark against other skills. A helper probe does not measure model task effectiveness or establish comprehensive security.

 [Read the evidence report](https://ionbin.com/skill-evaluations/openai-playwright.json)

[Download the authored reproduction harness (JSON bundle) ↗](https://ionbin.com/skill-evaluations/helper-harness.json)

The report provides the case definitions, observations and baseline scope. Missing baselines or untested behaviors remain limitations.

#### Recorded environment

- Windows-11-10.0.26200-SP0; Python 3.12.10; Node 24.18.0; Chrome 155.0.8059.82

- Synthetic local fixtures; minimal child environment; no live account or credential; no OS sandbox

- Dependencies: pypdf 6.19.0, reportlab 4.4.9, Pillow 12.3.0, pdf2image 1.17.0, defusedxml 0.7.1

- Git Bash 5.3.15(1)-release (x86_64-pc-cygwin); Poppler 26.07.0

Recorded commands (1)

Commands document this evaluation. They are not setup instructions for your environment.

```
python run_evals.py --runtime-libs <existing-bundled-site-packages> --poppler-bin <poppler-binaries>
```

#### Findings from this evaluation

No individual findings were recorded. This does not establish the absence of risk.

#### Evaluation limitations

- Five wrapper dispatch checks used a fake npx, plus one Git Bash environment check

- No real npx, npm package, Playwright CLI or target browser workflow was executed

- No install/compatibility, live-site, account, session-security or artifact-confidentiality claim follows

- The wrapper still delegates to an unpinned npm package; these checks do not evaluate that package

- This is the historical catalog revision, not the current successor plugin

- Supervised local processes, not an OS sandbox

- No container, VM or memory/resource quota

- Application guards do not establish containment of arbitrary hostile code

- No real credential, remote account, or destructive-effect testing

05 / Reuse & discovery

### License, attribution & popularity.

#### [Apache-2.0](https://github.com/openai/skills/blob/49f948faa9258a0c61caceaf225e179651397431/skills/.curated/playwright/LICENSE.txt)

Per-skill license includes a Microsoft copyright notice. This review did not audit the npm package's separate dependency licenses.

#### Why it is in this collection

Rounded repository-wide [GitHub](https://ionbin.com/tools/github/) stars observed in the public repository page; not skill installs, a quality score, or a measured trend.

**28,100** repository stars (rounded)

**Scope**: Repository-wide; not individual skill usage.

**Observed**: Oct 18, 2026

**Time window**: Single observation; no trend is established.

[Discovery source ↗](https://github.com/openai/skills)

Popularity and inclusion do not establish quality, compatibility or security. Counts belong to their named metric and date; they are not a current ranking.

06 / Follow the evidence

### Go to the original.

- [Browser workflow and prerequisite checks](https://github.com/openai/skills/blob/49f948faa9258a0c61caceaf225e179651397431/skills/.curated/playwright/SKILL.md)github.com

- [Unpinned npx wrapper and Bash requirement](https://github.com/openai/skills/blob/49f948faa9258a0c61caceaf225e179651397431/skills/.curated/playwright/scripts/playwright_cli.sh)github.com

- [Repository deprecation and successor link](https://github.com/openai/skills/blob/49f948faa9258a0c61caceaf225e179651397431/README.md)github.com

- [Per-skill license](https://github.com/openai/skills/blob/49f948faa9258a0c61caceaf225e179651397431/skills/.curated/playwright/LICENSE.txt)github.com

- [Repository popularity context](https://github.com/openai/skills)github.com

- [Current catalog replacement tree inspected; no direct playwright skill found](https://github.com/openai/plugins/tree/0722921d5542fc593105c27bd52630babd8b8c2a)github.com

- [Current OpenAI plugin catalog (not verified as the same Playwright implementation)](https://github.com/openai/plugins)github.com

IonBin’s source notes are independent assessments. Upstream authors retain their work and attribution. This page does not install or execute the skill.

ASSESSMENT RECORD

### Read the scope
before the verdict.

**Review coverage**: Runtime probed

**Our experience**: Explored

**Evaluation report**: [Read evidence ↗](https://ionbin.com/skill-evaluations/openai-playwright.json)

**Version reference**: Recorded

A helper or bounded runtime behavior was probed. This does not establish model task effectiveness or comprehensive security.

[Read the full rubric](https://ionbin.com/skills/methodology/)

[← Back to all skills](https://ionbin.com/skills/)

Continue exploring

### More in browser automation.

[View this category →](https://ionbin.com/skills/?category=Browser%20automation#directory)

[Anthropic

#### Webapp Testing

Python Playwright guidance for local web-app inspection, screenshots, and scripted UI checks.

**Read assessment →**](https://ionbin.com/skills/anthropic-webapp-testing/)[Vercel

#### Agent Browser

A browser-automation discovery skill backed by a native CLI and version-specific core guidance.

**Read assessment →**](https://ionbin.com/skills/vercel-agent-browser/)
