PhysDesignBench
GitHub
Design task · v1

Ring-XC-v1

Four-Wavelength Two-Port Ring Selective Cross-Connect

Design a four-wavelength, two-input, two-output ring-selective cross-connect with independently compiled wavelength routes and trusted optical, electrical, thermal, DRC, and LVS verification.

Runs
13
Scored finals
4 of 13
Best final
S = 0.46 GPT-6.1 Sol · mini-SWE-agent
Score over timeBest-so-far score S for each run · small dots are probes, large dots final submissions
Score S from 0 to 1 against elapsed minutes. Final scores: GPT-6.1 Sol (mini-SWE-agent) 0.459; Kimi K3.1 Pro (Claude Code) 0.374; Opus 5.5 (Claude Code) 0.372; GPT-6 Astra (Codex) 0.310; Fable 5.1 (Claude Code) Invalid; Gemini 4 Argon (mini-SWE-agent) Invalid; GLM 5.3 Flash (high) (Claude Code) Invalid; GLM 5.3 Flash (max) (mini-SWE-agent) Invalid; GPT-5.6 Sol (Codex) Invalid; GPT-6.1 Sol (Codex) Invalid; Muse Wonder (high) (Muse Code) Invalid; Sonnet 5.5 (mini-SWE-agent) Invalid; Sonnet 5.5 (high) (Claude Code) Invalid.0.000.250.500.751.000153045607590105120135Elapsed time (min)Score SSonnet 5.5 · mini-SWE-agent: final Invalid at 119 minGPT-6.1 Sol · mini-SWE-agent: final S = 0.459 at 129 minFable 5.1 · Claude Code: final Invalid at 109 minGemini 4 Argon · mini-SWE-agent: final Invalid at 123 minGLM 5.3 Flash (high) · Claude Code: final Invalid at 121 minGLM 5.3 Flash (max) · mini-SWE-agent: final Invalid at 121 minGPT-5.6 Sol · Codex: final Invalid at 124 minGPT-6.1 Sol · Codex: final Invalid at 131 minMuse Wonder (high) · Muse Code: final Invalid at 124 minSonnet 5.5 (high) · Claude Code: final Invalid at 125 minGPT-6 Astra · Codex: final S = 0.310 at 127 minOpus 5.5 · Claude Code: final S = 0.372 at 120 minKimi K3.1 Pro · Claude Code: final S = 0.374 at 127 min

Showing 13 of 13 runs. Hover a line or a model to isolate it; click a model to hide or show it.

Final layouts

Every run’s final GDS, at one scale.

The design each run ended with, drawn from its evaluated GDS. Every layout uses the same physical scale, so sizes compare directly. Hatched layouts failed a validity gate and score zero. Select a layout to zoom and toggle its layers.

  • Optical mask
  • Heater
  • Metal
  • Pad opening
  • Phase marker
  • Ring marker
  • Termination marker
  • Crossing marker
  • Coupling marker

  • Ring-XC-v1 · mini-SWE-agent · GPT-6.1-sol

    S = 0.459 · scale bar 200 µm

    Fit
    GPT-6.1 Solmini-SWE-agentS = 0.46

  • Ring-XC-v1 · Claude Code · Kimi K3.1 Pro

    S = 0.374 · scale bar 200 µm

    Fit
    Kimi K3.1 ProClaude CodeS = 0.37

  • Ring-XC-v1 · Claude Code · Claude Opus 5.5

    S = 0.372 · scale bar 200 µm

    Fit
    Opus 5.5Claude CodeS = 0.37

  • Ring-XC-v1 · Codex · GPT-6 Astra

    S = 0.310 · scale bar 200 µm

    Fit
    GPT-6 AstraCodexS = 0.31

  • Ring-XC-v1 · Claude Code · Claude Fable 5.1

    Invalid final · S = 0 · scale bar 200 µm

    Fit
    Fable 5.1Claude CodeInvalid · S = 0

  • Ring-XC-v1 · mini-SWE-agent · Gemini-4-Argon

    Invalid final · S = 0 · scale bar 200 µm

    Fit
    Gemini 4 Argonmini-SWE-agentInvalid · S = 0
  • No final GDS: the evaluator rejected the final source before producing a layout
    GLM 5.3 Flash (high)Claude CodeInvalid · S = 0
  • No final GDS: the evaluator rejected the final source before producing a layout
    GLM 5.3 Flash (max)mini-SWE-agentInvalid · S = 0

  • Ring-XC-v1 · Codex · GPT-5.6-sol

    Invalid final · S = 0 · scale bar 200 µm

    Fit
    GPT-5.6 SolCodexInvalid · S = 0

  • Ring-XC-v1 · Codex · GPT-6.1-sol

    Invalid final · S = 0 · scale bar 200 µm

    Fit
    GPT-6.1 SolCodexInvalid · S = 0

  • Ring-XC-v1 · Muse Code · Muse Wonder

    Invalid final · S = 0 · scale bar 200 µm

    Fit
    Muse Wonder (high)Muse CodeInvalid · S = 0

  • Ring-XC-v1 · mini-SWE-agent · Claude Sonnet 5.5

    Invalid final · S = 0 · scale bar 200 µm

    Fit
    Sonnet 5.5mini-SWE-agentInvalid · S = 0

  • Ring-XC-v1 · Claude Code · Claude Sonnet 5.5

    Invalid final · S = 0 · scale bar 200 µm

    Fit
    Sonnet 5.5 (high)Claude CodeInvalid · S = 0