Leaderboard github.com
MarkMcCaskey/factorioctl
CLI to control Factorio + tools for Claude code to play Factorio
unreviewed-ai-risk
AI provenance
100%
explicit
- Confidence
- 89%
- Coverage
- 100%
Estimated share of AI-generated code. Explicit attribution is a lower bound.
Code quality
48/100
poor
- Confidence
- 90%
- Coverage
- 100%
Complexity, duplication, lint density, tests, CI, docs and review process.
Security
78/100
adequate
- Confidence
- 85%
- Coverage
- 100%
Secrets, static analysis, vulnerable dependencies, CI and supply-chain posture.
AI provenance
100% explicit
Explicit AI attribution on 100% of first-party code added; an estimated 100% including velocity signals.
How the score is built
- Explicitly attributed share100%
- Unattributed share in AI-pace bursts0%
- Estimated AI-generated share100%
- AI tool configuration files2
- Work sessions at AI pace5
- Releases at AI pacenot measured
- Coding-style index (1.0+ means possible)0.14
Attributed AI tools
| Tool | Commits | Lines added | First seen | Last seen |
|---|---|---|---|---|
| Claude Code | 69 | 19,931 | 2026-01-24 | 2026-01-26 |
Lines added per month all AI-attributed share
- 2026-0119,931 · 100% AI
Findings in AI-attributed lines vs the rest
From git blame: 17,555 lines trace to AI-attributed commits, 0 to others. Too few lines in one group for a fair comparison. Reported, not scored.
| Findings per 1,000 lines | AI-attributed | Other | Ratio |
|---|---|---|---|
| Code quality | 0.00 | — | — |
| Security | 0.06 | — | — |
Evidence by analyzer
Explicit AI attributionok26 items
- Claude Code: 69 attributed commits, 19,931 lines added
- Claude Code: trailer 'Co-Authored-By: Claude'
- Claude Code: trailer 'Co-Authored-By: Claude'
- Claude Code: trailer 'Co-Authored-By: Claude'
- Claude Code: trailer 'Co-Authored-By: Claude'
- Claude Code: trailer 'Co-Authored-By: Claude'
- Claude Code: trailer 'Co-Authored-By: Claude'
- Claude Code: trailer 'Co-Authored-By: Claude'
- Claude Code: trailer 'Co-Authored-By: Claude'
- Claude Code: trailer 'Co-Authored-By: Claude'
- Claude Code: trailer 'Co-Authored-By: Claude'
- Claude Code: trailer 'Co-Authored-By: Claude'
- Claude Code: trailer 'Co-Authored-By: Claude'
- Claude Code: trailer 'Co-Authored-By: Claude'
- Claude Code: trailer 'Co-Authored-By: Claude'
- Claude Code: trailer 'Co-Authored-By: Claude'
- Claude Code: trailer 'Co-Authored-By: Claude'
- Claude Code: trailer 'Co-Authored-By: Claude'
- Claude Code: trailer 'Co-Authored-By: Claude'
- Claude Code: trailer 'Co-Authored-By: Claude'
- Claude Code: trailer 'Co-Authored-By: Claude'
- Claude Code: trailer 'Co-Authored-By: Claude'
- Claude Code: trailer 'Co-Authored-By: Claude'
- Claude Code: trailer 'Co-Authored-By: Claude'
- Claude Code: trailer 'Co-Authored-By: Claude'
- Claude Code: trailer 'Co-Authored-By: Claude'
- attributed_commit_share
- 93.2%
- attributed_commits
- 69
- attributed_loc
- 19,931
- attributed_loc_share
- 100.0%
- commits
- 74
- effective_loc
- 19,931
- tools_detected
- 1
AI tool configurationok2 items
- artifacts
- 2
- earliest_adoption
- 2026-01-24
- tools_configured
- 1
- workflow_agents
- 0
Commit velocityok5 items
- 1,763 lines of first-party code in ~0.8h (2,187 lines/hour, 1 commit session)
- 3,192 lines of first-party code in ~2.1h (1,520 lines/hour, 8 commit session)
- 4,097 lines of first-party code in ~3.5h (1,181 lines/hour, 9 commit session)
- 4,180 lines of first-party code in ~5.3h (793 lines/hour, 9 commit session)
- 2,414 lines of first-party code in ~3.7h (652 lines/hour, 11 commit session)
- excluded_import_loc
- 0
- flagged_loc
- 15,646
- flagged_loc_share
- 78.5%
- flagged_units
- 5
- max_loc_per_hour
- 2,187.04
- measured_loc
- 19,931
- median_loc_per_hour
- 759.81
- pr_timed_units
- 0
- pre_ai_era_burst_loc
- 0
- pre_ai_era_bursts
- 0
- pre_ai_era_measured_loc
- 0
- work_units
- 9
Release velocityskipped
Coding styleok1 item
- count:assistant_voice
- 1
- count:emoji_in_code
- 1
- count:narrated_steps
- 0
- count:placeholder
- 0
- files:assistant_voice
- 1
- files:emoji_in_code
- 1
- files:narrated_steps
- 0
- files:placeholder
- 0
- index
- 0.14
- lines_scanned
- 17,555
- per_kloc:assistant_voice
- 0.06
- per_kloc:emoji_in_code
- 0.06
- per_kloc:narrated_steps
- 0
- per_kloc:placeholder
- 0
Findings in AI-written linesok
- ai_lines
- 17,555
- blame_failures
- 0
- files_blamed
- 61
- other_lines
- 0
- quality:ai_findings
- 0
- quality:ai_per_kloc
- 0
- quality:other_findings
- 0
- security:ai_findings
- 1
- security:ai_per_kloc
- 0.06
- security:other_findings
- 0
Code quality
48 poor
Code quality is poor: test-to-source ratio 0.05, no CI test run detected; 29% of function code in complex or long functions; 10% duplicated lines. Weakest area: testing.
How the score is built
- Complexity42
- Duplication54
- Lint and smells100
- Tests and CI23
- Documentation40
- Type safety40
- Review processnot measured
Evidence by analyzer
Complexity (lizard)ok10 items
- execute in src/cli/get.rs: complexity 55, 120 lines
- execute in src/cli/blueprint.rs: complexity 49, 113 lines
- render_ascii_map in src/cli/map.rs: complexity 38, 121 lines
- entity_char in src/cli/map.rs: complexity 38, 84 lines
- entity_size in src/world/mod.rs: complexity 33, 26 lines
- route_belt in src/bin/mcp.rs: complexity 32, 152 lines
- transform_direction in src/cli/clipboard.rs: complexity 31, 49 lines
- walk_to in src/client/mod.rs: complexity 30, 94 lines
- execute_paste in src/cli/clipboard.rs: complexity 27, 101 lines
- main in src/main.rs: complexity 27, 36 lines
- complex_functions
- 22
- function_nloc
- 11,405
- functions
- 529
- long_functions
- 20
- many_param_functions
- 0
- mean_ccn
- 3.93
- p90_ccn
- 9
- risky_nloc_share
- 29.0%
Duplication (jscpd)ok10 items
- 6+ duplicated lines: src/analyze/belt_gaps.rs:64 and src/analyze/belt_graph.rs:142
- 6+ duplicated lines: src/analyze/belt_gaps.rs:74 and src/analyze/inserter.rs:92
- 6+ duplicated lines: src/analyze/belt_graph.rs:152 and src/analyze/belt_network.rs:87
- 6+ duplicated lines: src/analyze/entity_reach.rs:18 and src/analyze/entity_reach.rs:43
- 6+ duplicated lines: src/bin/mcp.rs:77 and src/bin/mcp.rs:91
- 6+ duplicated lines: src/bin/mcp.rs:931 and src/cli/map.rs:98
- 6+ duplicated lines: src/bin/mcp.rs:1806 and src/cli/say.rs:74
- 6+ duplicated lines: src/cli/analyze.rs:69 and src/cli/analyze.rs:85
- 6+ duplicated lines: src/cli/belt.rs:34 and src/cli/belt.rs:57
- 6+ duplicated lines: src/cli/blueprint.rs:28 and src/cli/blueprint.rs:46
- compared_lines
- 12,364
- duplicated_lines
- 1,277
- duplicated_share
- 10.3%
- files
- 61
Lintok
- findings
- 0
- scanned_lines
- 17,555
- weighted_findings
- 0
Tests and CIok
- check:ci_present
- no
- check:ci_runs_lint
- no
- check:ci_runs_tests
- no
- check:has_tests
- yes
- check:test_ratio
- no
- check:tests_cochange
- no
- ci_files
- 0
- cochange_commits
- 57
- cochange_share
- 1.8%
- source_lines
- 17,555
- test_lines
- 846
- test_ratio
- 0.05
Documentationok1 item
- README.md
README.md
- check:changelog
- no
- check:contributing
- no
- check:license
- no
- check:readme
- yes
- readme_lines
- 145
Type safetyok
- check:low_escape_density
- yes
- check:strict_config
- no
- escapes
- 0
- escapes_per_kloc
- 0
Security
78 adequate
Security posture is adequate: 11 known vulnerabilities in 6 dependencies; 1 high-severity SAST findings. Weakest area: posture.
How the score is built
- Secrets100
- Static analysis (SAST)98
- Vulnerable dependencies68
- CI workflowsnot measured
- Security posture0
- OpenSSF Scorecardnot measured
Evidence by analyzer
OpenSSF Scorecardskipped
no published OpenSSF Scorecard result for this repo
Package registriesok
- checked
- 13
- declared
- 13
- lookup_errors
- 0
- missing
- 0
- recent
- 0
Secrets (gitleaks)ok
- secrets_current
- 0
- secrets_history
- 0
- secrets_low_confidence
- 0
- secrets_nonprod
- 0
Static analysis (opengrep)ok
- findings
- 1
- findings_high
- 1
- findings_low
- 0
- findings_medium
- 0
- parse_errors
- 0
- scanned_lines
- 17,555
- weighted_findings
- 0.75
Dependencies (osv-scanner)ok
- penalty
- 23
- vulnerabilities
- 11
- vulnerable_packages
- 6
- vulns_critical
- 0
- vulns_high
- 3
- vulns_low
- 0
- vulns_medium
- 4
- vulns_unknown
- 4
CI workflows (zizmor)skipped
Security postureok
- check:dependency_updates
- no
- check:lockfiles
- yes
- check:security_policy
- no
- check:signed_commits
- no
- signed_commit_share
- 0.0%
- unpinned_manifests
- 0
Release downloadsok
- binary_assets
- 0
- signals
- 0
- suspicious
- 0
Findings
4 high8 medium
12 findings
| Severity | Rule | Location | Message | Tool |
|---|---|---|---|---|
| high | osv/GHSA-33f5-2c5q-wgwj |
Cargo.lock | [email protected] (crates.io) is affected by GHSA-33f5-2c5q-wgwj | Dependencies (osv-scanner) |
| high | osv/GHSA-89vp-x53w-74fx |
Cargo.lock | [email protected] (crates.io) is affected by RUSTSEC-2026-0189, GHSA-89vp-x53w-74fx | Dependencies (osv-scanner) |
| high | osv/GHSA-9pj6-vhgr-3mwh |
Cargo.lock | [email protected] (crates.io) is affected by GHSA-9pj6-vhgr-3mwh | Dependencies (osv-scanner) |
| high | opengrep/python.lang.security.audit.dangerous-subprocess-use-audit |
scripts/create_map.py:79 | Detected subprocess function 'run' without a static string. If this data can be controlled by a malicious actor, it may be an instance of command injection. Audit the use of this call to ensure it is not controllable by an external... | Static analysis (opengrep) |
| medium | osv/GHSA-434x-w66g-qw3r |
Cargo.lock | [email protected] (crates.io) is affected by RUSTSEC-2026-0007, GHSA-434x-w66g-qw3r | Dependencies (osv-scanner) |
| medium | osv/GHSA-9g45-5xwm-f3wc |
Cargo.lock | [email protected] (crates.io) is affected by GHSA-9g45-5xwm-f3wc | Dependencies (osv-scanner) |
| medium | osv/GHSA-c9xm-49cp-xcr9 |
Cargo.lock | [email protected] (crates.io) is affected by GHSA-c9xm-49cp-xcr9 | Dependencies (osv-scanner) |
| medium | osv/RUSTSEC-2026-0190 |
Cargo.lock | [email protected] (crates.io) is affected by RUSTSEC-2026-0190 | Dependencies (osv-scanner) |
| medium | osv/RUSTSEC-2026-0386 |
Cargo.lock | [email protected] (crates.io) is affected by RUSTSEC-2026-0386 | Dependencies (osv-scanner) |
| medium | osv/RUSTSEC-2026-0441 |
Cargo.lock | [email protected] (crates.io) is affected by RUSTSEC-2026-0441 | Dependencies (osv-scanner) |
| medium | osv/RUSTSEC-2026-0462 |
Cargo.lock | [email protected] (crates.io) is affected by RUSTSEC-2026-0462 | Dependencies (osv-scanner) |
| medium | osv/RUSTSEC-2026-0486 |
Cargo.lock | [email protected] (crates.io) is affected by RUSTSEC-2026-0486 | Dependencies (osv-scanner) |
Tools and coverage
Every analyzer that ran on this commit. A failed or skipped tool is a coverage gap: its share of the score is left out and the coverage figure drops.
| Analyzer | Pillar | Status | Version | Findings | Note |
|---|---|---|---|---|---|
| AI tool configuration | AI provenance | ok | signatures-v1 | 0 | |
| Explicit AI attribution | AI provenance | ok | signatures-v1 | 0 | |
| Release velocity | AI provenance | skipped | — | 0 | |
| Coding style | AI provenance | ok | — | 0 | |
| Commit velocity | AI provenance | ok | prov-4 | 0 | |
| Findings in AI-written lines | AI provenance | ok | git-blame | 0 | |
| Complexity (lizard) | Code quality | ok | lizard 1.25.1 | 0 | |
| Documentation | Code quality | ok | — | 0 | |
| Duplication (jscpd) | Code quality | ok | repotrust-dup-w6 | 0 | |
| Lint | Code quality | ok | opengrep 1.33.1; rules f1d2b562b414 | 0 | |
| Tests and CI | Code quality | ok | — | 0 | |
| Type safety | Code quality | ok | — | 0 | |
| CI workflows (zizmor) | Security | skipped | — | 0 | |
| Dependencies (osv-scanner) | Security | ok | osv-scanner version: 2.7.1 | 11 | |
| Release downloads | Security | ok | — | 0 | |
| Security posture | Security | ok | — | 0 | |
| Package registries | Security | ok | — | 0 | |
| Static analysis (opengrep) | Security | ok | opengrep 1.33.1; rules f1d2b562b414 | 1 | |
| OpenSSF Scorecard | Security | skipped | — | 0 | no published OpenSSF Scorecard result for this repo |
| Secrets (gitleaks) | Security | ok | gitleaks 8.30.1 | 0 |
Score history
Scores from different scoring versions aren't directly comparable.
| Scored | Commit | Scoring | AI provenance | Quality | Security |
|---|---|---|---|---|---|
| 2026-11-14 | c3abe9ea099b | prov-5+qual-2+sec-2 | 100% | 48 | 78 |
| 2026-11-14 | c3abe9ea099b | prov-4+qual-2+sec-2 | 100% | 48 | 78 |
Full text report
- Repository: https://github.com/MarkMcCaskey/factorioctl
- Commit:
c3abe9ea099b549e18b149d0ea483de21a73bdbe - Generated: 2026-11-14T14:52:00+00:00
- Scorer 0.1.0, scoring prov-5+qual-2+sec-2, report schema v2
Scores
Unreviewed AI code risk: a large share of this code is explicitly AI-attributed, and its tests or review process are weak while quality or security scores are low.
| Pillar | Score | Signal | Confidence | Coverage |
|---|---|---|---|---|
| AI provenance (estimated AI-generated share) | 100 | explicit | 89% | 100% |
| Code quality | 48 | poor | 90% | 100% |
| Security | 78 | adequate | 85% | 100% |
AI provenance
Explicit AI attribution on 100% of first-party code added; an estimated 100% including velocity signals.
- Explicitly attributed share (lower bound): 100.0%
- Unattributed share in AI-consistent velocity bursts: 0.0%
- Estimated AI-generated share: 100.0%
| AI tool | Attributed commits | Lines added |
|---|---|---|
| Claude Code | 69 | 19,931 |
- AI tooling configured in repo: claude-code
Current source lines last changed by AI-attributed commits: 17,555 of 17,555.
Too few lines in one group to compare finding densities.
- Stylometry index: 0.14 per 1,000 lines (narrated steps 0, placeholders 0, assistant phrasing 1, emoji 1). Reported as a signal, not scored.
| Month | Lines added | Attributed to AI |
|---|---|---|
| 2026-01 | 19,931 | 100% |
Evidence
- Claude Code: trailer 'Co-Authored-By: Claude' (2e1a9c302d25)
- Claude Code: trailer 'Co-Authored-By: Claude' (a85460a49ba5)
- Claude Code: trailer 'Co-Authored-By: Claude' (0e76e5e0a946)
- Claude Code: trailer 'Co-Authored-By: Claude' (b53d36b3d089)
- Claude Code: trailer 'Co-Authored-By: Claude' (d5c038a17c27)
- Claude Code: trailer 'Co-Authored-By: Claude' (9f406c8eca40)
- Claude Code: trailer 'Co-Authored-By: Claude' (abb7ff6fbe23)
- Claude Code: trailer 'Co-Authored-By: Claude' (7a4f33031a45)
- Claude Code: trailer 'Co-Authored-By: Claude' (a622373d0d1b)
- Claude Code: trailer 'Co-Authored-By: Claude' (b5a8ec28c1af)
- Claude Code: trailer 'Co-Authored-By: Claude' (90ee39d87770)
- Claude Code: trailer 'Co-Authored-By: Claude' (7cd78d716523)
- Claude Code: trailer 'Co-Authored-By: Claude' (cb275368a613)
- Claude Code: trailer 'Co-Authored-By: Claude' (21a6df3322c4)
- Claude Code: trailer 'Co-Authored-By: Claude' (718d52f9b4e4)
AI provenance describes how code was produced; it is not a quality judgment. Unless attribution is explicit, these are signals consistent with AI generation, not proof. Squash/rebase workflows, imported code, and rewritten history reduce accuracy.
Code quality
Code quality is poor: test-to-source ratio 0.05, no CI test run detected; 29% of function code in complex or long functions; 10% duplicated lines. Weakest area: testing.
| Area | Score |
|---|---|
| Complexity (lizard) | 42 |
| Duplication | 54 |
| Code smells (Opengrep) | 100 |
| Tests and CI | 23 |
| Documentation | 40 |
| Type safety | 40 |
| Process (Scorecard review/maintenance) | n/a |
- Functions: 529; mean complexity 3.9, 90th percentile 9; 22 complex and 20 long functions
- Duplicated lines: 10.3% of 12,364 compared
- Tests: 846 test lines for 17,555 source lines (ratio 0.05); CI test commands: none detected; 2% of recent source commits also change tests
- Docs missing or thin: license, contributing, changelog
Most complex functions:
- execute in src/cli/get.rs: complexity 55, 120 lines
- execute in src/cli/blueprint.rs: complexity 49, 113 lines
- render_ascii_map in src/cli/map.rs: complexity 38, 121 lines
- entity_char in src/cli/map.rs: complexity 38, 84 lines
- entity_size in src/world/mod.rs: complexity 33, 26 lines
Security
Security posture is adequate: 11 known vulnerabilities in 6 dependencies; 1 high-severity SAST findings. Weakest area: posture.
| Area | Score |
|---|---|
| Secrets (gitleaks, tree + history) | 100 |
| Static analysis (Opengrep) | 98 |
| Vulnerable dependencies (OSV) | 68 |
| CI workflows (zizmor) | n/a |
| Posture (policy, updates, signing, lockfiles) | 0 |
| OpenSSF Scorecard | n/a |
-
Known vulnerabilities: 11 in 6 packages (critical 0, high 3, medium 4, low 0)
-
Posture checks passed: lockfiles; missing: security policy, dependency updates, signed commits
Top findings
| Severity | Finding | Location |
|---|---|---|
| high | opengrep/python.lang.security.audit.dangerous-subprocess-use-audit: Detected subprocess function 'run' without a static string. If this data can be controlled by a malicious actor, it may be an instance of command injection. Audit the use of this call to ensure it is not controllable by an external resource. You may consider using 'shlex.escape()'. [confidence low] |
scripts/create_map.py:79 |
| high | osv/GHSA-89vp-x53w-74fx: [email protected] (crates.io) is affected by RUSTSEC-2026-0189, GHSA-89vp-x53w-74fx |
Cargo.lock |
| high | osv/GHSA-33f5-2c5q-wgwj: [email protected] (crates.io) is affected by GHSA-33f5-2c5q-wgwj |
Cargo.lock |
| high | osv/GHSA-9pj6-vhgr-3mwh: [email protected] (crates.io) is affected by GHSA-9pj6-vhgr-3mwh |
Cargo.lock |
| medium | osv/RUSTSEC-2026-0190: [email protected] (crates.io) is affected by RUSTSEC-2026-0190 |
Cargo.lock |
| medium | osv/GHSA-434x-w66g-qw3r: [email protected] (crates.io) is affected by RUSTSEC-2026-0007, GHSA-434x-w66g-qw3r |
Cargo.lock |
| medium | osv/RUSTSEC-2026-0441: [email protected] (crates.io) is affected by RUSTSEC-2026-0441 |
Cargo.lock |
| medium | osv/RUSTSEC-2026-0462: [email protected] (crates.io) is affected by RUSTSEC-2026-0462 |
Cargo.lock |
| medium | osv/GHSA-9g45-5xwm-f3wc: [email protected] (crates.io) is affected by GHSA-9g45-5xwm-f3wc |
Cargo.lock |
| medium | osv/GHSA-c9xm-49cp-xcr9: [email protected] (crates.io) is affected by GHSA-c9xm-49cp-xcr9 |
Cargo.lock |
| medium | osv/RUSTSEC-2026-0486: [email protected] (crates.io) is affected by RUSTSEC-2026-0486 |
Cargo.lock |
| medium | osv/RUSTSEC-2026-0386: [email protected] (crates.io) is affected by RUSTSEC-2026-0386 |
Cargo.lock |
Static signals only: the scorer never runs the project's code. Secret findings are pattern matches that were not verified, and secret values are never stored.
Repository profile
- Source lines: 17,555; test lines: 846
| Language | Lines |
|---|---|
| Rust | 17,439 |
| Python | 619 |
| Shell | 343 |