Leaderboard github.com
hemadri-labs/sonic-route-checker
SONiC Route Consistency Checker + AI Agent
AI provenance
0%
possible
- Confidence
- 41%
- Coverage
- 100%
Estimated share of AI-generated code. Explicit attribution is a lower bound.
Code quality
60/100
weak
- Confidence
- 90%
- Coverage
- 100%
Complexity, duplication, lint density, tests, CI, docs and review process.
Security
62/100
weak
- Confidence
- 85%
- Coverage
- 100%
Secrets, static analysis, vulnerable dependencies, CI and supply-chain posture.
AI provenance
0% possible
Weak signals consistent with AI-assisted development. Comments and strings use phrasing typical of LLM-written code (see the coding style evidence).
How the score is built
- Explicitly attributed share0%
- Unattributed share in AI-pace bursts0%
- Estimated AI-generated share0%
- AI tool configuration files1
- Work sessions at AI pace0
- Releases at AI pacenot measured
- Coding-style index (1.0+ means possible)2.55
Lines added per month all AI-attributed share
- 2026-033,588 · 0% AI
Evidence by analyzer
Explicit AI attributionok
- attributed_commit_share
- 0.0%
- attributed_commits
- 0
- attributed_loc
- 0
- attributed_loc_share
- 0.0%
- commits
- 4
- effective_loc
- 3,588
- tools_detected
- 0
AI tool configurationok1 item
- artifacts
- 1
- earliest_adoption
- 2026-03-26
- tools_configured
- 1
- workflow_agents
- 0
Commit velocityok
- excluded_import_loc
- 3,145
- flagged_loc
- 0
- flagged_loc_share
- 0.0%
- flagged_units
- 0
- max_loc_per_hour
- 110.75
- measured_loc
- 443
- median_loc_per_hour
- 110.75
- pr_timed_units
- 0
- pre_ai_era_burst_loc
- 0
- pre_ai_era_bursts
- 0
- pre_ai_era_measured_loc
- 0
- work_units
- 1
Release velocityskipped
Coding styleok2 items
- placeholder or demo-only phrasing: Inject a fault scenario into the running SONiC environment for demo purposes.
- placeholder or demo-only phrasing: # Inject a fault scenario into the running SONiC environment for demo purposes.
- count:assistant_voice
- 0
- count:emoji_in_code
- 7
- count:narrated_steps
- 0
- count:placeholder
- 2
- files:assistant_voice
- 0
- files:emoji_in_code
- 1
- files:narrated_steps
- 0
- files:placeholder
- 2
- index
- 2.55
- lines_scanned
- 2,941
- per_kloc:assistant_voice
- 0
- per_kloc:emoji_in_code
- 2.38
- per_kloc:narrated_steps
- 0
- per_kloc:placeholder
- 0.68
Code quality
60 weak
Code quality is weak: test-to-source ratio 0.20, no CI test run detected; 11% of function code in complex or long functions; 3% duplicated lines. Weakest area: testing.
How the score is built
- Complexity73
- Duplication85
- Lint and smells70
- Tests and CI40
- Documentation40
- Type safety40
- Review processnot measured
Evidence by analyzer
Complexity (lizard)ok2 items
- diff in checker/diff_engine.py: complexity 29, 70 lines
- stream_agent_response._run in agent/agent.py: complexity 16, 26 lines
- complex_functions
- 2
- function_nloc
- 908
- functions
- 71
- long_functions
- 0
- many_param_functions
- 0
- mean_ccn
- 4.01
- p90_ccn
- 11
- risky_nloc_share
- 10.6%
Duplication (jscpd)ok3 items
- 6+ duplicated lines: agent/agent.py:215 and agent/agent.py:271
- 6+ duplicated lines: checker/collector.py:132 and checker/collector.py:199
- 6+ duplicated lines: checker/diff_engine.py:272 and checker/diff_engine.py:299
- compared_lines
- 2,126
- duplicated_lines
- 56
- duplicated_share
- 2.6%
- files
- 12
Lintok
- category:best-practice
- 2
- category:correctness
- 1
- findings
- 3
- scanned_lines
- 2,941
- weighted_findings
- 4.25
Tests and CIok
- check:ci_present
- no
- check:ci_runs_lint
- no
- check:ci_runs_tests
- no
- check:has_tests
- yes
- check:test_ratio
- no
- check:tests_cochange
- yes
- ci_files
- 0
- cochange_commits
- 2
- cochange_share
- 50.0%
- source_lines
- 2,941
- test_lines
- 590
- test_ratio
- 0.20
Documentationok1 item
- README.md
README.md
- check:changelog
- no
- check:contributing
- no
- check:license
- no
- check:readme
- yes
- readme_lines
- 118
Type safetyok
- check:low_escape_density
- yes
- check:strict_config
- no
- escapes
- 1
- escapes_per_kloc
- 0.36
Security
62 weak
Security posture is weak: 21 known vulnerabilities in 7 dependencies; 4 high-severity SAST findings. Weakest area: posture.
How the score is built
- Secrets100
- Static analysis (SAST)54
- Vulnerable dependencies44
- CI workflowsnot measured
- Security posture20
- OpenSSF Scorecardnot measured
Evidence by analyzer
OpenSSF Scorecardskipped
no published OpenSSF Scorecard result for this repo
Package registriesok
- checked
- 14
- declared
- 14
- lookup_errors
- 0
- missing
- 0
- recent
- 0
Secrets (gitleaks)ok
- secrets_current
- 0
- secrets_history
- 0
- secrets_low_confidence
- 0
- secrets_nonprod
- 0
Static analysis (opengrep)ok
- findings
- 4
- findings_high
- 4
- findings_low
- 0
- findings_medium
- 0
- parse_errors
- 0
- scanned_lines
- 2,941
- weighted_findings
- 5.10
Dependencies (osv-scanner)ok
- penalty
- 50
- vulnerabilities
- 21
- vulnerable_packages
- 7
- vulns_critical
- 2
- vulns_high
- 9
- vulns_low
- 2
- vulns_medium
- 8
- vulns_unknown
- 0
CI workflows (zizmor)skipped
Security postureok
- check:dependency_updates
- no
- check:lockfiles
- yes
- check:security_policy
- no
- check:signed_commits
- yes
- signed_commit_share
- 50.0%
- unpinned_manifests
- 0
Release downloadsok
- binary_assets
- 0
- signals
- 0
- suspicious
- 0
Findings
2 critical14 high9 medium3 low
28 findings
| Severity | Rule | Location | Message | Tool |
|---|---|---|---|---|
| critical | osv/GHSA-c67j-w6g6-q2cm |
requirements.txt | [email protected] (PyPI) is affected by PYSEC-2026-373, GHSA-c67j-w6g6-q2cm | Dependencies (osv-scanner) |
| critical | osv/PYSEC-2026-2194 |
requirements.txt | [email protected] (PyPI) is affected by PYSEC-2026-2194 | Dependencies (osv-scanner) |
| high | opengrep/python.lang.best-practice.arbitrary-sleep |
infra/routes.py:34 | time.sleep() call; did you mean to leave this in? | Lint |
| high | opengrep/python.lang.security.audit.dangerous-subprocess-use-audit |
agent/tools.py:50 | Detected subprocess function 'run' without a static string. If this data can be controlled by a malicious actor, it may be an instance of command injection. Audit the use of this call to ensure it is not controllable by an external... | Static analysis (opengrep) |
| high | opengrep/python.lang.security.audit.subprocess-shell-true |
agent/tools.py:51 | Found 'subprocess' function 'run' with 'shell=True'. This is dangerous because this call will spawn the command using a shell process. Doing so propagates current shell settings and variables, which makes it much easier for a malicious... | Static analysis (opengrep) |
| high | opengrep/python.lang.security.audit.dangerous-subprocess-use-audit |
checker/collector.py:266 | Detected subprocess function 'run' without a static string. If this data can be controlled by a malicious actor, it may be an instance of command injection. Audit the use of this call to ensure it is not controllable by an external... | Static analysis (opengrep) |
| high | opengrep/python.lang.security.audit.subprocess-shell-true |
checker/collector.py:266 | Found 'subprocess' function 'run' with 'shell=True'. This is dangerous because this call will spawn the command using a shell process. Doing so propagates current shell settings and variables, which makes it much easier for a malicious... | Static analysis (opengrep) |
| high | osv/GHSA-3qhf-m339-9g5v |
requirements.txt | [email protected] (PyPI) is affected by PYSEC-2026-1616, GHSA-3qhf-m339-9g5v | Dependencies (osv-scanner) |
| high | osv/GHSA-6qv9-48xg-fc7f |
requirements.txt | [email protected] (PyPI) is affected by PYSEC-2026-1518, GHSA-6qv9-48xg-fc7f | Dependencies (osv-scanner) |
| high | osv/GHSA-9h52-p55h-vw2f |
requirements.txt | [email protected] (PyPI) is affected by PYSEC-2026-1617, GHSA-9h52-p55h-vw2f | Dependencies (osv-scanner) |
| high | osv/GHSA-g48c-2wqr-h844 |
requirements.txt | [email protected] (PyPI) is affected by PYSEC-2026-83, GHSA-g48c-2wqr-h844 | Dependencies (osv-scanner) |
| high | osv/GHSA-j975-95f5-7wqh |
requirements.txt | [email protected] (PyPI) is affected by PYSEC-2026-1618, GHSA-j975-95f5-7wqh | Dependencies (osv-scanner) |
| high | osv/GHSA-jpw9-pfvf-9f58 |
requirements.txt | [email protected] (PyPI) is affected by PYSEC-2026-3482, GHSA-jpw9-pfvf-9f58 | Dependencies (osv-scanner) |
| high | osv/GHSA-pjwx-r37v-7724 |
requirements.txt | [email protected] (PyPI) is affected by PYSEC-2026-2564, GHSA-pjwx-r37v-7724 | Dependencies (osv-scanner) |
| high | osv/GHSA-qh6h-p6c9-ff54 |
requirements.txt | [email protected] (PyPI) is affected by PYSEC-2026-2193, GHSA-qh6h-p6c9-ff54 | Dependencies (osv-scanner) |
| high | osv/GHSA-vj7q-gjh5-988w |
requirements.txt | [email protected] (PyPI) is affected by PYSEC-2026-3483, GHSA-vj7q-gjh5-988w | Dependencies (osv-scanner) |
| medium | opengrep/python.lang.best-practice.unspecified-open-encoding |
dashboard/app.py:37 | Missing 'encoding' parameter. 'open()' uses device locale encodings by default, corrupting files with special characters. Specify the encoding to ensure cross-platform support when opening files in text mode (e.g. encoding="utf-8"). | Lint |
| medium | osv/GHSA-45x7-px36-x8w8 |
requirements.txt | [email protected] (PyPI) is affected by PYSEC-2026-1758, GHSA-45x7-px36-x8w8 | Dependencies (osv-scanner) |
| medium | osv/GHSA-5chr-fjjv-38qv |
requirements.txt | [email protected] (PyPI) is affected by PYSEC-2026-1517, GHSA-5chr-fjjv-38qv | Dependencies (osv-scanner) |
| medium | osv/GHSA-7p48-42j8-8846 |
requirements.txt | [email protected] (PyPI) is affected by PYSEC-2026-2285, GHSA-7p48-42j8-8846 | Dependencies (osv-scanner) |
| medium | osv/GHSA-926x-3r5x-gfhw |
requirements.txt | [email protected] (PyPI) is affected by PYSEC-2026-2563, GHSA-926x-3r5x-gfhw | Dependencies (osv-scanner) |
| medium | osv/GHSA-gr75-jv2w-4656 |
requirements.txt | [email protected] (PyPI) is affected by PYSEC-2026-2556, GHSA-gr75-jv2w-4656 | Dependencies (osv-scanner) |
| medium | osv/GHSA-mr82-8j83-vxmv |
requirements.txt | [email protected] (PyPI) is affected by PYSEC-2026-1812, GHSA-mr82-8j83-vxmv | Dependencies (osv-scanner) |
| medium | osv/GHSA-rxff-vr5r-8cj5 |
requirements.txt | [email protected] (PyPI) is affected by PYSEC-2024-153, GHSA-rxff-vr5r-8cj5 | Dependencies (osv-scanner) |
| medium | osv/GHSA-vqwp-45wm-r9r5 |
requirements.txt | [email protected] (PyPI) is affected by PYSEC-2026-212, GHSA-vqwp-45wm-r9r5 | Dependencies (osv-scanner) |
| low | opengrep/bash.lang.correctness.unquoted-variable-expansion-in-command |
start.sh:112 | Variable expansions must be double-quoted so as to prevent being split into multiple pieces according to whitespace or whichever separator is specified by the IFS variable. If you really wish to split the variable's contents, you may... | Lint |
| low | osv/GHSA-2g6r-c272-w58r |
requirements.txt | [email protected] (PyPI) is affected by PYSEC-2026-2562, GHSA-2g6r-c272-w58r | Dependencies (osv-scanner) |
| low | osv/GHSA-r374-rxx8-8654 |
requirements.txt | [email protected] (PyPI) is affected by PYSEC-2026-2858, GHSA-r374-rxx8-8654 | Dependencies (osv-scanner) |
Tools and coverage
Every analyzer that ran on this commit. A failed or skipped tool is a coverage gap: its share of the score is left out and the coverage figure drops.
| Analyzer | Pillar | Status | Version | Findings | Note |
|---|---|---|---|---|---|
| AI tool configuration | AI provenance | ok | signatures-v1 | 0 | |
| Explicit AI attribution | AI provenance | ok | signatures-v1 | 0 | |
| Release velocity | AI provenance | skipped | — | 0 | |
| Coding style | AI provenance | ok | — | 0 | |
| Commit velocity | AI provenance | ok | prov-4 | 0 | |
| Complexity (lizard) | Code quality | ok | lizard 1.25.1 | 0 | |
| Documentation | Code quality | ok | — | 0 | |
| Duplication (jscpd) | Code quality | ok | repotrust-dup-w6 | 0 | |
| Lint | Code quality | ok | opengrep 1.33.1; rules f1d2b562b414 | 3 | |
| Tests and CI | Code quality | ok | — | 0 | |
| Type safety | Code quality | ok | — | 0 | |
| CI workflows (zizmor) | Security | skipped | — | 0 | |
| Dependencies (osv-scanner) | Security | ok | osv-scanner version: 2.7.1 | 21 | |
| Release downloads | Security | ok | — | 0 | |
| Security posture | Security | ok | — | 0 | |
| Package registries | Security | ok | — | 0 | |
| Static analysis (opengrep) | Security | ok | opengrep 1.33.1; rules f1d2b562b414 | 4 | |
| OpenSSF Scorecard | Security | skipped | — | 0 | no published OpenSSF Scorecard result for this repo |
| Secrets (gitleaks) | Security | ok | gitleaks 8.30.1 | 0 |
Score history
Scores from different scoring versions aren't directly comparable.
| Scored | Commit | Scoring | AI provenance | Quality | Security |
|---|---|---|---|---|---|
| 2026-11-14 | cbefa90c2492 | prov-5+qual-2+sec-2 | 0% | 60 | 62 |
| 2026-11-14 | cbefa90c2492 | prov-4+qual-2+sec-2 | 0% | 60 | 62 |
Full text report
- Repository: https://github.com/hemadri-labs/sonic-route-checker
- Commit:
cbefa90c2492f6e179821deb77ac752469710c9c - Generated: 2026-11-14T14:52:05+00:00
- Scorer 0.1.0, scoring prov-5+qual-2+sec-2, report schema v2
Scores
| Pillar | Score | Signal | Confidence | Coverage |
|---|---|---|---|---|
| AI provenance (estimated AI-generated share) | 0 | possible | 41% | 100% |
| Code quality | 60 | weak | 90% | 100% |
| Security | 62 | weak | 85% | 100% |
AI provenance
Weak signals consistent with AI-assisted development. Comments and strings use phrasing typical of LLM-written code (see the coding style evidence).
-
Explicitly attributed share (lower bound): 0.0%
-
Unattributed share in AI-consistent velocity bursts: 0.0%
-
Estimated AI-generated share: 0.0%
-
AI tooling configured in repo: claude-code
-
Stylometry index: 2.55 per 1,000 lines (narrated steps 0, placeholders 2, assistant phrasing 0, emoji 7). Reported as a signal, not scored.
| Month | Lines added | Attributed to AI |
|---|---|---|
| 2026-03 | 3,588 | 0% |
Evidence
- CLAUDE.md (claude-code configuration) (CLAUDE.md)
- placeholder or demo-only phrasing: Inject a fault scenario into the running SONiC environment for demo purposes. (agent/mcp_se)
- placeholder or demo-only phrasing: # Inject a fault scenario into the running SONiC environment for demo purposes. (agent/tools.)
AI provenance describes how code was produced; it is not a quality judgment. Unless attribution is explicit, these are signals consistent with AI generation, not proof. Squash/rebase workflows, imported code, and rewritten history reduce accuracy.
Code quality
Code quality is weak: test-to-source ratio 0.20, no CI test run detected; 11% of function code in complex or long functions; 3% duplicated lines. Weakest area: testing.
| Area | Score |
|---|---|
| Complexity (lizard) | 73 |
| Duplication | 85 |
| Code smells (Opengrep) | 70 |
| Tests and CI | 40 |
| Documentation | 40 |
| Type safety | 40 |
| Process (Scorecard review/maintenance) | n/a |
- Functions: 71; mean complexity 4.0, 90th percentile 11; 2 complex and 0 long functions
- Duplicated lines: 2.6% of 2,126 compared
- Tests: 590 test lines for 2,941 source lines (ratio 0.20); CI test commands: none detected; 50% of recent source commits also change tests
- Docs missing or thin: license, contributing, changelog
Most complex functions:
- diff in checker/diff_engine.py: complexity 29, 70 lines
- stream_agent_response._run in agent/agent.py: complexity 16, 26 lines
Security
Security posture is weak: 21 known vulnerabilities in 7 dependencies; 4 high-severity SAST findings. Weakest area: posture.
| Area | Score |
|---|---|
| Secrets (gitleaks, tree + history) | 100 |
| Static analysis (Opengrep) | 54 |
| Vulnerable dependencies (OSV) | 44 |
| CI workflows (zizmor) | n/a |
| Posture (policy, updates, signing, lockfiles) | 20 |
| OpenSSF Scorecard | n/a |
-
Known vulnerabilities: 21 in 7 packages (critical 2, high 9, medium 8, low 2)
-
Posture checks passed: signed commits, lockfiles; missing: security policy, dependency updates
Top findings
| Severity | Finding | Location |
|---|---|---|
| critical | osv/GHSA-c67j-w6g6-q2cm: [email protected] (PyPI) is affected by PYSEC-2026-373, GHSA-c67j-w6g6-q2cm |
requirements.txt |
| critical | osv/PYSEC-2026-2194: [email protected] (PyPI) is affected by PYSEC-2026-2194 |
requirements.txt |
| high | opengrep/python.lang.security.audit.dangerous-subprocess-use-audit: Detected subprocess function 'run' without a static string. If this data can be controlled by a malicious actor, it may be an instance of command injection. Audit the use of this call to ensure it is not controllable by an external resource. You may consider using 'shlex.escape()'. [confidence low] |
agent/tools.py:50 |
| high | opengrep/python.lang.security.audit.subprocess-shell-true: Found 'subprocess' function 'run' with 'shell=True'. This is dangerous because this call will spawn the command using a shell process. Doing so propagates current shell settings and variables, which makes it much easier for a malicious actor to execute commands. Use 'shell=False' instead. [confidence medium] |
agent/tools.py:51 |
| high | opengrep/python.lang.security.audit.dangerous-subprocess-use-audit: Detected subprocess function 'run' without a static string. If this data can be controlled by a malicious actor, it may be an instance of command injection. Audit the use of this call to ensure it is not controllable by an external resource. You may consider using 'shlex.escape()'. [confidence low] |
checker/collector.py:266 |
| high | opengrep/python.lang.security.audit.subprocess-shell-true: Found 'subprocess' function 'run' with 'shell=True'. This is dangerous because this call will spawn the command using a shell process. Doing so propagates current shell settings and variables, which makes it much easier for a malicious actor to execute commands. Use 'shell=False' instead. [confidence medium] |
checker/collector.py:266 |
| high | osv/GHSA-6qv9-48xg-fc7f: [email protected] (PyPI) is affected by PYSEC-2026-1518, GHSA-6qv9-48xg-fc7f |
requirements.txt |
| high | osv/GHSA-qh6h-p6c9-ff54: [email protected] (PyPI) is affected by PYSEC-2026-2193, GHSA-qh6h-p6c9-ff54 |
requirements.txt |
| high | osv/GHSA-pjwx-r37v-7724: [email protected] (PyPI) is affected by PYSEC-2026-2564, GHSA-pjwx-r37v-7724 |
requirements.txt |
| high | osv/GHSA-g48c-2wqr-h844: [email protected] (PyPI) is affected by PYSEC-2026-83, GHSA-g48c-2wqr-h844 |
requirements.txt |
| high | osv/GHSA-3qhf-m339-9g5v: [email protected] (PyPI) is affected by PYSEC-2026-1616, GHSA-3qhf-m339-9g5v |
requirements.txt |
| high | osv/GHSA-9h52-p55h-vw2f: [email protected] (PyPI) is affected by PYSEC-2026-1617, GHSA-9h52-p55h-vw2f |
requirements.txt |
| high | osv/GHSA-j975-95f5-7wqh: [email protected] (PyPI) is affected by PYSEC-2026-1618, GHSA-j975-95f5-7wqh |
requirements.txt |
| high | osv/GHSA-jpw9-pfvf-9f58: [email protected] (PyPI) is affected by PYSEC-2026-3482, GHSA-jpw9-pfvf-9f58 |
requirements.txt |
| high | osv/GHSA-vj7q-gjh5-988w: [email protected] (PyPI) is affected by PYSEC-2026-3483, GHSA-vj7q-gjh5-988w |
requirements.txt |
| medium | osv/GHSA-gr75-jv2w-4656: [email protected] (PyPI) is affected by PYSEC-2026-2556, GHSA-gr75-jv2w-4656 |
requirements.txt |
| medium | osv/GHSA-5chr-fjjv-38qv: [email protected] (PyPI) is affected by PYSEC-2026-1517, GHSA-5chr-fjjv-38qv |
requirements.txt |
| medium | osv/GHSA-926x-3r5x-gfhw: [email protected] (PyPI) is affected by PYSEC-2026-2563, GHSA-926x-3r5x-gfhw |
requirements.txt |
| medium | osv/GHSA-45x7-px36-x8w8: [email protected] (PyPI) is affected by PYSEC-2026-1758, GHSA-45x7-px36-x8w8 |
requirements.txt |
| medium | osv/GHSA-mr82-8j83-vxmv: [email protected] (PyPI) is affected by PYSEC-2026-1812, GHSA-mr82-8j83-vxmv |
requirements.txt |
| medium | osv/GHSA-rxff-vr5r-8cj5: [email protected] (PyPI) is affected by PYSEC-2024-153, GHSA-rxff-vr5r-8cj5 |
requirements.txt |
| medium | osv/GHSA-vqwp-45wm-r9r5: [email protected] (PyPI) is affected by PYSEC-2026-212, GHSA-vqwp-45wm-r9r5 |
requirements.txt |
| medium | osv/GHSA-7p48-42j8-8846: [email protected] (PyPI) is affected by PYSEC-2026-2285, GHSA-7p48-42j8-8846 |
requirements.txt |
| low | osv/GHSA-2g6r-c272-w58r: [email protected] (PyPI) is affected by PYSEC-2026-2562, GHSA-2g6r-c272-w58r |
requirements.txt |
| low | osv/GHSA-r374-rxx8-8654: [email protected] (PyPI) is affected by PYSEC-2026-2858, GHSA-r374-rxx8-8654 |
requirements.txt |
Static signals only: the scorer never runs the project's code. Secret findings are pattern matches that were not verified, and secret values are never stored.
Repository profile
- Source lines: 2,941; test lines: 590
| Language | Lines |
|---|---|
| Python | 3,367 |
| Shell | 164 |