Skip to content

Verification ​

Celox results for the pinned sv-tests corpus. Switch between Main tests, Cores, and Imported, then search by language feature or test-suite tag. Only Celox results are displayed. The layout follows the upstream dashboard.

Reviewed baseline — not a fresh run

Celox · 2state

96.24%

1588 / 1650 passed

62 failed · 0 skipped

Celox · 4state

97.27%

1605 / 1650 passed

45 failed · 0 skipped

Source and execution conditions
Recorded at
2026-11-19T18:43:38Z
Baseline source revision
0c7f46bd9c25f71161f41ddd6f82d40a845c39f8
sv-tests revision
db159ad8e9cbbd62036569d240153f753258f640
expected.tsv

346 tags. A case with multiple tags appears in multiple rows.

Feature / test suiteTagCelox 2stateCelox 4state
White space5.37 / 7100%7 / 7100%
Comments5.47 / 7100%7 / 7100%
Identifiers, keywords, and system names5.62 / 2100%2 / 2100%
Escaped identifiers5.6.12 / 2100%2 / 2100%
Keywords5.6.2248 / 248100%248 / 248100%
System tasks and system functions5.6.31 / 1100%1 / 1100%
Compiler directives5.6.490 / 90100%90 / 90100%
Integer literal constants5.7.164 / 64100%64 / 64100%
Real literal constants5.7.258 / 58100%58 / 58100%
Time literals5.81 / 1100%1 / 1100%
String literals5.94 / 4100%4 / 4100%
Special characters in strings5.9.11 / 1100%1 / 1100%
Structure literals5.104 / 4100%4 / 4100%
Array literals5.113 / 3100%3 / 3100%
Attributes5.125 / 5100%5 / 5100%
Built-in methods5.131 / 1100%1 / 1100%
Nets and variables6.54 / 4100%4 / 4100%
Wire and tri nets6.6.12 / 2100%2 / 2100%
Unresolved nets6.6.21 / 1100%1 / 1100%
Wired nets6.6.34 / 4100%4 / 4100%
Trireg net6.6.40 / 10%0 / 10%
Tri0 and tri1 nets6.6.52 / 2100%2 / 2100%
Supply nets6.6.62 / 2100%2 / 2100%
User-defined nettypes6.6.71 / 250%1 / 250%
Generic interconnect6.6.81 / 1100%1 / 1100%
Specifying vectors6.9.11 / 1100%1 / 1100%
Vector net accessibility6.9.23 / 3100%3 / 3100%
Implicit declarations6.103 / 3100%3 / 3100%
Integer data types6.1127 / 27100%27 / 27100%
Real, shortreal, and realtime data types6.126 / 6100%6 / 6100%
Void data type6.131 / 1100%1 / 1100%
Chandle data type6.141 / 1100%1 / 1100%
Class6.1541 / 41100%41 / 41100%
String data type6.161 / 1100%1 / 1100%
Len()6.16.11 / 1100%1 / 1100%
Putc()6.16.21 / 1100%1 / 1100%
Getc()6.16.31 / 1100%1 / 1100%
Toupper()6.16.41 / 1100%1 / 1100%
Tolower()6.16.51 / 1100%1 / 1100%
Compare()6.16.61 / 1100%1 / 1100%
Icompare()6.16.71 / 1100%1 / 1100%
Substr()6.16.81 / 1100%1 / 1100%
Atoi(), atohex(), atooct(), atobin()6.16.94 / 4100%4 / 4100%
Atoreal()6.16.101 / 1100%1 / 1100%
Itoa()6.16.111 / 1100%1 / 1100%
Hextoa()6.16.121 / 1100%1 / 1100%
Octtoa()6.16.131 / 1100%1 / 1100%
Bintoa()6.16.141 / 1100%1 / 1100%
Realtoa()6.16.151 / 1100%1 / 1100%
Event data type6.171 / 1100%1 / 1100%
User-defined types6.1829 / 3096.7%29 / 3096.7%
Enumerations6.195 / 5100%5 / 5100%
Defining new data types as enumerated types6.19.11 / 1100%1 / 1100%
Enumerated type ranges6.19.22 / 2100%2 / 2100%
Type checking6.19.32 / 2100%2 / 2100%
Enumerated types in numerical expressions6.19.43 / 3100%3 / 3100%
First()6.19.5.11 / 1100%1 / 1100%
Last()6.19.5.21 / 1100%1 / 1100%
Next()6.19.5.31 / 1100%1 / 1100%
Prev()6.19.5.41 / 1100%1 / 1100%
Num()6.19.5.51 / 1100%1 / 1100%
Name()6.19.5.61 / 1100%1 / 1100%
Value parameters6.20.26 / 6100%6 / 6100%
Type parameters6.20.31 / 1100%1 / 1100%
Local parameters (localparam)6.20.45 / 5100%5 / 5100%
Specify parameters6.20.52 / 2100%2 / 2100%
Const constants6.20.61 / 1100%1 / 1100%
Type operator6.233 / 3100%3 / 3100%
Cast operator6.24.11 / 1100%1 / 1100%
$cast dynamic casting6.24.22 / 2100%2 / 2100%
Bit-stream casting6.24.31 / 1100%1 / 1100%
General7.12 / 2100%2 / 2100%
Structures7.25 / 5100%5 / 5100%
Packed structures7.2.13 / 3100%3 / 3100%
Assigning to structures7.2.22 / 2100%2 / 2100%
Unions7.31 / 250%1 / 250%
Packed unions7.3.11 / 1100%1 / 1100%
Tagged unions7.3.21 / 250%1 / 250%
Packed and unpacked arrays7.42 / 366.7%2 / 366.7%
Packed arrays7.4.19 / 9100%9 / 9100%
Unpacked arrays7.4.213 / 13100%13 / 13100%
Operations on arrays7.4.314 / 14100%14 / 14100%
Memories7.4.42 / 2100%2 / 2100%
Multidimensional arrays7.4.54 / 4100%4 / 4100%
Indexing and slicing of arrays7.4.62 / 2100%2 / 2100%
Dynamic arrays7.51 / 1100%1 / 1100%
New[ ]7.5.11 / 1100%1 / 1100%
Size()7.5.21 / 1100%1 / 1100%
Delete()7.5.31 / 1100%1 / 1100%
Array assignments7.61 / 1100%1 / 1100%
Arrays as arguments to subroutines7.71 / 1100%1 / 1100%
Associative arrays7.87 / 7100%7 / 7100%
Wildcard index type7.8.12 / 2100%2 / 2100%
String index7.8.21 / 1100%1 / 1100%
Class index7.8.31 / 1100%1 / 1100%
Integral index7.8.41 / 1100%1 / 1100%
Accessing invalid indices7.8.61 / 1100%1 / 1100%
Allocating associative array elements7.8.71 / 1100%1 / 1100%
Associative array methods7.99 / 9100%9 / 9100%
Num() and size()7.9.14 / 4100%4 / 4100%
Delete()7.9.21 / 1100%1 / 1100%
Exists()7.9.31 / 1100%1 / 1100%
First()7.9.41 / 1100%1 / 1100%
Last()7.9.51 / 1100%1 / 1100%
Next()7.9.61 / 1100%1 / 1100%
Prev()7.9.71 / 1100%1 / 1100%
Arguments to traversal methods7.9.81 / 1100%1 / 1100%
Associative array assignment7.9.91 / 1100%1 / 1100%
Associative array arguments7.9.101 / 1100%1 / 1100%
Associative array literals7.9.111 / 1100%1 / 1100%
Queues7.1013 / 13100%13 / 13100%
Queue operators7.10.12 / 2100%2 / 2100%
Queue methods7.10.29 / 9100%9 / 9100%
Size()7.10.2.12 / 2100%2 / 2100%
Insert()7.10.2.21 / 1100%1 / 1100%
Delete()7.10.2.31 / 1100%1 / 1100%
Pop_front()7.10.2.41 / 1100%1 / 1100%
Pop_back()7.10.2.51 / 1100%1 / 1100%
Push_front()7.10.2.61 / 1100%1 / 1100%
Push_back()7.10.2.72 / 2100%2 / 2100%
Persistence of references to elements of a queue7.10.30 / 10%0 / 10%
Updating a queue using assignment and unpacked array concatenation7.10.46 / 6100%6 / 6100%
Bounded queues7.10.51 / 1100%1 / 1100%
Array querying functions7.118 / 8100%8 / 8100%
Array manipulation methods7.1210 / 10100%10 / 10100%
Array locator methods7.12.111 / 11100%11 / 11100%
Array ordering methods7.12.26 / 6100%6 / 6100%
Array reduction methods7.12.35 / 5100%5 / 5100%
Iterator index querying7.12.41 / 1100%1 / 1100%
Syntax8.370 / 70100%70 / 70100%
Objects (class instance)8.41 / 1100%1 / 1100%
Object properties and object parameter data8.53 / 3100%3 / 3100%
Object methods8.61 / 1100%1 / 1100%
Constructors8.73 / 3100%3 / 3100%
Typed constructor calls8.82 / 2100%2 / 2100%
Static class properties8.91 / 1100%1 / 1100%
Static methods8.101 / 1100%1 / 1100%
This8.111 / 1100%1 / 1100%
Assignment, renaming, and copying8.122 / 2100%2 / 2100%
Inheritance and subclasses8.131 / 1100%1 / 1100%
Overridden members8.141 / 1100%1 / 1100%
Super8.152 / 2100%2 / 2100%
Casting8.162 / 2100%2 / 2100%
Chaining constructors8.172 / 2100%2 / 2100%
Data hiding and encapsulation8.1810 / 10100%10 / 10100%
Constant class properties8.192 / 2100%2 / 2100%
Virtual methods8.201 / 1100%1 / 1100%
Abstract classes and pure virtual methods8.212 / 2100%2 / 2100%
Polymorphism: dynamic method lookup8.221 / 1100%1 / 1100%
Class scope resolution operator ::8.231 / 1100%1 / 1100%
Out-of-block declarations8.241 / 1100%1 / 1100%
Parameterized classes8.252 / 2100%2 / 2100%
Class scope resolution operator for parameterized classes8.25.12 / 2100%2 / 2100%
Interface classes8.265 / 5100%5 / 5100%
Extends versus implements8.26.24 / 4100%4 / 4100%
Type access8.26.33 / 3100%3 / 3100%
Type usage restrictions8.26.42 / 2100%2 / 2100%
Casting and object reference assignment8.26.52 / 2100%2 / 2100%
Method name conflict resolution8.26.6.12 / 2100%2 / 2100%
Parameter and type declaration inheritance conflicts and resolution8.26.6.22 / 2100%2 / 2100%
Diamond relationship8.26.6.32 / 2100%2 / 2100%
Partial implementation8.26.71 / 1100%1 / 1100%
Typedef class8.271 / 1100%1 / 1100%
Initial procedures9.2.11 / 1100%1 / 1100%
General purpose always procedure9.2.2.11 / 1100%1 / 1100%
Combinational logic always_comb procedure9.2.2.21 / 1100%1 / 1100%
Latched logic always_latch procedure9.2.2.31 / 1100%1 / 1100%
Sequential logic always_ff procedure9.2.2.41 / 1100%1 / 1100%
Final procedures9.2.31 / 1100%1 / 1100%
Sequential blocks9.3.11 / 1100%1 / 1100%
Parallel blocks9.3.23 / 3100%3 / 3100%
Statement block start and finish times9.3.33 / 3100%3 / 3100%
Block names9.3.42 / 2100%2 / 2100%
Statement labels9.3.52 / 2100%2 / 2100%
Delay control9.4.14 / 4100%4 / 4100%
Event control9.4.24 / 580%4 / 580%
Event OR operator9.4.2.12 / 2100%2 / 2100%
Implicit event_expression list9.4.2.21 / 1100%1 / 1100%
Conditional event controls9.4.2.31 / 1100%1 / 1100%
Sequence events9.4.2.40 / 10%0 / 10%
Level-sensitive event control9.4.31 / 1100%1 / 1100%
Intra-assignment timing controls9.4.57 / 7100%7 / 7100%
Wait fork statement9.6.11 / 1100%1 / 1100%
Disable statement9.6.22 / 2100%2 / 2100%
Disable fork statement9.6.31 / 1100%1 / 1100%
Fine-grain process control9.74 / 4100%4 / 4100%
Continuous assignments10.31 / 1100%1 / 1100%
The net declaration assignment10.3.12 / 2100%2 / 2100%
The continuous assignment statement10.3.21 / 1100%1 / 1100%
Continuous assignment delays10.3.32 / 2100%2 / 2100%
Continuous assignment strengths10.3.424 / 24100%24 / 24100%
Blocking procedural assignments10.4.11 / 1100%1 / 1100%
Nonblocking procedural assignments10.4.21 / 1100%1 / 1100%
The assign and deassign procedural statements10.6.11 / 1100%1 / 1100%
The force and release procedural statements10.6.21 / 1100%1 / 1100%
Operators11.36 / 6100%6 / 6100%
Operator expression short circuiting11.3.51 / 1100%1 / 1100%
Assignment within an expression11.3.611 / 11100%11 / 11100%
Assignment operators11.4.134 / 34100%34 / 34100%
Increment and decrement operators11.4.24 / 4100%4 / 4100%
Arithmetic operators11.4.324 / 24100%24 / 24100%
Relational operators11.4.416 / 16100%16 / 16100%
Equality operators11.4.533 / 3984.6%39 / 39100%
Wildcard equality operators11.4.69 / 1850%18 / 18100%
Logical operators11.4.724 / 24100%24 / 24100%
Bitwise operators11.4.815 / 15100%15 / 15100%
Reduction operators11.4.914 / 14100%14 / 14100%
Shift operators11.4.1014 / 14100%14 / 14100%
Conditional operator11.4.113 / 3100%3 / 3100%
Concatenation operators11.4.124 / 4100%4 / 4100%
Replication operator11.4.12.15 / 5100%5 / 5100%
String concatenation11.4.12.22 / 2100%2 / 2100%
Set membership operator11.4.133 / 3100%3 / 3100%
Concatenation of stream_expressions11.4.14.12 / 2100%2 / 2100%
Re-ordering of the generic stream11.4.14.24 / 4100%4 / 4100%
Streaming concatenation as an assignment target (unpack)11.4.14.36 / 6100%6 / 6100%
Streaming dynamically sized data11.4.14.43 / 3100%3 / 3100%
Vector bit-select and part-select addressing11.5.112 / 12100%12 / 12100%
Array and memory addressing11.5.25 / 5100%5 / 5100%
Signed expressions11.74 / 4100%4 / 4100%
Tagged union expressions and member access11.91 / 425%1 / 425%
String literal expressions11.102 / 2100%2 / 2100%
String literal operations11.10.12 / 366.7%2 / 366.7%
Empty string literal handling11.10.32 / 2100%2 / 2100%
Minimum, typical, and maximum delay expressions11.111 / 1100%1 / 1100%
Let construct11.121 / 1100%1 / 1100%
Conditional if-else statement12.42 / 2100%2 / 2100%
if-else-if construct12.4.11 / 1100%1 / 1100%
unique-if, unique0-if, and priority-if12.4.23 / 3100%3 / 3100%
Case statement12.51 / 1100%1 / 1100%
Case statement with do-not-cares12.5.12 / 2100%2 / 2100%
Constant expression in case statement12.5.21 / 1100%1 / 1100%
unique-case, unique0-case, and priority-case12.5.39 / 9100%9 / 9100%
Set membership case statement12.5.41 / 1100%1 / 1100%
Pattern matching in case statements12.6.10 / 30%0 / 30%
Pattern matching in if statements12.6.20 / 10%0 / 10%
Pattern matching in conditional expressions12.6.30 / 10%0 / 10%
The for-loop12.7.11 / 1100%1 / 1100%
The repeat loop12.7.21 / 1100%1 / 1100%
The foreach-loop12.7.32 / 2100%2 / 2100%
The while-loop12.7.41 / 1100%1 / 1100%
The do...while-loop12.7.51 / 1100%1 / 1100%
The forever-loop12.7.61 / 1100%1 / 1100%
Jump statements12.84 / 4100%4 / 4100%
Tasks13.32 / 2100%2 / 2100%
Static and automatic tasks13.3.12 / 2100%2 / 2100%
Functions13.42 / 2100%2 / 2100%
Return values and void functions13.4.13 / 3100%3 / 3100%
Static and automatic functions13.4.23 / 3100%3 / 3100%
Constant functions13.4.31 / 1100%1 / 1100%
Background processes spawned by function calls13.4.42 / 2100%2 / 2100%
Clocking block declaration14.35 / 5100%5 / 5100%
Mailboxes15.42 / 2100%2 / 2100%
Named Events15.53 / 3100%3 / 3100%
Overview16.23 / 3100%3 / 3100%
Deferred assertions16.46 / 6100%6 / 6100%
Sequences16.71 / 1100%1 / 1100%
Sequence operations16.96 / 1931.6%6 / 1931.6%
Local variables16.103 / 475%3 / 475%
Declaring properties16.125 / 5100%5 / 5100%
Concurrent assertions16.141 / 1100%1 / 1100%
Disable iff resolution16.152 / 2100%2 / 2100%
Expect statement16.171 / 1100%1 / 1100%
Rand modifier18.4.11 / 1100%1 / 1100%
Randc modifier18.4.21 / 1100%1 / 1100%
Constraint blocks18.51 / 1100%1 / 1100%
External constraint blocks18.5.14 / 4100%4 / 4100%
Constraint inheritance18.5.24 / 4100%4 / 4100%
Set membership18.5.31 / 1100%1 / 1100%
Distribution18.5.42 / 2100%2 / 2100%
Uniqueness constraints18.5.51 / 1100%1 / 1100%
Implication18.5.61 / 1100%1 / 1100%
if–else constraints18.5.74 / 4100%4 / 4100%
foreach iterative constraints18.5.8.11 / 1100%1 / 1100%
Array reduction iterative constraints18.5.8.21 / 1100%1 / 1100%
Global constraints18.5.91 / 1100%1 / 1100%
Variable ordering18.5.102 / 2100%2 / 2100%
Static constraint blocks18.5.111 / 1100%1 / 1100%
Functions in constraints18.5.121 / 1100%1 / 1100%
Constraint guards18.5.131 / 1100%1 / 1100%
Soft constraints18.5.142 / 2100%2 / 2100%
Soft constraint priorities18.5.14.12 / 2100%2 / 2100%
Discarding soft constraints18.5.14.22 / 2100%2 / 2100%
Pre_randomize() and post_randomize()18.6.22 / 2100%2 / 2100%
Behavior of randomization methods18.6.32 / 2100%2 / 2100%
In-line constraints—randomize() with18.73 / 3100%3 / 3100%
local:: scope resolution18.7.11 / 1100%1 / 1100%
Disabling random variables with rand_mode()18.82 / 2100%2 / 2100%
Randomization of scope variables—std::randomize()18.121 / 1100%1 / 1100%
Adding constraints to scope variables—std::randomize() with18.12.11 / 1100%1 / 1100%
$urandom18.13.12 / 2100%2 / 2100%
$urandom_range()18.13.21 / 1100%1 / 1100%
Manually seeding randomize18.151 / 1100%1 / 1100%
Random weighted case—randcase18.162 / 2100%2 / 2100%
Random sequence generation—randsequence18.172 / 2100%2 / 2100%
Random production weights18.17.11 / 1100%1 / 1100%
if–else production statements18.17.24 / 4100%4 / 4100%
Case production statements18.17.32 / 2100%2 / 2100%
Repeat production statements18.17.41 / 1100%1 / 1100%
Interleaving productions—rand join18.17.52 / 2100%2 / 2100%
Aborting productions—break and return18.17.63 / 3100%3 / 3100%
Value passing between productions18.17.71 / 1100%1 / 1100%
Simulation control system tasks20.23 / 3100%3 / 3100%
Simulation time system functions20.33 / 3100%3 / 3100%
Timescale system tasks20.43 / 3100%3 / 3100%
Conversion functions20.54 / 4100%4 / 4100%
Data query functions20.64 / 580%4 / 580%
Array query functions20.72 / 2100%2 / 2100%
Math functions20.822 / 22100%22 / 22100%
Bit vector system functions20.92 / 450%4 / 4100%
Severity tasks20.104 / 4100%4 / 4100%
Sampled value system functions20.136 / 1637.5%6 / 1637.5%
Coverage system functions20.141 / 1100%1 / 1100%
Probabilistic distribution functions20.158 / 8100%8 / 8100%
Display system tasks21.26 / 6100%6 / 6100%
File input/output system tasks and system functions21.316 / 1794.1%16 / 1794.1%
Loading memory array data from a file21.42 / 2100%2 / 2100%
Command line input21.62 / 2100%2 / 2100%
Value change dump (VCD) files21.71 / 250%1 / 250%
resetall22.33 / 3100%3 / 3100%
include22.48 / 8100%8 / 8100%
define22.5.129 / 29100%29 / 29100%
undef22.5.22 / 2100%2 / 2100%
undefineall22.5.32 / 2100%2 / 2100%
ifdef, else, elsif, endif, ifndef22.63 / 3100%3 / 3100%
timescale22.76 / 6100%6 / 6100%
default_nettype22.82 / 2100%2 / 2100%
unconnected_drive and nounconnected_drive22.95 / 5100%5 / 5100%
celldefine and endcelldefine22.102 / 2100%2 / 2100%
pragma22.116 / 6100%6 / 6100%
line22.127 / 7100%7 / 7100%
Module definitions23.23 / 3100%3 / 3100%
The program construct24.31 / 1100%1 / 1100%
Interface syntax25.31 / 1100%1 / 1100%
Package declarations26.21 / 1100%1 / 1100%
Referencing data in packages26.31 / 1100%1 / 1100%
Various sanity checkssanity1 / 1100%1 / 1100%
Tests imported from UVMuvm160 / 16994.7%160 / 16994.7%
uvm-1.2uvm-1.22 / 366.7%2 / 366.7%
uvm_agent examplesuvm-agents3 / 3100%3 / 3100%
UVM tests using assertionsuvm-assertions25 / 2696.2%25 / 2696.2%
Particular UVM classesuvm-classes36 / 36100%36 / 36100%
UVM examplesuvm-examples26 / 3574.3%26 / 3574.3%
uvm-randomuvm-random66 / 66100%66 / 66100%
UVM Prerequisitesuvm-req299 / 31794.3%301 / 31795%
uvm_scoreboard examplesuvm-scoreboards3 / 3100%3 / 3100%

Reading the results ​

Main tests come from the current checkout's reviewed expected.tsv on master. They are a baseline assembled from reviewed verdicts, rather than a fresh full run. The source link identifies a commit containing that baseline; it is not a single simulator build or measurement date. Main baseline changes appear on the next website deployment.

Cores and Imported are measured by the official upstream runner in a separate daily/manual workflow, outside PR gates. The page starts with checked-in measurements and loads newer complete daily results when available. Each group retains its own source revision and measurement time. Collection failures do not replace the last complete public result. Raw results and logs are retained as workflow artifacts for 14 days.

Skipped cases are excluded from the executed denominator. A dash means there are no executed cases, not a zero-percent score. Some core fixtures exclude Celox through upstream's compatible-runners metadata; those remain skipped and visible. The pinned CVA6 testbench has two unavailable include paths. Its failure is reported as an upstream input issue, not language support.

Tags overlap: a case can contribute to several tag rows but counts only once in the overall totals. Two-state and four-state results remain separate. Parsing and elaboration passes do not establish simulation correctness. Negative tests can pass because of an unsupported construct. Some imported cases check process success without validating their printed checks, so an official pass can still contain Failed output. These scores measure official test outcomes, not coverage of the language standard. Expand the execution details to inspect modes and diagnostics.

Local measurements use heliodor-dev; daily CI uses release. Upstream timeouts apply in both configurations, so build settings and machine load can affect results.