Decrease max `nmode` size in tests to 5 to further prevent numerical instabilities #26

apkille · 2024-12-30T22:18:11Z

Some CI tests fail sporadically due to numerical instabilities on higher mode Gaussian systems. Here, I am changing the max number of modes from 20 to 5 for random multi-mode tests.

github-actions · 2024-12-30T22:25:13Z

Benchmark Result

Judge result

Benchmark Report for /home/runner/work/Gabs.jl/Gabs.jl

Job Properties

Time of benchmarks:

Target: 30 Dec 2024 - 22:22
Baseline: 30 Dec 2024 - 22:24

Package commits:

Target: 1a868c
Baseline: 03cbd2

Julia commits:

Target: 4976d0
Baseline: 4976d0

Julia command flags:

Target: None
Baseline: None

Environment variables:

Target: None
Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID	time ratio	memory ratio
`["operations", "channel product", "10"]`	0.76 (5%) ✅	1.00 (1%)
`["operations", "channel product", "100"]`	1.41 (5%) ❌	1.00 (1%)
`["operations", "channel product", "50"]`	3.64 (5%) ❌	1.00 (1%)
`["operations", "partial trace", "200"]`	1.11 (5%) ❌	1.00 (1%)
`["operations", "partial trace", "50"]`	0.91 (5%) ✅	1.00 (1%)
`["operations", "tensor product", "100"]`	1.15 (5%) ❌	1.00 (1%)
`["operations", "tensor product", "50"]`	1.07 (5%) ❌	1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

["operations", "channel product"]
["operations", "partial trace"]
["operations", "tensor product"]
["operations", "unitary product"]

Julia versioninfo

Target

Julia Version 1.10.7
Commit 4976d05258e (2024-11-26 15:57 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 24.04.1 LTS
 uname: Linux 6.8.0-1017-azure #20-Ubuntu SMP Tue Oct 22 03:43:13 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 3239 MHz 519 s 0 s 285 s 2699 s 0 s
 #2 3240 MHz 817 s 0 s 617 s 2056 s 0 s
 #3 3237 MHz 1037 s 0 s 284 s 2162 s 0 s
 #4 3247 MHz 846 s 0 s 274 s 2358 s 0 s
 Memory: 15.615280151367188 GB (14227.84765625 MB free)
 Uptime: 357.89 sec
 Load Avg: 1.83 1.1 0.48
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.7
Commit 4976d05258e (2024-11-26 15:57 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 24.04.1 LTS
 uname: Linux 6.8.0-1017-azure #20-Ubuntu SMP Tue Oct 22 03:43:13 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 3239 MHz 843 s 0 s 422 s 3172 s 0 s
 #2 3239 MHz 1023 s 0 s 717 s 2684 s 0 s
 #3 3247 MHz 1346 s 0 s 547 s 2525 s 0 s
 #4 3246 MHz 1001 s 0 s 361 s 3051 s 0 s
 Memory: 15.615280151367188 GB (14184.74609375 MB free)
 Uptime: 451.53 sec
 Load Avg: 1.82 1.28 0.61
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/Gabs.jl/Gabs.jl

Job Properties

Time of benchmark: 30 Dec 2024 - 22:22
Package commit: 1a868c
Julia commit: 4976d0
Julia command flags: None
Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	memory	allocations
`["operations", "channel product", "10"]`	2.768 μs (5%)	10.19 KiB (1%)	5
`["operations", "channel product", "100"]`	736.582 μs (5%)	941.17 KiB (1%)	8
`["operations", "channel product", "2"]`	492.567 ns (5%)	768 bytes (1%)	5
`["operations", "channel product", "200"]`	3.277 ms (5%)	3.67 MiB (1%)	8
`["operations", "channel product", "50"]`	311.931 μs (5%)	236.27 KiB (1%)	8
`["operations", "partial trace", "10"]`	446.138 ns (5%)	2.89 KiB (1%)	2
`["operations", "partial trace", "100"]`	33.933 μs (5%)	308.12 KiB (1%)	3
`["operations", "partial trace", "2"]`	74.181 ns (5%)	176 bytes (1%)	2
`["operations", "partial trace", "200"]`	143.747 μs (5%)	1.21 MiB (1%)	3
`["operations", "partial trace", "50"]`	7.791 μs (5%)	75.98 KiB (1%)	3
`["operations", "tensor product", "10"]`	1.099 μs (5%)	13.02 KiB (1%)	2
`["operations", "tensor product", "100"]`	112.489 μs (5%)	1.22 MiB (1%)	3
`["operations", "tensor product", "2"]`	119.782 ns (5%)	704 bytes (1%)	2
`["operations", "tensor product", "200"]`	642.977 μs (5%)	4.89 MiB (1%)	3
`["operations", "tensor product", "50"]`	19.627 μs (5%)	314.31 KiB (1%)	3
`["operations", "unitary product", "10"]`	2.458 μs (5%)	6.94 KiB (1%)	4
`["operations", "unitary product", "100"]`	714.981 μs (5%)	628.62 KiB (1%)	6
`["operations", "unitary product", "2"]`	419.824 ns (5%)	576 bytes (1%)	4
`["operations", "unitary product", "200"]`	3.457 ms (5%)	2.45 MiB (1%)	6
`["operations", "unitary product", "50"]`	315.668 μs (5%)	158.09 KiB (1%)	6

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

["operations", "channel product"]
["operations", "partial trace"]
["operations", "tensor product"]
["operations", "unitary product"]

Julia versioninfo

Julia Version 1.10.7
Commit 4976d05258e (2024-11-26 15:57 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 24.04.1 LTS
 uname: Linux 6.8.0-1017-azure #20-Ubuntu SMP Tue Oct 22 03:43:13 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 3239 MHz 519 s 0 s 285 s 2699 s 0 s
 #2 3240 MHz 817 s 0 s 617 s 2056 s 0 s
 #3 3237 MHz 1037 s 0 s 284 s 2162 s 0 s
 #4 3247 MHz 846 s 0 s 274 s 2358 s 0 s
 Memory: 15.615280151367188 GB (14227.84765625 MB free)
 Uptime: 357.89 sec
 Load Avg: 1.83 1.1 0.48
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/Gabs.jl/Gabs.jl

Job Properties

Time of benchmark: 30 Dec 2024 - 22:24
Package commit: 03cbd2
Julia commit: 4976d0
Julia command flags: None
Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	memory	allocations
`["operations", "channel product", "10"]`	3.625 μs (5%)	10.19 KiB (1%)	5
`["operations", "channel product", "100"]`	521.711 μs (5%)	941.17 KiB (1%)	8
`["operations", "channel product", "2"]`	469.222 ns (5%)	768 bytes (1%)	5
`["operations", "channel product", "200"]`	3.325 ms (5%)	3.67 MiB (1%)	8
`["operations", "channel product", "50"]`	85.710 μs (5%)	236.27 KiB (1%)	8
`["operations", "partial trace", "10"]`	462.347 ns (5%)	2.89 KiB (1%)	2
`["operations", "partial trace", "100"]`	35.085 μs (5%)	308.12 KiB (1%)	3
`["operations", "partial trace", "2"]`	74.234 ns (5%)	176 bytes (1%)	2
`["operations", "partial trace", "200"]`	129.281 μs (5%)	1.21 MiB (1%)	3
`["operations", "partial trace", "50"]`	8.529 μs (5%)	75.98 KiB (1%)	3
`["operations", "tensor product", "10"]`	1.110 μs (5%)	13.02 KiB (1%)	2
`["operations", "tensor product", "100"]`	98.124 μs (5%)	1.22 MiB (1%)	3
`["operations", "tensor product", "2"]`	120.754 ns (5%)	704 bytes (1%)	2
`["operations", "tensor product", "200"]`	659.802 μs (5%)	4.89 MiB (1%)	3
`["operations", "tensor product", "50"]`	18.365 μs (5%)	314.31 KiB (1%)	3
`["operations", "unitary product", "10"]`	2.394 μs (5%)	6.94 KiB (1%)	4
`["operations", "unitary product", "100"]`	688.035 μs (5%)	628.62 KiB (1%)	6
`["operations", "unitary product", "2"]`	403.975 ns (5%)	576 bytes (1%)	4
`["operations", "unitary product", "200"]`	3.345 ms (5%)	2.45 MiB (1%)	6
`["operations", "unitary product", "50"]`	305.090 μs (5%)	158.09 KiB (1%)	6

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

["operations", "channel product"]
["operations", "partial trace"]
["operations", "tensor product"]
["operations", "unitary product"]

Julia versioninfo

Julia Version 1.10.7
Commit 4976d05258e (2024-11-26 15:57 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 24.04.1 LTS
 uname: Linux 6.8.0-1017-azure #20-Ubuntu SMP Tue Oct 22 03:43:13 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 3239 MHz 843 s 0 s 422 s 3172 s 0 s
 #2 3239 MHz 1023 s 0 s 717 s 2684 s 0 s
 #3 3247 MHz 1346 s 0 s 547 s 2525 s 0 s
 #4 3246 MHz 1001 s 0 s 361 s 3051 s 0 s
 Memory: 15.615280151367188 GB (14184.74609375 MB free)
 Uptime: 451.53 sec
 Load Avg: 1.82 1.28 0.61
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads	2
`BLAS.vendor()`	`lbt`
`Sys.CPU_THREADS`	4

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 48 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 4
On-line CPU(s) list: 0-3
Vendor ID: AuthenticAMD
Model name: AMD EPYC 7763 64-Core Processor
CPU family: 25
Model: 1
Thread(s) per core: 2
Core(s) per socket: 2
Socket(s): 1
Stepping: 1
BogoMIPS: 4890.85
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves user_shstk clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization: AMD-V
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 64 KiB (2 instances)
L1i cache: 64 KiB (2 instances)
L2 cache: 1 MiB (2 instances)
L3 cache: 32 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Not affected

Cpu Property	Value
Brand	AMD EPYC 7763 64-Core Processor
Vendor	:AMD
Architecture	:Unknown
Model	Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores	16 physical cores, 16 logical cores (on executing CPU)
	No Hyperthreading hardware capability detected
Clock Frequencies	Not supported by CPU
Data Cache	Level 1:3 : (32, 512, 32768) kbytes
	64 byte cache line size
Address Size	48 bits virtual, 48 bits physical
SIMD	256 bit = 32 byte max. SIMD vector size
Time Stamp Counter	TSC is accessible via `rdtsc`
	TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring	Performance Monitoring Counters (PMC) are not supported
Hypervisor	Yes, Microsoft

Benchmark Result

Judge result

Benchmark Report for /home/runner/work/Gabs.jl/Gabs.jl

Job Properties

Time of benchmarks:

Target: 30 Dec 2024 - 22:25
Baseline: 30 Dec 2024 - 22:26

Package commits:

Target: cb898f
Baseline: 03cbd2

Julia commits:

Target: 4976d0
Baseline: 4976d0

Julia command flags:

Target: None
Baseline: None

Environment variables:

Target: None
Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID	time ratio	memory ratio
`["operations", "channel product", "10"]`	0.77 (5%) ✅	1.00 (1%)
`["operations", "channel product", "100"]`	1.47 (5%) ❌	1.00 (1%)
`["operations", "partial trace", "200"]`	0.86 (5%) ✅	1.00 (1%)
`["operations", "partial trace", "50"]`	0.92 (5%) ✅	1.00 (1%)
`["operations", "tensor product", "10"]`	0.93 (5%) ✅	1.00 (1%)
`["operations", "tensor product", "100"]`	1.14 (5%) ❌	1.00 (1%)
`["operations", "tensor product", "50"]`	0.86 (5%) ✅	1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

["operations", "channel product"]
["operations", "partial trace"]
["operations", "tensor product"]
["operations", "unitary product"]

Julia versioninfo

Target

Julia Version 1.10.7
Commit 4976d05258e (2024-11-26 15:57 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 24.04.1 LTS
 uname: Linux 6.8.0-1017-azure #20-Ubuntu SMP Tue Oct 22 03:43:13 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 3234 MHz 753 s 0 s 502 s 1699 s 0 s
 #2 3243 MHz 817 s 0 s 337 s 1778 s 0 s
 #3 3245 MHz 947 s 0 s 359 s 1673 s 0 s
 #4 3242 MHz 719 s 0 s 261 s 1970 s 0 s
 Memory: 15.615280151367188 GB (14192.59375 MB free)
 Uptime: 303.92 sec
 Load Avg: 1.81 1.06 0.45
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.7
Commit 4976d05258e (2024-11-26 15:57 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 24.04.1 LTS
 uname: Linux 6.8.0-1017-azure #20-Ubuntu SMP Tue Oct 22 03:43:13 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 3240 MHz 942 s 0 s 614 s 2333 s 0 s
 #2 3220 MHz 1040 s 0 s 519 s 2308 s 0 s
 #3 3244 MHz 1234 s 0 s 541 s 2141 s 0 s
 #4 3241 MHz 1003 s 0 s 380 s 2504 s 0 s
 Memory: 15.615280151367188 GB (14176.66015625 MB free)
 Uptime: 397.7 sec
 Load Avg: 1.72 1.22 0.57
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/Gabs.jl/Gabs.jl

Job Properties

Time of benchmark: 30 Dec 2024 - 22:25
Package commit: cb898f
Julia commit: 4976d0
Julia command flags: None
Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	memory	allocations
`["operations", "channel product", "10"]`	2.862 μs (5%)	10.19 KiB (1%)	5
`["operations", "channel product", "100"]`	756.936 μs (5%)	941.17 KiB (1%)	8
`["operations", "channel product", "2"]`	490.454 ns (5%)	768 bytes (1%)	5
`["operations", "channel product", "200"]`	3.318 ms (5%)	3.67 MiB (1%)	8
`["operations", "channel product", "50"]`	324.928 μs (5%)	236.27 KiB (1%)	8
`["operations", "partial trace", "10"]`	466.774 ns (5%)	2.89 KiB (1%)	2
`["operations", "partial trace", "100"]`	36.458 μs (5%)	308.12 KiB (1%)	3
`["operations", "partial trace", "2"]`	75.811 ns (5%)	176 bytes (1%)	2
`["operations", "partial trace", "200"]`	132.678 μs (5%)	1.21 MiB (1%)	3
`["operations", "partial trace", "50"]`	7.778 μs (5%)	75.98 KiB (1%)	3
`["operations", "tensor product", "10"]`	1.092 μs (5%)	13.02 KiB (1%)	2
`["operations", "tensor product", "100"]`	121.136 μs (5%)	1.22 MiB (1%)	3
`["operations", "tensor product", "2"]`	122.749 ns (5%)	704 bytes (1%)	2
`["operations", "tensor product", "200"]`	671.708 μs (5%)	4.89 MiB (1%)	3
`["operations", "tensor product", "50"]`	19.305 μs (5%)	314.31 KiB (1%)	3
`["operations", "unitary product", "10"]`	2.488 μs (5%)	6.94 KiB (1%)	4
`["operations", "unitary product", "100"]`	703.978 μs (5%)	628.62 KiB (1%)	6
`["operations", "unitary product", "2"]`	429.397 ns (5%)	576 bytes (1%)	4
`["operations", "unitary product", "200"]`	3.431 ms (5%)	2.45 MiB (1%)	6
`["operations", "unitary product", "50"]`	304.119 μs (5%)	158.09 KiB (1%)	6

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

["operations", "channel product"]
["operations", "partial trace"]
["operations", "tensor product"]
["operations", "unitary product"]

Julia versioninfo

Julia Version 1.10.7
Commit 4976d05258e (2024-11-26 15:57 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 24.04.1 LTS
 uname: Linux 6.8.0-1017-azure #20-Ubuntu SMP Tue Oct 22 03:43:13 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 3234 MHz 753 s 0 s 502 s 1699 s 0 s
 #2 3243 MHz 817 s 0 s 337 s 1778 s 0 s
 #3 3245 MHz 947 s 0 s 359 s 1673 s 0 s
 #4 3242 MHz 719 s 0 s 261 s 1970 s 0 s
 Memory: 15.615280151367188 GB (14192.59375 MB free)
 Uptime: 303.92 sec
 Load Avg: 1.81 1.06 0.45
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/Gabs.jl/Gabs.jl

Job Properties

Time of benchmark: 30 Dec 2024 - 22:26
Package commit: 03cbd2
Julia commit: 4976d0
Julia command flags: None
Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	memory	allocations
`["operations", "channel product", "10"]`	3.696 μs (5%)	10.19 KiB (1%)	5
`["operations", "channel product", "100"]`	516.186 μs (5%)	941.17 KiB (1%)	8
`["operations", "channel product", "2"]`	471.809 ns (5%)	768 bytes (1%)	5
`["operations", "channel product", "200"]`	3.322 ms (5%)	3.67 MiB (1%)	8
`["operations", "channel product", "50"]`	335.007 μs (5%)	236.27 KiB (1%)	8
`["operations", "partial trace", "10"]`	454.128 ns (5%)	2.89 KiB (1%)	2
`["operations", "partial trace", "100"]`	37.259 μs (5%)	308.12 KiB (1%)	3
`["operations", "partial trace", "2"]`	75.626 ns (5%)	176 bytes (1%)	2
`["operations", "partial trace", "200"]`	153.597 μs (5%)	1.21 MiB (1%)	3
`["operations", "partial trace", "50"]`	8.499 μs (5%)	75.98 KiB (1%)	3
`["operations", "tensor product", "10"]`	1.179 μs (5%)	13.02 KiB (1%)	2
`["operations", "tensor product", "100"]`	106.228 μs (5%)	1.22 MiB (1%)	3
`["operations", "tensor product", "2"]`	121.309 ns (5%)	704 bytes (1%)	2
`["operations", "tensor product", "200"]`	698.547 μs (5%)	4.89 MiB (1%)	3
`["operations", "tensor product", "50"]`	22.421 μs (5%)	314.31 KiB (1%)	3
`["operations", "unitary product", "10"]`	2.452 μs (5%)	6.94 KiB (1%)	4
`["operations", "unitary product", "100"]`	701.142 μs (5%)	628.62 KiB (1%)	6
`["operations", "unitary product", "2"]`	416.407 ns (5%)	576 bytes (1%)	4
`["operations", "unitary product", "200"]`	3.431 ms (5%)	2.45 MiB (1%)	6
`["operations", "unitary product", "50"]`	304.230 μs (5%)	158.09 KiB (1%)	6

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

["operations", "channel product"]
["operations", "partial trace"]
["operations", "tensor product"]
["operations", "unitary product"]

Julia versioninfo

Julia Version 1.10.7
Commit 4976d05258e (2024-11-26 15:57 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 24.04.1 LTS
 uname: Linux 6.8.0-1017-azure #20-Ubuntu SMP Tue Oct 22 03:43:13 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 3240 MHz 942 s 0 s 614 s 2333 s 0 s
 #2 3220 MHz 1040 s 0 s 519 s 2308 s 0 s
 #3 3244 MHz 1234 s 0 s 541 s 2141 s 0 s
 #4 3241 MHz 1003 s 0 s 380 s 2504 s 0 s
 Memory: 15.615280151367188 GB (14176.66015625 MB free)
 Uptime: 397.7 sec
 Load Avg: 1.72 1.22 0.57
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads	2
`BLAS.vendor()`	`lbt`
`Sys.CPU_THREADS`	4

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 48 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 4
On-line CPU(s) list: 0-3
Vendor ID: AuthenticAMD
Model name: AMD EPYC 7763 64-Core Processor
CPU family: 25
Model: 1
Thread(s) per core: 2
Core(s) per socket: 2
Socket(s): 1
Stepping: 1
BogoMIPS: 4890.85
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves user_shstk clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization: AMD-V
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 64 KiB (2 instances)
L1i cache: 64 KiB (2 instances)
L2 cache: 1 MiB (2 instances)
L3 cache: 32 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Not affected

Cpu Property	Value
Brand	AMD EPYC 7763 64-Core Processor
Vendor	:AMD
Architecture	:Unknown
Model	Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores	16 physical cores, 16 logical cores (on executing CPU)
	No Hyperthreading hardware capability detected
Clock Frequencies	Not supported by CPU
Data Cache	Level 1:3 : (32, 512, 32768) kbytes
	64 byte cache line size
Address Size	48 bits virtual, 48 bits physical
SIMD	256 bit = 32 byte max. SIMD vector size
Time Stamp Counter	TSC is accessible via `rdtsc`
	TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring	Performance Monitoring Counters (PMC) are not supported
Hypervisor	Yes, Microsoft

codecov · 2024-12-30T22:25:29Z

Codecov Report

All modified and coverable lines are covered by tests ✅

apkille added 2 commits December 30, 2024 17:17

decrease max nmode size in tests to 5

7796757

update changelog

ff064d6

apkille merged commit a120429 into main Dec 30, 2024
15 checks passed

apkille deleted the tests branch December 30, 2024 22:40

Decrease max nmode size in tests to 5 to further prevent numerical instabilities #26

Decrease max nmode size in tests to 5 to further prevent numerical instabilities #26

Conversation

apkille commented Dec 30, 2024 • edited Loading

github-actions bot commented Dec 30, 2024 • edited Loading

Judge result

Benchmark Report for /home/runner/work/Gabs.jl/Gabs.jl

Job Properties

Results

Benchmark Group List

Julia versioninfo

Target

Baseline

Target result

Benchmark Report for /home/runner/work/Gabs.jl/Gabs.jl

Job Properties

Results

Benchmark Group List

Julia versioninfo

Baseline result

Benchmark Report for /home/runner/work/Gabs.jl/Gabs.jl

Job Properties

Results

Benchmark Group List

Julia versioninfo

Runtime information

Judge result

Benchmark Report for /home/runner/work/Gabs.jl/Gabs.jl

Job Properties

Results

Benchmark Group List

Julia versioninfo

Target

Baseline

Target result

Benchmark Report for /home/runner/work/Gabs.jl/Gabs.jl

Job Properties

Results

Benchmark Group List

Julia versioninfo

Baseline result

Benchmark Report for /home/runner/work/Gabs.jl/Gabs.jl

Job Properties

Results

Benchmark Group List

Julia versioninfo

Runtime information

codecov bot commented Dec 30, 2024

Codecov Report

Decrease max `nmode` size in tests to 5 to further prevent numerical instabilities #26

Decrease max `nmode` size in tests to 5 to further prevent numerical instabilities #26

apkille commented Dec 30, 2024 •

edited

Loading

github-actions bot commented Dec 30, 2024 •

edited

Loading