perf(v2): word-level burst reads - 2.24-2.37x real wall-clock speedup (DEC-0015)

Implements optimization #1 from the final benchmark campaign's own
recommendation: exploit psram_controller.v's already-implemented
page-mode support (confirmed present by direct inspection) by
fetching multiple bytes per real backend transaction instead of one
at a time.

Root cause addressed: int8_memory_access.v (the byte-level backend
prefetch_engine.v originally sat on) already converts every 8-bit
logical request into a full 16-bit PSRAM word access internally
(mem_addr <= addr >> 1), discarding half of every word it already
paid for. prefetch_engine.v/memory_manager.v now speak
memory_interface.v's own 16-bit word protocol directly, bypassing
int8_memory_access.v entirely - which remains untouched, still frozen
V1 (§1/§34); V2 simply reuses the lower layer of the same frozen
chain instead of the byte-splitting layer on top of it, the same
"reuse what fits" precedent slot_mem_arbiter.v already set.
slot_mem_arbiter.v and neural_multiprocessor.v widened to match
(lb_n/ub_n added, master port wired directly to memory_interface.v).

Real, measured results: M4's own single-job testbench shows 49-56%
fewer cycles (166->84, 446->204, 728->322, all still bit-exact). The
full final-benchmark campaign (24/24 workload/config combinations)
re-verified bit-exact with D-Stress's real wall-clock time (cycles /
real POST-P&R Fmax) improving 2.24-2.37x across every N_SLOTS tested,
against a small real Fmax cost (unchanged at N=1, -6.2% at N=2, -1.2%
at N=4).

tb_neural_multiprocessor.v (M8) and tb_benchmark_suite.v (final
campaign) needed zero changes - both treat neural_multiprocessor.v as
a black box. Only tb_memory_manager.v (M4, rewired to skip
int8_memory_access.v) and tb_dataflow_core.v (M7, behavioral model
widened to word-level) needed updates.

The "real parallel scaling is flat beyond N_SLOTS=2" finding (DEC-0014)
still holds - this optimization made the shared PSRAM port more
efficient per transaction, not multi-ported - so N_SLOTS=2 remains
the recommended default.

Logged: simulation/synthesis/timing/benchmark/decisions (DEC-0015)/
experiments (EXP-0015)/development.log.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_013xXuuRUWZScuo1DeYJxs3v
This commit is contained in:
2026-09-05 20:35:19 +02:00
co-authored by Claude Sonnet 5
parent 3cdaeaee35
commit e4a5540b6e
14 changed files with 489 additions and 168 deletions
+80
View File
@@ -857,3 +857,83 @@ future memory-bandwidth-scaling architecture change.
STATUS:
ACCEPTED
DEC-0015
DATE: 2026-09-05
DECISION:
prefetch_engine.v/memory_manager.v's own Memory Backend Interface is
changed from byte-level (matching hardware/v1/rtl/int8_memory_access.v's
contract, one 8-bit logical transaction per real backend round-trip)
to WORD-level (matching hardware/v1/rtl/memory_interface.v's own
16-bit contract directly, one transaction moving 2 consecutive bytes).
neural_multiprocessor.v no longer instantiates int8_memory_access.v --
the arbiter's master port connects directly to memory_interface.v.
slot_mem_arbiter.v's own per-port data width and lb_n/ub_n signals are
widened to match.
WHY (user-requested, directly following the M9/M10 benchmark
campaign's own finding that the system is memory-bound -- see the
final-benchmark.md report's recommendation #1): int8_memory_access.v
ALREADY converts every 8-bit logical request into a FULL 16-bit
PSRAM word access internally (`mem_addr <= addr >> 1`, one byte lane
selected via lb_n/ub_n) -- so fetching X/W tile arrays one byte at a
time was ALREADY paying for two bytes of real PSRAM bandwidth per
transaction while discarding half of it, and paying int8_memory_access's
own STATE_IDLE/STATE_WAIT round-trip TWICE for every 2 real bytes
instead of once. hardware/v1/rtl/psram_controller.v's own real
page-mode support (already implemented, unmodified, confirmed present
by direct inspection) then has fewer, more effective opportunities to
serve consecutive words fast once transactions are batched this way.
int8_memory_access.v/memory_interface.v/psram_controller.v are all
frozen V1 files and remain byte-for-byte unmodified (§1/§34) --
V2 simply chooses to reuse the lower (word-level) layer of that same
frozen chain directly instead of the byte-splitting layer on top of
it, the same "reuse what fits" precedent slot_mem_arbiter.v already
set by not reusing hardware/v1/rtl/mem_arbiter.v verbatim.
EVIDENCE (real, measured, before/after -- see experiments.log EXP-0015
for full detail): hardware/v2/sim/tb_memory_manager.v (M4, real V1
PSRAM chain): 3-tile job 446->204 cycles (-54%), 1-tile 166->84
(-49%), 5-tile 728->322 (-56%), all still bit-exact. Full campaign
(tb_benchmark_suite.v, EXP-0014's own workloads) re-run at N_SLOTS=
1/2/4/8: D-Stress real wall-clock (cycles / real POST-P&R Fmax)
improves 2.24-2.37x across every N_SLOTS tested, all 24/24 workload/
config combinations still bit-exact. Real Fmax cost is small (N=1:
152.46->152.44 MHz, unchanged; N=2: 142.45->133.58 MHz, -6.2%; N=4:
113.38->112.07 MHz, -1.2%) -- overwhelmingly a net win in real
wall-clock terms at every N_SLOTS.
CONSTRAINT introduced: P_IN must be even (already true, P_IN=8), and
tile base addresses (x_base/w_base, and therefore every x_base +
tile_idx*P_IN the system ever computes) must be word-aligned (even
byte addresses) -- true of every address this project's own
testbenches already use, and a trivial constraint for any real
loader/host to satisfy (place tile arrays at even byte offsets).
ALTERNATIVES:
1. Modify int8_memory_access.v itself to return/accept 2 bytes per
logical transaction. Rejected: that file is frozen V1 (§1/§34) --
never modified, regardless of how small the change would be.
2. Build a NEW byte-level burst wrapper on top of int8_memory_access.v
(queue N byte requests, pipeline them). Rejected: int8_memory_access's
own STATE_IDLE only samples a new req once back in STATE_IDLE after
the previous transaction's mem_ready -- it fundamentally does not
support pipelining/overlapped requests, so no wrapper on TOP of it
can avoid paying its full per-byte round-trip cost twice per word.
Only bypassing it (going one layer lower, to memory_interface.v's
own native word interface) actually eliminates the redundant
round-trip.
RESULT:
prefetch_engine.v/memory_manager.v/slot_mem_arbiter.v/
neural_multiprocessor.v now speak a word-level (16-bit + lb_n/ub_n)
Memory Backend Interface, bypassing int8_memory_access.v entirely
(still frozen, still reused unmodified -- just one layer lower in the
same frozen stack). Real, measured 2.24-2.37x wall-clock improvement
at every N_SLOTS tested, negligible real Fmax cost, all functional
correctness preserved (24/24 bit-exact).
STATUS:
ACCEPTED