exp: N=16 timing closure fixed (EXP-0056), weight-reuse gives real 7.16x memory speedup without DDR3 (EXP-0057)
EXP-0056: N_SLOTS=16 failed timing on LFE5U-85F (23-24MHz vs 64MHz
target). First hypothesis (dependency_manager.v's serial ready-scan)
was wrong but real -- built and verified priority_encoder_lsb.v (a
generic recursive tree encoder) and dependency_manager_fast.v, bit-
exact equivalent to the original, but integrated it made no real
difference (24.26MHz). The real cause, found from nextpnr's own
critical-path report: nms_activation_fill_ctrl_v3.v's balanced max-
tree was only ever extended to N_SLOTS in {1,2,4,8}, silently falling
back to the original slow scan for 16. Added the missing case
(nms_activation_fill_ctrl_v3_n16.v), verified isolated (10017/10017)
and functionally (D-Stress N=16 still 256/256 bit-exact). Real result:
71.01MHz, PASS at 64MHz (single seed so far).
EXP-0057: built layer_weight_buffer.v, a double-buffered per-layer
weight scratchpad (fill one buffer in the background from SDRAM while
compute reads many times from the other -- weight-stationary reuse,
as opposed to D-Stress's own deliberately zero-reuse pattern). Wired
to the real sdram_controller_openrow.v + sdram_model.v, no new
hardware. For the same 32768 bytes of useful data: zero-reuse costs
27048 real cycles, reuse costs 3777 -- 7.16x real measured speedup on
the SAME SDR SDRAM, no DDR3, no clock change. This is the answer to
whether DDR3 is necessary for a workload class that actually has
reuse (e.g. conv-style face recognition, unlike D-Stress) -- it isn't,
at least not for this reason.
Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01MUG92aM9m68TRc4rG55BcC
This commit is contained in:
@@ -0,0 +1,70 @@
|
||||
`timescale 1ns/1ps
|
||||
|
||||
// ============================================================
|
||||
// EXP-0056 -- generic, recursive binary-tree priority encoder
|
||||
// (lowest-set-bit wins), O(log2(WIDTH)) depth.
|
||||
//
|
||||
// MOTIVATION: dependency_manager.v's own first_ready_idx scan (a
|
||||
// serial for-loop overwriting a register variable across up to
|
||||
// N_NODES=1024 iterations) is the SAME architectural anti-pattern
|
||||
// already found and fixed twice elsewhere in this project (ERR-0027,
|
||||
// neural_director.v's free-slot scan; ERR-0028, activation_fill_
|
||||
// ctrl's max-tree; ERR-0029, sdram_unified_backend.v's W-cache hit-
|
||||
// index) -- a data-dependent sequential overwrite that forces a
|
||||
// SERIAL dependency chain across every iteration, even though the
|
||||
// result does not logically require one. Those three fixes used a
|
||||
// flat one-hot compare + single-level casez priority-encode, correct
|
||||
// and efficient for their own small widths (4-8 entries). N_NODES can
|
||||
// be up to 1024 in this project's own real configs -- a single flat
|
||||
// casez at that width is impractical to hand-write and not guaranteed
|
||||
// to synthesize as a balanced tree. This module generalizes the SAME
|
||||
// underlying principle (no serial dependency chain) to arbitrary
|
||||
// width via recursive halving: each half is encoded independently
|
||||
// and in parallel (no dependency between them), and only the FINAL
|
||||
// combine step (low_valid ? low_result : high_result) depends on
|
||||
// both halves -- giving real O(log2(WIDTH)) depth instead of O(WIDTH).
|
||||
//
|
||||
// Semantics: idx = index of the LOWEST set bit in `in` (bit 0 has
|
||||
// highest priority), valid = |in. This matches dependency_manager.v's
|
||||
// own original scan exactly: it iterates ri from N_NODES-1 DOWN TO 0,
|
||||
// unconditionally overwriting first_ready_idx on every match -- the
|
||||
// LAST (i.e. lowest-index) match therefore wins, not the first one
|
||||
// found during the loop's own execution order.
|
||||
// ============================================================
|
||||
module priority_encoder_lsb #(
|
||||
parameter WIDTH = 16,
|
||||
parameter IDXW = (WIDTH <= 1) ? 1 : $clog2(WIDTH)
|
||||
)(
|
||||
input wire [WIDTH-1:0] in,
|
||||
output wire [IDXW-1:0] idx,
|
||||
output wire valid
|
||||
);
|
||||
generate
|
||||
if (WIDTH <= 1) begin : GEN_BASE
|
||||
assign valid = in[0];
|
||||
assign idx = {IDXW{1'b0}};
|
||||
end else begin : GEN_SPLIT
|
||||
localparam LOW_W = WIDTH/2;
|
||||
localparam HIGH_W = WIDTH - LOW_W;
|
||||
localparam LOW_IDXW = (LOW_W <= 1) ? 1 : $clog2(LOW_W);
|
||||
localparam HIGH_IDXW = (HIGH_W <= 1) ? 1 : $clog2(HIGH_W);
|
||||
|
||||
wire [LOW_IDXW-1:0] low_idx;
|
||||
wire low_valid;
|
||||
wire [HIGH_IDXW-1:0] high_idx;
|
||||
wire high_valid;
|
||||
|
||||
priority_encoder_lsb #(.WIDTH(LOW_W)) u_low (
|
||||
.in(in[LOW_W-1:0]), .idx(low_idx), .valid(low_valid)
|
||||
);
|
||||
priority_encoder_lsb #(.WIDTH(HIGH_W)) u_high (
|
||||
.in(in[WIDTH-1:LOW_W]), .idx(high_idx), .valid(high_valid)
|
||||
);
|
||||
|
||||
assign valid = low_valid | high_valid;
|
||||
assign idx = low_valid
|
||||
? {{(IDXW-LOW_IDXW){1'b0}}, low_idx}
|
||||
: ({{(IDXW-HIGH_IDXW){1'b0}}, high_idx} + LOW_W[IDXW-1:0]);
|
||||
end
|
||||
endgenerate
|
||||
endmodule
|
||||
Reference in New Issue
Block a user