feat(v2): scaffold hardware/v1 frozen baseline + M1 Neural Processor
Begins the V2 Neural Multiprocessor / Dataflow architecture per docs/v2-description.md, per explicit user request to freeze V1 and start V2 development, copying from V1 what's needed. Scaffold: - hardware/v1/: byte-exact, read-only copy of the current V1 codebase (rtl, testbenches, tools, constraints, a representative subset of synthesis results, and reference docs) -- verified identical via diff/cmp against the live top-level tree before being made filesystem-read-only. The live top-level tree is untouched and remains the project's "production" V1 (see hardware/v1/README.md and hardware/v2/logs/decisions.log DEC-0001 for why copy-not-move). - hardware/v2/: mandatory structure (rtl/sim/constraints/synthesis/ reports/scripts/logs/docs) plus the full logging system required by the spec (development/architecture/simulation/synthesis/timing/ benchmark/decisions/experiments/errors.log). M1 -- Neural Processor (hardware/v2/rtl/neural_processor.v): - 8-stage pipelined perceptron unit (P_IN=8): input align, 8 multipliers, 3-level adder tree, accumulator, bias+activation, INT8 saturation. Genuine 1-tile/cycle throughput, not just a wider combinational datapath. - 7-state FSM (NP_IDLE..NP_ERROR per docs/v2-description.md §6, with 4 baseline states merged into NP_WAIT_OPERANDS -- see decisions.log DEC-0002); valid/ready/data/last stream interfaces per §7. - Bit-exact vs the frozen hardware/v1/rtl/neuron_parallel.v + mac8.v + mac_unit.v: 7/7 tests pass (hardware/v2/sim/tb_neural_processor.v), covering regular/mixed-sign/extreme-INT8 vectors, both activations, a zero-idle-gap back-to-back-tiles throughput check, and an 8-tile job -- verified with Verilator (see below for why). - Real synthesis + place&route (Yosys + nextpnr-ecp5): 0 CHECK problems, Fmax 183.12 MHz at ACC_WIDTH=32 (PASS at 80MHz, ~3x V1's isolated PARALLEL=8 Fmax of 61.71 MHz) and 176.21 MHz at ACC_WIDTH=24 (a user-requested comparison experiment, also bit-exact-verified; see experiments.log EXP-0001/EXP-0002 and benchmark.log). Three real bugs found and resolved during M1 development (full diagnostic record in errors.log): - Two independent, reproducible Icarus Verilog v13.0 scheduling defects (ERR-0001, ERR-0002) that silently produced wrong simulation results for standard sequential Verilog -- confirmed via Verilator 5.050 giving correct results on the same minimal repros. Verilator is now the trusted simulator for hardware/v2/ (decisions.log DEC-0004); Icarus's affected protocol-violation check was removed from the RTL and deferred architecturally to the Neural Director (DEC-0003) rather than chased further. - One real RTL bug (ERR-0003): last0 wasn't gated like valid0, letting a "last tile" tag leak into the pipeline ahead of its actual valid tile on back-to-back jobs. Fixed and verified. Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_013xXuuRUWZScuo1DeYJxs3v
This commit is contained in:
@@ -0,0 +1,120 @@
|
||||
#!/usr/bin/env python3
|
||||
"""
|
||||
netasm CLI: compiles a .netasm source file (see parser.py's docstring
|
||||
for the grammar) into an SPI load sequence + human-readable debug
|
||||
dump. Host-side tool only -- see rtl/graph_engine.v / spi_engine.v
|
||||
for the hardware side of this protocol.
|
||||
|
||||
Usage:
|
||||
python3 -m tools.netasm.cli input.netasm -o out_prefix \\
|
||||
[--parallel 8] [--max-conn 32] [--n-total 4096]
|
||||
|
||||
Produces:
|
||||
out_prefix.frames.bin -- length-prefixed SPI transaction bytes
|
||||
out_prefix.debug.txt -- human-readable id/address/byte dump
|
||||
"""
|
||||
|
||||
from __future__ import annotations
|
||||
|
||||
import argparse
|
||||
import sys
|
||||
|
||||
try:
|
||||
from . import frames as F
|
||||
from .assembler import (
|
||||
NetasmError,
|
||||
assemble_dense,
|
||||
assemble_graph,
|
||||
dump_dense_debug,
|
||||
dump_graph_debug,
|
||||
)
|
||||
from .parser import DenseNet, GraphNet, NetasmSyntaxError, parse
|
||||
except ImportError:
|
||||
# Allow running this file directly (`python3 tools/netasm/cli.py`)
|
||||
# without the package being importable as `tools.netasm` -- e.g.
|
||||
# an unrelated `tools` namespace package earlier on PYTHONPATH
|
||||
# shadowing this repo's tools/ directory.
|
||||
import os
|
||||
import sys
|
||||
sys.path.insert(0, os.path.dirname(os.path.abspath(__file__)))
|
||||
import frames as F
|
||||
from assembler import (
|
||||
NetasmError,
|
||||
assemble_dense,
|
||||
assemble_graph,
|
||||
dump_dense_debug,
|
||||
dump_graph_debug,
|
||||
)
|
||||
from parser import DenseNet, GraphNet, NetasmSyntaxError, parse
|
||||
|
||||
|
||||
def main(argv=None) -> int:
|
||||
ap = argparse.ArgumentParser(description=__doc__)
|
||||
ap.add_argument("source", help="path to a .netasm source file")
|
||||
ap.add_argument("-o", "--output", required=True, help="output file prefix")
|
||||
ap.add_argument("--parallel", type=int, default=8, help="hardware PARALLEL (default 8)")
|
||||
ap.add_argument("--max-conn", type=int, default=32, help="graph_engine's MAX_CONN (default 32)")
|
||||
ap.add_argument("--n-total", type=int, default=4096, help="graph_engine's N_TOTAL (default 4096)")
|
||||
ap.add_argument("--table-base", type=lambda s: int(s, 0), default=0x000000)
|
||||
ap.add_argument("--edges-base", type=lambda s: int(s, 0), default=0x010000)
|
||||
ap.add_argument("--x-base", type=lambda s: int(s, 0), default=0x000000)
|
||||
ap.add_argument("--out-base", type=lambda s: int(s, 0), default=0x020000,
|
||||
help="graph out_base / dense buf_a_base")
|
||||
ap.add_argument("--buf-b-base", type=lambda s: int(s, 0), default=0x021000,
|
||||
help="dense buf_b_base only")
|
||||
ap.add_argument("--weights-base", type=lambda s: int(s, 0), default=0x010000,
|
||||
help="dense weight/bias region base")
|
||||
args = ap.parse_args(argv)
|
||||
|
||||
with open(args.source, "r") as f:
|
||||
text = f.read()
|
||||
|
||||
try:
|
||||
net = parse(text)
|
||||
except NetasmSyntaxError as e:
|
||||
print(f"{args.source}: syntax error: {e}", file=sys.stderr)
|
||||
return 1
|
||||
|
||||
try:
|
||||
if isinstance(net, GraphNet):
|
||||
layout = assemble_graph(
|
||||
net,
|
||||
parallel=args.parallel,
|
||||
max_conn=args.max_conn,
|
||||
n_total=args.n_total,
|
||||
table_base=args.table_base,
|
||||
edges_base=args.edges_base,
|
||||
x_base=args.x_base,
|
||||
out_base=args.out_base,
|
||||
)
|
||||
debug = dump_graph_debug(layout)
|
||||
frames = layout.frames
|
||||
else:
|
||||
assert isinstance(net, DenseNet)
|
||||
layout = assemble_dense(
|
||||
net,
|
||||
parallel=args.parallel,
|
||||
table_base=args.table_base,
|
||||
weights_base=args.weights_base,
|
||||
x_base=args.x_base,
|
||||
buf_a_base=args.out_base,
|
||||
buf_b_base=args.buf_b_base,
|
||||
)
|
||||
debug = dump_dense_debug(layout)
|
||||
frames = layout.frames
|
||||
except NetasmError as e:
|
||||
print(f"{args.source}: assembly error: {e}", file=sys.stderr)
|
||||
return 1
|
||||
|
||||
F.dump_frames(frames, args.output + ".frames.bin")
|
||||
with open(args.output + ".debug.txt", "w") as f:
|
||||
f.write(debug + "\n")
|
||||
|
||||
print(f"wrote {args.output}.frames.bin ({sum(len(fr.data) for fr in frames)} payload bytes, "
|
||||
f"{len(frames)} SPI transactions)")
|
||||
print(f"wrote {args.output}.debug.txt")
|
||||
return 0
|
||||
|
||||
|
||||
if __name__ == "__main__":
|
||||
sys.exit(main())
|
||||
Reference in New Issue
Block a user