NTransformer β€” Neuratal's open-source PyTorch Transformer

NTransformer is not a pretrained model; this page documents the project, not model weights.

NTransformer is an independently developed, PyTorch-based, decoder-only Transformer research/engineering framework by Neuratal (https://neuratal.com).

What it is

A research/engineering framework covering architecture, inference, training, and checkpointing β€” everything you need to train, evaluate and iterate on a decoder-only Transformer without vendoring a tokenizer, model hub, or hosted inference service. NTransformer is not a pretrained model; no trained weights are distributed. No quality claims are made. Use as a research tool, not as a production ML stack.

  • Architecture block: decoder-only pre-norm; GQA, RoPE, SwiGLU, RMSNorm, factorized tied embeddings β€” all LLaMA-style.
  • Long-context paths for 16K/32K sequences with gradient checkpointing.
  • Tested: 460 tests, real release, honest release notes.

Why this is here

NTransformer needs a presence on Hugging Face so that the project card, tags and references live where serious ML practitioners browse. This page intentionally does not host a model; it points to the open-source repository.

Links

Limitations (honest)

  • No trained weights.
  • Not production support; research-oriented.
  • Multi-GPU/NCCL not verified on the development hardware.
  • Benchmarks are development-machine numbers; do not treat as broad-hardware measurements.
Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support