Tabby-Prompt โ€” seed 42, inference mask 128

This optional prompt-only package contains the 25 prompt tensors for the frozen Tabby-Pretrain backbone at pretraining step 165,000. The prompt has 160 tokens, uses segmented context-aware conditioning, and was selected at epoch 14 (val_loss=2.0483945271).

The earlier tabby_prompt_plen160_seed4.pt remains in this repository for historical reproducibility. Use tabby_prompt_plen160_seed42_mask128.pt for the current release.

tabby_prompt_plen160_seed42_mask128.pt has identical tensor values to the supplied seed-42 checkpoint_best.pt. Its inference config sets min_forecast_span=128, making the existing TabbyTSFM GIFT-Eval and TIME prompt evaluators mask max(H, 128) positions and score the first H. The original training setting was min_forecast_span=0, retained as training_min_forecast_span=0 for provenance. The internal pretraining path was replaced with the public backbone reference.

The full, independently loadable backbone-plus-prompt release is the Tabby model package. This prompt-only file is for reproducing evaluations through TabbyTSFM or for prompt research.

For GIFT-Eval, use --mode prompt --ckpt tabby_prompt_plen160_seed42_mask128.pt --pretrain_ckpt <Tabby-Pretrain snapshot> --context_length 8096 --precision bf16 with benchmarks/forecasting/gift_eval/evaluate.py. For TIME, use the same checkpoint and backbone with benchmarks/forecasting/time/evaluate.py --mode prompt --context_length 8096 and the official TIME data. The checkpoint's 128 setting is read automatically in prompt mode.

The GIFT-Eval 97-configuration Seasonal-Naive-normalized geometric means are MASE 0.6880 and CRPS 0.4758 under this inference protocol. Prompt post-training used GIFT-Eval training tasks.

License: CC BY-NC 4.0.

Downloads last month
353
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support