Model · stablelm-base-alpha-7b

stablelm-base-alpha-7b

Developer: Stability AI
Availability: available · checked 2026-09-24 · source

Raw record: /data/models/stablelm-base-alpha-7b.json

Fields

identifiers

huggingface: stabilityai/stablelm-base-alpha-7b

developer

Stability AI

release_date

2023-04-11partial · source

note: HF repo creation date; may predate or postdate public release.

weights_status

open

availability

available · checked 2026-09-24 · source

license

CC BY-SA-4.0recorded · source

architecture

family: decoder_only
note: family read from config 'architectures': ['GPTNeoXForCausalLM'].
n_layers: 16recorded · source
hidden_size: 6144recorded · source
n_heads: 48recorded · source
vocab_size: 50432recorded · source
context_length: 4096recorded · source
positional_encoding: nullnot_recorded

training_data

~1.5T tokens: 'a new experimental dataset built atop The Pile', described as roughly 3x the size of the Pile itself.recorded · source

techniques

primary_sources

https://huggingface.co/stabilityai/stablelm-base-alpha-7b

https://huggingface.co/stabilityai/stablelm-base-alpha-7b/raw/1d43a3b40d7d708d8084d07dfae0c4e9fd95c04f/config.json

record_history

date:2026-09-24 · change:ingested as candidate from HF (stabilityai/stablelm-base-alpha-7b@1d43a3b40d7d708d8084d07dfae0c4e9fd95c04f) · by:ingest_hf.py ·

date:2026-09-24 · change:preparer: developer, license, training_data filled; layer count flagged for reconciliation · by:claude (preparer, Sonnet 5) ·

date:2026-09-24 · change:preparer cleanup: removed 2 stale flag(s) · by:claude (preparer, Sonnet 5) ·

date:2026-09-24 · change:reviewed and promoted from staging (0 edge(s) accepted) · by:Wilson Pruitt ·

Parents

No edges recorded.

Children

Weights descend

← fine_tuned_from StableLM-Tuned-Alpha-7B declared source Card: 'a suite of 3B and 7B parameter decoder-only language models built on top of the StableLM-Base-Alpha models and further fine-tuned on various chat and instruction-following datasets.' Same layer/hidden/head/context values as the base record.

Read in

No station on the reading path has touched this record yet.