Model · falcon-40b-instruct
falcon-40b-instruct
Developer: Technology Innovation Institute (TII)
Availability: available · checked 2026-09-24 · source
Raw record: /data/models/falcon-40b-instruct.json
Fields
- id
- falcon-40b-instruct
- identifiers
- huggingface
- tiiuae/falcon-40b-instruct
- developer
- Technology Innovation Institute (TII)
- release_date
- 2023-05-25partial · sourcenote: HF repo creation date; may predate or postdate public release.
- weights_status
- open
- availability
- available · checked 2026-09-24 · source
- license
- apache-2.0partial · sourcenote: From HF card metadata (uploader-declared); confirm against the license text.
- architecture
- family
- decoder_only
- note
- family read from config 'architectures': ['FalconForCausalLM'].
- n_layers
- 60recorded · source
- hidden_size
- 8192recorded · source
- n_heads
- 128recorded · source
- vocab_size
- 65024recorded · source
- context_length
- nullnot_recorded
- positional_encoding
- rotary (RoPE)recorded · sourcenote: Architecture unchanged from falcon-40b (instruction fine-tune).
- training_data
- 150M tokens from Baize mixed with 5% RefinedWeb data.recorded · source
- techniques
- primary_sources
- record_history
- date:2026-09-24 · change:ingested as candidate from HF (tiiuae/falcon-40b-instruct@ecb78d97ac356d098e79f0db222c9ce7c5d9ee5f) · by:ingest_hf.py ·date:2026-09-24 · change:preparer: developer, fine_tuned_from falcon-40b, trained_on refinedweb, training_data filled · by:claude (preparer, Sonnet 5) ·date:2026-09-24 · change:preparer: deduplicated refinedweb edge (ingest had already resolved it) · by:claude (preparer, Sonnet 5) ·date:2026-09-24 · change:preparer cleanup: removed 3 stale flag(s) · by:claude (preparer, Sonnet 5) ·date:2026-09-24 · change:preparer cleanup: positional_encoding propagated from an unchanged parent architecture · by:claude (preparer, Sonnet 5) ·date:2026-09-24 · change:reviewed and promoted from staging (2 edge(s) accepted) · by:Wilson Pruitt ·
Parents
Weights descend
- fine_tuned_from → falcon-40b declared source Card: 'Finetuned from model: Falcon-40B'.
Training data
- trained_on → RefinedWeb declared_by_uploader source Card: '150M tokens from Baize mixed with 5% of RefinedWeb data.'
Children
No edges recorded.
Read in
No station on the reading path has touched this record yet.