Model · falcon-7b-instruct

falcon-7b-instruct

Developer: Technology Innovation Institute (TII)
Availability: available · checked 2026-09-24 · source

Raw record: /data/models/falcon-7b-instruct.json

Fields

id

falcon-7b-instruct

identifiers

huggingface

tiiuae/falcon-7b-instruct

developer

Technology Innovation Institute (TII)

release_date

2023-04-25partial · source

note:  HF repo creation date; may predate or postdate public release.

weights_status

open

availability

available · checked 2026-09-24 · source

license

apache-2.0partial · source

note:  From HF card metadata (uploader-declared); confirm against the license text.

architecture

family

decoder_only

note

family read from config 'architectures': ['FalconForCausalLM'].

n_layers

32recorded · source

hidden_size

4544recorded · source

n_heads

71recorded · source

vocab_size

65024recorded · source

context_length

nullnot_recorded

n_kv_heads

1recorded · source

note:  config multi_query: true

positional_encoding

rotary (RoPE)recorded · source

note:  Architecture unchanged from falcon-7b (instruction fine-tune).

training_data

250M tokens: Baize (65%, chat), GPT4All (25%, instruct), GPTeacher (5%, instruct), RefinedWeb-English (5%, web).recorded · source

techniques

primary_sources

https://huggingface.co/tiiuae/falcon-7b-instruct

https://huggingface.co/tiiuae/falcon-7b-instruct/raw/8782b5c5d8c9290412416618f36a133653e85285/config.json

record_history

date:2026-09-24 · change:ingested as candidate from HF (tiiuae/falcon-7b-instruct@8782b5c5d8c9290412416618f36a133653e85285) · by:ingest_hf.py ·

date:2026-09-24 · change:preparer: developer, fine_tuned_from falcon-7b, trained_on refinedweb, training_data filled · by:claude (preparer, Sonnet 5) ·

date:2026-09-24 · change:preparer: deduplicated refinedweb edge (ingest had already resolved it) · by:claude (preparer, Sonnet 5) ·

date:2026-09-24 · change:preparer cleanup: removed 2 stale flag(s) · by:claude (preparer, Sonnet 5) ·

date:2026-09-24 · change:preparer cleanup: positional_encoding propagated from an unchanged parent architecture · by:claude (preparer, Sonnet 5) ·

date:2026-09-24 · change:reviewed and promoted from staging (2 edge(s) accepted) · by:Wilson Pruitt ·

Parents

Weights descend

• fine_tuned_from → Falcon 7B declared source Card: 'built by TII based on Falcon-7B and finetuned on a mixture of chat/instruct datasets.'

Training data

• trained_on → RefinedWeb declared_by_uploader source Card: RefinedWeb-English is 5% (13M of 250M) of the fine-tuning mix.

Children

No edges recorded.

Read in

No station on the reading path has touched this record yet.