Data Science Wire

Pretraining nanoGPT with LanceDB

LanceDB Blog1d4 min read

Training a GPT-2-like model from raw text in 25 minutes with LanceDB, using one table for curation, tokenization, shuffling, packing, training, and analysis.

Read the full story at LanceDB Blog

More in MLOps / LLMOps