Skip to content

AvijitChowdhury/A-Mini-GPT-Model-From-Scratch-Using-PyTorch

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 

Repository files navigation

#How LLMs like GPT work

#Understanding the probability formula behind next-word prediction

#Creating your text dataset

#Tokenizing words into numerical IDs

#Building the model architecture in PyTorch

#Training the mini GPT

#Making predictions with your trained model

About

Mini GPT Language Model from scratch using PyTorch! This is a beginner-friendly, step-by-step implementation of a tiny language model that learns to predict the next word, just like how GPT and other Large Language Models work internally.

Resources

License

Stars

0 stars

Watchers

0 watching

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages