#Gpt-2
Showing 52 of 52 repositories tagged #gpt-2, ranked by stars
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.
Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
AI Code Completions
[NeurIPS 2024 Best Paper Award][GPT beats diffusion๐ฅ] [scaling laws in visual generation๐] Official impl. of "Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction". An *ultra-simple, user-friendly yet state-of-the-art* codebase for autoregressive image generation!
An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.
Chinese version of GPT2 training code, using BERT tokenizer.
Awesome Pretrained Chinese NLP Models๏ผ้ซ่ดจ้ไธญๆ้ข่ฎญ็ปๆจกๅ&ๅคงๆจกๅ&ๅคๆจกๆๆจกๅ&ๅคง่ฏญ่จๆจกๅ้ๅ
An unnecessarily tiny implementation of GPT-2 in NumPy.
Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)
Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6
Large-scale pretraining for dialogue
Toolkit for Machine Learning, Natural Language Processing, and Text Generation, in TensorFlow. This is part of the CASL project: http://casl-project.ai/
Kashgari is a production-level NLP Transfer learning framework built on top of tf.keras for text-labeling and text-classification, includes Word2Vec, BERT, and GPT2 Language Embedding.
Simple UI for LLM Model Finetuning
llama and other large language models on iOS and MacOS offline using GGML library.
Guide to using pre-trained large language models of source code
๐ฆ State-of-the-Art Conversational AI with Transfer Learning
Visual Studio Code client for Tabnine. https://marketplace.visualstudio.com/items?itemName=TabNine.tabnine-vscode
๐ธ Use pretrained transformers like BERT, XLNet and GPT-2 in spaCy
This series will take you on a journey from the fundamentals of NLP and Computer Vision to the cutting edge of Vision-Language Models.
A curated list of NLP resources focused on Transformer networks, attention mechanism, GPT, BERT, ChatGPT, LLMs, and transfer learning.
The fastest JavaScript BPE Tokenizer Encoder Decoder for OpenAI's GPT models (gpt-5, gpt-o*, gpt-4o, etc.). Port of OpenAI's tiktoken with additional features.
Integrating the Best of TF into PyTorch, for Machine Learning, Natural Language Processing, and Text Generation. This is part of the CASL project: http://casl-project.ai/
Medical Q&A with Deep Language Models
Implementation of ChatGPT RLHF (Reinforcement Learning with Human Feedback) on any generation model in huggingface's transformer (blommz-176B/bloom/gpt/bart/T5/MetaICL)
Jetbrains IDEs client for TabNine. Compatible with all IntelliJ-based IDEs. https://plugins.jetbrains.com/plugin/12798-tabnine
Annotations of the interesting ML papers I read
Tabnine Autocomplete AI: JavaScript, Python, TypeScript, PHP, C/C++, HTML/CSS, Go, Java, Ruby, C#, Rust, SQL, Bash, Kotlin, Julia, Lua, OCaml, Perl, Haskell, React
Xcode client for TabNine.
Generating paper titles (and more!) with GPT trained on data scraped from arXiv.
AI classifier for indicating AI-written text
Deepstory turns a text/generated text into a video where the character is animated to speak your story using his/her voice.
lm-scratch-pytorch - The code is designed to be beginner-friendly, with a focus on understanding the fundamentals of PyTorch and implementing LLMs from scratch,step by step.
Visual Studio client for TabNine.
Galois is an auto code completer for code editors (or any text editor) based on OpenAI GPT-2.
This repo contains all the notebooks mentioned in blog.
Go BPE tokenizer (Encoder+Decoder) for GPT2 and GPT3
nanogpt turned into a chat model
โจ Make your LLM prompts executable and version controlled. โจ
Password cracking research using the Have I Been Pwned (HIBP) dataset to evaluate the effectiveness of the PassGPT Large Language Model (LLM).
Interact with ChatGPT and Bard at the terminal.
OpenAI chatbot for Telegram using GPT-3.
NameKrea is an AI Domain Name Generator which uses GPT-2
Build production ready apps for GPT using Node.js & TypeScript
Script Buddy v2 is a film script text generation tool built using film scripts from the world's most popular film scripts and GPT2.
The original transformer implementation from scratch. It contains informative comments on each block
This repository will guide you to create ChatGPT like chatbot using OpenAI's GPT 3.5 model
[ACL 2023] Code for ContraCLM: Contrastive Learning For Causal Language Model
A GPT-2-class language model trained from scratch on OpenWebText with the intent to augment AI Transformer-model education and reverse engineer GPT models from scratch.
DrugGen: Advancing Drug Discovery with Large Language Models and Reinforcement Learning Feedback
GPT-based protein language model for PTM site prediction
Implementation of build a LLM from scratch by Sebastian Raschka.