#Bert
Showing 60 of 136 repositories tagged #bert, ranked by stars
《李宏毅深度学习教程》（李宏毅老师推荐👍，苹果书🍎），PDF下载地址：https://github.com/datawhalechina/leedl-tutorial/releases
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
🏄 Scalable embedding, reasoning, ranking for images and sentences with CLIP
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
Pre-Training with Whole Word Masking for Chinese BERT（中文BERT-wwm系列模型）
vits2 backbone with multilingual-bert
BertViz: Visualize Attention in Transformer Models
Leveraging BERT and c-TF-IDF to create easily interpretable topics.
Google AI 2018 BERT pytorch implementation
Awesome Pretrained Chinese NLP Models，高质量中文预训练模型&大模型&多模态模型&大语言模型集合
Must-read papers on prompt-based tuning for pre-trained language models.
State of the Art Natural Language Processing
🧠💬 Articles I wrote about machine learning, archived from MachineCurve.com.
快速上手AI理论及应用实战：基础知识、Transformer、NLP、ML、DL、竞赛。含大量注释及数据集，力求每一位能看懂并复现。
Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)
Chinese-LLaMA 1&2、Chinese-Falcon 基础模型；ChatFlow中文对话模型；中文OpenLLaMA模型；NLP预训练/指令微调数据集
A model library for exploring state-of-the-art deep learning topologies and techniques for optimizing Natural Language Processing neural networks
Jupyter Notebook tutorials on solving real-world problems with Machine Learning & Deep Learning using PyTorch. Topics: Face detection with Detectron 2, Time Series anomaly detection with LSTM Autoencoders, Object Detection with YOLO v5, Build your first Neural Network, Time Series forecasting for Coronavirus daily cases, Sentiment Analysis with BER
Datasets, tools, and benchmarks for representation learning of code.
Toolkit for Machine Learning, Natural Language Processing, and Text Generation, in TensorFlow. This is part of the CASL project: http://casl-project.ai/
Kashgari is a production-level NLP Transfer learning framework built on top of tf.keras for text-labeling and text-classification, includes Word2Vec, BERT, and GPT2 Language Embedding.
Multi-Task Deep Neural Networks for Natural Language Understanding
A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.
EasyNLP: A Comprehensive and Easy-to-use NLP Toolkit
ALIbaba's Collection of Encoder-decoders from MinD (Machine IntelligeNce of Damo) Lab
[CVPR 2021] Official PyTorch implementation for Transformer Interpretability Beyond Attention Visualization, a novel method to visualize classifications by Transformer based networks.
Self-contained Machine Learning and Natural Language Processing library in Go
自然语言处理、知识图谱、对话系统，大模型等技术研究与应用。
:house_with_garden: Fast & easy transfer learning for NLP. Harvesting language models for the industry. Focus on Question Answering.
Bringing BERT into modernity via both architecture changes and scaling
🛸 Use pretrained transformers like BERT, XLNet and GPT-2 in spaCy
[ICLR'23 Spotlight🔥] The first successful BERT/MAE-style pretraining on any convolutional network; Pytorch impl. of "Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modeling"
An elegent pytorch implement of transformers
Pocket-Sized Multimodal AI for content understanding and generation across multilingual texts, images, and 🔜 video, up to 5x faster than OpenAI CLIP and LLaVA 🖼️ & 🖋️
Neural Network Compression Framework for enhanced OpenVINO™ inference
A curated list of NLP resources focused on Transformer networks, attention mechanism, GPT, BERT, ChatGPT, LLMs, and transfer learning.
Machine Learning tutorials with TensorFlow 2 and Keras in Python (Jupyter notebooks included) - (LSTMs, Hyperameter tuning, Data preprocessing, Bias-variance tradeoff, Anomaly Detection, Autoencoders, Time Series Forecasting, Object Detection, Sentiment Analysis, Intent Recognition with BERT)
SPLADE: sparse neural search (SIGIR21, SIGIR22)
Source code of K-BERT (AAAI2020)
building a chinese dialogue system based on the newest version of rasa(基于最新版本rasa搭建的对话系统)
TextGen: Implementation of Text Generation models, include LLaMA, BLOOM, GPT2, BART, T5, SongNet and so on. 文本生成模型，实现了包括LLaMA，ChatGLM，BLOOM，GPT2，Seq2Seq，BART，T5，UDA等模型的训练和预测，开箱即用。
使用预训练语言模型BERT做中文NER
Official implementation of the papers "GECToR – Grammatical Error Correction: Tag, Not Rewrite" (BEA-20) and "Text Simplification by Tagging" (BEA-21)
Transformer models from BERT to GPT-4, environments from Hugging Face to OpenAI. Fine-tuning, training, and prompt engineering examples. A bonus section with ChatGPT, GPT-3.5-turbo, GPT-4, and DALL-E including jump starting GPT-4, speech-to-text, text-to-speech, text to image generation with DALL-E, Google Cloud AI,HuggingGPT, and more
Simple implementations of NLP models. Tutorials are written in Chinese on my website https://mofanpy.com
This repo contains a PyTorch implementation of a pretrained BERT model for multi-label text classification.
Elasticsearch with BERT for advanced document search.
🤖 A PyTorch library of curated Transformer models and their composable components
Portuguese pre-trained BERT models
从 NLP 到 LLM 的算法全栈教程，在线阅读地址：https://datawhalechina.github.io/base-llm/
Github repo with tutorials to fine tune transformers for diff NLP tasks
PhoBERT: Pre-trained language models for Vietnamese (EMNLP-2020 Findings)
fastHan是基于fastNLP与pytorch实现的中文自然语言处理工具，像spacy一样调用方便。
Integrating the Best of TF into PyTorch, for Machine Learning, Natural Language Processing, and Text Generation. This is part of the CASL project: http://casl-project.ai/
The prime repository for state-of-the-art Multilingual Question Answering research and development.
Simple implementation of OpenAI CLIP model in PyTorch.
Awesome-LLM-Eval: a curated list of tools, datasets/benchmark, demos, leaderboard, papers, docs and models, mainly for Evaluation on LLMs. 一个由工具、基准/数据、演示、排行榜和大模型等组成的精选列表，主要面向基础大模型评测，旨在探求生成式AI的技术边界.
基于Stable Diffusion优化的AI绘画模型。支持输入中英文文本，可生成多种现代艺术风格的高质量图像。| An optimized text-to-image model based on Stable Diffusion. Both Chinese and English text inputs are available to generate images. The model can generate high-quality images in several modern art styles.
Transformers for Longer Sequences
⛔ [NOT MAINTAINED] An End-To-End Closed Domain Question Answering System.