데이터 사이언티스트 (AI 리서치 엔지니어) 공부, 연구, 논문 기록
📚Study📚
📋 Contents
💪 Basic
🐍 Python
🎯 AI
📊 Data Analyst
☁️ Cloud
💼 Project
📓 Paper List
📘 Book List
🦋 Flutter
☕️ Java
💪 Basic
-⚙️ Algorithm⭐️
- 🔢 Statistics - 🧩 Design Pattern
🐍 Python
-🐍 Basic
🎯 AI
-🤖 ML & DL⭐️
- 📷 CV
- 💬 NLP
- 🤝 RecSys
📊 Data Analyst
-🔍 Analystical Skills
- 📈 Visualization
- Tableau
- Power BI
- 🧾 Query
- SQL
- DBeaver
- 🗃️ Big Data
- Spark
- Hadoop
- 📜 Certification
- R (ADsP)
☁️ Cloud
-🌿 Git
- 🐳 Docker
- 🌴 AWS
- 🛎️ AIaaS
💼 Project
-Resume
- Research - FCViT
- SPRNN
- Scholar
- [[연구 논문/DL] 딥러닝 모델 (Vision) 설계 최고 성능 달성](https://github.com/HiMyNameIsDavidKim/fcvit/blob/main/OVERVIEW_KOR.md)
- [[제조/ML] 애플워치 검사 자동화 알고리즘 설계 및 운영](https://github.com/HiMyNameIsDavidKim/Study/tree/main/6Project/lgd_project)
- [[은행/ML] 계좌 개설 사기 탐지를 통한 사기 패턴 분석](https://github.com/HiMyNameIsDavidKim/Study/tree/main/6Project/team_project)
- [[이커머스/KPIs] CAC 분석을 통한 성과지표 별 광고 최적화](https://github.com/HiMyNameIsDavidKim/Study/tree/main/6Project/final_project)
- Side Project
- [[VLM/DL] CLIP과 sLLM을 활용한 이미지 설명 생성 모델](https://github.com/HiMyNameIsDavidKim/image_captioning)
- [[TTS/DL] XTTS와 Whisper를 활용한 한국어 TTS 파인튜닝](https://github.com/HiMyNameIsDavidKim/xttstrainingko)
- 코딩 테스트
- 면접
📓 Paper List
- [print('✅') if (READ == True) else pass]
- New Architecture
Vision Mamba, 2024 / Blog Posting / Raw Note
* ✅ MambaOut, 2024 / Blog Posting / Raw Note
- Transformer
Attention is all you need, 2017 / Blog Posting / Raw Note
* [LoRA]()
* [RAG]()
- ViT
ViT, 2021 / Blog Posting / Raw Note
* ✅ Swin Transformer, 2021 / Blog Posting
* ✅ BEiT, 2021
* ✅ DeiT, 2021 / Blog Posting / Raw Note
* ✅ ViT-G/14, 2022 / Blog Posting / Raw Note
* ✅ MLP-Mixer, 2021 / Blog Posting / Raw Note
* ✅ ViT Robustness, 2022 / Blog Posting / Raw Note
* Self-Supervised Learning
* ✅ MoCo v3, 2021 / Blog Posting / Raw Note
* ✅ DINO, 2021 / Blog Posting / Raw Note
* ✅ iBOT, 2021 / Blog Posting / Raw Note
* ✅ MAE, 2022 / Blog Posting / Raw Note
* ✅ data2vec, 2022 / Blog Posting / Raw Note
* ✅ CAE, 2024 / Blog Posting / Raw Note
* ✅ I-JEPA, 2023 / Blog Posting / Raw Note
* ✅ V-JEPA, 2024 / Blog Posting / Raw Note
* [DINO v2]()
* [data2vec v2]()
- CNN
VGGNet, 2014 / Blog Posting / Raw Note
* ✅ Inception v1, 2014 / Blog Posting / Raw Note
* ✅ Inception v2~3, 2016
* ✅ Inception v4, 2016
* ✅ UNet, 2015 / Blog Posting / Raw Note
* ✅ ResNet, 2016 / Blog Posting / Raw Note
* ✅ DenseNet, 2017 / Blog Posting
* ✅ CoAtNet, 2021 / Blog Posting / Raw Note
* MobileNet v1, 2017
* MobileNet v2, 2018
* EfficientNet, 2019
* EfficientNet-L2, 2021
* Noisy Student, 2019
* Meta Pseudo Labels, 2020
* Self-Supervised Learning
* ✅ SimCLR
* ✅ MoCo v1, 2020 / Blog Posting / Raw Note
* ✅ MoCo v2, 2020 / Blog Posting / Raw Note
- Methods
Survey of augmentation, 2021
* ✅ Augmentation review post
* ✅ Learning Loss for Test-Time Augmentation, 2020
* ✅ Dropout, 2014
* ✅ Batch Normalization, 2015
* ✅ Layer Normalization, 2016
* ✅ Adam, 2015
* ✅ LARS, 2017
* ✅ SAM Optimizer, 2021 / Raw Note
* Loss Scaling Rule, 2018
* Loss Predictor, 2019
* Few-shot learning, 2020
- LLM Apps
BERT, 2019
* GPT-1, 2018
* GPT-2, 2019
* GPT-3, 2020
* ✅ LLaMA, 2023 / Blog Posting / Raw Note
* GPT-4, 2024
- Vision Apps
CLIP, 2021 / Blog Posting / Raw Note
* LLaVA, 2023
* ✅ LLaVA-UHD, 2024 / Blog Posting / Raw Note
* Video
* [Video Prism]()
* [Perception Encoder]()
* [SigLIP]()
* Segmentation
* ✅ Segment anything, 2023 / Blog Posting / Raw Note
* Object Detection
* R-CNN, 2014
* Fast R-CNN, 2015
* Faster R-CNN, 2015
* Mask R-CNN, 2017
* [DETR]()
* YOLO v1, 2016
* YOLO v2, 2016
* YOLO v3, 2018
* YOLO v4, 2020
* [YOLOS]()
* [EfficientDet]()
* ViTDet, 2022
* Jigsaw Puzzle
* ✅ Context Prediction, 2015
* ✅ CFN, 2016
* ✅ Knowledge Transfer, 2018
* ✅ Greedy, 2018 / Raw Note
* ✅ Brute force, 2018 / Raw Note
* ✅ Deepzzle, 2020
* ✅ Alphazzle, 2023 / Raw Note
* ✅ SDDRL, 2023 / Raw Note
* ✅ JPDVT, 2024 / Raw Note
* Jigsaw & Inpainting, 2018
* ✅ Jigsaw-ViT, 2023
* ✅ Masked Jigsaw Puzzle, 2023
* Vision Gen
* ✅ VAE, 2013
* ✅ Style Transfer, 2016
* DALL-E, 2022
- RecSys
2 stage RecSys
* MS Recommenders
* Retrieval (CF)
* ✅ YoutubeDNN, 2016
* [NCF]()
* [MIND]()
* [EBR]()
* Retrieval (Graph)
* ✅ GCN, 2016 / Blog Posting / Raw Note
* ✅ NGCF, 2019 / Blog Posting / Raw Note
* [LightGCN, 2020]()
* [Turbo-CF]()
* Retrieval (Gen)
* [TIGER]()
* [BERT4Rec]()
* [Transformer4Rec]()
* Re-Ranking (FM)
* ✅ DeepFM, 2017 / Blog Posting / Raw Note
* [xDeepFM]()
* [DeepFFM]()
* [DCN]()
* [DCN v2]()
* Re-Ranking (Multi-Task)
* [ESMM]()
* [MMoE]()
* [PEPNet]()
- ML
LightGBM]()
* [XGBoost]()
* TabNet, 2021
📘 Book List
- [print('✅') if (READ == True) else pass]
- 데이터 분석
- ML
- Algorithm
🦋 Flutter
-Dart Basic
- Widget
☕️ Java
-Basic and AI