#Databricks
Showing 60 of 74 repositories tagged #databricks, ranked by stars
Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.
📊 Cube Core is open-source semantic layer for AI, BI and embedded analytics
Databricks’ Dolly, a large language model trained on the Databricks Machine Learning Platform
Python SQL Parser and Transpiler
Open Source Feature Flags, Experimentation, and Product Analytics
Simple and Distributed Machine Learning
A native Rust library for Delta Lake, with bindings into Python
.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.
🔥🔥🔥 Open source Reverse ETL - alternative to hightouch and census.
👾 nao is an open source analytics agent. (1) Create context with nao-core cli, (2) deploy nao chat interface for everyone
Scalable master data management, identity resolution, entity resolution, and deduplication using ML
Open-source agentic data engineering harness for dbt, SQL, and cloud warehouses. 100+ tools, 10 warehouses, AI-powered.
DataOps for Microsoft Data Platform technologies. https://aka.ms/dataops-repo
This repo provides a customizable stack for starting new ML projects on Databricks that follow production best-practices out of the box.
Synmetrix – production-ready open source semantic layer on Cube
Databricks Terraform Provider
Streamline your workflow with Lynkr, a CLI tool that acts as an HTTP proxy for efficient code interactions using Claude Code CLI.
Compare MLOps Platforms. Breakdowns of SageMaker, VertexAI, AzureML, Dataiku, Databricks, h2o, kubeflow, mlflow...
Databricks CLI
End-to-end Data Lakehouse project built on Databricks, following the Medallion Architecture (Bronze, Silver, Gold). Covers real-world data engineering and analytics workflows using Spark, PySpark, SQL, Delta Lake, and Unity Catalog. Designed for learning, portfolio building, and job interviews.
Examples of using Terraform to deploy Databricks resources
The Lakehouse Engine is a configuration driven Spark framework, written in Python, serving as a scalable and distributed engine for several lakehouse algorithms, data flows and utilities for Data Products.
A SQL transformation engine that type-checks your whole pipeline and catches breaking changes before they run — branches, replay, column-level lineage, compile-time contracts, per-model cost. Adapters: Databricks, Snowflake, BigQuery, DuckDB. Single static Rust binary. Apache 2.0.
This repo contains "Databricks Certified Data Engineer Associate" Questions and related docs.
Databricks SQL Connector for Python
Practice Databricks coding skills with hands-on exercises. Import into Databricks Free Edition, write code, run assertions, check pass/fail. Covers Delta Lake, Spark SQL, PySpark, Auto Loader, medallion architecture, window functions, and more.
Open-Source Self-Service Analytics Platform
Scalable Data Science, course sets in big data Using Apache Spark over databricks and their mathematical, statistical and computational foundations using SageMath.
Demo of using the Nutter for testing of Databricks notebooks in the CI/CD pipeline
This repo contains "Databricks Certified Data Engineer Professional" Questions and related docs.
Notebooks and Code about Generative Ai, LLMs, MLOPS, NLP , CV and Graph databases
This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which we need in our real life experience as a data engineer. We will be using pyspark & sparksql for the development. At the end of the course we also cover few case studies.
🚀 Advanced Data & AI Engineering Portfolio: Real-world projects and production-ready patterns to level up your AI skills—from building clean data pipelines to deploying RAG systems, AI agents, and intelligent dashboards.
Azure Databricks MLOps sample for Python based source code using MLflow without using MLflow Project.
Tools for Deploying Databricks Solutions in Azure
Collection of Sample Databricks Spark Notebooks ( mostly for Azure Databricks )
Using U-Net Model to Detect Wildfire from Satellite Imagery
Databricks's Zerobus Ingest SDKs
ML Ops Accelerator: Databricks & Azure Machine Learning Unification
Databricks SDK for Go
A lightweight, declarative PySpark framework for data quality validation — check columns, rows, and entire datasets directly in your Spark pipelines
Cool DE Projects
A production-ready PySpark project template with medallion architecture, Python packaging, unit tests, integration tests, CI/CD automation, Databricks Asset Bundles, and DQX data quality framework.
DEPRECATED: Integrating Jupyter with Databricks via SSH
Baseline for Databricks Labs projects written in Python
Books and Papers in Mathematics, Econometrics, Machine Learning, Finance etc for different levels that can be useful for Data Scientists, Developers and everyone whoo is interesting in STEM.
🧱 A collection of supplementary utilities and helper notebooks to perform admin tasks on Databricks
code, labs and lectures for the course
Databricks DLT Apparel Pipeline Project: Learn medallion architecture, streaming, and data engineering with Delta Live Tables. Includes synthetic data, step-by-step guide, and certification prep.
PyJaws: A Pythonic Way to Define Databricks Jobs and Workflows
Databricks Data Engineer Associate Certification Lab: End-to-end hands-on project covering Auto Loader, Medallion Architecture, SCD Type 2, Unity Catalog governance, and Databricks Jobs orchestration. Build a production-grade pipeline on Databricks Free Edition.
Demo of Streamlit application with Databricks SQL Endpoint
Demonstration of using Files in Repos with Databricks Delta Live Tables
100 essential Databricks concepts for data engineers, organized by category with difficulty levels and self-assessment scoring
170+ curated resources every Databricks Data Engineer should bookmark - tools, courses, creators, labs, and communities
Production-style real-time e-commerce lakehouse with Kafka, Airflow, Databricks, Medallion architecture, data quality, quarantine, Terraform, and Dash analytics.
Databricks Add-on for Splunk
Semantic cost-linting and performance warnings extension for Databricks in VS Code
End-to-end data engineer project
Delta Lake Optimization Project: Hands‑on lab to explore partitioning, Z‑Ordering, compaction (manual & auto), Liquid Clustering, and VACUUM using a synthetic sales dataset in Databricks. Includes a step‑by‑step notebook to measure file scans, bytes read, and query performance for each optimization.