Awesome Data Analysis
Section: Tools · Version control system for machine learning projects.
Entry
Appears in 8 awesome lists
Version control for large files. kedro - Build data pipelines. feast - Feature store. Video. pgvector - Vector similarity search for Postgres. pinecone - Database for vector search applications. truss - Serve ML models. milvus - Vector database for similarity search. mlem - Version and deploy your…
Section: Tools · Version control system for machine learning projects.
Section: Miscellaneous Tools · An open-source data science version control system. It helps track, organize and make data science projects reproducible. In its very basic scenario it helps version control and share large data and model files.
Section: Data Management · Data Version Control - Git for Data & Models - ML Experiments Management.
Section: Tools · Data Science Version Control is an open-source version control system for machine learning projects with pipelines support. It makes ML projects reproducible and shareable.
Section: 8. MLOps / LLMOps & Production · Git-like versioning for data and models.
Section: Experimentation · Data Version Control | Git for Data & Models | ML Experiments Management.
Section: Version Control · Management and versioning of datasets and machine learning models.
Section: General · Version control for large files. kedro - Build data pipelines. feast - Feature store. Video. pgvector - Vector similarity search for Postgres. pinecone - Database for vector search applications. truss - Serve ML models. milvus - Vector database for similarity search. mlem - Version and deploy your…
Unified proxy and SDK that routes to 100+ LLM providers behind a single OpenAI-compatible interface, with a Router handling retry/fallback across deployments, per-project cost and rate-limit tracking, and OTEL callback integrations. The right infrastructure layer when your harness needs provider…
Comet's open-source AI observability and evaluation platform: deep tracing of LLM calls, conversation logging, and agent activity, plus built-in eval metrics, prompt versioning, guardrails, and the Opik Agent Optimizer. Worth including because it unifies observability, verification, and…
(from Hpcaitech) - A Unified Deep Learning System for Large-Scale Parallel Training (1D, 2D, 2.5D, 3D and sequence parallelism, and ZeRO protocol).
"Use airflow to author workflows as directed acyclic graphs (DAGs) of tasks. The airflow scheduler executes your tasks on an array of workers while following the specified dependencies. Rich command line utilities make performing complex surgeries on DAGs a snap. The rich user interface makes it…
A fast and simple framework for building and running distributed applications. Ray is packaged with RLlib, a scalable reinforcement learning library, and Tune, a scalable hyperparameter tuning library. ray.io
Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search,…