Metaflow
Build and manage real-life ML, AI, and data science projects with Metaflow.
Open-source Metaflow makes it quick and easy to build and manage real-life ML, AI, and data science projects. Explore with notebooks, develop with Metaflow, and test and debug locally. Results are stored and tracked automatically for easy analysis. Break out from the confines of a laptop or a single notebook. Scale out easily to the cloud, utilizing GPUs, multiple cores, and multiple instances in parallel. Metaflow organizes the work for easy collaboration on the way. Deploy experiments to production with a single click without changing anything in the code. Make flows react to updating data and other events automatically. Get started easily on a laptop. When you are ready to scale, deploy the Metaflow stack on your cloud account or on-premise Kubernetes cluster. Metaflow integrates seamlessly with your existing infrastructure, security, and data governance policies. To get a taste of Metaflow in the cloud, try Metaflow Sandbox in the browser. Deploy on EKS and S3, or AWS Batch & AWS Step Functions. Deploy on AKS and Azure Blob Storage. Deploy on GKE and Google Cloud Storage. For maximum flexibility, deploy on a custom Kubernetes cluster. Metaflow was originally developed at Netflix to address the needs of developers and data scientists who work on demanding real-life ML, AI, and data projects. Netflix open-sourced Metaflow in 2019. Today, Metaflow is used by hundreds of companies across industries, powering diverse projects from state-of-the-art GenAI and compute vision to business-oriented data science, statistics, and operations research. Create flows incrementally step-by-step with the new spin command Build agentic systems with the new recursive and conditional steps Compose flows with reusable custom decorators Use uv to manage dependencies, from dev to cloud Setup the full Metaflow stack on your laptop with one click Checkpoint long-running model training and other tasks with the new @checkpoint decorator Configure flows freely with the new Config object New APIs allow you to run and deploy Metaflow in notebooks and scripts Learn about various patterns of scalable compute with Metaflow. Train and fine-tune large language models and other generative AI models on AWS Trainium. Build observable ML/AI systems with cards that update in real-time. Install dependencies from PyPI as well as Conda in your Metaflow steps. Connect to external services securely using the new @secrets decorator. Metaflow 2.9 allows you to trigger workflows based on real-time events. Apache Arrow and Metaflow.S3 make it easy to process data fast. Learn how to use Metaflow for demanding GPU tasks. Develop with Metaflow, deploy on your existing Apache Airflow servers. Deploy and operate Metaflow on GCP and all other m
Unsloth
Unsloth is an open-source, no-code web UI for training, running and exporting open models in one unified local interface.
Unsloth lets you run and train AI models on your own local hardware. Run and train Google's new Gemma 4 models! A new open, no-code web UI to train and run LLMs. New Qwen3.5 Small Medium LLMs are here! Run the new 4B and 120B models by NVIDIA. Train MoE LLMs 12x faster with less VRAM. Learn to run local LLMs via Claude OpenAI. Run fine-tune the new 80B coding model. Run fine-tune 30B model for agentic coding. Unsloth streamlines local training, inference, data, and deployment Search + download + run any model like GGUFs, LoRA adapters, safetensors. Train and RL 500+ models ~2x faster with ~70% less VRAM (no accuracy loss) Supports full fine-tuning, pre-training, 4-bit, 16-bit and FP8 training. Enables LLMs to predict if a headline impacts a company positively or negatively. Can use historical customer interactions for more accurate and custom responses. Fine-tune LLM on legal texts for contract analysis, case law research, and compliance. You can think of a fine-tuned model as a specialized agent designed to do specific tasks more effectively and efficiently. Fine-tuning can replicate all of RAG's capabilities, but not vice versa.
Metaflow
Unsloth
Metaflow
Unsloth
Metaflow (1)
Metaflow
Unsloth