Skip to content

@basetenlabs Baseten

Change the repository type filter

All

    Repositories list

    66 repositories

    • truss-examples

      Public
      Examples of models deployable with Truss
      pythondockermachine-learningaiexamplesmlops
      Python
      •
      MIT License
      •49•203•14•57•Updated Sep 25, 2025Sep 25, 2025

    • ml-cookbook

      Public
      Ready-to-use ML training recipes to help you build and deploy models on Baseten.
      MIT License
      •0•29•0•5•Updated Sep 25, 2025Sep 25, 2025

    • truss

      Public
      The simplest way to serve AI/ML models in production
      open-sourcemachine-learningpackagingartificial-intelligencefalconeasy-to-usewhisperinference-servermodel-servinginference-api
      Python
      •
      MIT License
      •87•1.1k•64•28•Updated Sep 25, 2025Sep 25, 2025

    • TensorRT-Model-Optimizer

      Public
      A unified library of state-of-the-art model optimization techniques such as quantization, pruning, distillation, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM or TensorRT to optimize inference speed on NVIDIA GPUs.
      Python
      •
      Other
      •165•1•0•3•Updated Sep 23, 2025Sep 23, 2025

    • moon-ci-retrospect

      Public
      This action is designed for projects using Moonrepo, making the test results of the moon ci command more readable in GitHub Actions logs.
      TypeScript
      •4•0•0•1•Updated Sep 20, 2025Sep 20, 2025

    • genai-bench

      Public
      Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serving systems.
      Python
      •
      MIT License
      •21•0•0•0•Updated Sep 17, 2025Sep 17, 2025

    • gorilla

      Public
      Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)
      Python
      •
      Apache License 2.0
      •1.2k•0•0•3•Updated Sep 15, 2025Sep 15, 2025

    • action-slack

      Public
      Provides the function of slack notification to GitHub Actions.
      TypeScript
      •
      MIT License
      •142•0•0•2•Updated Sep 12, 2025Sep 12, 2025

    • harmony

      Public
      Renderer for the harmony response format to be used with gpt-oss
      Rust
      •
      Apache License 2.0
      •203•0•0•1•Updated Aug 30, 2025Aug 30, 2025

    • async-openai

      Public
      Rust library for OpenAI
      Rust
      •
      MIT License
      •316•0•0•0•Updated Aug 20, 2025Aug 20, 2025

    • LatentSync

      Public
      Taming Stable Diffusion for Lip Sync!
      Python
      •
      Apache License 2.0
      •801•0•0•2•Updated Aug 6, 2025Aug 6, 2025

    • create-pull-request

      Public
      A GitHub action to create a pull request for changes to your repository in the actions workspace
      TypeScript
      •
      MIT License
      •501•0•0•2•Updated Jul 22, 2025Jul 22, 2025

    • lws

      Public
      LeaderWorkerSet: An API for deploying a group of pods as a unit of replication
      Go
      •
      Apache License 2.0
      •110•0•0•2•Updated Jul 18, 2025Jul 18, 2025

    • llm-tools

      Public
      Python
      •
      MIT License
      •0•0•0•1•Updated Jul 15, 2025Jul 15, 2025

    • action-junit-report

      Public
      Reports junit test results as GitHub Pull Request Check
      TypeScript
      •
      Apache License 2.0
      •148•0•0•3•Updated Jul 12, 2025Jul 12, 2025

    • truss-grpc-example

      Public
      Go
      •0•0•0•1•Updated Jul 7, 2025Jul 7, 2025

    • frontend-take-home

      Public
      Front-End Take Home Challenge
      TypeScript
      •12•2•0•1•Updated Jun 30, 2025Jun 30, 2025

    • agent-workshop

      Public
      Build agents powered by open models
      Jupyter Notebook
      •
      MIT License
      •1•3•0•0•Updated Jun 12, 2025Jun 12, 2025

    • SGLang-Workshop

      Public
      Workshop materials for AI Engineer World's Fair
      Jupyter Notebook
      •
      MIT License
      •11•11•0•0•Updated Jun 3, 2025Jun 3, 2025

    • nx-set-shas

      Public
      ✨ A Github Action which sets the base and head SHAs required for `nx affected` commands in CI
      TypeScript
      •
      MIT License
      •86•0•0•1•Updated May 15, 2025May 15, 2025

    • changed-files

      Public
      :octocat: Github action to retrieve all (added, copied, modified, deleted, renamed, type changed, unmerged, unknown) files and directories.
      TypeScript
      •
      MIT License
      •308•0•0•1•Updated May 15, 2025May 15, 2025

    • frontend-log-viewer-challenge

      Public
      TypeScript
      •0•1•0•1•Updated May 15, 2025May 15, 2025

    • inference-optimization-interview

      Public
      1•1•0•0•Updated Mar 24, 2025Mar 24, 2025

    • honeymarker

      Public
      Add Honeycomb Markers to your GitHub Actions workflows.
      Dockerfile
      •
      Other
      •6•0•0•0•Updated Mar 17, 2025Mar 17, 2025

    • setup-mpi

      Public
      Set up your GitHub Actions workflow to use MPI
      Shell
      •
      MIT License
      •5•0•0•0•Updated Mar 17, 2025Mar 17, 2025

    • flashinfer

      Public
      FlashInfer: Kernel Library for LLM Serving
      Cuda
      •
      Apache License 2.0
      •518•0•0•0•Updated Feb 6, 2025Feb 6, 2025

    • .github

      Public
      0•0•0•0•Updated Jan 13, 2025Jan 13, 2025

    • autoscaler

      Public
      Autoscaling components for Kubernetes
      Go
      •
      Apache License 2.0
      •4.2k•0•0•3•Updated Dec 11, 2024Dec 11, 2024

    • axolotl

      Public
      Go ahead and axolotl questions
      Python
      •
      Apache License 2.0
      •1.2k•0•0•2•Updated Nov 7, 2024Nov 7, 2024

    • HackMIT-2024

      Public
      Jupyter Notebook
      •1•2•0•0•Updated Sep 14, 2024Sep 14, 2024