Skip to content
@neuralmagic

Neural Magic

Neural Magic (Acquired by Red Hat) empowers developers to optimize & deploy LLMs at scale. Our model compression & acceleration enable top performance with vLLM

Pinned Loading

  1. deepsparse deepsparse Public archive

    Sparsity-aware deep learning inference runtime for CPUs

    Python 3.2k 193

Repositories

Showing 10 of 108 repositories
  • llm-manifesto Public

    Declarative Kubernetes renderer for llm-d and vLLM deployments

    neuralmagic/llm-manifesto's past year of commit activity
    Python 2 Apache-2.0 0 0 2 Updated Sep 11, 2026
  • vllm Public Forked from vllm-project/vllm

    A high-throughput and memory-efficient inference and serving engine for LLMs

    neuralmagic/vllm's past year of commit activity
    Python 17 Apache-2.0 22,320 0 38 Updated Sep 11, 2026
  • vllm-vcr Public

    vLLM inference simulator and replay machine

    neuralmagic/vllm-vcr's past year of commit activity
    Rust 6 Apache-2.0 1 14 (2 issues need help) 11 Updated Sep 11, 2026
  • vllm-openshift-recipes Public
    neuralmagic/vllm-openshift-recipes's past year of commit activity
    0 0 0 1 Updated Sep 11, 2026
  • gpu-pruner Public

    Non-destructive GPU based idle-culler for RHOAI/Kubeflow workloads

    neuralmagic/gpu-pruner's past year of commit activity
    Rust 6 MIT 4 0 3 Updated Sep 11, 2026
  • model-validation-configs Public
    neuralmagic/model-validation-configs's past year of commit activity
    2 2 1 7 Updated Sep 10, 2026
  • nm-vllm-omni-ent Public Forked from vllm-project/vllm-omni

    A framework for efficient model inference with omni-modality models

    neuralmagic/nm-vllm-omni-ent's past year of commit activity
    Python 3 Apache-2.0 1,730 0 0 Updated Sep 10, 2026
  • inspect_evals Public Forked from UKGovernmentBEIS/inspect_evals

    Collection of evals for Inspect AI

    neuralmagic/inspect_evals's past year of commit activity
    Python 0 MIT 439 0 7 Updated Sep 10, 2026
  • DeepEP Public Forked from deepseek-ai/DeepEP

    DeepEP: an efficient expert-parallel communication library

    neuralmagic/DeepEP's past year of commit activity
    Cuda 1 MIT 1,443 0 1 Updated Sep 9, 2026
  • crucible Public

    Crucible: an autonomous goal-directed research loop engine

    neuralmagic/crucible's past year of commit activity
    Rust 8 Apache-2.0 4 4 7 Updated Sep 8, 2026
View all repositories