Skip to content

[Perf] flashdreams.accelerated Library #482

Closed
2 of 2 issues completed
Closed

Description

@fangjunzhou-nv

Issue Description

FlashDreams currently expose several levels of acceleration mechanism:

  • CUDA graph capture
  • Inference prewarm
  • Native acceleration kernel

While CUDA graph and prewarm are built into flashdreams/flashdreams/infra/acceleration, the native acceleration kernels are optimized per integration.

Proposed Solution

Build a flashdreams.accelerated (later refactored into flashdreams.core) library that implements generic PyTorch module and Triton kernels for accelerated inference.

The library should reside in flashdreams/flashdreams/accelerated (later refactored into flashdreams/core/module)

The library should provide:

  • flashdreams/accelerated/
    • triton/: Triton kernels (flashattention2, sageattention3, fused norm + rope + kv update, etc.).
    • cuda/(optional): highly specialized CUDA kernel.
    • PyTorch modules that uses these accelerated kernels (multi head attention, quantized linear, etc.)

Activity

  1. changed the title [-][Perf] `flashdreams.accelerated` Triton Kernel Library[/-] [+][Perf] `flashdreams.accelerated` Library[/+] on Aug 27, 2026
  2. removed theissue type on Sep 3, 2026
  3. added
    Type-epicLarge overarching task without a specific 'type'
    and removed
    Type-epicLarge overarching task without a specific 'type'
    on Sep 3, 2026
  4. fangjunzhou commented on Sep 7, 2026

    @fangjunzhou
    Contributor

    I believe this issue can be closed.

  5. jmccaffrey-nv commented on Sep 8, 2026

    @jmccaffrey-nv
    Collaborator

    Thanks !

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions