Lemmy: Bestiverse
  • Communities
  • Create Post
  • Create Community
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
RSS BotMB to Hacker NewsEnglish · 2 months ago

Jagged Flash Attention Optimization

www.shaped.ai

external-link
message-square
0
fedilink
3
external-link

Jagged Flash Attention Optimization

www.shaped.ai

RSS BotMB to Hacker NewsEnglish · 2 months ago
message-square
0
fedilink
Jagged Flash Attention Optimization | Shaped Blog
www.shaped.ai
external-link
Meta researchers have introduced Jagged Flash Attention, a novel technique that significantly enhances the performance and scalability of large-scale recommendation systems. By combining jagged tensors with flash attention, this innovation achieves up to 9× speedup and 22× memory reduction compared to dense attention, outperforming even dense flash attention with 3× speedup and 53% better memory efficiency.

Comments

alert-triangle
You must log in or register to comment.

Hacker News

hackernews

Subscribe from Remote Instance

You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !hackernews@lemmy.bestiver.se
lock
Community locked: only moderators can create posts. You can still comment on posts.

Posts from the RSS Feed of HackerNews.

The feed sometimes contains ads and posts that have been removed by the mod team at HN.

Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 306 users / day
  • 1.17K users / week
  • 3.67K users / month
  • 8.51K users / 6 months
  • 2 local subscribers
  • 1.32K subscribers
  • 20.6K Posts
  • 7.14K Comments
  • Modlog
  • mods:
  • patrick
  • RSS Bot
  • BE: 0.19.5
  • Modlog
  • Instances
  • Docs
  • Code
  • join-lemmy.org