Telegram Group & Telegram Channel
DeepSeek 开源日第 5 天:发布高性能并行文件系统 3FS,数据吞吐量高达 6.6 TiB/s

2025年2月28日,DeepSeek 在开源周的第五天发布了 3FS(Fire-Flyer File System),这是一个专为现代 SSD 和 RDMA 网络带宽设计的高性能并行文件系统。该系统在数据访问性能上表现出色,特别适用于深度学习等数据密集型应用。

3FS 在180节点集群中实现了6.6 TiB/s的聚合读取吞吐量,在25节点的GraySort基准测试中达到了3.66 TiB/min的吞吐量。每个客户端节点的KVCache查找峰值吞吐量超过40 GiB/s。3FS采用去中心化架构,提供强一致性语义。

该文件系统在DeepSeek V3 / R1版本中广泛应用,涵盖了数据预处理、数据集加载、检查点保存/加载等关键过程,同时DeepSeek还开源了基于3FS的处理框架Smallpond。

DeepSeek | GitHub

📮投稿  ☘️频道  🌸聊天  🗞𝕏



group-telegram.com/TestFlightCN/31171
Create:
Last Update:

DeepSeek 开源日第 5 天:发布高性能并行文件系统 3FS,数据吞吐量高达 6.6 TiB/s

2025年2月28日,DeepSeek 在开源周的第五天发布了 3FS(Fire-Flyer File System),这是一个专为现代 SSD 和 RDMA 网络带宽设计的高性能并行文件系统。该系统在数据访问性能上表现出色,特别适用于深度学习等数据密集型应用。

3FS 在180节点集群中实现了6.6 TiB/s的聚合读取吞吐量,在25节点的GraySort基准测试中达到了3.66 TiB/min的吞吐量。每个客户端节点的KVCache查找峰值吞吐量超过40 GiB/s。3FS采用去中心化架构,提供强一致性语义。

该文件系统在DeepSeek V3 / R1版本中广泛应用,涵盖了数据预处理、数据集加载、检查点保存/加载等关键过程,同时DeepSeek还开源了基于3FS的处理框架Smallpond。

DeepSeek | GitHub

📮投稿  ☘️频道  🌸聊天  🗞𝕏

BY 科技圈🎗在花频道📮




Share with your friend now:
group-telegram.com/TestFlightCN/31171

View MORE
Open in Telegram


Telegram | DID YOU KNOW?

Date: |

Channels are not fully encrypted, end-to-end. All communications on a Telegram channel can be seen by anyone on the channel and are also visible to Telegram. Telegram may be asked by a government to hand over the communications from a channel. Telegram has a history of standing up to Russian government requests for data, but how comfortable you are relying on that history to predict future behavior is up to you. Because Telegram has this data, it may also be stolen by hackers or leaked by an internal employee. Again, in contrast to Facebook, Google and Twitter, Telegram's founder Pavel Durov runs his company in relative secrecy from Dubai. Telegram users are able to send files of any type up to 2GB each and access them from any device, with no limit on cloud storage, which has made downloading files more popular on the platform. After fleeing Russia, the brothers founded Telegram as a way to communicate outside the Kremlin's orbit. They now run it from Dubai, and Pavel Durov says it has more than 500 million monthly active users. Telegram boasts 500 million users, who share information individually and in groups in relative security. But Telegram's use as a one-way broadcast channel — which followers can join but not reply to — means content from inauthentic accounts can easily reach large, captive and eager audiences.
from vn


Telegram 科技圈🎗在花频道📮
FROM American