Наличие выбросов в активациях извествено с LLM.int8(), bitsandbytes квантования уже работают с учётом этого. Статья же выше логически продолжает эту же линию, находя прям очень маленький набор весов.
Наличие выбросов в активациях извествено с LLM.int8(), bitsandbytes квантования уже работают с учётом этого. Статья же выше логически продолжает эту же линию, находя прям очень маленький набор весов.
Stocks dropped on Friday afternoon, as gains made earlier in the day on hopes for diplomatic progress between Russia and Ukraine turned to losses. Technology stocks were hit particularly hard by higher bond yields. The Security Service of Ukraine said in a tweet that it was able to effectively target Russian convoys near Kyiv because of messages sent to an official Telegram bot account called "STOP Russian War." Just days after Russia invaded Ukraine, Durov wrote that Telegram was "increasingly becoming a source of unverified information," and he worried about the app being used to "incite ethnic hatred." A Russian Telegram channel with over 700,000 followers is spreading disinformation about Russia's invasion of Ukraine under the guise of providing "objective information" and fact-checking fake news. Its influence extends beyond the platform, with major Russian publications, government officials, and journalists citing the page's posts. "There are a lot of things that Telegram could have been doing this whole time. And they know exactly what they are and they've chosen not to do them. That's why I don't trust them," she said.
from cn
