Mistral AI has released its flagship large language model, Mistral Large, which supports a 32K context window, native multilingual capabilities (English, French, Spanish, German, Italian), function calling, and JSON format output. It is now available via la Plateforme and Azure AI Studio.
The Hugging Face blog systematically introduces watermarking techniques for AI-generated content, covering the principles of visible and invisible watermarks, and comparing embedding during generation (e.g., IMATAG, Stable Diffusion XL Turbo integration) with post-generation addition (e.g., Truepic).
Hugging Face released a tutorial introducing how to perform parameter-efficient fine-tuning (PEFT) on Google DeepMind's open-source Gemma (2B/7B) models on GPUs and Cloud TPUs.
Haize Labs, in collaboration with Hugging Face, released the Red-Teaming Resistance Benchmark (RTR), which systematically evaluates the robustness of frontier large language models against high-quality adversarial prompts constructed by humans.
The Hugging Face blog systematically introduces Matryoshka embedding models, explaining their characteristic of concentrating key information in the leading dimensions of embedding vectors to support arbitrary truncation. It also describes how to train (using MatryoshkaLoss) and perform inference (using the truncate_dim parameter) with the Sentence Transformers framework.
Google releases the open-source large language model Gemma, including four open model variants: gemma-2b, gemma-2b-it, gemma-7b, and gemma-7b-it, with a context window of 8K tokens.
Upstage and Hugging Face jointly launched the Open Ko-LLM Leaderboard, an open evaluation platform designed specifically for Korean large language models, which includes Ko-ARC.
Hugging Face has added support for multiple dynamic LoRA adapter merging methods in the PEFT library, including concat, linear, svd, ties, dare, and magnitude_prune.
A Hugging Face blog post introduces how to use open-source LLMs such as Mixtral-8x7B-Instruct-v0.1 to generate synthetic data, training models that achieve comparable performance to GPT4 (94% accuracy) on investor sentiment recognition tasks.
OpenAI explores training generative models on large-scale video data, jointly training text-conditioned diffusion models on videos and images with variable durations, resolutions, and aspect ratios; employing a Transformer architecture operating on spatiotemporal patches of video and image latent codes; the largest model, Sora, can generate one-minute high-fidelity videos; results indicate that scaling video generation models is a viable path toward building general-purpose simulators of the physical world.
OpenAI is testing ChatGPT's memory feature, enabling it to remember content discussed by users to improve the helpfulness of subsequent conversations. Users have full control over this memory.
Hugging Face introduced the Messages API in Text Generation Inference (TGI) version 1.4.0, offering an interface compatible with the OpenAI Chat Completion API.
SegMoE is a new framework for building Mixture-of-Experts (MoE) diffusion models from scratch. It has been deeply integrated into the Hugging Face ecosystem and supports diffusers; this release includes SegMoE-4x2.
The Hugging Face blog announced the launch of the NPHardEval leaderboard. This benchmark was developed by researchers from the University of Michigan and Rutgers University. It includes 900 algorithmic problems covering P, NP-complete, and NP-hard complexity classes, with automatic monthly updates. The evaluation uses dual metrics: Weighted Accuracy (WA) and Failure Rate (FR). All problems are automatically generated and verified based on computable problems, excluding numerical calculations to focus on logical reasoning. The code, dataset, and leaderboard have been open-sourced on GitHub and Hugging Face.
PyTorch 2.2 has been officially released. Core updates include the integration of FlashAttention-v2 into scaled_dot_product_attention, delivering an approximately 2x speedup.
Hugging Face announced in a blog post that it achieved inference acceleration for StarCoder-15B on fourth-generation Intel Xeon processors via 🤗 Optimum Intel: using SmoothQuant INT8 quantization resulted in 2.19x TTFT and 2.20x TPOT speedups.
Hugging Face has launched the Hallucinations Leaderboard, an open-source, continuously updated evaluation platform using the EleutherAI Evaluation Harness framework.
The Hugging Face blog introduces DecodingTrust, the first comprehensive and unified LLM trustworthiness evaluation platform proposed by Secure Learning Lab in 2023.
A Hugging Face blog post introduces how to integrate open-source large language models (such as Mixtral-8x7B and Zephyr-7b-beta) into LangChain to build ReAct agents.
The official Hugging Face blog published a tutorial guiding users on how to fine-tune Meta's Wav2Vec2-BERT (facebook/w2v-bert-2.0) model using 🤗 Transformers.
The Hugging Face blog empirically evaluated three reinforcement-learning-free large language model alignment methods: Direct Preference Optimization (DPO), Identity Preference Optimisation (IPO), and Kahneman-Tversky Optimisation (KTO).