Published inResearch Highlights by Winston WangDeepSeek in a Nutshell: Everything you need to know at a GlanceRecently, the large language model (LLM) DeepSeek has gained widespread attention. Out of curiosity, I conducted a brief investigation to…Jan 6Jan 6
Published inPaper Skimming by Winston WangExploring Implicit Chain of Thought (ICoT): A Faster but Unproven Alternative to CoT ReasoningSince the release of OpenAI’s o1 model, Chain of Thought (CoT) prompting has gained widespread attention for its ability to enhance…Jan 2Jan 2
Sequoia’s Vision for AI in 2025: Key Predictions That Will Shape the FutureAs 2024, dubbed the “primordial soup year” for AI, draws to a close, the AIGC ecosystem has seen explosive growth across infrastructure…Jan 2Jan 2
Published inResearch Highlights by Winston WangAI’s Mathematical Myth Busted? FrontierMath Leaves LLMs Nearly Empty-HandedAlthough many large language models (LLMs) have recently demonstrated high scores in certain mathematical tests, growing research suggests…Jan 1Jan 1
Published inPaper Skimming by Winston WangEvaluating the Mathematical Reasoning Capabilities of Large Language Models: Limitations and…LLMs have made remarkable progress in various fields, including natural language processing, question answering, and creative tasks, even…Oct 15, 2024Oct 15, 2024
Published inResearch Highlights by Winston WangUnveiling AlphaFold 3: The Next Leap in Predicting Biomolecular Structures Across the Chemical…On October 9, 2024, the Royal Swedish Academy of Sciences decided to award half of the 2024 Nobel Prize in Chemistry to Demis Hassabis and…Oct 12, 2024Oct 12, 2024
Published inTutorial by Winston Wang在Apple Silicon上使用MLX对模型进行微调的新手教程目前市面上针对大语言模型微调的 python库,例如unsloth and lamini,在Apple M系列芯片上都不支持GPU加速。Apple Silicon芯片下的Mac使用MLX进行finetuning是一个很好的选择。Oct 2, 2024Oct 2, 2024
Published inTutorial by Winston WangBeginner’s guide to fine-tuning models using MLX on Apple Silicon.This article is also available in Simplified Chinese.Oct 2, 20241Oct 2, 20241
Published inResearch Highlights by Winston WangGrade-School Math and the Hidden Reasoning ProcessOriginally posted on 09/02/2024Sep 30, 2024Sep 30, 2024
Published inResearch Highlights by Winston WangHow RAG Technology Powers AI-Driven Search Engines: A Deep Dive into Tech Behind Perplexity AIOriginally posted on 08/27/2024Sep 30, 2024Sep 30, 2024