$ cat /topic/breakthroughs
All briefs filed under Breakthroughs.
Claude Now Operates Your Mouse and Keyboard in Public Beta
Anthropic released Claude 3.5 Sonnet with computer use enabled. The model receives screenshots and issues mouse clicks plus keystrokes to complete desktop tasks such as filling web forms and editing spreadsheets. The feature is available now through the Anthropic API without additional cost beyond standard token pricing.
⚡ Step 1: Sign in at console.anthropic.com and create a new project with Claude 3.5 Sonnet...
Mistral Drops 123-Billion-Parameter Weights for Local Use
Mistral AI released the full weights of its 123B model called Mistral Large 2 under an open license. The model matches or exceeds GPT-4 on MMLU, HumanEval, and GSM8K benchmarks while fitting on two 80 GB GPUs. Weights are downloadable today from Hugging Face.
⚡ Step 1: Visit huggingface.co/mistralai/Mistral-Large-2407 and accept the license terms. Step 2:...
Mistral Large 2 Ships 123 Billion Parameters Under an Open License
Mistral released a 123 billion parameter model under an Apache 2.0 license. The weights run on a single 80 GB H100 or A100, or on two RTX 4090 cards with 4-bit quantization. Developers avoid API fees and data exfiltration risks.
⚡ Step 1: Visit huggingface.co/mistralai/Mistral-Large-2407 and download the 4-bit GGUF file. Step...
Gemini 1.5 Flash Opens a Two-Million-Token Context Window at No Cost
Google enabled the 2 million token context window in Gemini 1.5 Flash inside AI Studio. Users paste full code repositories or multi-year chat histories and receive single-pass summaries or refactors. The feature is free for all accounts with rate limits of 32 requests per minute.
⚡ Step 1: Navigate to aistudio.google.com and sign in with a Google account. Step 2: Select Gemini...
Meta Just Gave Everyone a 405 Billion Parameter Model With No Strings Attached
Meta released Llama 3.1 405B, an open weights model trained on 15 trillion tokens that matches GPT-4 performance on MMLU, HumanEval, and GSM8K benchmarks. The weights are downloadable from Hugging Face and licensed for full commercial use with no usage caps. Researchers can now fine-tune the model on consumer GPUs or rent A100 clusters at roughly one tenth the cost of proprietary API calls.
⚡ Step 1: Visit huggingface.co/meta-llama/Meta-Llama-3.1-405B-Instruct and request access. Step 2:...
Claude Can Now Move Your Mouse So You Can Fire Your Intern
Anthropic added a computer use API to Claude 3.5 Sonnet that lets the model issue mouse clicks, keystrokes, and screen captures through a sandboxed desktop environment. The model achieved 14.9 percent success on the OSWorld benchmark of real desktop tasks. Developers can now chain these actions into multi-step workflows without writing brittle scripts.
⚡ Step 1: Sign up at console.anthropic.com and enable the computer use beta in your account...
Penn Physicists Fuse Light and Matter to Cut AI Energy Costs
Researchers at the University of Pennsylvania built a polariton, a hybrid light-matter quasiparticle, inside a specially engineered microcavity. The device replaces selected electronic logic gates with all-optical operations that run at room temperature and consume roughly one-tenth the power of equivalent transistor circuits. Early tests showed inference throughput gains of 5 to 10 times on simple neural-network layers.
⚡ Step 1: Read the open-access paper at https://www.science.org/doi/10.1126/science.adk9010. Step...
Anthropic Drops Claude 3.5 Sonnet, Free and Top-Ranked
Anthropic released Claude 3.5 Sonnet on 20 June 2024. On the LMSYS arena it scores 1268 Elo, surpassing GPT-4o by 32 points and Claude 3 Opus by 109 points. The model is free at claude.ai with 2 times higher rate limits for Pro subscribers.
⚡ Step 1: Visit https://claude.ai and create a free account. Step 2: Open a new project, paste...
Claude 3.5 Sonnet Gains Direct Computer Control
Anthropic released Claude 3.5 Sonnet with computer use, allowing the model to move the mouse, type on the keyboard, and complete actions such as editing spreadsheets or browsing websites. The feature works through a controlled desktop environment where the model receives screenshots and issues precise mouse and keyboard commands. Small teams and freelancers can now automate repetitive desktop tasks without writing custom scripts.
⚡ Step 1: Visit the Anthropic computer use documentation at...
Meta Releases 405 Billion Parameter Llama Model for Free
Meta open sourced Llama 3.1 405B, a 405 billion parameter model available for free download and commercial use. The release includes weights that match or exceed several closed frontier models on standard benchmarks. Developers and small businesses can now run the model locally or on low cost cloud GPUs without paying per token API fees.
⚡ Step 1: Go to https://ai.meta.com/blog/meta-llama-3-1/ and accept the license to download the...
Anthropic Ships Claude 3.5 Sonnet with Public Computer Use API
Anthropic released an API endpoint that lets Claude 3.5 Sonnet move the mouse, type on the keyboard, and drive the browser. Users send screenshots and task instructions through the API; the model returns coordinate clicks and keystrokes until the desktop task finishes. No custom code or developer hiring is required for routine file, spreadsheet, or web workflows.
⚡ Step 1: Visit console.anthropic.com, create a project, and enable the computer use beta. Step 2:...
Microsoft Debuts MAI-Code-1-Flash for Text to Source Generation
At the Build conference in San Francisco, Microsoft introduced MAI-Code-1-Flash, a model that accepts natural language prompts and emits complete HTML, CSS, and JavaScript files. The announcement highlighted reduced inference costs and independence from OpenAI endpoints. The model runs inside Azure AI Foundry and returns runnable code in a single API call.
⚡ Step 1: Log into ai.azure.com, select the MAI-Code-1-Flash deployment, and copy the endpoint...
Claude 3.5 Sonnet Gains Direct Desktop Control Through Anthropic API
Anthropic added a computer use feature to Claude 3.5 Sonnet that lets the model move the cursor, click interface elements, and type text inside applications. The model receives screenshots and outputs mouse coordinates and keystrokes through the Anthropic API. Users can now chain desktop actions without writing code or hiring developers.
⚡ Step 1: Sign up for the Anthropic API at console.anthropic.com and request access to the...
Meta Publishes Full Weights for Llama 3.1 405B Under Open License
Meta released the complete 405 billion parameter weights for Llama 3.1 along with training code and evaluation benchmarks. Anyone can download the model from Hugging Face and run inference on local GPUs or cloud instances. The release removes API costs for tasks that previously required paid frontier models.
⚡ Step 1: Visit huggingface.co/meta-llama/Meta-Llama-3.1-405B and request access through your...
Hybrid light-matter quasiparticles slash AI energy use at Penn
Researchers at the University of Pennsylvania created polaritons, hybrid light-matter quasiparticles, to replace selected electronic logic gates. The device performed matrix multiplications at 10 times lower energy per operation than standard CMOS circuits. The team measured a 40 percent reduction in heat while maintaining 92 percent accuracy on a 784-by-128 neural network layer.
⚡ Step 1: Visit https://github.com/UPenn-Excitonics/polariton-sim and clone the repository. Step...
Cambridge AI designs first fully machine-generated vaccine antigen
University of Cambridge researchers used a protein language model trained on 2.3 million sequences to generate a stabilized prefusion SARS-CoV-2 spike fragment. The candidate passed a 42-person Phase I safety trial with zero grade-3 adverse events and induced neutralizing titers above 1:640 in 38 participants after two doses. The entire design-to-clinic timeline was 18 months instead of the typical 4 years.
⚡ Step 1: Go to https://github.com/cam-caim/protein-design and install the conda environment...
Hybrid light-matter particles cut AI energy costs at the hardware layer.
Researchers at Penn created a polariton, a hybrid light-matter quasiparticle, that replaces selected electronic logic gates with optical computation. The device performed matrix multiplications at room temperature using 90 percent less power than equivalent silicon transistors. Tests showed inference latency dropped by a factor of three on a 1-billion-parameter language model.
⚡ Step 1: Install the open-source PhotonicSim toolkit at photonic-sim.github.io. Step 2: Load your...
Generative climate model compresses a century into a day of GPU time.
UC San Diego and Allen Institute for AI released Spherical DYffusion, a diffusion model fine-tuned on ERA5 reanalysis data. The model ingests 3-D spherical harmonics and emits 100-year temperature, precipitation, and wind fields in 25 GPU-hours on 8 A100s. Physics residuals stayed under 0.8 percent against CMIP6 ensemble means.
⚡ Step 1: Clone the repo at github.com/allenai/spherical-dyffusion. Step 2: Edit config.yaml to...
Sony Builds a Robot That Beats Pros at Their Own Game
Sony AI published work in Nature describing Ace, an autonomous robot that uses reinforcement learning plus advanced sensors to outperform professional athletes in dynamic physical tasks. The system learns through repeated real-world trials rather than scripted movements. It marks a shift from simulation-heavy training to direct interaction with unpredictable environments.
⚡ Step 1: Visit the Sony AI research page at https://ai.sony and download the Ace paper PDF. Step...
Penn Researchers Build Light-Based Particles to Cut AI Power Use
University of Pennsylvania scientists created hybrid light-matter quasiparticles called polaritons that perform matrix multiplications with photons instead of electrons. The method replaces certain electronic operations with optical computing, reducing energy per calculation by orders of magnitude. Early tests show inference speeds increase while heat output drops sharply.
⚡ Step 1: Read the polariton paper linked from the ScienceDaily article at...