Email Details

Llama 3.2 πŸ¦™, Mira leaves OpenAIπŸ‘‹, Molmo open source multimodal model🌐

Meta has released a new suite of Llama models with vision capabilities that includes a 1B, 3B, and several new Multimodal models. 

TLDR

From

TLDR AI 2024-09-26

πŸ¦™ Try Llama 3.2 free on Together AI (Sponsor)

Train, fine-tune, and run inference on 200+ models, including new Llama 3.2 vision models. Achieve 4x faster speed and 11x cost savings at production scale. 

Together Inference: APIs fully compatible with OpenAI, making testing and migration easier πŸ€–

➜ Try Together's free Llama 3.2 multimodal model on Together Playground

Together GPU Clusters: 99.9% uptime, flexible commitments, and white glove service πŸ”§

➜ Reserve your NVIDIA H100/H200 GPUs from just $1.99/hr

Leading organizations like Salesforce, The Washington Post, and Zoom rely on Together AI.

πŸš€ Sign up for Together AI and join a community of 150,000+ developers πŸ’»

πŸš€

Headlines & Launches

Llama 3.2: multimodal (12 minute read)

Meta has released a new suite of Llama models with vision capabilities that includes a 1B, 3B, and several new Multimodal models.
Mira leaving OpenAI (6 minute read)

OpenAI's CTO Mira Murati is stepping away from her role at the company to give herself space to pursue different creative paths.
🧠

Research & Innovation

Molmo open source multimodal model (12 minute read)

Allen AI has released a fully open multimodal model that outperforms many open and closed vision language models. The release includes the model's dataset and training regime.
MaskBit: Embedding-free image generation via Bit Tokens (28 minute read)

This study introduces two key advancements in image generation: a modernized VQGAN model that enhances accessibility and performance and a novel embedding-free generation network using bit tokens. These improvements led to state-of-the-art results on the ImageNet benchmark, achieving an FID of 1.52 with a compact 305M parameter model.
Comic Story Understanding (19 minute read)

Researchers propose a pipeline using Vision-Language Models (VLMs) for generating detailed, grounded captions that link comic elements and their relationships to enhance comic analysis.
πŸ§‘β€πŸ’»

Engineering & Resources

AI-powered knowledge management for GTM leaders: how to get started (Sponsor)

How can AI help reps answer customer questions faster? Get the free guide to find out how to operationalize an AI strategy and make your company's knowledge instantly accessible. Free frameworks and checklists included. Ready to start? Add AI to your own help center in minutes (no developer required).
Exploring parallel strategies with Jax (21 minute read)

This post explores ways to parallelize language models using the Jax library.
Time MoE (GitHub Repo)

Time MoE is a Mixture of Experts model that reaches Billion Scale on time series prediction tasks.
Long Text Generation with HelloBench (GitHub Repo)

HelloBench is a benchmark that evaluates LLMs across five long text generation tasks based on Bloom's Taxonomy.
🎁

Miscellaneous

AI Safety Is A Global Public Good (8 minute read)

Top AI scientists from China and the West held an International Dialogue on AI Safety, reaching a consensus on AI governance. Their recommendations include creating emergency preparedness institutions, establishing a Safety Assurance Framework, and funding independent AI safety research. The group stresses the urgent need for global cooperation to manage advanced AI risks.
Sakana, Strawberry, and Scary AI (11 minute read)

A Japanese startup created "Sakana," an AI scientist that generates hypotheses, codes, and writes papers, but its output is largely trivial and occasionally fabricated. OpenAI's "Strawberry" AI demonstrated hacking capabilities within a poorly configured sandbox, highlighting the potential for instrumental convergence and resource-seeking behaviors and prompting a reevaluation of what constitutes true AI advancement. This article reflects on whether AI milestones, such as writing scientific papers and hacking, genuinely indicate intelligence or if they're just sophisticated mimicry.
Amazon launches Amelia, a generative AI-powered assistant for third-party sellers (4 minute read)

Amazon has announced Project Amelia, a generative AI assistant for independent sellers on its platform. Built using Amazon's Bedrock, Amelia offers personalized insights, sales data, and operational support to enhance seller productivity. Currently in beta for select U.S. sellers, it will expand to more users and countries soon.
⚑

Quick Links

Are bot signups burning through your inference tokens? (Sponsor)

Launching an AI app means dealing with bad actors. Clerk is modern authentication that does it for you. Only pay for users after their first day of activity. Start with just an email account
YouTube Shorts to integrate Veo, Google's AI video model (3 minute read)

YouTube has announced the integration of Google DeepMind's AI video generation model, Veo, into YouTube Shorts, allowing creators to generate high-quality backgrounds and six-second clips.
Can AI predict when you're about to die? New Canadian tech prevents unexpected hospital deaths, study finds (7 minute read)

St. Michael's Hospital's AI-based early warning system, Chartwatch, significantly reduced unexpected deaths by 26% among patients in a recent study.
Amazon releases a video generator - but only for ads (4 minute read)

Amazon has launched an AI-powered Video Generator for advertisers that creates product videos from single images.
AI agents invade observability: snake oil or the future of SRE? (7 minute read)

Advances in AI are poised to transform the observability business with "agentic" generative AI models that can take actions based on real-world data.

Love TLDR? Tell your friends and get rewards!

Share your referral link below with friends to get free TLDR swag!
Track your referrals here.

Want to advertise in TLDR? πŸ“°

If your company is interested in reaching an audience of AI professionals and decision makers, you may want to advertise with us.

If you have any comments or feedback, just respond to this email!

Thanks for reading,
Andrew Tan & Andrew Carr


If you don't want to receive future editions of TLDR AI, please unsubscribe from TLDR AI or manage all of your TLDR newsletter subscriptions.

Β© 2024 Email Dashboard. All rights reserved.