Language Models with Unlimited Context 🧠

Before we get started, we want to thank our sponsor Shortwave.

Today’s top AI Highlights:

1. Streaming LLMs for Infinite Sequence Lengths

2. Most Comprehensive Robotic-learning Dataset by Google DeepMind

3. The Real AI Assistant for Browsing

4. New AI Features in LinkedIn

& so much more!

Read time: 3 mins

Latest Developments 🌍

LLMs for Endless Conversations 💬

Deploying LLMs in streaming applications, like multi-round dialogues, is challenging due to memory consumption and the inability to handle longer texts than their training sequence length. Researchers introduce an attention sink phenomenon to address this.

Key Highlights:

• StreamingLLM is an efficient framework to enable LLMs trained with a finite attention window to handle infinite sequence lengths without the need for fine-tuning.

• The context window of LLMs remains unchanged with StreamingLLM, and only the most recent tokens and attention sinks are retained, allowing the model to process the latest tokens based on its initial pre-training.

• It enables models like Llama-2, MPT, Falcon, and Pythia to efficiently perform language modeling with up to 4 million tokens or more. In streaming settings, it achieves up to a 22.2x speedup compared to the sliding window recomputation baseline.

Biggest, Most Comprehensive Robotics Dataset 🤖

Google DeepMind, in collaboration with 33 academic labs, has created the Open X-Embodiment dataset and RT-X model, aiming to train general-purpose robots that can adapt to various robot types and tasks.

Key Highlights:

• This most comprehensive robotics dataset includes data from 22 different robot types, encompassing over 500 skills and 150,000 tasks from more than 1 million episodes.

• RT-X models derived from RT-1 and RT-2, trained on the Open X-Embodiment dataset, achieve a remarkable 50% improvement in performance and the ability to acquire new skills not present in their original datasets.

• The RT-2 model showcases an extraordinary threefold performance boost on real-world robotic tasks, stemming from knowledge transfer facilitated by diverse training data from multiple robot embodiments.

How Should AI Browse the Internet? 🕸️

In a bid to transform web browsing using AI, The Browser Company introduces Arc Max, a suite of AI-powered features powered by a combination of GPT-3.5 and Anthropic.

Key Highlights:

• Arc Max includes features such as automatic tab title and download renaming, making web navigation more efficient and user-friendly.

• Users can now ask ChatGPT questions directly from the Arc Command Line, get short summaries and previews of web pages on hover, and also query AI when the standard page search doesn't yield results.

Smarter Recruiting and Learning with AI on LinkedIn 🙋‍♀️

LinkedIn has unveiled a series of AI-powered enhancements across its platform leaning on OpenAI and Microsoft’s technology, ranging from recruitment to marketing and sales.

Key Highlights:

• Recruiter 2024 is a generative AI to assist recruitment professionals in refining candidate searches using conversational language and providing unexpected suggestions.

• AI-driven LinkedIn Learning Coach will offer personalized advice and course recommendations, initially focusing on soft skills while leveraging LinkedIn's extensive learning catalog.

• Accelerate is an AI-powered marketing tool to simplify campaign management within the LinkedIn ecosystem, though with limitations beyond the platform's borders.

Tools of the Trade ⚒️

• Visily: AI-powered wireframing and design tool for easy creation of stunning software wireframes and prototypes from hand-drawn sketches, app & website screenshots, text prompts or built-in templates.

• Rewind Pendant: A wearable AI device that captures what you say and hear in the real world and then transcribes, encrypts, and stores it entirely locally on your phone.

• Nara: AI-driven sales assistant that helps SMBs automate sales and support, providing personalized recommendations and 24/7 customer assistance.

• PresetAI: AI-powered private knowledge base chatbot for intelligent developer support, documentation search, and developer activity analysis.

• Layerbrain: Human language interface for software. Execute tasks with any software, data, or API using only natural language without any coding.

Hot Takes 🔥

• I'm trying to raise $20mill to put a H100 on a necklace so you can run your AI models from anywhere ~ anton

• people who want to start a company have almost nothing in common with people who want to run a company ~ anu

• When you actually look at LLM training code you realise that banning open source AI is basically banning math smh ~ Emad Mostaque

Meme of the Day 🤡

That’s all for today!

See you tomorrow with more such AI-filled content. Don’t forget to subscribe and give your feedback below 👇

Real-time AI Updates 🚨

⚡️ Follow me on Twitter @Saboo_Shubham for lightning-fast AI updates and never miss what’s trending!!

PS: I curate this AI newsletter every day for FREE, your support is what keeps me going. If you find value in what you read, share it with your friends by clicking the share button below!