How LLMs Stay Current with the Changing World 🔄

Today’s top AI Highlights:

1. Recent Advances in Aligning LLMs with the Ever-changing World

2. xVAL: A Continuous Number Encoding for LLMs

3. New Opensource Models with Language and Coding Capabilities

4. Google Provides Two-fold Indemnification for Generative AI Services

5. All-in-one AI Assistant for Chat, Image Generation, Documents, Voice Synthesis

& so much more!

Read time: 3 mins

Latest Developments 🌍

How Do LLMs Capture the Ever-changing World Knowledge 📚

Although LLMs have proven their prowess in various applications, keeping these models up-to-date with the ever-changing world knowledge has become a pressing concern. A report sheds light on the latest methods for aligning LLMs with real-time information without the need for extensive re-training.

Key Highlights:

• Leveraging techniques such as meta-learning, hypernetwork editing, and locate-and-edit strategies, LLMs are implicitly updated with specific, localized knowledge without extensive re-training.

• Explicit methods focus on augmenting LLMs with external knowledge retrieved from various sources, without affecting their core architecture. Recent progress includes the use of external memory and off-the-shelf retrievers.

• To ensure LLMs stay abreast of the latest information, researchers are equipping models with access to the entire web, like LangChain and ChatGPT Plugins, allowing LLMs to connect directly to the internet without retraining.

LLMs Can Excel in Math 🔢

LLMs have difficulty with tasks involving numerical operations due to the unique nature of numerical data, which exists on a continuous scale with complex rules. Researchers at Polymathic AI introduce xVal, a novel numerical encoding method for LLMs to enhance the handling of numerical data within LLMs.

Key Highlights:

• xVal involves representing any real number with just a single token, storing the numerical value separately. This reduces memory, compute resources, and training time while ensuring superior performance in scientific tasks.

• By embedding key information about the continuous nature of numbers, xVal significantly enhances the model's predictions, making it particularly suitable for scientific applications that often involve complex, continuous functions and datasets.

• Compared to existing numerical encoding schemes, xVal demonstrates remarkable interpolation capabilities, enabling accurate predictions even outside the scope of the training data, a crucial feature for dealing with complex scientific datasets.

Mastering both Language and Coding 🎓

Introducing Lemur and Lemur-Chat, the new open-source language models adept in both natural language and coding unlike other models which are either proficient in language or coding tasks. These models showcase exceptional proficiency in diverse agent tasks.

Key Highlights:

• Lemur's meticulous pre-training on a code-intensive corpus and instruction fine-tuning using text and code data positions it as a standout model, demonstrating balanced proficiencies in both text and code benchmarks.

• Lemur-Chat's performance surpasses that of Llama 2 and CodeLlama in 12 out of 13 agent benchmarks, showcasing superior tool-usage abilities and adaptability to environment feedback.

• It performs comparably or surpasses GPT 3.5 Turbo, narrowing the performance gap between open-source and closed models.

Indemnification for Google’s Gen AI ⚖️

Google promises to protect customer with generative AI indemnification, offering two key indemnities. The first indemnity covers Google's use of training data for generative AI models, ensuring protection against copyright claims. The second indemnity extends protection to the generated output created by customers using services like Duet AI in Workspace including Docs, Gmail, Slides, Duet AI in Google Cloud, Vertex AI services.

Tools of the Trade ⚒️

• AI Buddy: All-in-one AI assistant app integrating various advanced LLMs including GPT 4 and 3.5, Claude 2. Chat with document and web page chat, generate art, along with voice synthesization so you can listen to the AI responses.

• Morph Studio: Create engaging videos from text prompts in 1080p clarity, of duration between 3-7 seconds.

• Cal.ai: An AI scheduling tool to effortlessly manage meetings and schedules, with automated rescheduling, availability checks, and AI-assisted meeting booking.

• Avian: AI-driven analytics platform for quick, privacy-compliant data insights, enabling data connection, analysis, visualization, and report generation, all with simple text prompts.

• Deasie: Data governance platform designed to ensure the safety, quality, and relevance of data used in language model applications.

Hot Takes 🔥

• Research culture at top AI labs: DeepMind: strategic OpenAI: haphazard Google Brain: lackadaisical Microsoft: academic Meta: no-nonsense ~ Pedro Domingos

• The future will consist of - a small number of open source inference code, - free pre-trained base models, and - crowd-sourced fine-tuned models, on top of which customized (possibly closed source) products will be built. ~ Yann LeCun

Meme of the Day 🤡

That’s all for today!

See you tomorrow with more such AI-filled content. Don’t forget to subscribe and give your feedback below 👇

Real-time AI Updates 🚨

⚡️ Follow me on Twitter @Saboo_Shubham for lightning-fast AI updates and never miss what’s trending!!

PS: I curate this AI newsletter every day for FREE, your support is what keeps me going. If you find value in what you read, share it with your friends by clicking the share button below!