Siri plus ChatGPT will be the Ultimate AI Assistant

Today’s top AI Highlights:

1. Apple to give Siri a big upgrade: voice commands for everything

2. Nvidia reveals Blackwell’s successor - a new GPU platform

3. Claude 3 can now access to external tools and APIs

4. Generate sound effects from text prompts with Eleven Labs’ new AI model

& so much more!

Read time: 3 mins

Latest Developments 🌍

Your Voice Would be the Ultimate Remote Control 🎚️

Apple is reportedly giving Siri a major upgrade, making it more powerful and versatile than ever before. Soon, you’ll be able to use your voice to control individual app functions, going beyond simple commands. You could do things like open specific documents, move notes, send emails, open a specific article in Apple News, and even get a summary of a web page – all with just your voice.

The new system will be powered by OpenAI’s GPT model or Google’s Gemini, allowing Siri to analyze your activities on devices and automatically suggest voice-controlled features, making it even more intuitive. It will initially focus on Apple’s own apps, but the company plans to expand support to hundreds of commands across various apps.

You’ll be able to chain together multiple commands, like asking Siri to summarize a meeting and then send it to a colleague, all in one request. The system will handle basic AI tasks on the device while more advanced tasks will be processed via cloud computing.

Nvidia’s Upcoming GPU Platforms and AI Innovations 🌟

At Computex 2024 in Taipei, Jensen Huang just revealed the company’s roadmap for its GPU architecture till 2027. As he said that Nvidia is on a one-year rhythm, he revealed very few details on the new platforms which will be announced in the coming years. This includes the Blackwell Ultra platform in 2025, the all-new Rubin platform in 2026, and the Rubin Ultra platform in 2027. These platforms are under development and will be backward compatible with existing softwares.

Key Highlights:

1. The Rubin platform will have the next generation of high-bandwidth memory HBM4, a new Arm-based Vera CPU, connected with the 6th generation of NVLink. NVLink 6 would be capable of handling data transfers at a speed of 3600GB/s.

1. Nvidia has announced the general availability of ACE generative AI microservices suite which helps create lifelike human avatars. New tools in this suite include -Nvidia unveiled Project G-Assist, an AI assistant that provides context-aware help for PC games and apps. It takes voice or text inputs from the player, along with contextual game information, using AI vision models to enhance contextual awareness.

   1. Nvidia Audio2Gesture for generating body gestures from audioNemotron-3 4.5B, a small language model for low-latency, on-device RTX AI PC inference

1. Nvidia teased “RTX AI PC” laptops from Asus and MSI that will feature GeForce RTX 4070 GPUs and power-efficient systems-on-a-chip with Windows 11 AI PC capabilities. These laptops will receive a free update to Copilot+PC experiences when available.Nvidia also unveiled the RTX AI Toolkit which is a suite of tools and SDKs for model customization, optimization, and deployment on RTX AI PCs. It will help developers customize pre-trained models with open-source QLoRa tools and optimize them with Nvidia TensorRT, reducing RAM usage by up to 3x and increasing performance by up to 4x.

Tool Use Available for All Claude 3 Models ⚙️

Anthropic has announced that Claude 3 can now use external tools and APIs, enhancing its capabilities significantly. This feature is available across the Claude 3 model family on platforms like the Anthropic Messages API, Amazon Bedrock, and Google Cloud’s Vertex AI. With tool use, Claude can perform tasks, manipulate data, and provide more accurate responses. Developers can now leverage Claude’s ability to interact with tools to automate tasks, extract structured data, and convert natural language requests into structured API calls.

Key Highlights:

1. Customizable Tool Use: Developers can now define a toolset for Claude, allowing it to select and execute the appropriate tool for specific tasks, enhancing flexibility and functionality.

2. Improved Developer Experience: The introduction of features like streaming for real-time responses, forced tool use, and image input capabilities provides a more seamless and efficient development process.

3. Thinking Tags: During the beta, Opus was used to build sophisticated user-facing assistants. Now, Opus includes tags in its outputs to clarify Claude’s reasoning and simplify debugging, further enhancing the development experience.

Tools of the Trade ⚒️

1. Text to Sound Effects by Eleven Labs: Imagine any sound and bring it to life with just text prompts. Eleven Labs’ Text to Sound Effects generates sound effects, instrumental tracks, soundscapes, and various character voices all with simple text prompts. It’s available for all users.

1. AI Note Taker: Lets you capture and organize notes in text, image, and audio formats. It provides AI-powered summaries and automatic categorization to streamline your workflow and ensure you never miss important details.

2. Mainline ALPHA: Your AI-powered auto-trader that executes trades and identifies promising tokens in the crypto market. It lets you set trading preferences, activate auto-trading, and receive real-time insights, all while ensuring your assets’ security.

3. Awesome LLM Apps: Build awesome LLM apps using RAG for interacting with data sources like GitHub, Gmail, PDFs, and YouTube videos through simple texts. These apps will let you retrieve information, engage in chat, and extract insights directly from content on these platforms.

Hot Takes 🔥

1. LLMs are useful, but they are an off ramp on the road to human-level AI. If you are a PhD student, don't work on LLMs. Try to discover methods that would lift the limitations of LLMs. ~Yann LeCun

2. LLMs are the best bullshitters ever! 😀They appear trustworthy, confident and knowledgeable until you pay attention and realize that may not be getting the details right. ~Bindu Reddy

Meme of the Day 🤡

What is happening with these two!

That’s all for today! See you tomorrow with more such AI-filled content.

Real-time AI Updates 🚨

⚡️ Follow me on Twitter @Saboo_Shubham for lightning-fast AI updates and never miss what’s trending!

PS: I curate this AI newsletter every day for FREE, your support is what keeps me going. If you find value in what you read, share it with your friends by clicking the share button below!