Apple Intelligence is the New AI 🌟

Today’s top AI Highlights:

1. All you need to know about Apple’s flagship event WWDC 2024

2. New research paper on why RAG doesn’t work for enterprises

3. AI-generated models compete in the first-ever Miss AI beauty pageant

4. Real-time speech recognition directly in your browser

& so much more!

Read time: 3 mins

Latest Developments 🌍

Apple’s biggest event of the year WWDC 2024 just wrapped up and the pressure was high. The company was expected to “catch up” in generative AI with competitors to stay relevant in the market. It’s comfortable to say that Apple met the expectations. In a slew of announcements, Apple made sure to highlight the word AI, but it wasn’t Artificial Intelligence, it was “Apple Intelligence.” Integrating generative AI deeply into the new OS, Apple has made its devices and Siri smarter, more personal, and intuitive to use.

Key Highlights:

1. Apple Intelligence - It is a personal intelligence system that integrates generative AI at the OS level. It draws from your personal context to deliver more relevant experiences. It will be available for free with the new iOS, iPadOS, and MacOS.

   1. Using language models, Apple’s Writing Tools will give you an AI writing assistant that can rewrite, proofread, change the tone, summarize, generate key points, and more across apps like Mail, Notes, Pages, and even other third-party apps.

   2. It will suggest Smart Reply for emails to give you relevant reply suggestions. In your inbox, it will also give a summarized preview of emails so you don’t have to open each email to understand what it’s for.

   3. For images, Apple uses a diffusion model to generate images in different styles, be it animation or illustrations. Since it would have context from your personal information, for eg., people in your photos, these images can be personalized for your conversations with them. This is also available across multiple apps.

   4. The new Genmoji feature will let you generate new emojis from simple text prompts within the keyboard itself.

   5. In Photos, the new Clean Up feature will identify distracting objects in an image and make them disappear, automatically filling that part of the image.

   6. Apple Intelligence will also let you search photos and videos through natural language. For eg., “photos/videos of my mom in pink jacket.”

   7. Apple Intelligence also comes with speech-to-text functionality in Notes and phone calls which can be then summarized, rewritten, and more.

   8. Apple Intelligence can take actions on your behalf. You can chain multiple commands together and it will understand which apps to use to carry out the task. For eg., when you ask it to “Play the podcast that my wife sent last week”, it knows that Message and Podcast apps are required to perform this task.

   9. Maintaining its stance on privacy, most of these experiences are carried out on-device using A-17 Pro and M series chips, so your data doesn’t leave your phone.

   10. For more complex requests that would require larger generative models that can’t be processed on-device, Apple has designed a “Private Cloud Compute” that uses server-based models on Apple’s servers. Apple Intelligence understands which requests need to be processed on servers, and sends only the required data to the server which never stores your data.

1. Updates to Siri powered by Apple Intelligence

   1. Using Apple Intelligence, Siri will now be more natural, helpful, and contextually relevant. Siri can understand the intent behind your request better and let you ask follow-up questions. You can also type your query to Siri to be more discrete.

   2. Siri will have extensive product knowledge to help you use different apps. For eg., if you don’t know what a specific feature is called, you can describe it and Siri will tell you what you’re looking for.

   3. Apple Intelligence will also provide Siri with on-screen awareness so it knows what you’re seeing and can help you accordingly. For eg., if your friend has sent you a message to invite you to a brunch, you can ask Siri to “add this invitation to my calendar” and it’ll do that.

1. ChatGPT integrated with Siri

   1. Siri will be able to use ChatGPT’s expertise when it finds ChatGPT to be more helpful. For eg., if you need help with decorating your backyard, you can give Siri an image of it along with your question, it will ask for your permission to send this to ChatGPT and take ChatGPT’s answer to give to you.

   2. This would be helpful for questions related to documents, PDFs, PPTs, and more.

   3. ChatGPT is also integrated in the Writing Tools where you can enter a text prompt to generate a draft using ChatGPT without switching apps.

1. VisionOS

   1. Just 4 months after launching Vision Pro and VisionOS, Apple has released visionOS2 with major upgrades to Photos.

   2. VisionOS2 will let you turn your existing 2D photos into spatial photos with natural depth.

   3. New and easy gestures for Home and Control Centre.

   4. Mac Virtual Display will let you expand your Mac’s screen further into an ultra-wide display that wraps around you, just like two 4K displays side-by-side.

   5. New frameworks and APIs for developers to create 3D spatial apps.

1. iOS18

   1. New customization features very subtly integrate AI, for eg., it suggests colors to customize your Home Screen that would best compliment your wallpaper.

   2. Emails will be categorized on-device in categories like Primary for important mails, Transactions, Updates for newsletters and announcements, and more.

   3. Photos is getting an overhaul to let you declutter and see your photos in an organized manner.

2. New updates to AirPods will let you interact with Siri through head movements for yes/no responses. For eg., in a crowded place when you don’t want to speak and you get a call, you can simply nod your head to decline the call.

3. Math Notes in iPad is a whole new experience of using the calculator. Rather than looking for symbols and expressions, you can start writing with the Apple Pencil like you would on a piece of paper, and it automatically calculates as soon as you write “=”. It shows results in your handwriting, and the results get updated when you change the values.

RAG Does Not Work for Enterprises 🏣

Implementing Retrieval-Augmented Generation (RAG) in enterprises faces several significant challenges, particularly in compliance-regulated industries like healthcare and finance. A new paper explores these challenges, emphasizing the need for secure, accurate, and scalable solutions. It also proposes an evaluation framework to validate RAG solutions and outlines the requirements for successful enterprise deployment. Collaboration between researchers and industry partners is crucial to advancing RAG technology in enterprise settings.

Key Highlights:

1. Data Security and Privacy are Paramount: Enterprises in regulated industries need RAG systems that ensure sensitive data is never exposed or misused. The paper emphasizes the need for robust access controls, data anonymization techniques, and auditing mechanisms.

2. Accuracy and Explainability are Crucial: For legal and financial applications, RAG outputs must be accurate, consistent, and interpretable. The paper argues for advanced semantic search techniques and hybrid query strategies to improve retrieval accuracy, along with clear explanations for generated content.

3. Seamless Integration and Scalability are Essential: Implementing RAG in enterprises requires flexible, API-driven architectures and pre-built connectors for popular enterprise systems. The paper stresses the need for high-performance solutions that can handle massive, heterogeneous knowledge bases and diverse user requirements.

They’re Not Real, But They’re Competing for a Crown 👑

Here’s a new kind of beauty contest! The first-ever Miss AI pageant is underway, featuring contestants who are entirely AI-generated. These digital beauties exist only on social media, boasting stunning looks and even sharing their “thoughts” in videos and text posts. The contest isn’t just about beauty though – it’s a showcase of how AI can be used to create influencers and engage audiences.

The winner will receive a $5,000 cash prize, public relations and mentorship perks. The company behind the event, the U.K.-based online creator platform FanVue, stated that the awards have uncovered AI creators none of them were aware of.

Miss AI is highlighting the growing power of AI in the marketing world. These AI influencers are incredibly effective at engaging audiences, and many of them are landing lucrative brand deals. The competition might be a bit out there, but it’s a glimpse into the future of digital marketing, where AI might just become the new face of influence.

Tools of the Trade ⚒️

1. Whisper WebGPU: Blazingly fast speech recognition and translation in real-time, directly in your browser, supporting over 100 languages. It runs locally on your device, ensuring your data stays private.

1. Surface Labs: Helps you convert more website visitors into customers with AI-driven lead management. It offers customizable forms, AI agents to engage leads, and detailed analytics to boost conversions and streamline your lead qualification process.

2. Recall: Summarize any online content and save it to your knowledge base, where it’s automatically organized and linked for easy access later. It helps you quickly get key points from various sources like articles, videos, and podcasts, making information management simple and efficient.

3. Awesome LLM Apps: Build awesome LLM apps using RAG for interacting with data sources like GitHub, Gmail, PDFs, and YouTube videos through simple texts. These apps will let you retrieve information, engage in chat, and extract insights directly from content on these platforms.

Hot Takes 🔥

1. If Apple integrates OpenAI at the OS level, then Apple devices will be banned at my companies. That is an unacceptable security violation.And visitors will have to check their Apple devices at the door, where they will be stored in a Faraday cage ~Elon Musk

2. AI systems don't have to do everything to cause explosive growth—they just have to automate AI R&D. ~Leopold Aschenbrenner

Meme of the Day 🤡

That’s all for today! See you tomorrow with more such AI-filled content.

Real-time AI Updates 🚨

⚡️ Follow me on Twitter @Saboo_Shubham for lightning-fast AI updates and never miss what’s trending!

PS: I curate this AI newsletter every day for FREE, your support is what keeps me going. If you find value in what you read, share it with your friends by clicking the share button below!