Microsoft's Phi-3 gets Vision 👀

Today’s top AI Highlights:

1. Microsoft introduces Team Copilot which can be a valuable member of your team

2. Microsoft expands Phi-3 model family with a vision model and two new language models

3. Create your own Copilot agent that can carry out tasks

4. Adobe’s new AI tool in Lightroom to remove unwanted objects

5. AI search engine for visualizing world knowledge

& so much more!

Read time: 3 mins

Latest Developments 🌍

Top AI Announcements at Microsoft Build 2024 💡

Microsoft Build 2024 kicked off with a host of new announcements to enhance AI and developer tools across their Copilot and Azure AI ecosystem. The conference revealed new AI capabilities and features that promise to improve productivity and collaboration. Among the standout announcements were the new Teams Copilot, Copilot Studio, new Phi-3 models, GitHub Copilot extensions, and more. Here are the top 10 AI announcements:

1. Team Copilot: The new Teams Copilot extends Copilot for Microsoft 365 from a personal assistant to a team-oriented AI assistant. It’s your new teammate that can manage meeting agendas, take notes, show important information in chats, track action items, and manage project tasks and deadlines, improving team collaboration and communication.

1. Copilot Studio: This new platform enables developers to build custom Copilots that act as agents for specific tasks.

   1. You can create your own Copilot agents which can independently carry out tasks, automate business processes, have memory and knowledge, learn based on user feedback, and ask for help when needed.

   2. To ground these custom Copilots’ responses in organizational data, you can bring together data from Microsoft’s various data sources like Microsoft Graph and Fabric, combining all with a visual connector.

1. Phi Silica: A transformer-based, 3.3B parameter local language model optimized for Copilot+ PCs. It is the first small language model locally deployed on Windows, offering fast first-token latency performance. Developers can access the Phi Silica API to deliver user experiences across the Windows ecosystem.

2. New Phi-3 Models: Microsoft has released three new models as part of Phi-3 models family - Phi-3-vision is Microsoft’s first small vision language model with 4.2B parameters, Phi-3 small model with 7B parameters, and Phi-3 medium model with 14B parameters. Phi-3 mini, small and medium models are generally available on Azure.

3. Real-Time Intelligence: Microsoft Fabric is a unified platform for data integration and analytics. The new Real-Time Intelligence feature, in preview, allows you to act on high-volume, time-sensitive data with tools like the Real-Time hub, event streams, and AI-powered insights for anomaly detection.

4. GitHub Copilot Extensions: GitHub’s new Copilot extensions integrate tools and services from third parties within GitHub’s IDE. Developers can customize their GitHub Copilot experience by integrating their preferred tools like Azure, Docker, and Sentry, where the Copilot Chat will now have context from all these tools to help you through your workflow without switching tools.

1. Azure AI Search: The new Azure AI Search, a full-featured information retrieval system, is designed for superior RAG and enterprise search. It offers enhanced information retrieval with new vector search capabilities, hybrid search improvements, and seamless integration with Microsoft Fabric’s OneLake connector. 

2. Azure AI Studio: Microsoft’s pro-code platform for developing and deploying custom AI models now is generally available and has a more user-friendly interface alongside code-first capabilities.

   1. Code-First Development Experiences - Integration with Azure Developer CLI and the AI Toolkit for Visual Studio Code streamlines the development process, facilitating LLMOps and accelerating code-to-cloud workflows.

   2. Opensource Foundation Models - The studio will have more models from companies like Nixtla, Cohere, and AI21 Labs.

   3. Other features: It provides a comprehensive toolchain for developers, including features like collaborative project hubs, experimentation playgrounds, data retrieval with Azure AI Search, fine-tuning capabilities, agent-based orchestration, and tracing for debugging.

1. Azure OpenAI Service: This provides access to advanced AI models, including OpenAI’s latest GPT-4o model, now generally available in Azure AI Studio and as an API. It also provides fine-tuning capabilities for customized outputs, and an Assistants API for advanced virtual assistants. 

2. Cognition + Microsoft: Microsoft will use Cognition’s AI software engineer Devin to help its developers achieve more, starting with code migrations and modernization, and bring Devin to its customer base. Devin will be powered by Azure.

Remove Unwanted Objects from Images with a Click 🌁

Adobe has just released a major update to its popular photo editing software, Lightroom, adding several new AI-powered features to simplify editing and give you more creative control. Powered by Adobe’s Firefly, Lightroom’s new Generative Remove tool lets you quickly and easily remove unwanted objects from photos with just a single click.

Key Highlights:

1. Generative Remove: Seamlessly remove unwanted objects from your photos in seconds. It intelligently analyzes the surrounding area and creates a natural-looking fill for a flawless image. Remove a distracting element from a landscape, take a person out of a group photo, or simply clean up a messy background without complex editing techniques.

2. Lens Blur: Apply beautiful blur effects to any part of your photos in a single click for a more professional look and feel. The tool comes with various preset options to create a range of styles, from subtle soft focus to dramatic bokeh effects.

3. Expanded tethering support for more cameras: This expands Lightroom Classic’s tethering capabilities so you can connect and control an even wider range of cameras. This means you can see your photos in Lightroom Classic in real-time as you shoot, saving you time and allowing for seamless editing workflows.

Tools of the Trade ⚒️

1. BlackBox AI: Blackbox AI lets you create AI agents with RAG to chat with your internal data for FREE. It also has a VS Code extension that helps developers by providing real-time code completion, documentation, and debugging suggestions.

1. Tako: A new AI search engine to visualize and share real-world knowledge. It sources accurate, real-time answers from authoritative providers and plots them in a graph to visualize and draw conclusions about trends. It currently supportsYou can try it now in Perplexity AI.

   1. single-domain searches (e.g. Nvidia stock price),

   2. cross-domain searches (e.g. Nvidia stock price vs. Biden approval rating), and

   3. time-based searches (e.g. Nvidia stock price vs. Biden approval rating since 1/11/22) across financial, economic, and political data.

1. Neolocus: Design your dream home by uploading a picture of your space and receiving AI-generated renders based on your style preferences. You can then purchase recommended products to bring your envisioned home to life.

2. Awesome LLM Apps: Build awesome LLM apps using RAG for interacting with data sources like GitHub, Gmail, PDFs, and YouTube videos through simple texts. These apps will let you retrieve information, engage in chat, and extract insights directly from content on these platforms.

Hot Takes 🔥

1. The paradox of the Information Age is that the more information we have the more disconnected from reality we get. Generative AI is latest manifestation of this. ~Pedro Domingos

2. The OpenAI documentary is gonna be wild. ~emily freeman

Meme of the Day 🤡

This [AI] is clearly programmed to feed dudes’ ego!

That’s all for today! See you tomorrow with more such AI-filled content.

Real-time AI Updates 🚨

⚡️ Follow me on Twitter @Saboo_Shubham for lightning-fast AI updates and never miss what’s trending!

PS: I curate this AI newsletter every day for FREE, your support is what keeps me going. If you find value in what you read, share it with your friends by clicking the share button below!