• unwind ai
  • Posts
  • AI Independence from bots and web crawlers

AI Independence from bots and web crawlers

PLUS: Major updates to Perplexity Pro Search, RAG chatbot to query your data

Today’s top AI Highlights:

  1. Cloudflare lets you block AI web scraping bots in a single click

  2. Perplexity Pro Search now solves problems like an AI research assistant

  3. ChatGPT desktop app was storing your conversations

  4. WhatsApp’s new update will let you imagine your photos in new ways

& so much more!

Read time: 3 mins

Latest Developments 🌍

The explosion of generative AI has unfortunately spawned a problematic side effect: AI bots continuously scraping content from websites to feed their hungry AI models. Only a few AI companies including OpenAI and Google give the option to turn these bots off, but not all AI companies are being transparent. This raises questions about data ownership and usage while also threatening the livelihood of content creators.

Addressing this issue, Cloudflare has added a brand new one-click to block all AI bots in their dashboard. It’s available for all customers, including those on the free tier.

Key Highlights:

  1. No complex configurations - This is an incredibly easy way to safeguard your content. With a single click in the Cloudflare dashboard, you can activate this feature to block all AI bots from accessing your site.

  2. Proactive, Data-Driven Identification - Cloudflare leverages the massive scale of its global network to proactively identify, categorize, and flag suspicious AI bot activity.

  3. Evasive Bot Detection - Even AI bots that attempt to mask themselves as regular web browsers by spoofing user agents are not safe. Cloudflare utilizes advanced machine learning models to analyze multiple signals and behavioral patterns, and identify and block AI bots, regardless of how well they try to disguise themselves.

Perplexity AI has upgraded its Pro Search to handle complex research tasks. Previously capable of quick searches, Pro Search can now execute multi-step reasoning to answer intricate questions by understanding, planning, and working through goals. This upgrade combines enhanced search and synthesis capabilities with advanced computational abilities for a comprehensive research tool.

Key Highlights:

  1. Multi-step Reasoning - Pro Search can now handle complex queries that require planning and multi-step processes. It can understand the nuances of a question, break it down into smaller steps, and synthesize information from various sources to deliver a complete answer.

  2. Advanced Math and Programming - With faster code execution and integration with the Wolfram|Alpha engine, Pro Search can tackle complex mathematical problems and programming tasks with increased speed and accuracy. It can analyze data, debug code, and even generate content based on user inputs.

  3. Depth and Insights - Pro Search goes beyond simple QA by providing in-depth analysis and insights. It presents its findings in an easily understandable format, citing all its sources and showing the step-by-step process behind its reasoning. This makes it a powerful tool for anyone who needs to conduct thorough research.

Quick Bites 🤌

  1. OpenAI’s ChatGPT macOS app was storing user conversations in plain text on the computer. This means if anyone or a malicious app accessed your machine, they could easily read your conversations with ChatGPT. OpenAI has addressed the issue with an update that encrypts these locally stored chats. (Source)

  2. Meta is working on a new update for WhatsApp where you’ll be able to generate images of yourself with Meta AI. This will require you to give your photos to Meta AI, and ask it to generate versions of you based on your text prompts. (Source)

😍 Enjoying so far, share it with your friends!

Tools of the Trade ⚒️

  1. Devyan: AI software development assistant that orchestrates a team of agents to solve programming tasks. It uses OpenAI’s GPT-based agents to perform various roles such as architecture design, implementation, testing, and reviewing.

  2. Verba: Open-source RAG chatbot to query and interact with your data. Resolve questions around your documents, cross-reference multiple data points or gain insights from existing knowledge bases. 

  1. Lytix: Monitor, test, and analyze your LLM applications with minimal changes to your code. It provides product insights, end-to-end analytics, and error tracking, so you can see how users interact with your LLM stack and measure the impact of changes.

  2. Awesome LLM Apps: Build awesome LLM apps using RAG for interacting with data sources like GitHub, Gmail, PDFs, and YouTube videos through simple texts. These apps will let you retrieve information, engage in chat, and extract insights directly from content on these platforms.

Hot Takes 🔥

  1. If you’re having a bad day, start signing up to SaaS platforms with the first and last name of “[object Object]”, then someone else is guaranteed to have a bad day too ~
    I Am Devloper

  2. Humans are the species that keeps growing because it always finds an innovation to save the day when it's on the brink of catastrophe. In the 20th century it was the Haber process. In the 21st it will be AI. ~
    Pedro Domingos

Meme of the Day 🤡

me: yea I fixed the bug. it was quick and easy

pm: production is down

me:

That’s all for today! See you tomorrow with more such AI-filled content.

Real-time AI Updates 🚨

⚡️ Follow me on Twitter @Saboo_Shubham for lightning-fast AI updates and never miss what’s trending!

PS: We curate this AI newsletter every day for FREE, your support is what keeps me going. If you find value in what you read, share it with your friends by clicking the share button below!

Reply

or to participate.