Think Before you Speak 🤔

Today’s top AI Highlights:

1. “Pause Token” to Delay and Improve Output in Language Models

2. Disney’s WALL.E Comes to Life

3. AI + Asana = Data-Driven Success

4. Perplexity’s API for Open-Source Language Models

& so much more!

Read time: 3 mins

Latest Developments 🌍

Think Before you Speak 🤔

Researchers at CMU and Google Research have introduced the concept of Pause Tokens in language models, specifically Transformer-based models, appended to the input, allowing the model to delay its output generation and improve its performance.

Key Highlights:

• Pause Tokens during both pretraining and fine-tuning liberates language models from computational constraints, enabling models to perform additional computations before generating each token and yielding significant performance improvements.

• Extensive testing on a 1B and 130M parameter decoder-only model shows remarkable results, including an 18% improvement in exact match scores on SQuAD questions, and improvement in CommonSense QA and reasoning (GSM8k) tasks.

• Ablation studies reveal crucial insights: appending pause tokens is more effective than prepending, optimal token counts vary by task, and reducing inference-time pause tokens leads to a graceful performance decline.

Disney’s WALL.E Comes to Life 🤖

Disney Research unveiled an innovative creation in emotive robotics, seamlessly blending animation with reinforcement learning to deliver captivating, expressive robot.

Key Highlights:

• The child-size bipedal robot packs an incredible amount of emotion into its compact frame with a highly expressive head, wiggly antennae, and dynamic leg movements, conveying a unique sense of life and personality through its motions.

• Developed by Moritz Bächer's team, this robot is mostly 3D printed, featuring modular hardware and actuator components for rapid design iterations, including a four-degree-of-freedom head and five-degree-of-freedom legs with hip joints for dynamic balance.

Organization’s Path to Success with AI in Asana 🏆

Asana has unveiled its latest innovation, Asana Intelligence, aimed at equipping executives, departments, and entire organizations with powerful AI-driven tools for enhancing clarity, accountability, and overall productivity.

Key Highlights:

• Asana Intelligence leverages historical performance data to assist users in crafting precise and effective goals. Say goodbye to strategic planning guesswork as AI drafts goals that align with your organization's track record, setting a clear path for success.

• It accelerates status reporting by tapping into real-time work data. It identifies potential risks, open questions, and roadblocks hindering goal achievement. This feature empowers teams to respond proactively and stay on track.

• Asana will also introduce the capability to build and optimize organization-wide workflows. Users can provide natural instructions, and AI will fine-tune workflows over time to align with specific goals and industry best practices.

Boost Your Projects with pplx-api 🚀

Perplexity Lab introduces pplx-api, a fast and efficient API designed for open-source LLMs like Mistral 7B, Llama2 13B, Code Llama 34B, Llama2 70B, and Replit-Code-V1.5-3B. It allows developers to easily integrate these models into their projects.

Key Highlights:

• Developers can quickly get started with pplx-api using a familiar REST API without the need for deep knowledge of C++/CUDA or access to GPUs.

• pplx-api is optimized for fast inference, achieving up to 2.9x lower latency than Replicate and 3.1x lower latency than Anyscale. It utilizes NVIDIA's TensortRT-LLM on A100 GPUs for efficient inference.

• It has demonstrated 4x reduction in cost, and can handle a daily load of over one million requests.

Tools of the Trade ⚒️

• Heuristica: Simplifies learning and research through AI-powered concept maps, enabling limitless exploration and knowledge discovery with helpful learning aids.

• Leap: Quickly create and deploy customizable AI workflows. Offers diverse models and integrates AI into applications effortlessly through a single API call.

• Copilot by CommandBar: An embedded user assistant for web apps, blogs, and marketing sites for UI guidance and automated actions via HTML embedding.

• Defog AI Agents: AI assistants to streamline data workflows, automate tasks, break down complex questions, explore hypotheses, and enhance collaboration.

• Surmount: AI-driven investment management to easily connect and automate your equities, crypto, and forex accounts with pre-built strategies and a web-based Python IDE.

Hot Takes 🔥

• a language model can be fine tuned to have whatever set of values or moral judgements or politics. there is no such thing as an amoral or apolitical chatbot because they are all playing characters drawn from the internet prior ~ roon

• The era of asymmetric warfare has barely begun. A year from now these drones will be running open source multimodal models that can navigate complex environments, recognize faces, and think step-by-step about how to cause the most damage. ~ Samuel Hammond

Meme of the Day 🤡

That’s all for today!

See you tomorrow with more such AI-filled content. Don’t forget to subscribe and give your feedback below 👇

Real-time AI Updates 🚨

⚡️ Follow me on Twitter @Saboo_Shubham for lightning-fast AI updates and never miss what’s trending!!

PS: I curate this AI newsletter every day for FREE, your support is what keeps me going. If you find value in what you read, share it with your friends by clicking the share button below!