The semiconductor industry closed 2023 on a high note as the U.S. CHIPS Act brought renewed attention to our importance and product introductions from startups and established players buoyed our confidence. Technological innovations will continue into 2024 along the same trends line much as they did last year more or less. Despite a drop in … Read more
What you’ll learn: Lauro Rizzatti has turned his vast understanding of the semiconductor and verification markets to generative AI to better understand its benefits and limitations, something long overdue as myths and misconceptions multiply across the internet. Below he debunks 11 of those myths surrounding the technology. 1. Any computing engine, whether CPUs, GPUs, FPGAs, … Read more
Software is eating the world today while hardware is feeding it and data is driving it. In 2024, software will be eating the hardware as AI and Generative AI take more and more compute power to execute. GenAI also needs substantial data communication throughput delivered by the underlying hardware infrastructure. These demanding requirements are necessary … Read more
The latest algorithms, such as GPT-4, pose a challenge to the current state-of-the-art processing hardware, and GenAI accelerators aren’t keeping up. In fact, no hardware on the market today can run the full GPT-4. Current large language model (LLM) development focuses on creating smaller but more specialized LLMs that can run on existing hardware is a diversion. … Read more
Two recent software-based algorithmic technologies –– autonomous driving (ADAS/AD) and generative AI (GenAI) –– are keeping the semiconductor engineering community up at night. While ADAS at Level 2 and Level 3 are on track, AD at Levels 4 and 5 are far from reality, causing a drop in venture capital enthusiasm and money. Today, GenAI … Read more
When you look under the hood of generative AI processing, the system design challenges are many. Learn how efficiency, power consumption, and memory issues all come into play. In less than a year, generative AI saw global fame and use through OpenAI’s ChatGPT, a popular algorithm based on transformers. Transformer-based algorithms can learn complex interactions … Read more
Judged by the presence of artificial intelligence (AI) and machine learning (ML) technologies at 2023 Design Automation Conference (DAC), the premiere event for semiconductor designers, computing hardware for accelerating AI/ML software workloads is finally receiving due attention. According to PitchBook Data, in the first six months of 2023, more than 100 startups designing novel AI/ML … Read more
Mass adoption of generative AI hinges on improving processing efficiency and lowering total cost of ownership. Similar to the internet and the invention of its World Wide Web application, generative AI has seized the public’s imagination. ChatGPT, the most popular AI chatbot launched a mere eight months ago, caught the world by surprise, reported to … Read more
The next evolution in autonomous driving is to fuse sensor data in a 3D representation to increase the accuracy of understanding the environment and of tracking the movement of dynamic objects.
In general, the largest system-on-chip (SoC) designs in industries such as automotive, artificial intelligence/machine learning (AI/ML), and graphics/computing/storage share complexity and size, measured in billions of transistors.