GPU - The brain of Artificial Intelligence






Machine Learning algorithms require tens and thousands of CPU based servers to train a model, which turns out to be an expensive activity. Machine Learning researchers and engineers are often faced with the problem of running their algorithms fast.

Although initially invented for processing graphics in computer games, GPUs today are used in machine learning to perform feature detection from vast amount of unlabeled data. Compared to CPUs, GPUs take far less time to train models that perform classification and prediction.

Characteristics of GPUs that make them ideal for machine learning

  • Handle large datasets
  • Needs far less data centre infrastructure
  • Can be specialized for specific machine learning needs
  • Perform vector computations faster than any known processor
  • Designed to perform data parallel computation

NVIDIA CUDA GPUs today are used to build deep learning image processing tools for  Adobe Creative Cloud. According to NVIDIA blog future Adobe applications might be able to automatically identify font styles from images to help their users choose the right font for their creative projects. For such intense deep learning methods CPUs stand far behind GPUs.  According to NVIDIA’s website, GPUs perform more than 33% faster compared to CPUs on recognition tasks.

Major corporations including Baidu, Netflix, Facebook, Google, Bitcoin and many more are using GPUs for machine learning. The recent open source machine learning toolkits such as Theano and Tensorflow provide GPU support. With just few lines of code you can allocate the machine learning algorithm to learn the model on multiple GPUs.

Recently Facebook open sourced its AI hardware design named Big Sur which leverages NVIDIA's Tesla Accelerated Computing Platform. Check out the news.

GPUs are changing the AI scene too fast, and have established themselves as the necessary hardware to build deep learning applications. They might turn out to be the most important component in brain, or the brain itself in the most advanced machines of the future.

Comments

Post a Comment

Popular posts from this blog

Can language models reason?

Image
  Illustration by Rajashree Rajadhyax Large language models are an impressive technology that excels at providing answers based on vast knowledge of the world. However, they often struggle with reasoning and logic-based questions. To overcome this limitation, the Chain-of-Thought (CoT) method was introduced. This technique emulates how humans solve problems by reasoning step-by-step. Just as we break down complex problems into smaller, manageable parts for analysis and logical resolution, CoT guides language models to adopt a similar approach. By mimicking this natural, structured problem-solving process, CoT enhances the models’ ability to handle logic-driven tasks with greater accuracy and reliability. This approach, however, requires more time and computational effort because it involves processing more tokens . Tokens are the building blocks of text, like words or parts of words, that the model uses to understand and generate responses. Since the Chain-of-Thought method involv...
Read more

AI implementation myths

Image
  Visionary leaders recognize the importance of adopting cutting-edge technologies to enhance their business operations. This is a bold move, especially in the early stages when few businesses have embraced it. Generative AI is currently at such a juncture. Although AI has experienced several setbacks over the years, recent advancements in foundational models like large language models (LLMs) have reignited interest and investment in the field. Generative AI never fails to impress those who see it in action. At Cere Labs, my company, we have developed a Gen AI framework, and whenever I demonstrate it, the feedback is unanimously positive, with many stating it is "useful." However, despite this enthusiasm, there is hesitation when it comes to integrating this technology into business practices. Addressing certain misconceptions and concerns could help leaders more easily adopt Generative AI to enhance their operations. With my 8 years of experience assisting businesses in inco...
Read more

Homework 2.0: The science behind homework and why it still matters in the AI age!

Image
  Illustration by Rajashree Rajadhyax I recently came across an article about how teachers are coming up with methods to distinguish between homework done by students and that done by AI. This effort by teachers is not without cause; a recent case in Massachusetts saw a student penalized for using AI in their history paper, highlighting the need for such measures. I found it intriguing and couldn’t help but reflect on this shifting trend.  Homework! Does that word bring back memories? The race to finish it as fast as possible so you could finally go play! Holidays would’ve been so much better without it, don’t you think? I know I felt that way, and I’m pretty sure you did too. And let’s not forget those classmates with endless excuses for not doing it. The most common one? “I wasn’t feeling well!” 🤒 Some would even throw in a few coughs just to make it believable 😏. I was that kid on the opposite end. Just before a holiday, I’d be sneaking in some homework during lunch break...
Read more