LLM Mastery: Build with Transformers & AI Like a Pro

About Course

Welcome to “LLM Mastery: Build with Transformers & AI Like a Pro”! This practical course is designed to equip you with the knowledge and skills to build efficient, production-ready Large Language Models using cutting-edge technologies. Key Topics Covered:

Generative AI: Understand the principles and applications of Generative AI in creating new data instances.
ChatGPT & GPT4: Dive into the workings of advanced AI models like ChatGPT and GPT4.
LLMs: Start with the basics of LLMs, learning how they decode, process inputs and outputs, and how they are taught to communicate effectively.
Encoder-Decoders: Master the concept of encoder-decoder models in the context of Transformers.
T5, GPT2, BERT: Get hands-on experience with popular Transformer models such as T5, GPT2, and BERT.
Machine Learning & Data: Understand the role of machine learning and data in training robust AI models.
Advanced Techniques: Sophisticated training strategies like PeFT, LoRa, managing data memory and merging adapters.
Specialised Skills: Cutting-edge training techniques, including 8-bit, 4-bit training and Flash-Attention.
Scalable Solutions: Master the use of advanced tools like DeepSpeed and FSDP to efficiently scale model training.

Course Benefits: • Career Enhancement: Position yourself as a valuable asset in tech teams, capable of tackling significant AI challenges and projects. • Practical Application: Learn by doing—build projects that demonstrate your ability to apply advanced LLM techniques in real-world situations. • Innovative Approach: Stay at the forefront of AI technology by mastering techniques that are shaping the future of machine learning.

Grasp NLP Fundamentals: Understand the evolution from rule-based systems to advanced LLMs like Llama3, Gemma2, Phi3, and Mistral.
Master Transformers & LLMs: Learn the architecture and application of Transformers in depth. Including tokenization, embeddings, pre-training & fine-tunning.
Understand Generative AI Principles: Develop skills in building and fine-tuning generative models for real-world applications using RLHF and Chat-Templates
Use Transformer Models: Overview LLMs and Encoder-Decoder models like BERT, GPT, T5, Llama and more in many different NLP tasks: Personal assistant, Reviews, QA
Specialised Techniques: Implement 8-bit and 4-bit training, and use tools like DeepSpeed and FSDP, along with PeFT, LoRA, FlashAttention and more.

Course Content

1.1 Introduction: Course Overview + What You’ll Learn

Introduction to Part 1 of the Course: Transformers Fundamentals
Introduction to Part 2 of The Course: LLMs

1.2 Getting Started: How to Make the Best Use of this Course

1.3 Overview of Natural Language Processing: Bring Transformers into Perspective

1.4 Transformers Introduction: Important Concepts and Use-cases

1.5 Popular Transformers Models: Choose the Best Model for the Job

1.6 Using Transformers: Building Blocks and Hidden Gems (Practical)

1.7 Mastering Real-World Scenarios with Transformers and LLMs (Practical)

2.1 Introduction to Large Language Models

2.2 Preparing for LLM Training (Practical)

2.3 Advanced LLM Training Techniques (Practical)

2.4 Exploring Specialised LLM Training Techniques (Practical)

2.5 Scale LLM Training with Advanced Tools (Practical)

Student Ratings & Reviews

No Review Yet