Generative AI

Duration: 2 Months
Instructor location: US/India
Mode: Online, daily 1 HR

Module 1: Introduction to Generative AI

Topics:

  • Overview of Generative AI
  • Generative AI vs Traditional AI
  • Use Cases
  • Understanding AI: Basics and Use Cases
  • Differentiating ML, DL and AI
  • Basics of NLP

Module 2: Large Language Models

Topics:

  • Introduction to OpenAI and LLMs
  • What are LLMs?
  • How do LLMs work?
  • Types of LLMs
  • Practical uses of LLMs
  • Text Generation
  • Chatbot Creation
  • Foundations of Generative Models & LLMs
  • Generative Adversarial Networks (GANs)
  • Autoencoders in Generative AI
  • Significance of Transformers in AI
  • "Attention is All You Need" – Transformer Architecture
  • Reinforcement Learning (RLHF)

Module 3: LLM Foundation Models

Topics:

  • Encoder Models (BERT)
  • Decoder Models (GPT)
  • Encoder-Decoder Models (T5)
  • Open-Source vs Commercial Models
  • Quantization Models (GGML vs GGUF)

Module 4: LangChain & LlamaIndex Framework

Topics:

  • Introduction to LangChain & LlamaIndex
  • Hugging Face API + LangChain
  • Hugging Face API + LlamaIndex
  • Memory in LangChain
  • LLM Chain

Module 5: Retrieval Augmented Generation (RAG) & Evaluation

Topics:

  • Overview of RAG
  • Semantic Search, Vectors & Vector Databases
  • Building a GenAI App with RAG
  • Evaluating RAG
  • End-to-End Medical Chatbot Project

Module 6: Advanced RAG

Topics:

  • LOTR (Layered/Optimized Techniques in RAG)
  • Chain of Thought (CoT)

Module 7: Fine-Tuning & Evaluating LLMs

Topics:

  • Instruction Fine-Tuning
  • Single-Task Fine-Tuning
  • Multi-Task Instruction Fine-Tuning
  • Model Evaluation & Benchmarks
  • Parameter Efficient Fine-Tuning (PEFT)
  • LoRA
  • Soft Prompts
  • Lab Walkthrough

Module 8: Evaluation Metrics

Topics:

  • ROUGE
  • BLEU
  • METEOR
  • CIDEr

Module 9: Deployment & Hardware Considerations

Topics:

  • Deployment Strategies
  • Hardware Requirements

Module 10: Generative AI on Cloud – Hugging Face

Topics:

  • Hugging Face Overview
  • Hugging Face Hub

Module 11: Generative AI on Cloud – GCP

Topics:

  • Model Evaluation
  • Prompt Design

Module 12: Generative AI on Cloud – Azure

Topics:

  • Azure ML
  • Azure Cognitive Services
  • Azure Databricks

Module 13: Generative AI on Cloud – AWS

Topics:

  • AWS Bedrock

Module 14: Introduction to GPT & ChatGPT Architectures

Topics:

  • Overview of GPT
  • ChatGPT Capabilities
  • GPT Architecture
  • GPT-3 vs GPT-4
  • Advancements in GPT-4
  • Ethical Considerations

Module 15: Introduction to Prompt Engineering

Topics:

  • Fundamentals of Prompt Engineering
  • Types of Prompts
  • Content Generation Strategies
  • Video & Music Generation with Prompts
  • Tokens & Parameters

Module 16: Advanced Prompt Engineering

Topics:

  • Zero-Shot, One-Shot & Few-Shot Learning
  • Model Parameter Adjustments
  • Managing Hallucinations & Bias
  • Advanced Prompt Crafting Techniques
  • Prompt Optimization & Refinement

Module 17: Agents

Topics:

  • Overview of Agents
  • LangChain Agents
  • AWS Bedrock Agents
  • Crew AI

Module 18: Guardrails

Topics:

  • Overview of Guardrails
  • Implementing Guardrails
  • AWS & Azure Guardrails

Module 19: GitHub Copilot

Topics:

  • Overview of GitHub Copilot
  • Complex Coding with Copilot
  • Generate, Document & Test Code
  • Effective Prompting for Developers
  • Commands & Agents

Module 20: Generative AI for Software Testing

Topics:

  • Generate Test Documentation
  • AI for Understanding Test Scripts
  • Generate Test Cases from Images
  • QA Strategy with Generative AI

Module 21: Real-World Applications & Case Studies

Topics:

  • End-to-End GenAI Project (Gemini Pro)
  • Medical Chatbot
  • Talk to Your Codebase
  • Code Translation & Conversion
  • Chatbot for Complex PDFs
  • Self-Healing Code
  • NLP to SQL