Evaluating Large Language Models (LLMs)

File Name

Size

Lesson 2 Evaluating Generative Tasks/004. 2.3 Evaluating Free Text Response Tasks, Part 2.mp4

188 MB

Introduction/001. Evaluating Large Language Models (LLMs) Introduction.mp4

18 MB

Lesson 1 Foundations of LLM Evaluation/001. Learning objectives.en.srt

791 B

Lesson 1 Foundations of LLM Evaluation/001. Learning objectives.mp4

4.7 MB

Lesson 1 Foundations of LLM Evaluation/002. 1.1 Introduction to Evaluation Why It Matters.en.srt

18 kB

Lesson 1 Foundations of LLM Evaluation/002. 1.1 Introduction to Evaluation Why It Matters.mp4

51 MB

Lesson 1 Foundations of LLM Evaluation/003. 1.2 Generative versus Understanding Tasks.en.srt

14 kB

Lesson 1 Foundations of LLM Evaluation/003. 1.2 Generative versus Understanding Tasks.mp4

41 MB

Lesson 1 Foundations of LLM Evaluation/004. 1.3 Key Metrics for Common Tasks.en.srt

26 kB

Lesson 1 Foundations of LLM Evaluation/004. 1.3 Key Metrics for Common Tasks.mp4

86 MB

Lesson 2 Evaluating Generative Tasks/001. Learning objectives.en.srt

706 B

Lesson 2 Evaluating Generative Tasks/001. Learning objectives.mp4

5.1 MB

Lesson 2 Evaluating Generative Tasks/002. 2.1 Evaluating Multiple-Choice Tasks.en.srt

18 kB

Lesson 2 Evaluating Generative Tasks/002. 2.1 Evaluating Multiple-Choice Tasks.mp4

52 MB

Lesson 2 Evaluating Generative Tasks/003. 2.2 Evaluating Free Text Response Tasks, Part 1.en.srt

31 kB

Lesson 2 Evaluating Generative Tasks/003. 2.2 Evaluating Free Text Response Tasks, Part 1.mp4

101 MB

Lesson 2 Evaluating Generative Tasks/004. 2.3 Evaluating Free Text Response Tasks, Part 2.en.srt

38 kB

Introduction/001. Evaluating Large Language Models (LLMs) Introduction.en.srt

2.5 kB

Lesson 2 Evaluating Generative Tasks/005. 2.3 AIs Supervising AIs LLM as a Judge.mp4

49 MB

Lesson 2 Evaluating Generative Tasks/005. 2.4 AIs Supervising AIs LLM as a Judge.en.srt

17 kB

Lesson 3 Evaluating Understanding Tasks/001. Learning objectives.en.srt

933 B

Lesson 3 Evaluating Understanding Tasks/001. Learning objectives.mp4

6.8 MB

Lesson 3 Evaluating Understanding Tasks/002. 3.1 Evaluating Embedding Tasks.en.srt

20 kB

Lesson 3 Evaluating Understanding Tasks/002. 3.1 Evaluating Embedding Tasks.mp4

62 MB

Lesson 3 Evaluating Understanding Tasks/003. 3.2 Evaluating Classification Tasks.en.srt

28 kB

Lesson 3 Evaluating Understanding Tasks/003. 3.2 Evaluating Classification Tasks.mp4

82 MB

Lesson 3 Evaluating Understanding Tasks/004. 3.3 Building an LLM Classifier with BERT and GPT.en.srt

31 kB

Lesson 3 Evaluating Understanding Tasks/004. 3.3 Building an LLM Classifier with BERT and GPT.mp4

89 MB

Lesson 4 Using Benchmarks Effectively/001. Learning objectives.en.srt

854 B

Lesson 4 Using Benchmarks Effectively/001. Learning objectives.mp4

6.4 MB

Lesson 4 Using Benchmarks Effectively/002. 4.1 The Role of Benchmarks.en.srt

11 kB

Lesson 4 Using Benchmarks Effectively/002. 4.1 The Role of Benchmarks.mp4

32 MB

Lesson 4 Using Benchmarks Effectively/003. 4.2 Interrogating Common Benchmarks.en.srt

30 kB

Lesson 4 Using Benchmarks Effectively/003. 4.2 Interrogating Common Benchmarks.mp4

90 MB

Lesson 4 Using Benchmarks Effectively/004. 4.3 Evaluating LLMs with Benchmarks.en.srt

31 kB

Lesson 4 Using Benchmarks Effectively/004. 4.3 Evaluating LLMs with Benchmarks.mp4

131 MB

Lesson 5 Probing LLMs for a World Model/001. Learning objectives.en.srt

703 B

Lesson 5 Probing LLMs for a World Model/001. Learning objectives.mp4

5.1 MB

Lesson 5 Probing LLMs for a World Model/002. 5.1 Probing LLMs for Knowledge.en.srt

25 kB

Lesson 5 Probing LLMs for a World Model/002. 5.1 Probing LLMs for Knowledge.mp4

74 MB

Lesson 5 Probing LLMs for a World Model/003. 5.2 Probing LLMs to Play Games.en.srt

34 kB

Lesson 5 Probing LLMs for a World Model/003. 5.2 Probing LLMs to Play Games.mp4

148 MB

Lesson 6 Evaluating LLM Fine-Tuning/001. Learning objectives.en.srt

693 B

Lesson 6 Evaluating LLM Fine-Tuning/001. Learning objectives.mp4

5.0 MB

Lesson 6 Evaluating LLM Fine-Tuning/002. 6.1 Fine-Tuning Objectives.en.srt

14 kB

Lesson 6 Evaluating LLM Fine-Tuning/002. 6.1 Fine-Tuning Objectives.mp4

33 MB

Lesson 6 Evaluating LLM Fine-Tuning/003. 6.2 Metrics for Fine-Tuning Success.en.srt

14 kB

Lesson 6 Evaluating LLM Fine-Tuning/003. 6.2 Metrics for Fine-Tuning Success.mp4

42 MB

Lesson 6 Evaluating LLM Fine-Tuning/004. 6.3 Practical Demonstration Evaluating Fine-Tuning.en.srt

37 kB

Lesson 6 Evaluating LLM Fine-Tuning/004. 6.3 Practical Demonstration Evaluating Fine-Tuning.mp4

102 MB

Lesson 6 Evaluating LLM Fine-Tuning/005. 6.4 Evaluating and Cleaning Data.en.srt

45 kB

Lesson 6 Evaluating LLM Fine-Tuning/005. 6.4 Evaluating and Cleaning Data.mp4

167 MB

Lesson 7 Case Studies/001. Learning objectives.en.srt

832 B

Lesson 7 Case Studies/001. Learning objectives.mp4

6.2 MB

Lesson 7 Case Studies/002. 7.1 Evaluating AI Agents Task Automation and Tool Integration.en.srt

24 kB

Lesson 7 Case Studies/002. 7.1 Evaluating AI Agents Task Automation and Tool Integration.mp4

78 MB

Lesson 7 Case Studies/003. 7.2 Measuring Retrieval-Augmented Generation (RAG) Systems.en.srt

15 kB

Lesson 7 Case Studies/003. 7.2 Measuring Retrieval-Augmented Generation (RAG) Systems.mp4

48 MB

Lesson 7 Case Studies/004. 7.3 Building and Evaluating a Recommendation Engine Using LLMs.en.srt

24 kB

Lesson 7 Case Studies/004. 7.3 Building and Evaluating a Recommendation Engine Using LLMs.mp4

87 MB

Lesson 7 Case Studies/005. 7.4 Using Evaluation to Combat AI Drift.en.srt

28 kB

Lesson 7 Case Studies/005. 7.4 Using Evaluation to Combat AI Drift.mp4

118 MB

Lesson 7 Case Studies/006. 7.5 Time-Series Regression.en.srt

24 kB

Lesson 7 Case Studies/006. 7.5 Time-Series Regression.mp4

107 MB

Lesson 8 Summary of Evaluation and Looking Ahead/001. Learning objectives.en.srt

812 B

Lesson 8 Summary of Evaluation and Looking Ahead/001. Learning objectives.mp4

5.4 MB

Lesson 8 Summary of Evaluation and Looking Ahead/002. 8.1 When and How to Evaluate.en.srt

14 kB

Lesson 8 Summary of Evaluation and Looking Ahead/002. 8.1 When and How to Evaluate.mp4

46 MB

Lesson 8 Summary of Evaluation and Looking Ahead/003. 8.2 Looking Ahead Trends in LLM Evaluation.en.srt

8.7 kB

Lesson 8 Summary of Evaluation and Looking Ahead/003. 8.2 Looking Ahead Trends in LLM Evaluation.mp4

27 MB

Summary/001. Evaluating Large Language Models (LLMs) Summary.en.srt

1.2 kB

Summary/001. Evaluating Large Language Models (LLMs) Summary.mp4

7.9 MB