Tag: catastrophic forgetting

Preventing Catastrophic Forgetting During LLM Fine-Tuning: Techniques That Work

Preventing Catastrophic Forgetting During LLM Fine-Tuning: Techniques That Work

by Phillip Ramos

Explore proven techniques to prevent catastrophic forgetting in LLM fine-tuning. We analyze LoRA, EWC, FIP, and hybrid methods to help you preserve model knowledge.

Hyperparameter Selection for Fine-Tuning Large Language Models Without Forgetting

Hyperparameter Selection for Fine-Tuning Large Language Models Without Forgetting

by Phillip Ramos

Learn how to fine-tune large language models without losing their original knowledge. Discover the best hyperparameters, methods like LoRA and FAPM, and real-world trade-offs that keep models accurate and reliable.

Categories

Archives

Recent-posts

Retraining After Compression: How to Restore Accuracy in Compressed LLMs

Retraining After Compression: How to Restore Accuracy in Compressed LLMs

Jun, 22 2026

Interactive Clarification Prompts in Generative AI: Asking Before Answering

Interactive Clarification Prompts in Generative AI: Asking Before Answering

May, 13 2026

Allocating LLM Costs Across Teams: Chargeback Models That Actually Work

Allocating LLM Costs Across Teams: Chargeback Models That Actually Work

Jul, 26 2025

Latency Optimization for Large Language Models: Streaming, Batching, and Caching

Latency Optimization for Large Language Models: Streaming, Batching, and Caching

Aug, 1 2025

Prompt Libraries for Generative AI: Governance, Versioning, and Best Practices

Prompt Libraries for Generative AI: Governance, Versioning, and Best Practices

Apr, 15 2026