Tag: small LLMs

Compression-Aware Prompting: Getting the Best from Small LLMs

Compression-Aware Prompting: Getting the Best from Small LLMs

Learn how compression-aware prompting optimizes small LLMs by distilling prompts. Explore techniques like TPC and LJMLingua to cut costs, boost speed, and improve RAG accuracy.

Categories

Archives

Recent-posts

Citation and Attribution in RAG Outputs: How to Build Trustworthy LLM Responses

Citation and Attribution in RAG Outputs: How to Build Trustworthy LLM Responses

Jul, 10 2025

Speculative Decoding Guide: Speed Up LLM Inference with Draft and Verifier Models

Speculative Decoding Guide: Speed Up LLM Inference with Draft and Verifier Models

Apr, 25 2026

Bias in Large Language Models: Sources, Measurement, and Mitigation

Bias in Large Language Models: Sources, Measurement, and Mitigation

Mar, 18 2026

Procurement Checklists for Vibe Coding Tools: Security and Legal Terms You Can't Ignore

Procurement Checklists for Vibe Coding Tools: Security and Legal Terms You Can't Ignore

Jan, 21 2026

Speculative Decoding and MoE: How These Techniques Slash LLM Serving Costs

Speculative Decoding and MoE: How These Techniques Slash LLM Serving Costs

Dec, 20 2025

PCables AI Interconnects

Menu