Local Inference with Large Language Models

The article explains why a small consultancy chose to run large language models on its own hardware rather than through commercial AI services, arguing that confidentiality under NDAs, distrust of data handling, and a desire for control over their workflow outweigh the capability gap.