» Tag
llm
473 postsInkling by Thinking Machines: A Groundbreaking Multimodal LLM
Thinking Machines introduces Inkling, a multimodal LLM with 1 trillion parameters and 1M context window, offering new opportunities for engineers.
LLM Red Team Lab: An Interactive Educational Tool
The LLM Red Team Lab offers an interactive educational tool for authorized testing of local LLMs.
AI Firewall: Security Gateway and Reverse Proxy for LLM Traffic
AI Firewall serves as a security gateway for LLM APIs, preventing data leaks and protecting user privacy.
CommitBrief — AI code reviews, right in your terminal
A provider-agnostic, local-first CLI that reviews your staged changes, a historic range, or a whole GitHub pull request. Zero telemetry, no server. Free and open source.
commitbrief.comWiFi Weight Streaming for LLM on ESP32
Run Llama-2 architecture on ESP32 via WiFi streaming. RAM usage remains flat, while generation is limited by network bandwidth.
LangChain4j and Spring AI: Connecting Your Java Apps to LLMs
LangChain4j and Spring AI simplify the integration of Java applications with LLMs.
Building a Hybrid RAG API: The LLM Was the Easy Part
Challenges in building a hybrid RAG API and its importance for engineers. Details on PDF processing and question answering.
Rules or Examples in LLM Context: What Works Best?
A study exploring the impact of rules vs examples in LLM contexts, focusing on data analytics use cases.
OpenAI's GPT-Red: A Super Hacker LLM for Enhanced Model Security
OpenAI's GPT-Red is a super-hacker LLM that automates security testing, enhancing model defenses against cyber threats.
Exploiting LLM Vulnerabilities: Accessing Dangerous Instructions
Dave Kuszmar revealed vulnerabilities in LLMs that allowed access to dangerous instructions, indicating a critical security issue across the industry.
Type-safe LLM Outputs with Zod: Stop Guessing What the Model Returns
Manage your LLM outputs safely with Zod. Define schemas and validate to prevent errors.