Introducing Julius: Open Source LLM Service Fingerprinting

Ali NematiJan 3030 sec read19 views

Julius is a tool for detecting various types of machine learning services and chat interfaces by sending HTTP requests to specified ports and analyzing responses. It includes predefined probes for many services like Salesforce Einstein, Gradio, AnythingLLM, and others, covering self-hosted LLMs, ML demo platforms, RAG platforms, and generic OpenAI-compatible APIs. Users can extend functionality with custom YAML-defined probes without modifying code. Validation of new probes is straightforward using the julius validate command.

Read the full article at Blog - Praetorian

Want to create content about this topic? Use Nemati AI tools to generate articles, social posts, and more.

Comments

MobileLLM-R1: Exploring the Limits of Sub-Billion Language Model Reasoners with Open Training Recipes

Researchers have developed MobileLLM-R1, a series of sub-billion-parameter reasoning models that demonstrate strong performance using only 2T tokens o...Researchers have developed MobileLLM-R1, a series of sub-billion-parameter reasoning models that demonstrate strong performance using only 2T tokens of high-quality data, challenging the notion that large datasets are essential for effective language...

Ali Nemati

AI & Machine LearningNov 20, 202540 sec read

Olmo 3: America's truly open reasoning models

Allen Institute for AI (Ai2) released Olmo 3, a comprehensive suite of large language models including base, thinking, and instruct variants across va...Allen Institute for AI (Ai2) released Olmo 3, a comprehensive suite of large language models including base, thinking, and instruct variants across various scales. The release includes extensive datasets and detailed methodologies for supervised fine...

Ali Nemati

AI & Machine LearningNov 19, 202432 sec read

MLSysBook.AI: Principles and Practices of Machine Learning Systems Engineering

MLSysBook.ai is an educational resource focusing on ML system engineering principles, distinct from specific tool implementations like TensorFlow. It ...MLSysBook.ai is an educational resource focusing on ML system engineering principles, distinct from specific tool implementations like TensorFlow. It includes interactive features such as SocratiQ for adaptive learning and real-time conversations wit...

Ali Nemati

AI & Machine LearningJul 17, 202429 sec read

Mistral AI's Open Source Models for Math and Coding

Andrej Karpathy wishes for a tech ecosystem resembling a thriving coral reef but sometimes it feels imbalanced, while Jaana Dogan notes that LLMs have...Andrej Karpathy wishes for a tech ecosystem resembling a thriving coral reef but sometimes it feels imbalanced, while Jaana Dogan notes that LLMs have attracted individuals who lack understanding of building systems with non-deterministic components ...

Ali Nemati

AI & Machine Learning2 days ago26 sec read

I Fed My Entire Codebase to Gemini. It Wrote Better Cursor Rules Than I Did.

A developer created a CLI tool called rule-gen that uses Google's Gemini AI to generate coding rules specific to a project's source code rather than r...A developer created a CLI tool called rule-gen that uses Google's Gemini AI to generate coding rules specific to a project's source code rather than relying on generic templates. This approach leverages Gemini's large context window and structured ou...

Ali Nemati

Introducing Julius: Open Source LLM Service Fingerprinting

Related Articles

MobileLLM-R1: Exploring the Limits of Sub-Billion Language Model Reasoners with Open Training Recipes

Olmo 3: America's truly open reasoning models

MLSysBook.AI: Principles and Practices of Machine Learning Systems Engineering

Mistral AI's Open Source Models for Math and Coding

I Fed My Entire Codebase to Gemini. It Wrote Better Cursor Rules Than I Did.