test-nonsense

Test and analyze text for nonsensical content using the nonsense detection system. This command helps identify gibberish, repetitive patterns, and other markers of low-quality or corrupted text output.

Basic Usage

python -m wisent test-nonsense [TEXT] [OPTIONS]

Examples

Analyze Text

python -m wisent test-nonsense "This is a normal sentence to analyze."

Interactive Mode

python -m wisent test-nonsense

With Verbose Output

python -m wisent test-nonsense "The quick brown fox jumps over the lazy dog." --verbose

Custom Thresholds

python -m wisent test-nonsense "Some text to analyze" \
  --max-word-length 25 \
  --repetition-threshold 0.8 \
  --gibberish-threshold 0.4

Test Built-in Examples

python -m wisent test-nonsense --examples

Arguments

Argument	Default	Description
text	-	Text to analyze (optional, uses interactive mode if not provided)
--max-word-length	20	Maximum reasonable word length
--repetition-threshold	0.7	Threshold for repetitive content detection (0-1)
--gibberish-threshold	0.3	Threshold for gibberish word detection (0-1)
--disable-dictionary-check	false	Disable dictionary-based word validation
--verbose	false	Show detailed analysis
--examples	false	Test with built-in example texts

Detection Types

The nonsense detection system checks for:

Gibberish words - Random character sequences that don't form valid words
Repetitive content - Text with excessive repetition of words or phrases
Overly long words - Words exceeding reasonable length thresholds
Dictionary validation - Words not found in standard dictionaries

Related Commands

Nonsensical Response Blocking - Learn about nonsense detection in steering
verify-steering - Verify steering effectiveness

Stay in the loop. Never miss out.

Subscribe to our newsletter and unlock Wisent insights.

Contact Careers Privacy Policy Terms of Service