｢‍｣ Lingenic

Format Comparison

HSV vs JSON, CSV, XML, and others

Overview

* Text mode never needs escaping. Binary mode uses DLE transparency (~0.4% overhead).

vs JSON

Simple Object

{"name": "Alice", "age": 30, "city": "NYC"}

[STX] name [US] Alice [RS] age [US] 30 [RS] city [US] NYC [ETX]

Special Characters

{"msg": "He said \"hello\""}

[STX] msg [US] He said "hello" [ETX]

{"path": "C:\\Users\\data"}

[STX] path [US] C:\Users\data [ETX]

Multiline Content

{"text": "line 1\nline 2\nline 3"}

[STX] text [US] line 1
line 2
line 3 [ETX]

Streaming

{"name": "Alice"}
{"name": "Bob"}
{"name": "Carol"}

[STX] name [US] Alice [FS] name [US] Bob [FS] name [US] Carol [ETX]

Nested Objects

{"user": {"name": "Alice", "email": "a@b.com"}}

[STX] user [US] [SSA] name [US] Alice [RS] email [US] a@b.com [ESA] [ETX]

Legend: [US] = key:value · [RS] = properties · [GS] = array · SSA/ESA = nested · [FS] = records · [STX]/[ETX] = start/end

Both JSON and HSV support unlimited nesting. HSV uses SSA/ESA (Start/End of Selected Area) for nesting depth.

vs CSV

The Quoting Problem

Alice,"likes cats, dogs"
Bob,"said ""hi"""

[STX] Alice [RS] likes cats, dogs [FS] Bob [RS] said "hi" [ETX]

CSV requires quoting when data contains commas or quotes. HSV never needs quoting.

vs XML

<user>
  <name>Alice</name>
  <age>30</age>
</user>

[STX] name [US] Alice [RS] age [US] 30 [ETX]

Entity Escaping

<msg>x &lt; y &amp; a &gt; b</msg>

[STX] msg [US] x < y & a > b [ETX]

Document Structures (HTML-like data)

HSV can represent document trees. Angle brackets are just visible nesting delimiters—SSA/ESA are invisible ones:

<div class="box">
  <p>Hello <b>world</b></p>
</div>

[STX] tag [US] div [RS] class [US] box [RS] children [US] [SSA]
  tag [US] p [RS] children [US] [SSA]
    text [US] Hello
    [GS] tag [US] b [RS] text [US] world
  [ESA]
[ESA] [ETX]

AST Serialization

Abstract syntax trees are nested structures with node types and properties—a natural fit for HSV:

{"type": "BinaryExpr",
 "op": "+",
 "left": {"type": "Num", "value": 1},
 "right": {"type": "Num", "value": 2}}

[STX] type [US] BinaryExpr [RS] op [US] + [RS] left [US] [SSA] type [US] Num [RS] value [US] 1 [ESA] [RS] right [US] [SSA] type [US] Num [RS] value [US] 2 [ESA] [ETX]

Compiler toolchains, linters, and code formatters can exchange ASTs without escaping operators like \, ", or &&.

Templating Engines

Templates mix literal text with structure. HSV keeps them separate without escape sequences:

Hello {{name}},
Your balance is ${{amount}}.
Click <a href="{{url}}">here</a>.

[STX] text [US] Hello [GS] var [US] name [GS] text [US] ,
Your balance is $ [GS] var [US] amount [GS] text [US] .
Click [GS] tag [US] a [RS] href [US] [SSA] var [US] url [ESA] [RS] text [US] here [GS] text [US] . [ETX]

Template compilation becomes tree manipulation, not string surgery.

vs Binary Formats

HSV fills the gap: More efficient than JSON/XML, more debuggable than binary, and can still embed raw bytes when needed.

Binary Data

HSV uses DLE (Data Link Escape) for binary transparency—the same technique BISYNC used in 1967:

{"image": "iVBORw0KGgo..."}

[STX] image [US] [DLE] [STX] <raw PNG bytes> [DLE] [ETX] [ETX]

How it works:

• [DLE] [STX] (DLE STX) = start binary section
• [DLE] [ETX] (DLE ETX) = end binary section
• [DLE] [DLE] (DLE DLE) = literal DLE byte

Inside binary mode, only DLE needs escaping. All 21 other reserved control codes become literal data.

Streaming Comparison

Parallel Parsing

HSV is the only format here that supports parallel parsing at every data level.

Why other formats require sequential parsing:

HSV has no escape state. Every separator byte (FS, GS, RS, US, SSA, ESA) is always structural. Split on any of them, parse chunks independently.

Parallel at Every Data Level

File level:     Scan for STX/ETX → split into blocks → parse blocks in parallel
Record level:   Scan for FS ([FS]) → split into records → parse records in parallel
Property level: Scan for RS ([RS]) → split into pairs → parse pairs in parallel
Array level:    Scan for GS ([GS]) → split into items → parse items in parallel

Every split is just "find byte, cut." No state machine. No lookahead. No backtracking.

When to Use What

Summary

HSV is ideal when:

• You need streaming with clean framing
• Data contains special characters (quotes, newlines, backslashes)
• Size matters but you want human-readable
• You want simple split-based parsing
• You need parallel parsing on multi-core systems
• You need bidirectional protocol support (ENQ/ACK/NAK)
• You need flow control (XON/XOFF)