0d576a14b7
The Blaze switch was hardwired to 42130 and could not intercept the redirector.
Rather than clone it, the iptables logic now lives in one place:
openfut-switch.sh generic: --server-ip --intercept-port --target-port
--name [--client-ip] [--legacy-tag]
blaze-switch.sh thin wrapper, CLI and output UNCHANGED so the validated
gate runbook and sidecar.sh's cross-check keep working
No deployment IP or port literal in the generic tool; 42130 is supplied by the
wrapper, 42127 by the redirector experiment.
VERIFICATION IS INDEPENDENT OF REMOVAL. Rules are created and deleted by their
comment tag; they are verified by parsing the kernel's own FIELDS (chain,
destination, dport, to-ports) with no reference to the comment. Status detects
duplicates, incomplete pairs, conflicting targets under one name, and foreign
redirects on the same port -- which it reports but never deletes. `off` removes
only rules bearing this switch's exact tag, then re-reads the table to confirm.
THREE BUGS FOUND WHILE BUILDING IT, all in the same family as the original
lying rollback:
1. Renaming the tag ORPHANED live rules. Gate 10 deliberately ended with the
switch on, so rules carrying the old tag were still installed and the
renamed tool could not see them -- `off` would have reported success while
traffic stayed redirected. Hence --legacy-tag: a rename must not strand
rules it owns.
2. Deleting by re-feeding the raw `iptables-save` line through the shell fails
on this iptables, which prints `--comment "tag"` WITH quotes; word-splitting
leaves the quotes inside the value so nothing matches. Bare-comment rules
deleted fine, which is exactly what made it look like it worked. Deletes are
now rebuilt from parsed fields and passed as argv elements.
3. `IFS=$'\t' read` collapsed consecutive tabs because tab is IFS *whitespace*,
so an absent `-s` shifted every later field left and produced
`-s <dport> --dport <to_ports> --to-ports ''`. Harmless here, but a shifted
spec that matched a real rule would delete the wrong one. Now uses \x1f.
Mutation-tested against all seven required cases: wrong intercept port, wrong
target port, missing rule, duplicate rule, changed comment representation
(bare vs quoted), and a rollback that leaves a foreign redirect installed --
which exits non-zero rather than claiming success.
Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
329 lines
12 KiB
Bash
Executable File
329 lines
12 KiB
Bash
Executable File
#!/usr/bin/env bash
|
|
# Generic client-side service interception for OpenFUT.
|
|
#
|
|
# openfut-switch.sh on --server-ip <IP> --intercept-port <P> --target-port <Q> \
|
|
# --name <ID> [--client-ip <IP>]
|
|
# openfut-switch.sh off --name <ID>
|
|
# openfut-switch.sh status [--name <ID>]
|
|
#
|
|
# ONE implementation. `blaze-switch.sh` is a thin compatibility wrapper over
|
|
# this; there is deliberately no second copy of the iptables logic, because two
|
|
# scripts manipulating the same table diverge and then disagree about what is
|
|
# installed.
|
|
#
|
|
# WHAT IT DOES
|
|
#
|
|
# Redirects traffic destined for <server-ip>:<intercept-port> to a local
|
|
# <target-port>, so a replacement or observer can sit in front of a service
|
|
# without touching that service. Loopback is never matched: the rule is scoped
|
|
# to the server address, so 127.0.0.1:<intercept-port> keeps reaching the
|
|
# original process and stays usable as an oracle.
|
|
#
|
|
# TWO INDEPENDENT VIEWS, ON PURPOSE
|
|
#
|
|
# Rules are CREATED and DELETED by their comment tag. They are VERIFIED by
|
|
# parsing the kernel's own rule fields — chain, destination, dport, to-ports —
|
|
# with no reference to the comment. An earlier version of the Blaze switch
|
|
# matched `--comment "tag"` with quotes this iptables does not emit, so removal
|
|
# found nothing AND the verification used the same broken matcher, confirming a
|
|
# rollback that had not happened. A verifier must not share the failure mode of
|
|
# the thing it verifies.
|
|
set -uo pipefail
|
|
|
|
TAG_PREFIX="openfut-switch"
|
|
SUDO=""
|
|
[[ $EUID -eq 0 ]] || SUDO=sudo
|
|
|
|
die() { echo "openfut-switch: $*" >&2; exit 2; }
|
|
|
|
# ------------------------------------------------------------------ parsing
|
|
#
|
|
# Structured view of the nat table. Parses FIELDS, not comment text — this is
|
|
# the independent verifier referred to above.
|
|
rules_json() {
|
|
$SUDO iptables-save -t nat 2>/dev/null | python3 -c '
|
|
import json, re, sys
|
|
out = []
|
|
for line in sys.stdin:
|
|
line = line.strip()
|
|
if not line.startswith("-A "):
|
|
continue
|
|
parts = line.split()
|
|
def val(flag):
|
|
try:
|
|
return parts[parts.index(flag) + 1]
|
|
except (ValueError, IndexError):
|
|
return None
|
|
# Comment may be quoted or bare depending on iptables version; correctness
|
|
# never depends on which, because every check below can use the fields.
|
|
m = re.search(r"--comment\s+(\"([^\"]*)\"|(\S+))", line)
|
|
comment = (m.group(2) or m.group(3)) if m else None
|
|
out.append({
|
|
"chain": parts[1],
|
|
"dest": (val("-d") or "").split("/")[0],
|
|
"src": (val("-s") or "").split("/")[0],
|
|
"dport": val("--dport"),
|
|
"target": val("-j"),
|
|
"to_ports": val("--to-ports"),
|
|
"comment": comment,
|
|
"spec": line,
|
|
})
|
|
print(json.dumps(out))
|
|
'
|
|
}
|
|
|
|
# Rules bearing a given switch name.
|
|
rules_named() {
|
|
rules_json | python3 -c '
|
|
import json, sys
|
|
name = sys.argv[1]
|
|
print(json.dumps([r for r in json.load(sys.stdin) if r["comment"] == name]))
|
|
' "$1"
|
|
}
|
|
|
|
# Any REDIRECT touching a port, whoever owns it. Used to spot conflicts and
|
|
# stale rules that lost or never had our tag.
|
|
redirects_on_port() {
|
|
rules_json | python3 -c '
|
|
import json, sys
|
|
port = sys.argv[1]
|
|
print(json.dumps([r for r in json.load(sys.stdin)
|
|
if r["target"] == "REDIRECT" and r["dport"] == port]))
|
|
' "$1"
|
|
}
|
|
|
|
# ------------------------------------------------------------------- args
|
|
CMD="${1:-}"; shift || true
|
|
NAME=""; SERVER=""; CLIENT=""; IPORT=""; TPORT=""; LEGACY=""
|
|
while [[ $# -gt 0 ]]; do
|
|
case "$1" in
|
|
--name) NAME="${2:-}"; shift 2 ;;
|
|
--server-ip) SERVER="${2:-}"; shift 2 ;;
|
|
--client-ip) CLIENT="${2:-}"; shift 2 ;;
|
|
--intercept-port) IPORT="${2:-}"; shift 2 ;;
|
|
--target-port) TPORT="${2:-}"; shift 2 ;;
|
|
# A tag this switch previously used. Rules carrying it are OURS and must
|
|
# still be removable, otherwise renaming a switch orphans live NAT rules
|
|
# that no tool can clean up while `off` cheerfully reports success.
|
|
--legacy-tag) LEGACY="${2:-}"; shift 2 ;;
|
|
*) die "unknown argument: $1" ;;
|
|
esac
|
|
done
|
|
|
|
tag_for() { echo "${TAG_PREFIX}:$1"; }
|
|
|
|
is_port() { [[ "$1" =~ ^[0-9]+$ ]] && (( $1 > 0 && $1 < 65536 )); }
|
|
|
|
# ------------------------------------------------------------------ status
|
|
cmd_status() {
|
|
local tag all
|
|
if [[ -n "$NAME" ]]; then
|
|
tag="$(tag_for "$NAME")"
|
|
all="$(rules_json | python3 -c '
|
|
import json,sys
|
|
tags=[t for t in sys.argv[1:] if t]
|
|
print(json.dumps([r for r in json.load(sys.stdin) if r["comment"] in tags]))
|
|
' "$tag" "$LEGACY")"
|
|
else
|
|
tag=""
|
|
all="$(rules_json | python3 -c '
|
|
import json,sys
|
|
print(json.dumps([r for r in json.load(sys.stdin)
|
|
if (r["comment"] or "").startswith("'"$TAG_PREFIX"':')]))')"
|
|
fi
|
|
|
|
python3 - "$all" "$tag" <<'PY'
|
|
import json, sys
|
|
rules = json.loads(sys.argv[1])
|
|
tag = sys.argv[2]
|
|
|
|
if not rules:
|
|
print("INACTIVE: no switch rules%s" % (f" named {tag}" if tag else ""))
|
|
raise SystemExit(0)
|
|
|
|
# Group by the SEMANTIC identity of the redirect, not by comment text.
|
|
groups = {}
|
|
for r in rules:
|
|
key = (r["dest"], r["dport"], r["to_ports"], r["comment"])
|
|
groups.setdefault(key, []).append(r)
|
|
|
|
print("ACTIVE:")
|
|
problems = []
|
|
for (dest, dport, to, comment), rs in sorted(groups.items()):
|
|
chains = ",".join(sorted(r["chain"] for r in rs))
|
|
print(f" {comment}: {dest}:{dport} -> :{to} [{chains}]")
|
|
# A healthy switch installs exactly one PREROUTING and one OUTPUT rule.
|
|
per_chain = {}
|
|
for r in rs:
|
|
per_chain[r["chain"]] = per_chain.get(r["chain"], 0) + 1
|
|
for chain, n in per_chain.items():
|
|
if n > 1:
|
|
problems.append(f"DUPLICATE: {n} identical rules in {chain} for {comment}")
|
|
for want in ("PREROUTING", "OUTPUT"):
|
|
if want not in per_chain:
|
|
problems.append(f"INCOMPLETE: {comment} has no {want} rule")
|
|
|
|
# Several different targets for one name is inconsistent state.
|
|
by_name = {}
|
|
for (dest, dport, to, comment), _ in groups.items():
|
|
by_name.setdefault(comment, set()).add((dest, dport, to))
|
|
for comment, variants in by_name.items():
|
|
if len(variants) > 1:
|
|
problems.append(f"CONFLICT: {comment} has {len(variants)} different redirects: {sorted(variants)}")
|
|
|
|
if problems:
|
|
print()
|
|
for p in problems:
|
|
print(f" !! {p}")
|
|
raise SystemExit(1)
|
|
PY
|
|
local rc=$?
|
|
|
|
# Foreign or untagged redirects on the same port are reported, never touched.
|
|
if [[ -n "$IPORT" ]]; then
|
|
local foreign
|
|
foreign="$(redirects_on_port "$IPORT" | python3 -c '
|
|
import json,sys
|
|
tag=sys.argv[1]
|
|
tags=set(sys.argv[1:])
|
|
o=[r for r in json.load(sys.stdin) if r["comment"] not in tags]
|
|
print("\n".join(" ?? untagged/foreign: %s" % r["spec"] for r in o))' "$(tag_for "$NAME")" "$LEGACY")"
|
|
[[ -n "$foreign" ]] && { echo "$foreign" >&2; rc=1; }
|
|
fi
|
|
return $rc
|
|
}
|
|
|
|
# ---------------------------------------------------------------------- on
|
|
cmd_on() {
|
|
[[ -n "$NAME" ]] || die "--name is required"
|
|
[[ -n "$SERVER" ]] || die "--server-ip is required (the backend the client dials)"
|
|
is_port "${IPORT:-}" || die "--intercept-port must be a port"
|
|
is_port "${TPORT:-}" || die "--target-port must be a port"
|
|
[[ "$IPORT" != "$TPORT" ]] || die "--intercept-port and --target-port must differ"
|
|
|
|
local tag; tag="$(tag_for "$NAME")"
|
|
|
|
# Never stack: start from a known state for THIS name only.
|
|
cmd_off_quiet "$tag"
|
|
[[ -n "$LEGACY" ]] && cmd_off_quiet "$LEGACY"
|
|
|
|
local scope=()
|
|
[[ -n "$CLIENT" ]] && scope=(-s "$CLIENT")
|
|
|
|
$SUDO iptables -t nat -I PREROUTING 1 -p tcp "${scope[@]}" -d "$SERVER" --dport "$IPORT" \
|
|
-m comment --comment "$tag" -j REDIRECT --to-ports "$TPORT" \
|
|
|| die "failed to add PREROUTING rule"
|
|
# OUTPUT covers this host's own connections so the switch can be smoke tested
|
|
# locally. Loopback is still unmatched: it is scoped to the server address.
|
|
$SUDO iptables -t nat -I OUTPUT 1 -p tcp -d "$SERVER" --dport "$IPORT" \
|
|
-m comment --comment "$tag" -j REDIRECT --to-ports "$TPORT" \
|
|
|| die "failed to add OUTPUT rule"
|
|
|
|
# Verify from the kernel's fields, not from what we think we just ran.
|
|
local ok
|
|
ok="$(rules_named "$tag" | python3 -c '
|
|
import json,sys
|
|
rs=json.load(sys.stdin); dest,dport,to=sys.argv[1:4]
|
|
good=[r for r in rs if r["dest"]==dest and r["dport"]==dport and r["to_ports"]==to
|
|
and r["target"]=="REDIRECT"]
|
|
chains={r["chain"] for r in good}
|
|
print("yes" if len(good)==2 and chains=={"PREROUTING","OUTPUT"} else "no:%d:%s"%(len(good),sorted(chains)))
|
|
' "$SERVER" "$IPORT" "$TPORT")"
|
|
[[ "$ok" == "yes" ]] || die "rule verification failed after install ($ok)"
|
|
|
|
echo "$NAME ON: $SERVER:$IPORT -> local :$TPORT"
|
|
echo " 127.0.0.1:$IPORT still reaches the original service (scoped to $SERVER)"
|
|
echo " roll back with: $0 off --name $NAME"
|
|
}
|
|
|
|
# --------------------------------------------------------------------- off
|
|
#
|
|
# Removes ONLY rules bearing this switch's exact tag. Anything else that
|
|
# redirects the same port is reported, never deleted — precise removal, not
|
|
# broad deletion.
|
|
cmd_off_quiet() {
|
|
local tag="$1"
|
|
# Delete by RECONSTRUCTED FIELDS, never by re-feeding the raw `iptables-save`
|
|
# line through the shell.
|
|
#
|
|
# `iptables-save` prints `--comment "tag"` WITH quotes on this version. Word-
|
|
# splitting that back into an argv leaves the quote characters inside the
|
|
# comment value, so iptables looks for a rule whose comment literally contains
|
|
# `"` and finds nothing — a silent no-op delete, and the same
|
|
# comment-formatting trap that produced the original lying rollback. Rules
|
|
# with a bare comment deleted fine, which is exactly what made it look like it
|
|
# worked.
|
|
#
|
|
# Fields are passed as argv elements, so no quoting survives to be
|
|
# misinterpreted.
|
|
# Unit Separator, NOT tab. Tab is an IFS *whitespace* character, so bash
|
|
# collapses runs of it and drops empties — an absent `-s` therefore shifted
|
|
# every later field left, producing `-s <dport> --dport <to_ports>
|
|
# --to-ports ''`. Those deletes failed harmlessly here, but a shifted spec
|
|
# that happened to match a real rule would delete the wrong one.
|
|
local chain dest src dport to
|
|
while IFS=$'\x1f' read -r chain dest src dport to; do
|
|
[[ -n "$chain" ]] || continue
|
|
local args=(-t nat -D "$chain" -p tcp)
|
|
[[ -n "$src" ]] && args+=(-s "$src")
|
|
[[ -n "$dest" ]] && args+=(-d "$dest")
|
|
args+=(--dport "$dport" -m comment --comment "$tag" -j REDIRECT --to-ports "$to")
|
|
$SUDO iptables "${args[@]}" 2>/dev/null
|
|
done < <(rules_named "$tag" | python3 -c '
|
|
import json,sys
|
|
for r in json.load(sys.stdin):
|
|
print("\x1f".join([r["chain"], r["dest"] or "", r["src"] or "",
|
|
r["dport"] or "", r["to_ports"] or ""]))')
|
|
}
|
|
|
|
cmd_off() {
|
|
[[ -n "$NAME" ]] || die "--name is required"
|
|
local tag; tag="$(tag_for "$NAME")"
|
|
|
|
local before legacy_before=0
|
|
before="$(rules_named "$tag" | python3 -c 'import json,sys; print(len(json.load(sys.stdin)))')"
|
|
if [[ -n "$LEGACY" ]]; then
|
|
legacy_before="$(rules_named "$LEGACY" | python3 -c 'import json,sys; print(len(json.load(sys.stdin)))')"
|
|
fi
|
|
|
|
cmd_off_quiet "$tag"
|
|
[[ -n "$LEGACY" ]] && cmd_off_quiet "$LEGACY"
|
|
before=$(( before + legacy_before ))
|
|
|
|
# Independent verification: re-read the table and check the FIELDS.
|
|
local after
|
|
after="$(rules_named "$tag" | python3 -c 'import json,sys; print(len(json.load(sys.stdin)))')"
|
|
if [[ -n "$LEGACY" ]]; then
|
|
after=$(( after + $(rules_named "$LEGACY" | python3 -c 'import json,sys; print(len(json.load(sys.stdin)))') ))
|
|
fi
|
|
if [[ "$after" != "0" ]]; then
|
|
echo "FAILED: $after rule(s) named $tag still present after removing $before" >&2
|
|
rules_named "$tag" | python3 -c 'import json,sys
|
|
for r in json.load(sys.stdin): print(" "+r["spec"])' >&2
|
|
return 1
|
|
fi
|
|
|
|
# A redirect on that port owned by someone else is a conflict to report, not
|
|
# something this switch may delete.
|
|
if [[ -n "$IPORT" ]]; then
|
|
local others
|
|
others="$(redirects_on_port "$IPORT" | python3 -c 'import json,sys
|
|
rs=json.load(sys.stdin)
|
|
print("\n".join(" "+r["spec"] for r in rs))')"
|
|
if [[ -n "$others" ]]; then
|
|
echo "WARNING: other REDIRECT rule(s) still target port $IPORT (not ours, not removed):" >&2
|
|
echo "$others" >&2
|
|
return 1
|
|
fi
|
|
fi
|
|
|
|
echo "$NAME OFF: removed $before rule(s), verified none remain"
|
|
}
|
|
|
|
case "$CMD" in
|
|
on) cmd_on ;;
|
|
off) cmd_off ;;
|
|
status) cmd_status ;;
|
|
*) sed -n '2,12p' "$0" | sed 's/^# \?//'; exit 2 ;;
|
|
esac
|