Payment Timeout
Use kprobe when a payment fails or slows down and the normal tools only show a timeout.
Symptom
payment pay_123 failed
ledger-service timeout after 750ms
Logs show the timeout. Traces show the ledger service was slow. Neither explains why the ledger service was slow.
What kprobe captures
kprobe records:
- ingress request timing
- service process activity
- read and write syscall latency
- disk I/O stalls
- TCP retransmits
- scheduler delay
- memory pressure events
Investigation
Search for:
payment_id = pay_123
Open the causal graph:
ledger timeout
<- database write syscall delayed
<- block I/O queued behind compaction
<- node-level storage saturation
Result
Instead of stopping at “ledger timed out,” kprobe shows the machine-level cause that pushed the payment past its timeout budget.