Skip to content

Commit

Permalink
Merge pull request #92 from KVM-VMI/doc_update_kvmi_versions
Browse files Browse the repository at this point in the history
Doc update kvmi versions
  • Loading branch information
Wenzel authored Nov 25, 2020
2 parents ee7327b + 0511d74 commit faac256
Showing 1 changed file with 217 additions and 9 deletions.
226 changes: 217 additions & 9 deletions docs/kvmi.md
Original file line number Diff line number Diff line change
@@ -1,17 +1,225 @@
# KVMi
# KVMi subsystem for KVM

Multiple versions of the `KVMi` API have been available.
This page tracks the new versions of the `KVMi` subsystem for KVM.

The following sections aims to track the changes
## Description

## KVMi-v1
The KVM introspection subsystem provides a facility for applications
running on the host or in a separate VM, to control the execution of
other VMs (pause, resume, shutdown), query the state of the vCPUs (GPRs,
MSRs etc.), alter the page access bits in the shadow page tables (only
for the hardware backed ones, eg. Intel's EPT) and receive notifications
when events of interest have taken place (shadow page table level faults,
key MSR writes, hypercalls etc.). Some notifications can be responded
to with an action (like preventing an MSR from being written), others
are mere informative (like breakpoint events which can be used for
execution tracing). With few exceptions, all events are optional. An
application using this subsystem will explicitly register for them.

[[RFC PATCH 00/19] Guest introspection](https://www.spinics.net/lists/kvm/msg151508.html)
The use case that gave way for the creation of this subsystem is to
monitor the guest OS and as such the ABI/API is highly influenced by how
the guest software (kernel, applications) sees the world. For example,
some events provide information specific for the host CPU architecture
(eg. `MSR_IA32_SYSENTER_EIP`) merely because its leveraged by guest software
to implement a critical feature (fast system calls).

## KVMi-v2
At the moment, the target audience for KVMI are security software authors
that wish to perform forensics on newly discovered threats (exploits)
or to implement another layer of security like preventing a large set
of kernel rootkits simply by "locking" the kernel image in the shadow
page tables (ie. enforce `.text` `r-x`, `.rodata` `rw-` etc.). It's the latter
case that made KVMI a separate subsystem, even though many of these
features are available in the device manager. The ability to build a
security application that does not interfere (in terms of performance)
with the guest software asks for a specialized interface that is designed
for minimum overhead.

[[RFC PATCH v2 0/1] VM introspection](https://www.spinics.net/lists/kvm/msg152567.html)
## v1

## KVMi-v5
- Publication: **16th June 2017**
- [Mailing list](https://www.spinics.net/lists/kvm/msg151508.html)

[[RFC,v5,00/20] VM introspection](https://patchwork.kernel.org/cover/10739309/)
## v2

- Publication: **7th July 2017**
- [Mailing list](https://www.spinics.net/lists/kvm/msg152567.html)

**Changes since** `v1`

- add documentation and ABI [Paolo, Jan]
- drop all the other patches for now [Paolo]
- remove KVMI_GET_GUESTS, KVMI_EVENT_GUEST_ON, KVMI_EVENT_GUEST_OFF,
and let libvirt/qemu handle this [Stefan, Paolo]
- change the license from LGPL to GPL [Jan]
- remove KVMI_READ_PHYSICAL and KVMI_WRITE_PHYSICAL (not used anymore)
- make the interface a little more consistent

## v5

- Publication: **20th December 2018**
- [Mailing list](https://www.spinics.net/lists/kvm/msg179441.html)
- Kernel: `4.20.0-rc7`

**Changes since** `v4`:

- move the new and improved remote mapping code to the mm/ tree
- add two VM events (in addition to vCPU events) - KVMI_EVENT_CREATE_VCPU
and KVMI_EVENT_UNHOOK - controlled by KVMI_CONTROL_VM_EVENTS
- add KVM_INTROSPECTION_UNHOOK ioctl to support suspend, snapshot
and live migration
- use KVMI_PAUSE_ALL_VCPUS instead of KVMI_PAUSE_VCPU (temporarily)
- fix the reinjection of guest breakpoints
- add single-stepping
- extend KVMI_EVENT_PF to support single-stepping and to reduce
the number of events on REP prefixed instructions
- allow the guest to update A/D bits when the page tables are tracked
(write protected)
- extend page tracking to pass the gva in addition to gpa
- make small changes to the wire protocol (error codes, padding, names)
- extend struct kvm_introspection (ioctl KVM_INTROSPECTION) with the guest's uuid
- change the maximum message size to 4K (from 64K)
- fix more bugs

**Changes since** `v3`:

- move the accept/handshake worker to QEMU
- extend and use the 'page_track' infrastructure to intercept page
accesses during emulation
- remove the 0x40000000-0x40001fff range from monitored MSR-s
- make small changes to the wire protocol (error codes, padding, names)
- simplify KVMI_PAUSE_VCPU
- add new commands: KVMI_GET_MAP_TOKEN, KVMI_GET_XSAVE
- add pat to KVMI_EVENT
- document KVM_HC_MEM_MAP and KVM_HC_MEM_UNMAP hypercalls

**Changes since** `v2`:

- make small changes to the wire protocol (eg. use kvmi_error_code
with every command reply, a few renames, etc.)
- removed '_x86' from x86 specific structure names. Architecture
specific structures will have the same name.
- drop KVMI_GET_MTRR_TYPE and KVMI_GET_MTRRS (use KVMI_SET_REGISTERS)
- drop KVMI_EVENT_ACTION_SET_REGS (use KVMI_SET_REGISTERS)
- remove KVMI_MAP_PHYSICAL_PAGE_TO_GUEST and KVMI_UNMAP_PHYSICAL_PAGE_FROM_GUEST
(to be replaced by a token+hypercall pair)
- extend KVMI_GET_VERSION with allowed commnd/event masks
- replace KVMI_PAUSE_GUEST/KVMI_UNPAUSE_GUEST with KVMI_PAUSE_VCPU
- replace KVMI_SHUTDOWN_GUEST with KVMI_EVENT_ACTION_CRASH
- replace KVMI_GET_XSAVE_INFO with KVMI_GET_CPUID
- merge KVMI_INJECT_PAGE_FAULT and KVMI_INJECT_BREAKPOINT
in KVMI_INJECT_EXCEPTION
- replace event reply flags with ALLOW/SKIP/RETRY/CRASH actions
- make KVMI_SET_REGISTERS work with vCPU events only
- add EPT view support in KVMI_GET_PAGE_ACCESS/KVMI_SET_PAGE_ACCESS
- add support for multiple pages in KVMI_GET_PAGE_ACCESS/KVMI_SET_PAGE_ACCESS
- add (back) KVMI_READ_PHYSICAL/KVMI_WRITE_PHYSICAL
- add KVMI_CONTROL_VE
- add cstar to KVMI_EVENT
- add new events: KVMI_EVENT_VCPU_PAUSED, KVMI_EVENT_CREATE_VCPU,
KVMI_EVENT_DESCRIPTOR_ACCESS, KVMI_EVENT_SINGLESTEP
- add new sections: "Introspection capabilities", "Live migrations",
"Guest snapshots with memory", "Memory access safety"
- document the hypercall used by the KVMI_EVENT_HYPERCALL command
(was KVMI_EVENT_USER_CALL)

## v6

- Publication: **9th August 2019**
- [Patches on the mailing list](https://lore.kernel.org/kvm/20190809160047.8319-1-alazar@bitdefender.com/)
- Kernel: `5.0-rc7`

**Changes since** `v5`:

- small changes to the protocol, but enough to make it backward
incompatible with v5
- fix CR3 interception (thanks to Mathieu Tarral for reporting the issue)
- add SPP support (thanks to Weijiang Yang)
- add two more ioctls in order to let userspace/QEMU control
the commands/events allowed for introspection
- extend the breakpoint event with the instruction length
- complete the descriptor table registers interception
- add new instructions to the x86 emulator
- move arch dependent code to arch/x86/kvm/
- lots of fixes, especially on page tracking, single-stepping, exception
injection and remote memory mapping
- the guests are much more stable (on pair with our introspection
products using Xen)
- speed improvements (the penalty on web browsing actions is 50% lower,
at least)

## v7

- Publication: **7th February 2020**
- [Mailing list](https://lore.kernel.org/kvm/20200207181636.1065-1-alazar@bitdefender.com/)
- Kernel: `5.4.24`

**Changes since** `v6`:

- this is a subset of the previous version, as Sean and Paolo suggested,
keeping "only" the basic introspection capabilities
- add a x86_64 test in tools/testing/selftests/kvm [Paolo]
- simplify the requests/replies handling [Paolo]
- add a new ioctl (PREHOOK) to notify the introspection tool to unhook
[Paolo, Sean]
- add two new commands KVMI_VCPU_CONTROL_SINGLESTEP
and KVMI_VCPU_TRANSLATE_GVA [Mathieu]
- restore the status of MSRs, CR3, descriptors access interception
and prevent conflicts with userspace [Sean]
- other fixes for allmost all the issues pointed in the previous
code review [Sean, Paolo]

## v8

- Publication: **30th March 2020**
- [Mailing list](https://lore.kernel.org/kvm/20200330101308.21702-1-alazar@bitdefender.com/)

**Changes since** `v7`:

- remove the RFC tag
- KVMI_EVENT_SINGLESTEP and KVMI_EVENT_TRAP doesn't have to
be enabled. These events are sent after a specific command
(KVMI_VCPU_CONTROL_SINGLESTEP/KVMI_VCPU_INJECT_EXCEPTION), as it is
the case with KVMI_VCPU_PAUSE/KVMI_EVENT_PAUSE.
- add kvm_x86_ops.desc_ctrl_supported()
- fix the descriptor-table and MSR events on AMD
- drop KVMI_EVENT_REPLY (use KVMI_EVENT instead; as we do with the commands)
- other small changes (code refactoring, message validation, etc.).

## v9

- Publication: **22nd Jul 2020**
- [Mailing list](https://lore.kernel.org/kvm/20200721210922.7646-1-alazar@bitdefender.com/)
- Kernel: `5.8`

**Changes since** `v8`:

- rebase on 5.8
- fix non-x86 builds (avoid including the UAPI headers from kvmi_host.h)
- fix the clean-up for KVMI_VCPU_SINGLESTEP [Mathieu]
- extend KVMI_VM_SET_PAGE_ACCESS with the 'visible' option
- improve KVMI_VM_GET_MAX_GFN (skip read-only, invalid or non-user memslots)
- add KVMI_VM_CONTROL_CLEANUP [Tamas, Mathieu]
- add KVMI_VCPU_GET_XCR and KVMI_VCPU_SET_XSAVE (SSE emulation)
- move KVM_REQ_INTROSPECTION in the range of arch-independent requests
- better split of x86 vs arch-independent code
- cover more error codes with tools/testing/selftests/kvm/x86_64/kvmi_test.c
- remove more error messages and close the introspection connection
when an error code can't be sent back or it doesn't make sense to send it
- other small changes (code refactoring, message validation, etc.).

## v10

- Publication: **25th November 2020**
- [Mailing list](https://lore.kernel.org/kvm/20201125093600.2766-1-alazar@bitdefender.com/)
- Kernel: `5.10`

**Changes since** `v9`:

- rebase on 5.10 from 5.8
- complete the split of x86 and arch-independent code
- split the VM and vCPU events
- clean up the interface headers (VM vs vCPU messages/events)
- clean up the tests
- add a new exit code (for the CRASH action) instead of killing
the vCPU threads [Christoph]
- other small changes (code refactoring, message validation, etc.).

0 comments on commit faac256

Please sign in to comment.